2024-04-26T12:23:10.467 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T12:23:10.468 DEBUG:teuthology.run:Teuthology command: teuthology --name cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi --verbose --archive /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698 --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/orig.config.yaml 2024-04-26T12:23:10.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:23:10.584 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698 branch: wip-cbodley2-testing description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7674698' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cbodley2-testing ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley2-testing sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 8596 sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley2-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 targets: smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBW3Y8Zhays6MfscIJlezRXcUSNAkuk+H2Z/tpsgg4/Fh5mZLmzfI43WbXMn5vLclpaK1IQQQJ9uDccG84bssYQ= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEVfi3vBeyxnL1p6I6CO/tJHhgNflaBSam5FkedU2pYf3Q1iTgv1cM4+V4WxYKXG3P69o8NpHxqKxf9D0Z20NAw= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_12:10:35 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T12:23:10.585 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa; will attempt to use it 2024-04-26T12:23:10.585 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa/tasks 2024-04-26T12:23:10.586 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T12:23:10.587 INFO:teuthology.task.internal:Checking packages... 2024-04-26T12:23:10.613 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0' 2024-04-26T12:23:10.614 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T12:23:10.614 INFO:teuthology.packaging:ref: None 2024-04-26T12:23:10.614 INFO:teuthology.packaging:tag: None 2024-04-26T12:23:10.614 INFO:teuthology.packaging:branch: wip-cbodley2-testing 2024-04-26T12:23:10.614 INFO:teuthology.packaging:sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:23:10.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cbodley2-testing 2024-04-26T12:23:10.760 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2451.g7fad7ff2 2024-04-26T12:23:10.762 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T12:23:10.768 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T12:23:10.768 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T12:23:10.775 INFO:teuthology.task.internal:Saving configuration 2024-04-26T12:23:10.788 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T12:23:10.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T12:23:10.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:18:08.310924', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBW3Y8Zhays6MfscIJlezRXcUSNAkuk+H2Z/tpsgg4/Fh5mZLmzfI43WbXMn5vLclpaK1IQQQJ9uDccG84bssYQ='} 2024-04-26T12:23:10.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:18:08.309107', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEVfi3vBeyxnL1p6I6CO/tJHhgNflaBSam5FkedU2pYf3Q1iTgv1cM4+V4WxYKXG3P69o8NpHxqKxf9D0Z20NAw='} 2024-04-26T12:23:10.835 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T12:23:10.842 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-26T12:23:10.842 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-26T12:23:10.842 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T12:23:10.904 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f82c26e10d0>, signals=[15]) 2024-04-26T12:23:10.904 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T12:23:10.910 INFO:teuthology.task.internal:Opening connections... 2024-04-26T12:23:10.910 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-04-26T12:23:10.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:23:10.989 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:23:10.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:23:11.063 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T12:23:11.070 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-26T12:23:11.088 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-26T12:23:11.088 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-26T12:23:11.146 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-04-26T12:23:11.146 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-04-26T12:23:11.146 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-04-26T12:23:11.146 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:23:11.146 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-04-26T12:23:11.146 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-04-26T12:23:11.146 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T12:23:11.147 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-26T12:23:11.147 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-04-26T12:23:11.147 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T12:23:11.147 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:23:11.147 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:23:11.147 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T12:23:11.147 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:23:11.148 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-26T12:23:11.169 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-04-26T12:23:11.186 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-04-26T12:23:11.187 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-04-26T12:23:11.243 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-04-26T12:23:11.243 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-04-26T12:23:11.243 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T12:23:11.244 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:23:11.244 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-04-26T12:23:11.260 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T12:23:11.268 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T12:23:11.273 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T12:23:11.274 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:23:11.276 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:23:11.299 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T12:23:11.305 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T12:23:11.305 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:23:11.333 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:23:11.440 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T12:23:11.493 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T12:23:11.507 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-26T12:23:11.508 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-26T12:23:11.508 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:23:11.508 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:23:11.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:23:11.525 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-04-26T12:23:11.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:23:11.527 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-04-26T12:23:11.582 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-437.el9.x86_64 2024-04-26T12:23:11.585 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-437.el9.x86_64 2024-04-26T12:23:11.585 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-04-26T12:23:11.587 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-437.el9.x86_64 2024-04-26T12:23:11.587 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-437.el9.x86_64 2024-04-26T12:23:11.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2024-04-26T12:23:13.867 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-26T12:23:14.128 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.0 MB 00:00 2024-04-26T12:23:15.869 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T12:23:16.179 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T12:23:20.136 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.2 MB 00:00 2024-04-26T12:23:20.280 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T12:23:22.376 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-26T12:23:22.694 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-26T12:23:23.721 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-26T12:23:24.344 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-26T12:23:28.846 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T12:23:29.460 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-26T12:23:30.694 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T12:23:30.694 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T12:23:30.798 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:23:30.799 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:23:30.799 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:23:30.923 DEBUG:teuthology.orchestra.run.smithi170:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:23:31.342 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T12:23:31.342 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T12:23:31.419 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:23:28 PM UTC. 2024-04-26T12:23:31.432 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:23:31.433 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:23:31.433 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:23:31.544 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:23:31.550 DEBUG:teuthology.orchestra.run.smithi132:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:23:31.552 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:23:31.552 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-26T12:23:31.552 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:23:31.552 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-04-26T12:23:31.552 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:23:31.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:23:31.553 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:23:31.553 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:23:31.553 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:23:31.553 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 255 k 2024-04-26T12:23:31.553 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-04-26T12:23:31.553 INFO:teuthology.orchestra.run.smithi170.stderr:Operation aborted. 2024-04-26T12:23:31.616 INFO:teuthology.orchestra.run.smithi170.stdout:Is this ok [y/N]: 2024-04-26T12:23:31.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum reinstall -y kernel || true 2024-04-26T12:23:32.047 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:23:29 PM UTC. 2024-04-26T12:23:32.113 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 12:23:28 PM UTC. 2024-04-26T12:23:32.165 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:23:32.176 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:23:32.176 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalling: 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 255 k 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 0 2024-04-26T12:23:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:Operation aborted. 2024-04-26T12:23:32.229 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 255 k 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-04-26T12:23:32.230 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:23:32.235 INFO:teuthology.orchestra.run.smithi132.stdout:Is this ok [y/N]: 2024-04-26T12:23:32.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum reinstall -y kernel || true 2024-04-26T12:23:32.531 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.7 MB/s | 255 kB 00:00 2024-04-26T12:23:32.531 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:23:32.532 INFO:teuthology.orchestra.run.smithi170.stdout:Total 845 kB/s | 255 kB 00:00 2024-04-26T12:23:32.549 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:23:32.727 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:23:29 PM UTC. 2024-04-26T12:23:32.728 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:23:32.728 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:23:32.733 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:23:32.733 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:23:32.845 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:23:32.845 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:23:32.845 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalling: 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 255 k 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 0 2024-04-26T12:23:32.846 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:23:32.867 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:23:32.957 INFO:teuthology.orchestra.run.smithi170.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:23:32.957 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:23:33.037 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-26T12:23:33.038 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:23:33.038 INFO:teuthology.orchestra.run.smithi132.stdout:Total 1.3 MB/s | 255 kB 00:00 2024-04-26T12:23:33.056 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:23:33.231 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:23:33.232 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:23:33.237 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:23:33.237 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:23:33.369 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:23:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:23:33.439 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:23:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:23:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:23:34.151 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:23:34.151 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T12:23:34.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:23:34.293 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:23:34.293 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalled: 2024-04-26T12:23:34.293 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T12:23:34.293 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:23:34.293 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:23:34.459 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:23:34.505 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T12:23:34.505 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T12:23:34.505 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:23:34.505 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-26T12:23:34.505 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:23:34.538 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-04-26T12:23:34.560 DEBUG:teuthology.parallel:result is None 2024-04-26T12:23:34.837 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T12:23:34.838 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:23:34.838 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalled: 2024-04-26T12:23:34.838 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T12:23:34.838 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:23:34.838 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:23:35.009 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:23:35.056 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T12:23:35.056 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T12:23:35.056 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:23:35.056 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T12:23:35.056 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:23:35.087 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2024-04-26T12:23:35.109 DEBUG:teuthology.parallel:result is None 2024-04-26T12:23:35.109 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T12:23:35.117 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T12:23:35.117 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:23:35.152 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:23:35.167 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T12:23:35.177 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T12:23:35.184 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T12:23:35.185 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:23:35.207 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:23:35.247 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T12:23:35.254 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T12:23:35.254 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:23:35.285 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:23:35.310 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:23:35.312 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:23:35.320 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:23:35.321 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:23:35.323 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T12:23:35.333 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T12:23:35.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:23:35.364 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:23:35.387 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T12:23:35.396 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T12:23:35.396 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:23:35.428 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:23:35.442 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:23:35.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:23:35.569 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:23:35.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:23:35.690 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:23:35.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:23:35.753 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:23:35.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:23:35.839 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:23:35.918 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:23:35.959 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:23:35.959 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:23:36.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-04-26T12:23:36.023 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-04-26T12:23:36.055 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:23:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:23:36.441 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T12:23:36.451 INFO:teuthology.task.internal:Starting timer... 2024-04-26T12:23:36.451 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T12:23:36.460 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T12:23:36.468 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T12:23:36.469 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-04-26T12:23:36.514 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-04-26T12:23:36.516 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-04-26T12:23:36.575 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-04-26T12:23:36.576 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T12:23:36.576 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-04-26T12:23:36.615 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-04-26T12:23:36.615 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-04-26T12:23:36.640 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-04-26T12:23:36.640 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-04-26T12:23:36.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T12:23:36.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:23:36.681 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T12:23:36.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:23:36.706 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T12:23:36.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:23:36.745 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:23:36.770 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T12:23:36.779 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T12:23:36.796 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T12:23:36.798 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:27:04.186 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-04-26T12:27:04.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-26T12:27:04.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:27:04.265 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-26T12:27:04.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-26T12:27:04.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T12:27:04.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:27:04.422 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-04-26T12:27:04.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T12:27:04.455 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:27:04.466 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:27:04.466 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:27:04.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:27:04.469 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:27:04.469 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:27:04.495 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:27:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:27:04.523 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:27:04.530 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-04-26T12:27:04.536 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:27:04.540 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-04-26T12:27:04.553 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:27:04.558 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-04-26T12:27:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:27:04.568 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-04-26T12:27:04.581 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:27:04.594 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:27:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:27:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:27:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-26T12:27:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.651 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:27:04.654 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:27:04.654 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-04-26T12:27:04.654 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.655 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.655 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.655 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:27:04.655 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:27:04.667 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:27:04.667 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}} 2024-04-26T12:27:04.668 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'} 2024-04-26T12:27:04.668 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:27:04.674 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:27:04.674 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:27:04.674 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'tag': None, 'wait_for_package': False} 2024-04-26T12:27:04.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:27:04.677 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'tag': None, 'wait_for_package': False} 2024-04-26T12:27:04.677 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:27:04.823 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/ 2024-04-26T12:27:04.823 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2451.g7fad7ff2 2024-04-26T12:27:04.898 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/ 2024-04-26T12:27:04.898 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2451.g7fad7ff2 2024-04-26T12:27:05.009 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:27:05.009 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:27:05.009 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:27:05.034 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T12:27:05.034 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:27:05.101 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:27:05.103 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:27:05.103 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:27:05.104 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:27:05.129 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-26T12:27:05.129 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:27:05.172 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:27:05.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:27:05.235 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-04-26T12:27:05.237 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-04-26T12:27:05.267 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:27:05.330 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-04-26T12:27:05.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-04-26T12:27:05.462 INFO:teuthology.orchestra.run.smithi170.stdout:48 files removed 2024-04-26T12:27:05.490 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw 2024-04-26T12:27:05.555 INFO:teuthology.orchestra.run.smithi132.stdout:48 files removed 2024-04-26T12:27:05.583 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw 2024-04-26T12:27:06.178 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 195 kB/s | 83 kB 00:00 2024-04-26T12:27:06.333 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 170 kB/s | 83 kB 00:00 2024-04-26T12:27:06.662 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-04-26T12:27:06.801 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 27 kB/s | 11 kB 00:00 2024-04-26T12:27:07.071 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-26T12:27:07.152 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-26T12:27:07.649 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-26T12:27:07.913 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-26T12:27:09.741 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-26T12:27:10.172 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-26T12:27:14.326 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.2 MB 00:00 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.2 MB 00:00 2024-04-26T12:27:15.824 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-04-26T12:27:16.488 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 16 kB 00:00 2024-04-26T12:27:17.267 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T12:27:17.806 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-26T12:27:22.485 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 7.3 kB/s | 1.7 kB 00:00 2024-04-26T12:27:22.915 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-26T12:27:24.659 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 10 M 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 3.4 M 2024-04-26T12:27:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 3.1 M 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 5.4 M 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 21 M 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 25 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 746 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:27:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 500 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 5.3 M 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 45 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 133 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 162 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 321 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 298 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 99 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T12:27:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:Install 30 Packages 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-04-26T12:27:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:24.665 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 60 M 2024-04-26T12:27:24.665 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:27:25.117 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 10 M 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 3.4 M 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 3.1 M 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T12:27:25.119 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 5.4 M 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 21 M 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 25 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 746 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 500 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 5.3 M 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T12:27:25.120 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 45 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 133 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 162 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 321 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 298 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 99 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-04-26T12:27:25.121 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout:Install 30 Packages 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 2 Packages 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 60 M 2024-04-26T12:27:25.122 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:27:25.885 INFO:teuthology.orchestra.run.smithi170.stdout:(1/32): ceph-base-19.0.0-2451.g7fad7ff2.el7.x86 6.8 MB/s | 5.4 MB 00:00 2024-04-26T12:27:25.918 INFO:teuthology.orchestra.run.smithi170.stdout:(2/32): ceph-selinux-19.0.0-2451.g7fad7ff2.el7. 754 kB/s | 25 kB 00:00 2024-04-26T12:27:26.019 INFO:teuthology.orchestra.run.smithi170.stdout:(3/32): libcephfs2-19.0.0-2451.g7fad7ff2.el7.x8 7.3 MB/s | 746 kB 00:00 2024-04-26T12:27:26.119 INFO:teuthology.orchestra.run.smithi170.stdout:(4/32): libradosstriper1-19.0.0-2451.g7fad7ff2. 4.9 MB/s | 500 kB 00:00 2024-04-26T12:27:26.852 INFO:teuthology.orchestra.run.smithi170.stdout:(5/32): librgw2-19.0.0-2451.g7fad7ff2.el7.x86_6 7.3 MB/s | 5.3 MB 00:00 2024-04-26T12:27:26.928 INFO:teuthology.orchestra.run.smithi170.stdout:(6/32): python3-ceph-argparse-19.0.0-2451.g7fad 601 kB/s | 45 kB 00:00 2024-04-26T12:27:27.020 INFO:teuthology.orchestra.run.smithi170.stdout:(7/32): python3-ceph-common-19.0.0-2451.g7fad7f 1.4 MB/s | 133 kB 00:00 2024-04-26T12:27:27.120 INFO:teuthology.orchestra.run.smithi170.stdout:(8/32): python3-cephfs-19.0.0-2451.g7fad7ff2.el 1.6 MB/s | 162 kB 00:00 2024-04-26T12:27:27.478 INFO:teuthology.orchestra.run.smithi170.stdout:(9/32): ceph-radosgw-19.0.0-2451.g7fad7ff2.el7. 4.3 MB/s | 10 MB 00:02 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi170.stdout:(10/32): python3-rbd-19.0.0-2451.g7fad7ff2.el7. 2.5 MB/s | 298 kB 00:00 2024-04-26T12:27:27.621 INFO:teuthology.orchestra.run.smithi170.stdout:(11/32): python3-rados-19.0.0-2451.g7fad7ff2.el 641 kB/s | 321 kB 00:00 2024-04-26T12:27:27.696 INFO:teuthology.orchestra.run.smithi170.stdout:(12/32): python3-rgw-19.0.0-2451.g7fad7ff2.el7. 990 kB/s | 99 kB 00:00 2024-04-26T12:27:27.771 INFO:teuthology.orchestra.run.smithi170.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 711 kB/s | 107 kB 00:00 2024-04-26T12:27:27.805 INFO:teuthology.orchestra.run.smithi170.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2024-04-26T12:27:27.830 INFO:teuthology.orchestra.run.smithi170.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-04-26T12:27:27.972 INFO:teuthology.orchestra.run.smithi170.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-04-26T12:27:28.022 INFO:teuthology.orchestra.run.smithi170.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-04-26T12:27:28.048 INFO:teuthology.orchestra.run.smithi170.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 564 kB/s | 42 kB 00:00 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi170.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi170.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi170.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-04-26T12:27:28.291 INFO:teuthology.orchestra.run.smithi132.stdout:(1/32): ceph-base-19.0.0-2451.g7fad7ff2.el7.x86 1.9 MB/s | 5.4 MB 00:02 2024-04-26T12:27:28.466 INFO:teuthology.orchestra.run.smithi170.stdout:(22/32): ceph-common-19.0.0-2451.g7fad7ff2.el7. 6.2 MB/s | 21 MB 00:03 2024-04-26T12:27:28.500 INFO:teuthology.orchestra.run.smithi132.stdout:(2/32): ceph-common-19.0.0-2451.g7fad7ff2.el7.x 6.9 MB/s | 21 MB 00:03 2024-04-26T12:27:28.517 INFO:teuthology.orchestra.run.smithi132.stdout:(3/32): ceph-selinux-19.0.0-2451.g7fad7ff2.el7. 112 kB/s | 25 kB 00:00 2024-04-26T12:27:28.616 INFO:teuthology.orchestra.run.smithi170.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 174 kB/s | 26 kB 00:00 2024-04-26T12:27:28.634 INFO:teuthology.orchestra.run.smithi132.stdout:(4/32): ceph-radosgw-19.0.0-2451.g7fad7ff2.el7. 3.2 MB/s | 10 MB 00:03 2024-04-26T12:27:28.641 INFO:teuthology.orchestra.run.smithi170.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 597 kB/s | 309 kB 00:00 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi132.stdout:(5/32): libcephfs2-19.0.0-2451.g7fad7ff2.el7.x8 4.4 MB/s | 746 kB 00:00 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi132.stdout:(6/32): python3-ceph-argparse-19.0.0-2451.g7fad 1.3 MB/s | 45 kB 00:00 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi170.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi170.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi132.stdout:(7/32): libradosstriper1-19.0.0-2451.g7fad7ff2. 2.2 MB/s | 500 kB 00:00 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi132.stdout:(8/32): python3-ceph-common-19.0.0-2451.g7fad7f 2.2 MB/s | 133 kB 00:00 2024-04-26T12:27:28.801 INFO:teuthology.orchestra.run.smithi132.stdout:(9/32): python3-cephfs-19.0.0-2451.g7fad7ff2.el 2.4 MB/s | 162 kB 00:00 2024-04-26T12:27:28.835 INFO:teuthology.orchestra.run.smithi132.stdout:(10/32): python3-rados-19.0.0-2451.g7fad7ff2.el 4.2 MB/s | 321 kB 00:00 2024-04-26T12:27:28.842 INFO:teuthology.orchestra.run.smithi170.stdout:(27/32): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-04-26T12:27:28.867 INFO:teuthology.orchestra.run.smithi170.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-26T12:27:28.885 INFO:teuthology.orchestra.run.smithi132.stdout:(11/32): python3-rgw-19.0.0-2451.g7fad7ff2.el7. 1.9 MB/s | 99 kB 00:00 2024-04-26T12:27:28.909 INFO:teuthology.orchestra.run.smithi170.stdout:(29/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-04-26T12:27:28.911 INFO:teuthology.orchestra.run.smithi132.stdout:(12/32): python3-rbd-19.0.0-2451.g7fad7ff2.el7. 2.7 MB/s | 298 kB 00:00 2024-04-26T12:27:28.951 INFO:teuthology.orchestra.run.smithi170.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-26T12:27:29.044 INFO:teuthology.orchestra.run.smithi132.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 675 kB/s | 107 kB 00:00 2024-04-26T12:27:29.069 INFO:teuthology.orchestra.run.smithi132.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-04-26T12:27:29.095 INFO:teuthology.orchestra.run.smithi132.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-04-26T12:27:29.145 INFO:teuthology.orchestra.run.smithi132.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-04-26T12:27:29.204 INFO:teuthology.orchestra.run.smithi132.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-26T12:27:29.209 INFO:teuthology.orchestra.run.smithi170.stdout:(31/32): librbd1-19.0.0-2451.g7fad7ff2.el7.x86_ 10 MB/s | 3.1 MB 00:00 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi132.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 508 kB/s | 42 kB 00:00 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi132.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi132.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 719 kB/s | 36 kB 00:00 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi132.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-26T12:27:29.318 INFO:teuthology.orchestra.run.smithi170.stdout:(32/32): librados2-19.0.0-2451.g7fad7ff2.el7.x8 7.5 MB/s | 3.4 MB 00:00 2024-04-26T12:27:29.321 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:27:29.321 INFO:teuthology.orchestra.run.smithi170.stdout:Total 13 MB/s | 60 MB 00:04 2024-04-26T12:27:29.417 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:27:29.453 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:27:29.453 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:27:29.499 INFO:teuthology.orchestra.run.smithi132.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.4 MB/s | 309 kB 00:00 2024-04-26T12:27:29.574 INFO:teuthology.orchestra.run.smithi132.stdout:(23/32): librgw2-19.0.0-2451.g7fad7ff2.el7.x86_ 5.7 MB/s | 5.3 MB 00:00 2024-04-26T12:27:29.599 INFO:teuthology.orchestra.run.smithi132.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-26T12:27:29.650 INFO:teuthology.orchestra.run.smithi132.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-26T12:27:29.692 INFO:teuthology.orchestra.run.smithi132.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-04-26T12:27:29.759 INFO:teuthology.orchestra.run.smithi132.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-04-26T12:27:29.809 INFO:teuthology.orchestra.run.smithi132.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-26T12:27:29.876 INFO:teuthology.orchestra.run.smithi132.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-04-26T12:27:29.916 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:27:29.918 INFO:teuthology.orchestra.run.smithi132.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-26T12:27:29.920 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:27:30.160 INFO:teuthology.orchestra.run.smithi132.stdout:(31/32): librbd1-19.0.0-2451.g7fad7ff2.el7.x86_ 11 MB/s | 3.1 MB 00:00 2024-04-26T12:27:30.626 INFO:teuthology.orchestra.run.smithi132.stdout:(32/32): librados2-19.0.0-2451.g7fad7ff2.el7.x8 4.1 MB/s | 3.4 MB 00:00 2024-04-26T12:27:30.631 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:27:30.631 INFO:teuthology.orchestra.run.smithi132.stdout:Total 11 MB/s | 60 MB 00:05 2024-04-26T12:27:30.734 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:27:30.770 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:27:30.770 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:27:31.235 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:27:31.235 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:27:31.441 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:27:31.519 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T12:27:31.789 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T12:27:31.842 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T12:27:32.223 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-26T12:27:32.276 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 7/34 2024-04-26T12:27:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 7/34 2024-04-26T12:27:32.463 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 8/34 2024-04-26T12:27:32.494 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 9/34 2024-04-26T12:27:32.548 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 9/34 2024-04-26T12:27:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-26T12:27:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-2451.g7fad7ff2.el7. 11/34 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 12/34 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_6 13/34 2024-04-26T12:27:32.786 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_6 13/34 2024-04-26T12:27:32.786 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-26T12:27:32.820 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-26T12:27:32.823 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-26T12:27:32.849 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-26T12:27:32.872 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T12:27:32.892 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-26T12:27:32.926 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-26T12:27:32.954 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-04-26T12:27:32.994 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-26T12:27:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-26T12:27:33.047 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T12:27:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-04-26T12:27:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-26T12:27:33.111 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-26T12:27:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-26T12:27:33.435 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-26T12:27:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 22/34 2024-04-26T12:27:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 22/34 2024-04-26T12:27:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 7/34 2024-04-26T12:27:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 23/34 2024-04-26T12:27:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-26T12:27:33.635 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 7/34 2024-04-26T12:27:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 8/34 2024-04-26T12:27:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 9/34 2024-04-26T12:27:33.807 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 9/34 2024-04-26T12:27:33.836 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-26T12:27:33.879 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.0.0-2451.g7fad7ff2.el7. 11/34 2024-04-26T12:27:33.955 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 12/34 2024-04-26T12:27:33.980 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_6 13/34 2024-04-26T12:27:34.028 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_6 13/34 2024-04-26T12:27:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-04-26T12:27:34.062 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-26T12:27:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 26/34 2024-04-26T12:27:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 26/34 2024-04-26T12:27:34.172 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-26T12:27:34.204 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-04-26T12:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 27/34 2024-04-26T12:27:34.244 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-26T12:27:34.268 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x8 28/34 2024-04-26T12:27:34.270 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-26T12:27:34.299 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-04-26T12:27:34.332 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-26T12:27:34.648 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-26T12:27:34.695 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 22/34 2024-04-26T12:27:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 22/34 2024-04-26T12:27:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 23/34 2024-04-26T12:27:34.852 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-26T12:27:35.321 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-04-26T12:27:35.347 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 26/34 2024-04-26T12:27:35.402 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 26/34 2024-04-26T12:27:35.479 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 27/34 2024-04-26T12:27:35.508 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x8 28/34 2024-04-26T12:27:36.559 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 29/34 2024-04-26T12:27:36.606 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 29/34 2024-04-26T12:27:37.148 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 29/34 2024-04-26T12:27:37.184 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 30/34 2024-04-26T12:27:37.276 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 30/34 2024-04-26T12:27:37.277 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:27:37.277 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:27:37.277 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 31/34 2024-04-26T12:27:37.795 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 29/34 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 29/34 2024-04-26T12:27:38.447 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 29/34 2024-04-26T12:27:38.484 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 30/34 2024-04-26T12:27:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 30/34 2024-04-26T12:27:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T12:27:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T12:27:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:38.635 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 31/34 2024-04-26T12:27:46.790 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 31/34 2024-04-26T12:27:46.790 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-04-26T12:27:46.791 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-04-26T12:27:46.791 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-04-26T12:27:46.791 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-04-26T12:27:46.791 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-04-26T12:27:46.791 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-04-26T12:27:46.791 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-04-26T12:27:46.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:47.737 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/34 2024-04-26T12:27:47.761 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/34 2024-04-26T12:27:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:27:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:27:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:27:47.762 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:27:47.762 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:47.764 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T12:27:47.840 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T12:27:47.840 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T12:27:48.133 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 31/34 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-04-26T12:27:48.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:48.983 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 5/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_6 6/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 7/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2451.g7fad7ff2.el7. 8/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x8 9/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 10/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 11/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 12/34 2024-04-26T12:27:48.984 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 13/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-26T12:27:48.985 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-26T12:27:48.986 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-04-26T12:27:48.986 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-26T12:27:48.986 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-26T12:27:48.986 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 31/34 2024-04-26T12:27:48.986 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-26T12:27:48.986 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 33/34 2024-04-26T12:27:49.087 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/34 2024-04-26T12:27:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/34 2024-04-26T12:27:49.111 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:27:49.111 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T12:27:49.111 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:27:49.112 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:27:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T12:27:49.181 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-26T12:27:49.181 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.802 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:27:49.803 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:49.804 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:27:50.079 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-test 2024-04-26T12:27:50.413 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T12:27:50.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/34 2024-04-26T12:27:50.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/34 2024-04-26T12:27:50.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/34 2024-04-26T12:27:50.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/34 2024-04-26T12:27:50.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 5/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_6 6/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 7/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2451.g7fad7ff2.el7. 8/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x8 9/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 10/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 11/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 12/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 13/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-26T12:27:50.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-26T12:27:50.415 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-26T12:27:50.416 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-04-26T12:27:50.416 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-26T12:27:50.416 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-26T12:27:50.416 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 31/34 2024-04-26T12:27:50.416 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-26T12:27:50.416 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 33/34 2024-04-26T12:27:50.639 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:28 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:27:50.762 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:27:50.762 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:27:50.766 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:27:50.766 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:27:50.766 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 48 M 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 163 k 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-04-26T12:27:50.767 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:27:50.768 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 49 M 2024-04-26T12:27:50.768 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 207 M 2024-04-26T12:27:50.768 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.7 MB/s | 305 kB 00:00 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-26T12:27:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-26T12:27:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:51.194 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-04-26T12:27:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T12:27:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:27:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T12:27:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T12:27:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T12:27:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T12:27:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T12:27:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:51.197 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:27:51.198 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): libcephsqlite-19.0.0-2451.g7fad7ff2.el7. 519 kB/s | 163 kB 00:00 2024-04-26T12:27:51.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-test 2024-04-26T12:27:52.046 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:30 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:27:52.169 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:27:52.170 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:27:52.170 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:27:52.170 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:27:52.170 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:27:52.170 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 48 M 2024-04-26T12:27:52.170 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:27:52.170 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 163 k 2024-04-26T12:27:52.171 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T12:27:52.171 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T12:27:52.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:52.171 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:27:52.171 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:27:52.171 INFO:teuthology.orchestra.run.smithi132.stdout:Install 4 Packages 2024-04-26T12:27:52.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:27:52.172 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 49 M 2024-04-26T12:27:52.172 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 207 M 2024-04-26T12:27:52.172 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:27:52.560 INFO:teuthology.orchestra.run.smithi132.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-04-26T12:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 859 kB/s | 64 kB 00:00 2024-04-26T12:27:52.996 INFO:teuthology.orchestra.run.smithi132.stdout:(3/4): libcephsqlite-19.0.0-2451.g7fad7ff2.el7. 236 kB/s | 163 kB 00:00 2024-04-26T12:27:53.419 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): ceph-test-19.0.0-2451.g7fad7ff2.el7.x86_ 19 MB/s | 48 MB 00:02 2024-04-26T12:27:53.422 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:27:53.422 INFO:teuthology.orchestra.run.smithi170.stdout:Total 18 MB/s | 49 MB 00:02 2024-04-26T12:27:53.449 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:27:53.470 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:27:53.470 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:27:53.835 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:27:53.835 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:27:54.351 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:27:54.437 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T12:27:54.476 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/4 2024-04-26T12:27:59.017 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/4 2024-04-26T12:27:59.102 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/4 2024-04-26T12:28:00.061 INFO:teuthology.orchestra.run.smithi132.stdout:(4/4): ceph-test-19.0.0-2451.g7fad7ff2.el7.x86_ 6.2 MB/s | 48 MB 00:07 2024-04-26T12:28:00.064 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:00.064 INFO:teuthology.orchestra.run.smithi132.stdout:Total 6.2 MB/s | 49 MB 00:07 2024-04-26T12:28:00.091 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:28:00.111 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:28:00.112 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:28:00.476 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:28:00.477 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:28:00.995 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:28:01.061 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-26T12:28:01.101 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-26T12:28:01.121 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/4 2024-04-26T12:28:01.446 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/4 2024-04-26T12:28:01.446 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/4 2024-04-26T12:28:01.447 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/4 2024-04-26T12:28:01.447 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T12:28:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:01.747 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:02.045 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph 2024-04-26T12:28:02.546 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:40 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 6.6 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 2.4 M 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 1.5 M 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 249 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 4.7 M 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 17 M 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout:Install 36 Packages 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 30 M 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 107 M 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi170.stdout:(1/36): ceph-19.0.0-2451.g7fad7ff2.el7.x86_64.r 23 kB/s | 6.6 kB 00:00 2024-04-26T12:28:03.878 INFO:teuthology.orchestra.run.smithi170.stdout:(2/36): ceph-mds-19.0.0-2451.g7fad7ff2.el7.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-04-26T12:28:04.671 INFO:teuthology.orchestra.run.smithi170.stdout:(3/36): ceph-osd-19.0.0-2451.g7fad7ff2.el7.x86_ 21 MB/s | 17 MB 00:00 2024-04-26T12:28:04.721 INFO:teuthology.orchestra.run.smithi170.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2451.g7fad 4.9 MB/s | 249 kB 00:00 2024-04-26T12:28:04.972 INFO:teuthology.orchestra.run.smithi170.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-04-26T12:28:05.105 INFO:teuthology.orchestra.run.smithi170.stdout:(6/36): ceph-mgr-19.0.0-2451.g7fad7ff2.el7.x86_ 962 kB/s | 1.5 MB 00:01 2024-04-26T12:28:05.213 INFO:teuthology.orchestra.run.smithi170.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 5.1 MB/s | 1.2 MB 00:00 2024-04-26T12:28:05.239 INFO:teuthology.orchestra.run.smithi170.stdout:(8/36): python3-ply-3.11-14.el9.noarch.rpm 800 kB/s | 106 kB 00:00 2024-04-26T12:28:05.281 INFO:teuthology.orchestra.run.smithi170.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-04-26T12:28:05.306 INFO:teuthology.orchestra.run.smithi170.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 1.8 MB/s | 125 kB 00:00 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi170.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi170.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-26T12:28:05.423 INFO:teuthology.orchestra.run.smithi170.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-26T12:28:05.449 INFO:teuthology.orchestra.run.smithi170.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 520 kB/s | 35 kB 00:00 2024-04-26T12:28:05.499 INFO:teuthology.orchestra.run.smithi170.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-04-26T12:28:05.524 INFO:teuthology.orchestra.run.smithi170.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-04-26T12:28:05.549 INFO:teuthology.orchestra.run.smithi170.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-04-26T12:28:05.650 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/4 2024-04-26T12:28:05.727 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/4 2024-04-26T12:28:05.766 INFO:teuthology.orchestra.run.smithi170.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 200 kB/s | 43 kB 00:00 2024-04-26T12:28:05.808 INFO:teuthology.orchestra.run.smithi170.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 532 kB/s | 151 kB 00:00 2024-04-26T12:28:05.859 INFO:teuthology.orchestra.run.smithi170.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-04-26T12:28:05.892 INFO:teuthology.orchestra.run.smithi170.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 4.2 MB/s | 358 kB 00:00 2024-04-26T12:28:05.959 INFO:teuthology.orchestra.run.smithi170.stdout:(22/36): ceph-mon-19.0.0-2451.g7fad7ff2.el7.x86 2.2 MB/s | 4.7 MB 00:02 2024-04-26T12:28:05.985 INFO:teuthology.orchestra.run.smithi170.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 85 kB/s | 11 kB 00:00 2024-04-26T12:28:06.010 INFO:teuthology.orchestra.run.smithi170.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 151 kB/s | 18 kB 00:00 2024-04-26T12:28:06.035 INFO:teuthology.orchestra.run.smithi170.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 308 kB/s | 23 kB 00:00 2024-04-26T12:28:06.060 INFO:teuthology.orchestra.run.smithi170.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-04-26T12:28:06.085 INFO:teuthology.orchestra.run.smithi170.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-04-26T12:28:06.111 INFO:teuthology.orchestra.run.smithi170.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-04-26T12:28:06.153 INFO:teuthology.orchestra.run.smithi170.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 858 kB/s | 79 kB 00:00 2024-04-26T12:28:06.211 INFO:teuthology.orchestra.run.smithi170.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-04-26T12:28:06.237 INFO:teuthology.orchestra.run.smithi170.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 131 kB/s | 16 kB 00:00 2024-04-26T12:28:06.262 INFO:teuthology.orchestra.run.smithi170.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 826 kB/s | 90 kB 00:00 2024-04-26T12:28:06.287 INFO:teuthology.orchestra.run.smithi170.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 473 kB/s | 36 kB 00:00 2024-04-26T12:28:06.313 INFO:teuthology.orchestra.run.smithi170.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T12:28:06.371 INFO:teuthology.orchestra.run.smithi170.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-04-26T12:28:06.405 INFO:teuthology.orchestra.run.smithi170.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 171 kB/s | 20 kB 00:00 2024-04-26T12:28:06.410 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:06.411 INFO:teuthology.orchestra.run.smithi170.stdout:Total 8.1 MB/s | 30 MB 00:03 2024-04-26T12:28:06.547 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:06.587 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:06.587 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:06.881 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:06.881 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:08.112 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/4 2024-04-26T12:28:08.113 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/4 2024-04-26T12:28:08.113 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/4 2024-04-26T12:28:08.113 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-26T12:28:08.167 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:08.232 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-26T12:28:08.264 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-26T12:28:08.293 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:08.433 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-26T12:28:08.523 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-26T12:28:08.602 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-26T12:28:08.644 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-26T12:28:08.679 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-26T12:28:08.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph 2024-04-26T12:28:08.709 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-26T12:28:08.744 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-26T12:28:08.777 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-26T12:28:08.817 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-26T12:28:08.852 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-26T12:28:09.135 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-26T12:28:09.215 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:47 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-26T12:28:09.286 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-26T12:28:09.324 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-26T12:28:09.339 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:09.341 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:09.341 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 6.6 k 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 2.4 M 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 1.5 M 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 249 k 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 4.7 M 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 17 M 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T12:28:09.342 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T12:28:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:28:09.344 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:09.345 INFO:teuthology.orchestra.run.smithi132.stdout:Install 36 Packages 2024-04-26T12:28:09.345 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:09.345 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 30 M 2024-04-26T12:28:09.345 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 107 M 2024-04-26T12:28:09.345 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:28:09.373 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-26T12:28:09.429 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-26T12:28:09.613 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-26T12:28:09.662 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-26T12:28:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-26T12:28:09.828 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-26T12:28:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-26T12:28:09.984 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-26T12:28:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2451.g7fad7ff2.el7. 31/36 2024-04-26T12:28:10.175 INFO:teuthology.orchestra.run.smithi132.stdout:(1/36): ceph-19.0.0-2451.g7fad7ff2.el7.x86_64.r 23 kB/s | 6.6 kB 00:00 2024-04-26T12:28:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/36 2024-04-26T12:28:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/36 2024-04-26T12:28:10.213 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:10.213 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:28:10.213 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:28:10.213 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:28:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:10.830 INFO:teuthology.orchestra.run.smithi132.stdout:(2/36): ceph-mgr-19.0.0-2451.g7fad7ff2.el7.x86_ 1.6 MB/s | 1.5 MB 00:00 2024-04-26T12:28:11.055 INFO:teuthology.orchestra.run.smithi132.stdout:(3/36): ceph-mds-19.0.0-2451.g7fad7ff2.el7.x86_ 2.0 MB/s | 2.4 MB 00:01 2024-04-26T12:28:11.172 INFO:teuthology.orchestra.run.smithi132.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2451.g7fad 2.1 MB/s | 249 kB 00:00 2024-04-26T12:28:11.497 INFO:teuthology.orchestra.run.smithi132.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 779 kB/s | 253 kB 00:00 2024-04-26T12:28:11.665 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 33/36 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 33/36 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi132.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi132.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi132.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-04-26T12:28:11.865 INFO:teuthology.orchestra.run.smithi132.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-04-26T12:28:11.940 INFO:teuthology.orchestra.run.smithi132.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-04-26T12:28:12.024 INFO:teuthology.orchestra.run.smithi132.stdout:(11/36): ceph-mon-19.0.0-2451.g7fad7ff2.el7.x86 2.5 MB/s | 4.7 MB 00:01 2024-04-26T12:28:12.041 INFO:teuthology.orchestra.run.smithi132.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-04-26T12:28:12.108 INFO:teuthology.orchestra.run.smithi132.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-26T12:28:12.132 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 34/36 2024-04-26T12:28:12.155 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 34/36 2024-04-26T12:28:12.155 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:12.155 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:28:12.155 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:28:12.155 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:28:12.155 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:12.200 INFO:teuthology.orchestra.run.smithi132.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 219 kB/s | 35 kB 00:00 2024-04-26T12:28:12.225 INFO:teuthology.orchestra.run.smithi132.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-04-26T12:28:12.258 INFO:teuthology.orchestra.run.smithi132.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-04-26T12:28:12.284 INFO:teuthology.orchestra.run.smithi132.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 35/36 2024-04-26T12:28:12.413 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 35/36 2024-04-26T12:28:12.414 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:12.414 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:28:12.414 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:28:12.414 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:28:12.414 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:12.487 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 36/36 2024-04-26T12:28:12.842 INFO:teuthology.orchestra.run.smithi132.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 78 kB/s | 43 kB 00:00 2024-04-26T12:28:12.984 INFO:teuthology.orchestra.run.smithi132.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 208 kB/s | 151 kB 00:00 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi132.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 251 kB/s | 172 kB 00:00 2024-04-26T12:28:13.735 INFO:teuthology.orchestra.run.smithi132.stdout:(21/36): ceph-osd-19.0.0-2451.g7fad7ff2.el7.x86 5.8 MB/s | 17 MB 00:02 2024-04-26T12:28:13.905 INFO:teuthology.orchestra.run.smithi132.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 395 kB/s | 358 kB 00:00 2024-04-26T12:28:14.102 INFO:teuthology.orchestra.run.smithi132.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 19 kB/s | 11 kB 00:00 2024-04-26T12:28:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 36/36 2024-04-26T12:28:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 5/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2451.g7fad7ff2.el7. 6/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-26T12:28:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-26T12:28:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-26T12:28:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-26T12:28:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-26T12:28:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-26T12:28:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-26T12:28:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-26T12:28:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-26T12:28:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-26T12:28:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-26T12:28:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-26T12:28:14.244 INFO:teuthology.orchestra.run.smithi132.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 37 kB/s | 18 kB 00:00 2024-04-26T12:28:14.386 INFO:teuthology.orchestra.run.smithi132.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 47 kB/s | 23 kB 00:00 2024-04-26T12:28:14.586 INFO:teuthology.orchestra.run.smithi132.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 40 kB/s | 19 kB 00:00 2024-04-26T12:28:14.737 INFO:teuthology.orchestra.run.smithi132.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 40 kB/s | 20 kB 00:00 2024-04-26T12:28:14.945 INFO:teuthology.orchestra.run.smithi132.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 83 kB/s | 46 kB 00:00 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:15.058 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:28:15.059 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:28:15.060 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:28:15.061 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:28:15.061 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:15.061 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:15.220 INFO:teuthology.orchestra.run.smithi132.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 125 kB/s | 79 kB 00:00 2024-04-26T12:28:15.362 INFO:teuthology.orchestra.run.smithi132.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 39 kB/s | 16 kB 00:00 2024-04-26T12:28:15.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-base 2024-04-26T12:28:15.688 INFO:teuthology.orchestra.run.smithi132.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 286 kB/s | 272 kB 00:00 2024-04-26T12:28:15.754 INFO:teuthology.orchestra.run.smithi132.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 168 kB/s | 90 kB 00:00 2024-04-26T12:28:15.830 INFO:teuthology.orchestra.run.smithi132.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 77 kB/s | 36 kB 00:00 2024-04-26T12:28:15.923 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:53 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:16.003 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:28:16.045 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:16.046 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:28:16.046 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:16.113 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install cephadm 2024-04-26T12:28:16.205 INFO:teuthology.orchestra.run.smithi132.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 53 kB/s | 20 kB 00:00 2024-04-26T12:28:16.629 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:54 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:16.722 INFO:teuthology.orchestra.run.smithi132.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 442 kB/s | 427 kB 00:00 2024-04-26T12:28:16.758 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:16.759 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:16.759 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:16.759 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:16.759 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:16.759 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 762 k 2024-04-26T12:28:16.759 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 762 k 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 768 k 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:16.772 INFO:teuthology.orchestra.run.smithi132.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 212 kB/s | 230 kB 00:01 2024-04-26T12:28:16.776 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:16.776 INFO:teuthology.orchestra.run.smithi132.stdout:Total 4.1 MB/s | 30 MB 00:07 2024-04-26T12:28:16.907 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm-19.0.0-2451.g7fad7ff2.el7.noarch.rpm 2.7 MB/s | 762 kB 00:00 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.6 MB/s | 762 kB 00:00 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:17.124 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:17.239 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:28:17.240 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:17.965 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:18.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:18.208 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:18.208 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:18.209 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:18.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:18.209 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:18.429 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T12:28:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:28:18.558 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-26T12:28:18.590 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-26T12:28:18.619 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-26T12:28:18.688 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-26T12:28:18.734 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-26T12:28:18.767 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-26T12:28:18.858 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-26T12:28:18.936 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-26T12:28:18.943 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:56 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:18.978 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-26T12:28:19.013 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-26T12:28:19.043 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-26T12:28:19.066 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:19.066 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:19.066 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 145 k 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 145 k 2024-04-26T12:28:19.067 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 436 k 2024-04-26T12:28:19.068 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:19.078 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-26T12:28:19.112 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-26T12:28:19.144 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-26T12:28:19.198 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-26T12:28:19.231 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-26T12:28:19.268 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-26T12:28:19.290 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-immutable-object-cache-19.0.0-2451.g7fad7f 655 kB/s | 145 kB 00:00 2024-04-26T12:28:19.290 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:19.291 INFO:teuthology.orchestra.run.smithi170.stdout:Total 649 kB/s | 145 kB 00:00 2024-04-26T12:28:19.291 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:19.298 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:19.299 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:19.340 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-26T12:28:19.355 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:19.355 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:19.478 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-26T12:28:19.501 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:19.567 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-26T12:28:19.582 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2. 1/1 2024-04-26T12:28:19.607 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2. 1/1 2024-04-26T12:28:19.607 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:19.607 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:28:19.607 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:19.620 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-26T12:28:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-26T12:28:19.708 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-26T12:28:19.763 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-26T12:28:19.947 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-26T12:28:19.997 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-26T12:28:20.074 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-26T12:28:20.163 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-26T12:28:20.205 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-26T12:28:20.320 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-26T12:28:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2. 1/1 2024-04-26T12:28:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:20.474 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:20.474 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:20.494 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2451.g7fad7ff2.el7. 31/36 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/36 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 32/36 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:20.675 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr 2024-04-26T12:28:21.191 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:59 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:21.274 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:28:21.315 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:21.316 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:28:21.316 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:21.375 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T12:28:21.878 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:59 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:21.997 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:21.998 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:21.998 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:21.998 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 3.5 M 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 32 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 15 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:21.999 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-04-26T12:28:22.000 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 8.6 M 2024-04-26T12:28:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 103 M 2024-04-26T12:28:22.001 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:22.042 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 33/36 2024-04-26T12:28:22.071 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 33/36 2024-04-26T12:28:22.071 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:22.071 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T12:28:22.071 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:28:22.072 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T12:28:22.072 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:22.527 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 34/36 2024-04-26T12:28:22.550 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 34/36 2024-04-26T12:28:22.550 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:22.550 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T12:28:22.550 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:28:22.551 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T12:28:22.551 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:22.685 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2451.g7f 122 kB/s | 32 kB 00:00 2024-04-26T12:28:22.777 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 35/36 2024-04-26T12:28:22.800 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 35/36 2024-04-26T12:28:22.800 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:22.800 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T12:28:22.801 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:28:22.801 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T12:28:22.801 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:22.836 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2451.g7fa 37 kB/s | 15 kB 00:00 2024-04-26T12:28:22.864 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 36/36 2024-04-26T12:28:23.136 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-04-26T12:28:23.161 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 828 kB/s | 269 kB 00:00 2024-04-26T12:28:23.245 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 7.8 MB/s | 863 kB 00:00 2024-04-26T12:28:23.412 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.1 MB/s | 548 kB 00:00 2024-04-26T12:28:23.437 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 102 kB/s | 19 kB 00:00 2024-04-26T12:28:23.587 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-04-26T12:28:23.613 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 824 kB/s | 144 kB 00:00 2024-04-26T12:28:23.638 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 617 kB/s | 31 kB 00:00 2024-04-26T12:28:23.663 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-04-26T12:28:24.063 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): ceph-mgr-dashboard-19.0.0-2451.g7fad7f 2.1 MB/s | 3.5 MB 00:01 2024-04-26T12:28:24.067 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:24.067 INFO:teuthology.orchestra.run.smithi170.stdout:Total 4.2 MB/s | 8.6 MB 00:02 2024-04-26T12:28:24.114 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:24.131 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:24.131 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:24.285 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:24.287 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:24.411 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 36/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 3/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 4/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 5/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2451.g7fad7ff2.el7. 6/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-26T12:28:24.412 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-26T12:28:24.413 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-26T12:28:24.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-26T12:28:24.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-26T12:28:24.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-26T12:28:24.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-26T12:28:24.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-26T12:28:24.414 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-26T12:28:24.809 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:24.872 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-26T12:28:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-26T12:28:24.962 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-26T12:28:24.993 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-26T12:28:25.068 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-26T12:28:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-26T12:28:25.294 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-26T12:28:25.348 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-26T12:28:25.376 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T12:28:25.387 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T12:28:25.388 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:25.389 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:25.408 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2451.g7fad7ff2.el7 10/12 2024-04-26T12:28:25.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-base 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:04 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:26.330 INFO:teuthology.orchestra.run.smithi132.stdout:Package ceph-base-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:28:26.371 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:26.372 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:28:26.372 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:26.441 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install cephadm 2024-04-26T12:28:26.443 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2451.g7fad7ff2.el 11/12 2024-04-26T12:28:26.476 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noa 12/12 2024-04-26T12:28:26.947 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:04 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:27.067 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 762 k 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 762 k 2024-04-26T12:28:27.068 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 768 k 2024-04-26T12:28:27.069 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noa 12/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2451.g7fad7ff2.el 1/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noa 2/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2451.g7fad7ff2.el7 3/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-26T12:28:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-26T12:28:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-26T12:28:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-26T12:28:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-26T12:28:28.043 INFO:teuthology.orchestra.run.smithi132.stdout:cephadm-19.0.0-2451.g7fad7ff2.el7.noarch.rpm 782 kB/s | 762 kB 00:00 2024-04-26T12:28:28.043 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:28.044 INFO:teuthology.orchestra.run.smithi132.stdout:Total 781 kB/s | 762 kB 00:00 2024-04-26T12:28:28.044 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:28:28.049 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:28:28.049 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:28:28.055 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:28:28.056 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:28:28.126 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:28:28.173 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-26T12:28:28.173 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:28:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:28.175 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:28.427 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T12:28:28.562 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:28.655 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:28.933 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:06 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:28.965 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:29.055 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:29.056 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-26T12:28:29.056 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 7.4 M 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:28:29.057 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:29.058 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-26T12:28:29.059 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-04-26T12:28:29.059 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:29.059 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 38 M 2024-04-26T12:28:29.060 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 209 M 2024-04-26T12:28:29.060 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:29.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/1 2024-04-26T12:28:29.181 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:29.181 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:28:29.182 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:29.182 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:29.182 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:29.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-immutable-object-cache 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 660 kB/s | 33 kB 00:00 2024-04-26T12:28:29.789 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 242 kB/s | 18 kB 00:00 2024-04-26T12:28:29.901 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:07 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:29.906 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-04-26T12:28:29.932 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 250 kB/s | 35 kB 00:00 2024-04-26T12:28:30.015 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-26T12:28:30.022 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 145 k 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 145 k 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 436 k 2024-04-26T12:28:30.023 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:28:30.107 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-04-26T12:28:30.299 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.3 MB/s | 250 kB 00:00 2024-04-26T12:28:30.458 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-immutable-object-cache-19.0.0-2451.g7fad7f 333 kB/s | 145 kB 00:00 2024-04-26T12:28:30.459 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:30.459 INFO:teuthology.orchestra.run.smithi132.stdout:Total 332 kB/s | 145 kB 00:00 2024-04-26T12:28:30.460 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:28:30.467 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:28:30.467 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:28:30.524 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:28:30.524 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:28:30.677 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:28:30.743 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2. 1/1 2024-04-26T12:28:30.767 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2. 1/1 2024-04-26T12:28:30.768 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:30.768 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T12:28:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-04-26T12:28:30.950 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 5.0 MB/s | 7.4 MB 00:01 2024-04-26T12:28:30.953 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:30.953 INFO:teuthology.orchestra.run.smithi170.stdout:Total 20 MB/s | 38 MB 00:01 2024-04-26T12:28:31.303 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:31.330 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:31.330 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:31.633 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2. 1/1 2024-04-26T12:28:31.633 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:31.633 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:28:31.633 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:31.633 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:31.633 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:31.737 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:31.737 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:31.857 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr 2024-04-26T12:28:32.386 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:10 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:32.466 INFO:teuthology.orchestra.run.smithi132.stdout:Package ceph-mgr-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:28:32.509 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:32.510 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:28:32.511 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:32.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-dashboard 2024-04-26T12:28:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T12:28:32.665 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T12:28:32.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T12:28:32.799 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T12:28:32.985 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T12:28:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T12:28:33.090 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:11 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T12:28:33.210 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:28:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:33.211 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 3.5 M 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 32 k 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 15 k 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T12:28:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T12:28:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T12:28:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:28:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:33.213 INFO:teuthology.orchestra.run.smithi132.stdout:Install 12 Packages 2024-04-26T12:28:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:33.214 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 8.6 M 2024-04-26T12:28:33.214 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 103 M 2024-04-26T12:28:33.214 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:28:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T12:28:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T12:28:34.097 INFO:teuthology.orchestra.run.smithi132.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2451.g7f 100 kB/s | 32 kB 00:00 2024-04-26T12:28:34.122 INFO:teuthology.orchestra.run.smithi132.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2451.g7fa 45 kB/s | 15 kB 00:00 2024-04-26T12:28:34.281 INFO:teuthology.orchestra.run.smithi132.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-04-26T12:28:34.340 INFO:teuthology.orchestra.run.smithi132.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-04-26T12:28:34.381 INFO:teuthology.orchestra.run.smithi132.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 8.5 MB/s | 863 kB 00:00 2024-04-26T12:28:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 129 kB/s | 19 kB 00:00 2024-04-26T12:28:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.5 MB/s | 548 kB 00:00 2024-04-26T12:28:34.782 INFO:teuthology.orchestra.run.smithi132.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.7 MB/s | 144 kB 00:00 2024-04-26T12:28:34.857 INFO:teuthology.orchestra.run.smithi132.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 410 kB/s | 31 kB 00:00 2024-04-26T12:28:34.908 INFO:teuthology.orchestra.run.smithi132.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.4 MB/s | 2.0 MB 00:00 2024-04-26T12:28:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-04-26T12:28:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T12:28:36.116 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T12:28:36.149 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7 12/12 2024-04-26T12:28:37.816 INFO:teuthology.orchestra.run.smithi132.stdout:(12/12): ceph-mgr-dashboard-19.0.0-2451.g7fad7f 892 kB/s | 3.5 MB 00:04 2024-04-26T12:28:37.820 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:37.821 INFO:teuthology.orchestra.run.smithi132.stdout:Total 1.9 MB/s | 8.6 MB 00:04 2024-04-26T12:28:37.871 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:28:37.890 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:28:37.890 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:28:38.043 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:28:38.044 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:28:38.658 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-26T12:28:38.693 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-26T12:28:38.703 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7 12/12 2024-04-26T12:28:38.703 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7 1/12 2024-04-26T12:28:38.703 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T12:28:38.703 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T12:28:38.703 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T12:28:38.703 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T12:28:38.703 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T12:28:38.704 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T12:28:38.704 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T12:28:38.704 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T12:28:38.704 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T12:28:38.704 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-26T12:28:38.779 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-26T12:28:38.855 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-26T12:28:38.979 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-26T12:28:39.056 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T12:28:39.056 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:39.056 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:39.056 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:39.056 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:28:39.056 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:39.057 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:39.064 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2451.g7fad7ff2.el7 10/12 2024-04-26T12:28:39.548 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-rook 2024-04-26T12:28:40.066 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:18 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:40.184 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:40.185 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:40.185 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:40.185 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 49 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:28:40.186 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:28:40.187 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:28:40.187 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:40.187 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:40.187 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:40.187 INFO:teuthology.orchestra.run.smithi170.stdout:Install 13 Packages 2024-04-26T12:28:40.187 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:40.188 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 2.2 M 2024-04-26T12:28:40.188 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 26 M 2024-04-26T12:28:40.188 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:40.216 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2451.g7fad7ff2.el 11/12 2024-04-26T12:28:40.245 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noa 12/12 2024-04-26T12:28:40.932 INFO:teuthology.orchestra.run.smithi170.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 217 kB/s | 26 kB 00:00 2024-04-26T12:28:40.957 INFO:teuthology.orchestra.run.smithi170.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 134 kB/s | 19 kB 00:00 2024-04-26T12:28:41.016 INFO:teuthology.orchestra.run.smithi170.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-04-26T12:28:41.041 INFO:teuthology.orchestra.run.smithi170.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-04-26T12:28:41.066 INFO:teuthology.orchestra.run.smithi170.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 5.4 MB/s | 279 kB 00:00 2024-04-26T12:28:41.092 INFO:teuthology.orchestra.run.smithi170.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.1 MB/s | 54 kB 00:00 2024-04-26T12:28:41.117 INFO:teuthology.orchestra.run.smithi170.stdout:(7/13): ceph-mgr-rook-19.0.0-2451.g7fad7ff2.el7 162 kB/s | 49 kB 00:00 2024-04-26T12:28:41.467 INFO:teuthology.orchestra.run.smithi170.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 40 kB/s | 15 kB 00:00 2024-04-26T12:28:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 76 kB/s | 32 kB 00:00 2024-04-26T12:28:41.639 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noa 12/12 2024-04-26T12:28:41.639 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2451.g7fad7ff2.el 1/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noa 2/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2451.g7fad7ff2.el7 3/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-26T12:28:41.640 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-26T12:28:41.668 INFO:teuthology.orchestra.run.smithi170.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 338 kB/s | 59 kB 00:00 2024-04-26T12:28:41.710 INFO:teuthology.orchestra.run.smithi170.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 347 kB/s | 206 kB 00:00 2024-04-26T12:28:41.810 INFO:teuthology.orchestra.run.smithi170.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 632 kB/s | 90 kB 00:00 2024-04-26T12:28:41.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-26T12:28:41.928 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:41.928 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:28:41.928 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:41.929 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:42.010 INFO:teuthology.orchestra.run.smithi170.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-04-26T12:28:42.015 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:42.015 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-04-26T12:28:42.077 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:42.093 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:42.093 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:42.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-26T12:28:42.176 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:42.176 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:42.683 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:20 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:42.804 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:42.805 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-26T12:28:42.805 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:28:42.805 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-26T12:28:42.805 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:28:42.805 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 7.4 M 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T12:28:42.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T12:28:42.807 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:42.807 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:28:42.807 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-26T12:28:42.807 INFO:teuthology.orchestra.run.smithi132.stdout:Install 12 Packages 2024-04-26T12:28:42.807 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:42.807 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 38 M 2024-04-26T12:28:42.807 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 209 M 2024-04-26T12:28:42.808 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:28:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T12:28:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T12:28:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T12:28:42.996 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T12:28:43.037 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T12:28:43.130 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T12:28:43.192 INFO:teuthology.orchestra.run.smithi132.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi132.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi132.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 443 kB/s | 33 kB 00:00 2024-04-26T12:28:43.309 INFO:teuthology.orchestra.run.smithi132.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 451 kB/s | 18 kB 00:00 2024-04-26T12:28:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T12:28:43.376 INFO:teuthology.orchestra.run.smithi132.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-04-26T12:28:43.401 INFO:teuthology.orchestra.run.smithi132.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 390 kB/s | 35 kB 00:00 2024-04-26T12:28:43.443 INFO:teuthology.orchestra.run.smithi132.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 5.9 MB/s | 244 kB 00:00 2024-04-26T12:28:43.527 INFO:teuthology.orchestra.run.smithi132.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 32 MB/s | 4.7 MB 00:00 2024-04-26T12:28:43.611 INFO:teuthology.orchestra.run.smithi132.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-04-26T12:28:43.636 INFO:teuthology.orchestra.run.smithi132.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-04-26T12:28:44.020 INFO:teuthology.orchestra.run.smithi132.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-26T12:28:44.038 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T12:28:44.086 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T12:28:44.111 INFO:teuthology.orchestra.run.smithi132.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 6.9 MB/s | 7.4 MB 00:01 2024-04-26T12:28:44.114 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:44.114 INFO:teuthology.orchestra.run.smithi132.stdout:Total 29 MB/s | 38 MB 00:01 2024-04-26T12:28:44.120 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T12:28:44.168 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T12:28:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 13/13 2024-04-26T12:28:44.464 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:28:44.490 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:28:44.490 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 13/13 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/13 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T12:28:45.271 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T12:28:45.271 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:45.271 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:28:45.272 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:45.273 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:45.500 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T12:28:45.713 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:28:45.784 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-26T12:28:45.827 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-26T12:28:45.925 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-26T12:28:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-26T12:28:46.015 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:24 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:46.136 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:46.136 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:46.136 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:46.136 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 141 k 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout:Install 6 Packages 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:46.138 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 7.0 M 2024-04-26T12:28:46.138 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 33 M 2024-04-26T12:28:46.138 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:46.146 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-26T12:28:46.176 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-26T12:28:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-26T12:28:46.613 INFO:teuthology.orchestra.run.smithi170.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-04-26T12:28:46.788 INFO:teuthology.orchestra.run.smithi170.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-26T12:28:46.884 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-26T12:28:46.930 INFO:teuthology.orchestra.run.smithi170.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2451.g7fad7ff2.e 288 kB/s | 141 kB 00:00 2024-04-26T12:28:46.998 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-26T12:28:47.105 INFO:teuthology.orchestra.run.smithi170.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 183 kB/s | 58 kB 00:00 2024-04-26T12:28:47.131 INFO:teuthology.orchestra.run.smithi170.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2024-04-26T12:28:47.231 INFO:teuthology.orchestra.run.smithi170.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 170 kB/s | 51 kB 00:00 2024-04-26T12:28:47.234 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:47.235 INFO:teuthology.orchestra.run.smithi170.stdout:Total 6.4 MB/s | 7.0 MB 00:01 2024-04-26T12:28:47.306 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:47.317 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:47.318 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:47.714 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:47.878 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T12:28:47.932 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T12:28:48.205 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T12:28:48.448 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T12:28:48.535 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T12:28:48.615 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T12:28:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 6/6 2024-04-26T12:28:49.240 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-26T12:28:49.269 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7 12/12 2024-04-26T12:28:49.398 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 6/6 2024-04-26T12:28:49.398 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/6 2024-04-26T12:28:49.398 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T12:28:49.398 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T12:28:49.398 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T12:28:49.398 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T12:28:49.665 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T12:28:49.665 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:49.665 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:49.666 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:49.666 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:28:49.666 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:28:49.666 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:28:49.666 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:28:49.666 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:28:49.666 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:49.667 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:49.905 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-fuse 2024-04-26T12:28:50.453 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:28 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:50.572 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 889 k 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:50.573 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:50.574 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-04-26T12:28:50.574 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:50.574 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 969 k 2024-04-26T12:28:50.574 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 2.8 M 2024-04-26T12:28:50.574 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:50.825 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 664 kB/s | 80 kB 00:00 2024-04-26T12:28:51.017 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): ceph-fuse-19.0.0-2451.g7fad7ff2.el7.x86_ 2.8 MB/s | 889 kB 00:00 2024-04-26T12:28:51.018 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:51.018 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.1 MB/s | 969 kB 00:00 2024-04-26T12:28:51.030 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:51.052 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:51.052 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:51.129 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:51.130 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:51.476 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T12:28:51.548 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/2 2024-04-26T12:28:52.131 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7 12/12 2024-04-26T12:28:52.131 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7 1/12 2024-04-26T12:28:52.131 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-26T12:28:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-26T12:28:52.187 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/2 2024-04-26T12:28:52.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/2 2024-04-26T12:28:52.445 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T12:28:52.445 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:52.445 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:52.445 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T12:28:52.445 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:52.445 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:52.510 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-26T12:28:52.510 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:52.510 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:28:52.510 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:52.510 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:52.511 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:52.697 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-volume 2024-04-26T12:28:52.927 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-rook 2024-04-26T12:28:53.212 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:31 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:53.333 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 264 k 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-04-26T12:28:53.334 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:53.335 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 341 k 2024-04-26T12:28:53.335 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 1.5 M 2024-04-26T12:28:53.335 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:53.449 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:31 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 49 k 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout:Install 13 Packages 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 2.2 M 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 26 M 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 658 kB/s | 77 kB 00:00 2024-04-26T12:28:53.732 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): ceph-volume-19.0.0-2451.g7fad7ff2.el7.no 986 kB/s | 264 kB 00:00 2024-04-26T12:28:53.733 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:53.734 INFO:teuthology.orchestra.run.smithi170.stdout:Total 854 kB/s | 341 kB 00:00 2024-04-26T12:28:53.745 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:53.754 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:53.754 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:53.781 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:53.781 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:53.925 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:53.971 INFO:teuthology.orchestra.run.smithi132.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 150 kB/s | 19 kB 00:00 2024-04-26T12:28:53.988 INFO:teuthology.orchestra.run.smithi132.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 177 kB/s | 26 kB 00:00 2024-04-26T12:28:54.038 INFO:teuthology.orchestra.run.smithi132.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 3.3 MB/s | 222 kB 00:00 2024-04-26T12:28:54.063 INFO:teuthology.orchestra.run.smithi132.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi132.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 5.4 MB/s | 279 kB 00:00 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi132.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.1 MB/s | 54 kB 00:00 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 2/2 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi132.stdout:(7/13): ceph-mgr-rook-19.0.0-2451.g7fad7ff2.el7 166 kB/s | 49 kB 00:00 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 2/2 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:54.406 INFO:teuthology.orchestra.run.smithi132.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 51 kB/s | 15 kB 00:00 2024-04-26T12:28:54.431 INFO:teuthology.orchestra.run.smithi132.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 94 kB/s | 32 kB 00:00 2024-04-26T12:28:54.574 INFO:teuthology.orchestra.run.smithi132.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 417 kB/s | 59 kB 00:00 2024-04-26T12:28:54.599 INFO:teuthology.orchestra.run.smithi132.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 448 kB/s | 206 kB 00:00 2024-04-26T12:28:54.691 INFO:teuthology.orchestra.run.smithi132.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 769 kB/s | 90 kB 00:00 2024-04-26T12:28:54.741 INFO:teuthology.orchestra.run.smithi132.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-04-26T12:28:54.745 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:54.745 INFO:teuthology.orchestra.run.smithi132.stdout:Total 1.9 MB/s | 2.2 MB 00:01 2024-04-26T12:28:54.792 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/2 2024-04-26T12:28:54.807 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:28:54.822 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:28:54.822 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:28:54.907 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:28:54.907 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:28:55.085 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-26T12:28:55.085 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:55.085 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:55.085 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:55.085 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:28:55.085 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:55.085 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:55.403 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados-devel 2024-04-26T12:28:55.409 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:28:55.581 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-26T12:28:55.634 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-26T12:28:55.691 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-26T12:28:55.729 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-26T12:28:55.770 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-26T12:28:55.864 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-26T12:28:55.921 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:33 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:55.978 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-26T12:28:56.030 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-26T12:28:56.046 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:56.047 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:56.047 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-26T12:28:56.047 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:56.047 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:56.047 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 127 k 2024-04-26T12:28:56.047 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:56.047 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:56.048 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:56.048 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-26T12:28:56.048 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:56.048 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 127 k 2024-04-26T12:28:56.048 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 456 k 2024-04-26T12:28:56.048 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:56.389 INFO:teuthology.orchestra.run.smithi170.stdout:librados-devel-19.0.0-2451.g7fad7ff2.el7.x86_64 373 kB/s | 127 kB 00:00 2024-04-26T12:28:56.389 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:56.390 INFO:teuthology.orchestra.run.smithi170.stdout:Total 371 kB/s | 127 kB 00:00 2024-04-26T12:28:56.390 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:56.395 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:56.395 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:56.458 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:56.459 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-26T12:28:56.811 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-26T12:28:56.845 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-26T12:28:56.892 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-26T12:28:56.914 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 13/13 2024-04-26T12:28:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:57.607 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs2 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 13/13 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/13 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-26T12:28:57.969 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-26T12:28:57.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:57.969 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:28:57.969 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T12:28:57.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T12:28:57.971 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T12:28:57.971 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T12:28:57.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:57.971 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:36 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:58.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-cephadm 2024-04-26T12:28:58.220 INFO:teuthology.orchestra.run.smithi170.stdout:Package libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:28:58.261 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:58.262 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:28:58.262 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:28:58.346 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs-devel 2024-04-26T12:28:58.726 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:36 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:58.846 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:28:58.847 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:58.847 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 141 k 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout:Install 6 Packages 2024-04-26T12:28:58.848 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:28:58.849 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 7.0 M 2024-04-26T12:28:58.849 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 33 M 2024-04-26T12:28:58.849 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:28:58.861 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:36 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:28:58.980 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 32 k 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:28:58.981 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:28:58.982 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-26T12:28:58.982 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:28:58.982 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 32 k 2024-04-26T12:28:58.982 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 142 k 2024-04-26T12:28:58.982 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:28:59.234 INFO:teuthology.orchestra.run.smithi170.stdout:libcephfs-devel-19.0.0-2451.g7fad7ff2.el7.x86_6 126 kB/s | 32 kB 00:00 2024-04-26T12:28:59.234 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:59.234 INFO:teuthology.orchestra.run.smithi170.stdout:Total 125 kB/s | 32 kB 00:00 2024-04-26T12:28:59.234 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:28:59.238 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:28:59.238 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:28:59.240 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:28:59.240 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:28:59.331 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:28:59.445 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:28:59.545 INFO:teuthology.orchestra.run.smithi132.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-04-26T12:28:59.712 INFO:teuthology.orchestra.run.smithi132.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-26T12:28:59.807 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:28:59.837 INFO:teuthology.orchestra.run.smithi132.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2451.g7fad7ff2.e 282 kB/s | 141 kB 00:00 2024-04-26T12:29:00.008 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:00.008 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:00.008 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:29:00.009 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:00.009 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:00.009 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:00.129 INFO:teuthology.orchestra.run.smithi132.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 138 kB/s | 58 kB 00:00 2024-04-26T12:29:00.172 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados2 2024-04-26T12:29:00.229 INFO:teuthology.orchestra.run.smithi132.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 130 kB/s | 51 kB 00:00 2024-04-26T12:29:00.446 INFO:teuthology.orchestra.run.smithi132.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 609 kB/s | 548 kB 00:00 2024-04-26T12:29:00.448 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:00.448 INFO:teuthology.orchestra.run.smithi132.stdout:Total 4.4 MB/s | 7.0 MB 00:01 2024-04-26T12:29:00.521 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:00.532 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:00.533 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:00.628 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:00.628 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:00.694 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:38 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:00.773 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:00.814 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:00.815 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:29:00.815 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:00.887 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librbd1 2024-04-26T12:29:00.930 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:01.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-26T12:29:01.148 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:39 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:01.483 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:01.525 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:01.526 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:29:01.526 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:01.589 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rados 2024-04-26T12:29:01.666 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-26T12:29:01.758 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-26T12:29:01.821 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-26T12:29:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 6/6 2024-04-26T12:29:02.098 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:40 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:02.177 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:02.218 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:02.219 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:29:02.219 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:02.281 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rgw 2024-04-26T12:29:02.613 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 6/6 2024-04-26T12:29:02.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/6 2024-04-26T12:29:02.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-26T12:29:02.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-26T12:29:02.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-26T12:29:02.614 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-26T12:29:02.786 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:40 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-26T12:29:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:02.842 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:29:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T12:29:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T12:29:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T12:29:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T12:29:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T12:29:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:02.843 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:02.866 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:02.906 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:02.908 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:29:02.908 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:02.968 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-cephfs 2024-04-26T12:29:03.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-fuse 2024-04-26T12:29:03.478 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:41 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:03.557 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:03.598 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:03.599 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:29:03.599 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:03.609 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:41 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:03.660 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rbd 2024-04-26T12:29:03.728 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:03.728 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 889 k 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout:Install 2 Packages 2024-04-26T12:29:03.729 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:03.730 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 969 k 2024-04-26T12:29:03.730 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 2.8 M 2024-04-26T12:29:03.730 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:29:04.163 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:42 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:04.241 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:04.282 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:04.283 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T12:29:04.283 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:04.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-fuse 2024-04-26T12:29:04.373 INFO:teuthology.orchestra.run.smithi132.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 297 kB/s | 80 kB 00:00 2024-04-26T12:29:04.406 INFO:teuthology.orchestra.run.smithi132.stdout:(2/2): ceph-fuse-19.0.0-2451.g7fad7ff2.el7.x86_ 2.9 MB/s | 889 kB 00:00 2024-04-26T12:29:04.407 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:04.407 INFO:teuthology.orchestra.run.smithi132.stdout:Total 1.4 MB/s | 969 kB 00:00 2024-04-26T12:29:04.419 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:04.440 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:04.440 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:04.520 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:04.520 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:04.699 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:04.840 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-26T12:29:04.870 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:42 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:04.903 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/2 2024-04-26T12:29:04.990 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 85 k 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-26T12:29:04.991 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:04.992 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 85 k 2024-04-26T12:29:04.992 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 231 k 2024-04-26T12:29:04.992 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:29:05.212 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-fuse-19.0.0-2451.g7fad7ff2.el7.x86_64.rpm 387 kB/s | 85 kB 00:00 2024-04-26T12:29:05.212 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:05.212 INFO:teuthology.orchestra.run.smithi170.stdout:Total 385 kB/s | 85 kB 00:00 2024-04-26T12:29:05.213 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:29:05.220 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:29:05.220 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:29:05.428 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:29:05.525 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:05.543 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2/2 2024-04-26T12:29:05.543 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/2 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:06.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-volume 2024-04-26T12:29:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:06.102 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:29:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:06.102 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:06.389 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-mirror 2024-04-26T12:29:06.595 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:44 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:06.716 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:06.716 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:06.716 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-26T12:29:06.716 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.0.0-2451.g7fad7ff2.el7 ceph-noarch 264 k 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout:Install 2 Packages 2024-04-26T12:29:06.717 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:06.718 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 341 k 2024-04-26T12:29:06.718 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 1.5 M 2024-04-26T12:29:06.718 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:29:06.908 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:44 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:07.030 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 3.1 M 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 3.1 M 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 13 M 2024-04-26T12:29:07.031 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:29:07.194 INFO:teuthology.orchestra.run.smithi132.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 493 kB/s | 77 kB 00:00 2024-04-26T12:29:07.544 INFO:teuthology.orchestra.run.smithi132.stdout:(2/2): ceph-volume-19.0.0-2451.g7fad7ff2.el7.no 520 kB/s | 264 kB 00:00 2024-04-26T12:29:07.545 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:07.546 INFO:teuthology.orchestra.run.smithi132.stdout:Total 411 kB/s | 341 kB 00:00 2024-04-26T12:29:07.557 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:07.566 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:07.567 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:07.592 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:07.593 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:07.736 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:07.919 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 2/2 2024-04-26T12:29:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 2/2 2024-04-26T12:29:07.971 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:29:07.971 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T12:29:07.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:08.332 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-mirror-19.0.0-2451.g7fad7ff2.el7.x86_64.rpm 2.4 MB/s | 3.1 MB 00:01 2024-04-26T12:29:08.332 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:08.333 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.4 MB/s | 3.1 MB 00:01 2024-04-26T12:29:08.333 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:29:08.342 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:29:08.342 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:29:08.424 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:29:08.425 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:29:08.658 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 1/2 2024-04-26T12:29:08.848 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:29:08.916 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:08.940 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:08.940 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:29:08.940 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:29:08.940 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:29:08.940 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:29:08.940 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:08.951 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-26T12:29:08.951 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:08.951 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:08.951 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.0.0-2451.g7fad7ff2.el7.noarch 2024-04-26T12:29:08.951 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T12:29:08.951 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:08.951 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:09.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install librados-devel 2024-04-26T12:29:09.802 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:47 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:09.924 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:09.924 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:09.924 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-04-26T12:29:09.924 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:09.924 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:29:09.924 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 127 k 2024-04-26T12:29:09.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:29:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-04-26T12:29:09.925 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 127 k 2024-04-26T12:29:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 456 k 2024-04-26T12:29:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:29:09.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:09.953 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:09.953 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:29:09.953 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:09.953 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:09.953 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:10.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-nbd 2024-04-26T12:29:10.242 INFO:teuthology.orchestra.run.smithi132.stdout:librados-devel-19.0.0-2451.g7fad7ff2.el7.x86_64 401 kB/s | 127 kB 00:00 2024-04-26T12:29:10.243 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:10.243 INFO:teuthology.orchestra.run.smithi132.stdout:Total 399 kB/s | 127 kB 00:00 2024-04-26T12:29:10.243 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:10.248 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:10.249 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:10.313 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:10.313 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:10.463 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:10.556 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:10.695 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:48 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 171 k 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-26T12:29:10.823 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:10.824 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 171 k 2024-04-26T12:29:10.824 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 494 k 2024-04-26T12:29:10.824 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T12:29:10.975 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:11.052 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-nbd-19.0.0-2451.g7fad7ff2.el7.x86_64.rpm 739 kB/s | 171 kB 00:00 2024-04-26T12:29:11.053 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:11.053 INFO:teuthology.orchestra.run.smithi170.stdout:Total 733 kB/s | 171 kB 00:00 2024-04-26T12:29:11.053 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T12:29:11.060 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T12:29:11.060 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T12:29:11.123 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T12:29:11.123 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T12:29:11.216 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:11.216 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:11.216 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:11.217 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:11.217 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:11.217 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:11.278 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T12:29:11.381 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:11.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install libcephfs2 2024-04-26T12:29:11.802 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:12.030 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:50 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:12.033 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:12.034 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:12.034 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T12:29:12.034 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:12.034 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:12.034 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T12:29:12.112 INFO:teuthology.orchestra.run.smithi132.stdout:Package libcephfs2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:12.155 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:12.156 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:29:12.156 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:12.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install libcephfs-devel 2024-04-26T12:29:12.300 DEBUG:teuthology.parallel:result is None 2024-04-26T12:29:12.804 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:50 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:12.925 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:12.925 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 32 k 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 32 k 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 142 k 2024-04-26T12:29:12.926 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:29:13.104 INFO:teuthology.orchestra.run.smithi132.stdout:libcephfs-devel-19.0.0-2451.g7fad7ff2.el7.x86_6 179 kB/s | 32 kB 00:00 2024-04-26T12:29:13.105 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:13.105 INFO:teuthology.orchestra.run.smithi132.stdout:Total 177 kB/s | 32 kB 00:00 2024-04-26T12:29:13.105 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:13.108 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:13.108 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:13.110 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:13.111 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:13.199 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:13.308 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:13.663 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:13.867 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:13.867 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:13.867 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:13.867 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:13.867 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:13.867 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:14.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install librados2 2024-04-26T12:29:14.576 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:52 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:14.656 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:14.697 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:14.699 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:29:14.699 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:14.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install librbd1 2024-04-26T12:29:15.290 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:53 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:15.370 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:15.412 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:15.413 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:29:15.413 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:15.495 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-rados 2024-04-26T12:29:16.009 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:54 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:16.089 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-rados-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:16.129 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:16.130 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:29:16.130 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:16.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-rgw 2024-04-26T12:29:16.716 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:54 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:16.795 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-rgw-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:16.836 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:16.837 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:29:16.837 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:16.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-cephfs 2024-04-26T12:29:17.439 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:55 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:17.518 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-cephfs-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:17.559 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:17.560 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:29:17.560 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:17.631 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-rbd 2024-04-26T12:29:18.137 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:56 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:18.216 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-rbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 is already installed. 2024-04-26T12:29:18.257 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:18.258 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-26T12:29:18.258 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:18.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install rbd-fuse 2024-04-26T12:29:18.859 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:56 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:18.981 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:18.981 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 85 k 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 85 k 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 231 k 2024-04-26T12:29:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:29:19.291 INFO:teuthology.orchestra.run.smithi132.stdout:rbd-fuse-19.0.0-2451.g7fad7ff2.el7.x86_64.rpm 277 kB/s | 85 kB 00:00 2024-04-26T12:29:19.291 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:19.291 INFO:teuthology.orchestra.run.smithi132.stdout:Total 276 kB/s | 85 kB 00:00 2024-04-26T12:29:19.291 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:19.298 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:19.298 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:19.361 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:19.361 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:19.510 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:19.628 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:19.983 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:20.230 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:20.230 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:20.230 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:20.230 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:20.230 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:20.230 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:20.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install rbd-mirror 2024-04-26T12:29:21.041 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:59 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:21.163 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:21.163 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:21.163 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 3.1 M 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-04-26T12:29:21.164 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:21.165 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 3.1 M 2024-04-26T12:29:21.165 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 13 M 2024-04-26T12:29:21.165 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:29:21.702 INFO:teuthology.orchestra.run.smithi132.stdout:rbd-mirror-19.0.0-2451.g7fad7ff2.el7.x86_64.rpm 5.8 MB/s | 3.1 MB 00:00 2024-04-26T12:29:21.703 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:21.703 INFO:teuthology.orchestra.run.smithi132.stdout:Total 5.7 MB/s | 3.1 MB 00:00 2024-04-26T12:29:21.703 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:21.712 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:21.712 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:21.793 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:21.798 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:22.219 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:22.286 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:22.310 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:22.310 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T12:29:22.310 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T12:29:22.310 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:29:22.310 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T12:29:22.310 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:23.387 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:23.387 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:23.387 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:23.387 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:23.387 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:23.387 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:23.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install rbd-nbd 2024-04-26T12:29:24.131 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:02:02 ago on Fri 26 Apr 2024 12:27:22 PM UTC. 2024-04-26T12:29:24.253 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.0.0-2451.g7fad7ff2.el7 ceph 171 k 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-26T12:29:24.254 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-04-26T12:29:24.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:24.255 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 171 k 2024-04-26T12:29:24.255 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 494 k 2024-04-26T12:29:24.255 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-26T12:29:24.607 INFO:teuthology.orchestra.run.smithi132.stdout:rbd-nbd-19.0.0-2451.g7fad7ff2.el7.x86_64.rpm 487 kB/s | 171 kB 00:00 2024-04-26T12:29:24.607 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:29:24.608 INFO:teuthology.orchestra.run.smithi132.stdout:Total 485 kB/s | 171 kB 00:00 2024-04-26T12:29:24.608 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-26T12:29:24.616 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-26T12:29:24.616 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-26T12:29:24.682 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-26T12:29:24.682 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-26T12:29:24.841 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-26T12:29:24.962 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:25.416 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:25.670 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 1/1 2024-04-26T12:29:25.671 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-26T12:29:25.671 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.0.0-2451.g7fad7ff2.el7.x86_64 2024-04-26T12:29:25.671 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:25.671 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-26T12:29:25.949 DEBUG:teuthology.parallel:result is None 2024-04-26T12:29:25.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:29:26.197 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:29:26.217 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-2451.g7fad7ff2.el7 2024-04-26T12:29:26.218 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2451.g7fad7ff2.el7 2024-04-26T12:29:26.218 INFO:teuthology.task.install:The correct ceph version 19.0.0-2451.g7fad7ff2 is installed. 2024-04-26T12:29:26.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:29:26.358 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:29:26.383 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-2451.g7fad7ff2.el7 2024-04-26T12:29:26.383 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2451.g7fad7ff2.el7 2024-04-26T12:29:26.383 INFO:teuthology.task.install:The correct ceph version 19.0.0-2451.g7fad7ff2 is installed. 2024-04-26T12:29:26.385 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:29:26.385 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:26.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:29:26.409 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:26.409 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:29:26.450 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:29:26.451 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:26.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:29:26.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:29:26.537 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:26.537 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:29:26.563 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:29:26.629 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:29:26.629 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:26.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:29:26.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:29:26.737 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:26.737 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:29:26.763 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:29:26.827 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:29:26.827 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:26.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:29:26.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:29:26.912 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:26.912 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:29:26.935 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:29:26.999 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:29:27.082 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:29:27.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-04-26T12:29:27.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-04-26T12:29:27.108 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:29:27.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:29:27.149 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:29:27.172 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:29:27.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:29:27.212 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:29:27.246 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:29:27.246 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:29:27.246 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698', 'branch': 'wip-cbodley2-testing', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7674698', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cbodley2-testing'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley2-testing', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 8596, 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley2-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'targets': {'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBW3Y8Zhays6MfscIJlezRXcUSNAkuk+H2Z/tpsgg4/Fh5mZLmzfI43WbXMn5vLclpaK1IQQQJ9uDccG84bssYQ=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEVfi3vBeyxnL1p6I6CO/tJHhgNflaBSam5FkedU2pYf3Q1iTgv1cM4+V4WxYKXG3P69o8NpHxqKxf9D0Z20NAw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_12:10:35', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:29:27.247 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:29:27.276 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:29:27.294 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:29:27.331 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:29:27.357 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:27.357 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:29:27.407 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:29:27.407 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-04-26T12:29:27.461 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:29:27.461 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:27.461 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T12:29:27.461 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:27.461 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:27.461 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-26 12:29:22.554999146 +0000 2024-04-26T12:29:27.461 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-26 12:26:44.739241456 +0000 2024-04-26T12:29:27.462 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-26 12:26:44.739241456 +0000 2024-04-26T12:29:27.462 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-26 12:26:44.739241456 +0000 2024-04-26T12:29:27.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:29:27.522 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-26T12:29:27.522 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-26T12:29:27.522 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000243025 s, 2.1 MB/s 2024-04-26T12:29:27.524 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:29:27.579 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-04-26T12:29:27.633 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-26 12:29:22.554999146 +0000 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-26 12:26:45.063232889 +0000 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-26 12:26:45.063232889 +0000 2024-04-26T12:29:27.634 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-26 12:26:45.063232889 +0000 2024-04-26T12:29:27.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:29:27.696 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-26T12:29:27.696 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-26T12:29:27.696 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000192147 s, 2.7 MB/s 2024-04-26T12:29:27.697 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:29:27.752 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-04-26T12:29:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:29:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:27.807 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-26T12:29:27.808 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:27.808 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:27.808 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-26 12:29:22.555999121 +0000 2024-04-26T12:29:27.808 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-26 12:26:45.408223767 +0000 2024-04-26T12:29:27.808 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-26 12:26:45.408223767 +0000 2024-04-26T12:29:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-26 12:26:45.408223767 +0000 2024-04-26T12:29:27.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:29:27.869 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-26T12:29:27.870 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-26T12:29:27.870 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000211335 s, 2.4 MB/s 2024-04-26T12:29:27.871 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:29:27.926 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-26 12:29:22.555999121 +0000 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-26 12:26:45.743214909 +0000 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-26 12:26:45.743214909 +0000 2024-04-26T12:29:27.980 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-26 12:26:45.743214909 +0000 2024-04-26T12:29:27.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:29:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-26T12:29:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-26T12:29:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000201242 s, 2.5 MB/s 2024-04-26T12:29:28.043 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:29:28.099 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:29:28.099 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:28.099 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:29:28.117 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:29:28.117 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-04-26T12:29:28.171 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:29:28.171 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:28.172 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-26T12:29:28.172 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:28.172 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:28.172 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 12:29:09.184445551 +0000 2024-04-26T12:29:28.172 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 12:26:44.730521081 +0000 2024-04-26T12:29:28.172 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 12:26:44.730521081 +0000 2024-04-26T12:29:28.172 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 12:26:44.730521081 +0000 2024-04-26T12:29:28.172 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:29:28.234 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T12:29:28.234 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T12:29:28.234 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.7372e-05 s, 5.9 MB/s 2024-04-26T12:29:28.236 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:29:28.291 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-04-26T12:29:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:29:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:28.346 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-26T12:29:28.346 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:28.347 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:28.347 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 12:29:09.185445527 +0000 2024-04-26T12:29:28.347 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 12:26:45.065512989 +0000 2024-04-26T12:29:28.347 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 12:26:45.065512989 +0000 2024-04-26T12:29:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 12:26:45.065512989 +0000 2024-04-26T12:29:28.347 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:29:28.408 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T12:29:28.409 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T12:29:28.409 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.7129e-05 s, 5.9 MB/s 2024-04-26T12:29:28.410 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:29:28.466 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-04-26T12:29:28.521 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:29:28.521 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:28.521 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-26T12:29:28.521 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:28.521 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:28.521 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 12:29:09.185445527 +0000 2024-04-26T12:29:28.522 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 12:26:45.408504704 +0000 2024-04-26T12:29:28.522 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 12:26:45.408504704 +0000 2024-04-26T12:29:28.522 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 12:26:45.408504704 +0000 2024-04-26T12:29:28.523 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:29:28.582 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T12:29:28.582 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T12:29:28.582 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.5332e-05 s, 5.4 MB/s 2024-04-26T12:29:28.583 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:29:28.639 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 12:29:09.185445527 +0000 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 12:26:45.735496806 +0000 2024-04-26T12:29:28.693 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 12:26:45.735496806 +0000 2024-04-26T12:29:28.694 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 12:26:45.735496806 +0000 2024-04-26T12:29:28.694 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:29:28.756 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T12:29:28.756 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T12:29:28.756 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.525e-05 s, 6.0 MB/s 2024-04-26T12:29:28.757 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:29:28.813 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:29:28.813 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T12:29:28.813 INFO:tasks.ceph:Generating config... 2024-04-26T12:29:28.814 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T12:29:28.814 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-26T12:29:28.814 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-26T12:29:28.815 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-26T12:29:28.815 INFO:tasks.ceph:[client] setuser = ceph 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:29:28.815 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:29:28.816 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:29:28.816 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:28.816 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:29:28.816 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:29:28.816 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:29:28.816 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:29:28.816 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:29:28.816 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:29:28.816 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:29:28.816 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:29:28.816 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:29:28.817 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:29:28.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:29:28.867 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:29:28.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:29:28.912 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:28.975 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.132')] 2024-04-26T12:29:28.976 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.132'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-26T12:29:28.977 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:28.977 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:29:29.031 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.132 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:29.109 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:29:29.109 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:29:29.110 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: generated fsid 9f7de4b1-7365-4f06-b9fa-64d18aa7a81a 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:setting min_mon_release = quincy 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:epoch 0 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:fsid 9f7de4b1-7365-4f06-b9fa-64d18aa7a81a 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:last_changed 2024-04-26T12:29:29.109661+0000 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:created 2024-04-26T12:29:29.109661+0000 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:min_mon_release 17 (quincy) 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:election_strategy: 1 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2024-04-26T12:29:29.111 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-26T12:29:29.112 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:29:29.166 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9f7de4b1-7365-4f06-b9fa-64d18aa7a81a... 2024-04-26T12:29:29.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:29:29.208 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:29:29.245 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-04-26T12:29:29.246 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-04-26T12:29:29.247 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-04-26T12:29:29.248 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = 172.21.15.132 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 9f7de4b1-7365-4f06-b9fa-64d18aa7a81a 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-04-26T12:29:29.249 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: debug objclass = 20 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:29:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-04-26T12:29:29.252 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:29:29.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: rgw gc obj min wait = 15 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: debug rgw = 20 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: setgroup = ceph 2024-04-26T12:29:29.254 INFO:teuthology.orchestra.run.smithi132.stdout: setuser = ceph 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.255 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T12:29:29.256 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T12:29:29.257 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = 172.21.15.132 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 9f7de4b1-7365-4f06-b9fa-64d18aa7a81a 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T12:29:29.258 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T12:29:29.259 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: debug objclass = 20 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.260 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T12:29:29.261 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:29:29.262 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: rgw gc obj min wait = 15 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: debug rgw = 20 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: setgroup = ceph 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout: setuser = ceph 2024-04-26T12:29:29.263 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T12:29:29.265 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:29:29.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:29:29.358 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:29:29.358 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:29.358 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:29:29.373 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:29.373 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:29:29.428 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-04-26T12:29:29.428 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:29.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:29:29.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:29.500 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:29.500 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:29.554 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:29:29.555 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:29.555 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:29:29.555 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:29.588 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:29.588 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:29.643 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:29:29.643 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:29:29.643 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:29:29.743 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:29:29.745 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:29:29.745 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:29:29.745 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:29:29.785 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:29:29.797 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:29:29.797 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-26T12:29:29.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:29:29.823 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:29:29.823 INFO:tasks.ceph:role: osd.0 2024-04-26T12:29:29.823 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-26T12:29:29.823 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:29:29.893 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:29:29.893 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:29:29.893 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:29:29.894 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:29:29.894 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:29:29.894 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:29:29.894 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:29:29.894 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:29:29.894 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:29:29.894 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:29:30.403 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-26T12:29:30.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-26T12:29:30.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:29:30.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:29:30.539 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:30.634+0000 7febdc3da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:29:30.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:30.637+0000 7febdc3da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:29:30.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:30.637+0000 7febdc3da640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:29:30.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:30.637+0000 7febdc3da640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:29:30.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:30.637+0000 7febdc3da640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:29:30.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:30.644+0000 7febdc3da640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:29:33.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:29:33.525 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:29:33.553 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:29:33.553 INFO:tasks.ceph:role: osd.1 2024-04-26T12:29:33.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:29:33.553 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:29:33.620 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:29:33.653 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T12:29:33.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T12:29:33.655 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:29:33.727 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:29:33.797 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:29:33.860 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:29:33.861 INFO:tasks.ceph:role: osd.2 2024-04-26T12:29:33.861 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:29:33.861 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T12:29:33.924 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:29:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:29:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:29:33.957 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T12:29:33.959 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T12:29:33.959 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-26T12:29:34.032 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:29:34.099 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T12:29:34.162 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-26T12:29:34.162 INFO:tasks.ceph:role: osd.3 2024-04-26T12:29:34.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:29:34.162 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:29:34.225 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T12:29:34.226 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:29:34.226 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:29:34.256 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T12:29:34.258 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T12:29:34.258 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-26T12:29:34.331 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T12:29:34.398 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:34.497+0000 7f99af812640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:29:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:34.497+0000 7f99af812640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:29:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:34.497+0000 7f99af812640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:29:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:34.497+0000 7f99af812640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:29:34.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:34.497+0000 7f99af812640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:29:34.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:34.497+0000 7f99af812640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:29:37.349 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:29:37.377 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:37.466+0000 7fb1fd60d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:29:37.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:37.466+0000 7fb1fd60d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:29:37.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:37.466+0000 7fb1fd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:29:37.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:37.466+0000 7fb1fd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:29:37.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:37.466+0000 7fb1fd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:29:37.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:37.467+0000 7fb1fd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:29:40.321 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:29:40.348 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:40.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:40.436+0000 7fb9ee863640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T12:29:40.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:40.436+0000 7fb9ee863640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T12:29:40.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:40.436+0000 7fb9ee863640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:29:40.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:40.436+0000 7fb9ee863640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:29:40.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:40.436+0000 7fb9ee863640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:29:40.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:40.437+0000 7fb9ee863640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T12:29:43.295 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T12:29:43.323 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:29:43.323 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:43.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:29:43.351 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:43.352 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:29:43.389 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:43.389 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:29:43.454 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:43.454 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:29:43.520 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:43.520 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T12:29:43.584 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:43.584 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:29:43.639 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:29:43.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:29:43.665 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2024-04-26T12:29:43.665 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAqnitmZz7mJRAAb0/HM97wna4D2gZzBesXuw== 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQApnitmXdVGLBAA58A2aNaqfAcoTydhRcTuQg== 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAunitmAC+/HRAAVx31VHTmipQFCMdfzoba7w== 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAxnitmHLPcGxAAYapgpDqhdZECkJc3fXlNKg== 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQA0nitmmqETGhAAPIuZQF+NI/YUOe6YGQf0Iw== 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-04-26T12:29:43.666 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQApnitmyLDRLhAAa4HqC2fmiyBRFSwfUDMd8g== 2024-04-26T12:29:43.667 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:29:43.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:29:43.812 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:29:43.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:29:43.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:29:43.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:29:44.008 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:29:44.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:29:44.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:29:44.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:29:44.149 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:44.203 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:29:44.204 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:29:44.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:29:44.246 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:29:44.246 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:29:44.247 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:29:44.247 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:29:44.249 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:29:44.249 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:29:44.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:29:44.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.344+0000 7fbae532b640 1 Processor -- start 2024-04-26T12:29:44.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.344+0000 7fbae532b640 1 -- start start 2024-04-26T12:29:44.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.344+0000 7fbae532b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 0x7fbae01319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.344+0000 7fbae532b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae006fba0 con 0x7fbae0128d20 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.344+0000 7fbae532b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbae0129100 con 0x7fbae012f5f0 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.345+0000 7fbade7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 0x7fbae01319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.345+0000 7fbade7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 0x7fbae01319e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37000/0 (socket says 172.21.15.132:37000) 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.345+0000 7fbade7fc640 1 -- 172.21.15.132:0/1399595124 learned_addr learned my addr 172.21.15.132:0/1399595124 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.345+0000 7fbade7fc640 1 -- 172.21.15.132:0/1399595124 >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 msgr2=0x7fbae01319e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.345+0000 7fbade7fc640 1 -- 172.21.15.132:0/1399595124 >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 msgr2=0x7fbae01319e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.345+0000 7fbade7fc640 1 --2- 172.21.15.132:0/1399595124 >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 0x7fbae01319e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T12:29:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.345+0000 7fbade7fc640 1 --2- 172.21.15.132:0/1399595124 >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 0x7fbae01319e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T12:29:44.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.350+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279800620 0 0) 0x7fbae006fba0 con 0x7fbae0128d20 2024-04-26T12:29:44.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.350+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbac8003520 con 0x7fbae0128d20 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2361047236 0 0) 0x7fbac8003520 con 0x7fbae0128d20 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 msgr2=0x7fbae01319e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 --2- 172.21.15.132:0/1399595124 >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 0x7fbae01319e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae0070400 con 0x7fbae0128d20 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1243349309 0 0) 0x7fbad00015a0 con 0x7fbae0128d20 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 >> v1:172.21.15.132:6789/0 conn(0x7fbae0128d20 legacy=0x7fbae0129320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 --2- 172.21.15.132:0/1399595124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbac8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbae0129100 con 0x7fbac80039b0 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbadeffd640 1 --2- 172.21.15.132:0/1399595124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbac8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.351+0000 7fbadeffd640 1 -- 172.21.15.132:0/1399595124 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac8003520 con 0x7fbac80039b0 2024-04-26T12:29:44.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.353+0000 7fbadeffd640 1 --2- 172.21.15.132:0/1399595124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbac8003db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007f10 tx=0x7fbac8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1204bb3fa3cdc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:44.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.353+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad0039070 con 0x7fbac80039b0 2024-04-26T12:29:44.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.353+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad002ca60 con 0x7fbac80039b0 2024-04-26T12:29:44.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.353+0000 7fbaddffb640 1 -- 172.21.15.132:0/1399595124 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad0007be0 con 0x7fbac80039b0 2024-04-26T12:29:44.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 -- 172.21.15.132:0/1399595124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 msgr2=0x7fbac8003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 --2- 172.21.15.132:0/1399595124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbac8003db0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbad0007f10 tx=0x7fbac8005830 comp rx=0 tx=0).stop 2024-04-26T12:29:44.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 -- 172.21.15.132:0/1399595124 shutdown_connections 2024-04-26T12:29:44.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 --2- 172.21.15.132:0/1399595124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbac8003db0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 --2- 172.21.15.132:0/1399595124 >> v2:172.21.15.132:3300/0 conn(0x7fbae012f5f0 0x7fbae01319e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 -- 172.21.15.132:0/1399595124 >> 172.21.15.132:0/1399595124 conn(0x7fbae009b5e0 msgr2=0x7fbae009b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:44.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 -- 172.21.15.132:0/1399595124 shutdown_connections 2024-04-26T12:29:44.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.354+0000 7fbae532b640 1 -- 172.21.15.132:0/1399595124 wait complete. 2024-04-26T12:29:44.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.355+0000 7fbae532b640 1 Processor -- start 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.355+0000 7fbae532b640 1 -- start start 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.355+0000 7fbae532b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbae01c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.355+0000 7fbae532b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbae00738d0 con 0x7fbac80039b0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.355+0000 7fbadeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbae01c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.355+0000 7fbadeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbae01c0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37026/0 (socket says 172.21.15.132:37026) 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.355+0000 7fbadeffd640 1 -- 172.21.15.132:0/742603106 learned_addr learned my addr 172.21.15.132:0/742603106 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbadeffd640 1 -- 172.21.15.132:0/742603106 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae0072b00 con 0x7fbac80039b0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbadeffd640 1 --2- 172.21.15.132:0/742603106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbae01c0b20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbad0037040 tx=0x7fbad0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbac77fe640 1 -- 172.21.15.132:0/742603106 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad0039040 con 0x7fbac80039b0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbac77fe640 1 -- 172.21.15.132:0/742603106 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad0043070 con 0x7fbac80039b0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbac77fe640 1 -- 172.21.15.132:0/742603106 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad0001430 con 0x7fbac80039b0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae0126e90 con 0x7fbac80039b0 2024-04-26T12:29:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae008c2c0 con 0x7fbac80039b0 2024-04-26T12:29:44.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbac77fe640 1 -- 172.21.15.132:0/742603106 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbad003c070 con 0x7fbac80039b0 2024-04-26T12:29:44.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.356+0000 7fbac77fe640 1 -- 172.21.15.132:0/742603106 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbad0003b10 con 0x7fbac80039b0 2024-04-26T12:29:44.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.357+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae008ba30 con 0x7fbac80039b0 2024-04-26T12:29:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.359+0000 7fbac77fe640 1 -- 172.21.15.132:0/742603106 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbad00035f0 con 0x7fbac80039b0 2024-04-26T12:29:44.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.423+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbae0062ed0 con 0x7fbac80039b0 2024-04-26T12:29:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.424+0000 7fbac77fe640 1 -- 172.21.15.132:0/742603106 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbad0003db0 con 0x7fbac80039b0 2024-04-26T12:29:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2024-04-26T12:29:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.425+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 msgr2=0x7fbae01c0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.425+0000 7fbae532b640 1 --2- 172.21.15.132:0/742603106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbae01c0b20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbad0037040 tx=0x7fbad0001970 comp rx=0 tx=0).stop 2024-04-26T12:29:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.425+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 shutdown_connections 2024-04-26T12:29:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.425+0000 7fbae532b640 1 --2- 172.21.15.132:0/742603106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbac80039b0 0x7fbae01c0b20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.425+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 >> 172.21.15.132:0/742603106 conn(0x7fbae009b5e0 msgr2=0x7fbae012d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.425+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 shutdown_connections 2024-04-26T12:29:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:44.425+0000 7fbae532b640 1 -- 172.21.15.132:0/742603106 wait complete. 2024-04-26T12:29:44.438 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:29:44.438 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:29:44.438 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-26T12:29:44.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:29:44.462 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:44.462 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:29:44.472 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:44.472+0000 7f2f325f1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:29:44.486 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:44.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:29:44.550 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T12:29:44.550 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T12:29:44.614 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new d8400be6-015a-46df-8e1a-eda2d0564826 0 2024-04-26T12:29:44.627 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:44.626+0000 7f2f325f1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:29:44.683 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:44.682+0000 7f2f325f1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:29:44.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.722+0000 7fbea5b1e640 1 Processor -- start 2024-04-26T12:29:44.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.722+0000 7fbea5b1e640 1 -- start start 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbea5b1e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbea0111de0 0x7fbea01121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbea5b1e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea01127f0 con 0x7fbea0116790 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbea5b1e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbea0117350 con 0x7fbea0111de0 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbe9f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbea0111de0 0x7fbea01121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbe9effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbea0116790 0x7fbea0116c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:34132/0 (socket says 172.21.15.170:34132) 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbe9effd640 1 -- 172.21.15.170:0/2601822699 learned_addr learned my addr 172.21.15.170:0/2601822699 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbe9e7fc640 1 -- 172.21.15.170:0/2601822699 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913743805 0 0) 0x7fbea01127f0 con 0x7fbea0116790 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbe9e7fc640 1 -- 172.21.15.170:0/2601822699 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe88003520 con 0x7fbea0116790 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbe9f7fe640 1 -- 172.21.15.170:0/2601822699 >> v1:172.21.15.132:6789/0 conn(0x7fbea0116790 legacy=0x7fbea0116c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.723+0000 7fbe9f7fe640 1 -- 172.21.15.170:0/2601822699 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea0117500 con 0x7fbea0111de0 2024-04-26T12:29:44.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.724+0000 7fbe9f7fe640 1 --2- 172.21.15.170:0/2601822699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01121c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3e1e0dbd5639b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:44.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.724+0000 7fbe9e7fc640 1 -- 172.21.15.170:0/2601822699 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90039070 con 0x7fbea0111de0 2024-04-26T12:29:44.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.724+0000 7fbe9e7fc640 1 -- 172.21.15.170:0/2601822699 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9002cb10 con 0x7fbea0111de0 2024-04-26T12:29:44.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.724+0000 7fbe9e7fc640 1 -- 172.21.15.170:0/2601822699 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe9002ce10 con 0x7fbea0111de0 2024-04-26T12:29:44.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 -- 172.21.15.170:0/2601822699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 msgr2=0x7fbea01121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 --2- 172.21.15.170:0/2601822699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01121c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9002beb0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 -- 172.21.15.170:0/2601822699 shutdown_connections 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 --2- 172.21.15.170:0/2601822699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01121c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 -- 172.21.15.170:0/2601822699 >> 172.21.15.170:0/2601822699 conn(0x7fbea006e960 msgr2=0x7fbea010fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 -- 172.21.15.170:0/2601822699 shutdown_connections 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 -- 172.21.15.170:0/2601822699 wait complete. 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.725+0000 7fbea5b1e640 1 Processor -- start 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.726+0000 7fbea5b1e640 1 -- start start 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.726+0000 7fbea5b1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.726+0000 7fbea5b1e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbea011dea0 con 0x7fbea0111de0 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.726+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.726+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41872/0 (socket says 172.21.15.170:41872) 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.726+0000 7fbe9f7fe640 1 -- 172.21.15.170:0/1085402641 learned_addr learned my addr 172.21.15.170:0/1085402641 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbe9f7fe640 1 -- 172.21.15.170:0/1085402641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea01ac8e0 con 0x7fbea0111de0 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbe9f7fe640 1 --2- 172.21.15.170:0/1085402641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01ac310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe90037040 tx=0x7fbe90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:44.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbe87fff640 1 -- 172.21.15.170:0/1085402641 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90044020 con 0x7fbea0111de0 2024-04-26T12:29:44.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbe87fff640 1 -- 172.21.15.170:0/1085402641 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9003f470 con 0x7fbea0111de0 2024-04-26T12:29:44.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea01acb70 con 0x7fbea0111de0 2024-04-26T12:29:44.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbe87fff640 1 -- 172.21.15.170:0/1085402641 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe90039040 con 0x7fbea0111de0 2024-04-26T12:29:44.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea01a6580 con 0x7fbea0111de0 2024-04-26T12:29:44.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbe87fff640 1 -- 172.21.15.170:0/1085402641 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe90047020 con 0x7fbea0111de0 2024-04-26T12:29:44.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.727+0000 7fbe87fff640 1 -- 172.21.15.170:0/1085402641 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fbe90040a90 con 0x7fbea0111de0 2024-04-26T12:29:44.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.728+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea004fe80 con 0x7fbea0111de0 2024-04-26T12:29:44.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.730+0000 7fbe87fff640 1 -- 172.21.15.170:0/1085402641 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbe9004e030 con 0x7fbea0111de0 2024-04-26T12:29:44.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.802+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8400be6-015a-46df-8e1a-eda2d0564826", "id": 0} v 0) -- 0x7fbea01acd40 con 0x7fbea0111de0 2024-04-26T12:29:44.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.803+0000 7fbe87fff640 1 -- 172.21.15.170:0/1085402641 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8400be6-015a-46df-8e1a-eda2d0564826", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fbe90040d30 con 0x7fbea0111de0 2024-04-26T12:29:44.804 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-04-26T12:29:44.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.804+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 msgr2=0x7fbea01ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.804+0000 7fbea5b1e640 1 --2- 172.21.15.170:0/1085402641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01ac310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe90037040 tx=0x7fbe90004a40 comp rx=0 tx=0).stop 2024-04-26T12:29:44.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.804+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 shutdown_connections 2024-04-26T12:29:44.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.804+0000 7fbea5b1e640 1 --2- 172.21.15.170:0/1085402641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea0111de0 0x7fbea01ac310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.804+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 >> 172.21.15.170:0/1085402641 conn(0x7fbea006e960 msgr2=0x7fbea0110040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:44.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.804+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 shutdown_connections 2024-04-26T12:29:44.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.804+0000 7fbea5b1e640 1 -- 172.21.15.170:0/1085402641 wait complete. 2024-04-26T12:29:44.815 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 09f70d93-7270-42cb-8c52-5450d8b43f08 1 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f293662e640 1 Processor -- start 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f293662e640 1 -- start start 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f293662e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2930111de0 0x7f29301121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f293662e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29301127f0 con 0x7f2930116790 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f293662e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2930117350 con 0x7f2930111de0 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f292ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2930111de0 0x7f29301121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f292f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2930116790 0x7f2930116c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:34142/0 (socket says 172.21.15.170:34142) 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.911+0000 7f292f7fe640 1 -- 172.21.15.170:0/1745263706 learned_addr learned my addr 172.21.15.170:0/1745263706 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.912+0000 7f292ffff640 1 -- 172.21.15.170:0/1745263706 >> v1:172.21.15.132:6789/0 conn(0x7f2930116790 legacy=0x7f2930116c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.912+0000 7f292ffff640 1 -- 172.21.15.170:0/1745263706 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2930117500 con 0x7f2930111de0 2024-04-26T12:29:44.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.912+0000 7f292effd640 1 -- 172.21.15.170:0/1745263706 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456665364 0 0) 0x7f29301127f0 con 0x7f2930116790 2024-04-26T12:29:44.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.912+0000 7f292ffff640 1 --2- 172.21.15.170:0/1745263706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301121c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2920009720 tx=0x7f292002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68eee9b496e086f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:44.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.912+0000 7f292effd640 1 -- 172.21.15.170:0/1745263706 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29200316d0 con 0x7f2930111de0 2024-04-26T12:29:44.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f292effd640 1 -- 172.21.15.170:0/1745263706 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2920037070 con 0x7f2930111de0 2024-04-26T12:29:44.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f292effd640 1 -- 172.21.15.170:0/1745263706 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29200319c0 con 0x7f2930111de0 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f293662e640 1 -- 172.21.15.170:0/1745263706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 msgr2=0x7f29301121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f293662e640 1 --2- 172.21.15.170:0/1745263706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301121c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2920009720 tx=0x7f292002b840 comp rx=0 tx=0).stop 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f293662e640 1 -- 172.21.15.170:0/1745263706 shutdown_connections 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f293662e640 1 --2- 172.21.15.170:0/1745263706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301121c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f293662e640 1 -- 172.21.15.170:0/1745263706 >> 172.21.15.170:0/1745263706 conn(0x7f293006e960 msgr2=0x7f293010fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f293662e640 1 -- 172.21.15.170:0/1745263706 shutdown_connections 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.913+0000 7f293662e640 1 -- 172.21.15.170:0/1745263706 wait complete. 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.914+0000 7f293662e640 1 Processor -- start 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.914+0000 7f293662e640 1 -- start start 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.914+0000 7f293662e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.914+0000 7f293662e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f293011dea0 con 0x7f2930111de0 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.914+0000 7f292ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.914+0000 7f292ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41888/0 (socket says 172.21.15.170:41888) 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.914+0000 7f292ffff640 1 -- 172.21.15.170:0/759770725 learned_addr learned my addr 172.21.15.170:0/759770725 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f292ffff640 1 -- 172.21.15.170:0/759770725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29301ac810 con 0x7f2930111de0 2024-04-26T12:29:44.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f292ffff640 1 --2- 172.21.15.170:0/759770725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301ac240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2920009720 tx=0x7f29200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f292cff9640 1 -- 172.21.15.170:0/759770725 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2920032770 con 0x7f2930111de0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f292cff9640 1 -- 172.21.15.170:0/759770725 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2920032910 con 0x7f2930111de0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29301aca40 con 0x7f2930111de0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f292cff9640 1 -- 172.21.15.170:0/759770725 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2920032bf0 con 0x7f2930111de0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29301a6350 con 0x7f2930111de0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f292cff9640 1 -- 172.21.15.170:0/759770725 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f292004c060 con 0x7f2930111de0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.915+0000 7f292cff9640 1 -- 172.21.15.170:0/759770725 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f292002f050 con 0x7f2930111de0 2024-04-26T12:29:44.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.916+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293004fe80 con 0x7f2930111de0 2024-04-26T12:29:44.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.918+0000 7f292cff9640 1 -- 172.21.15.170:0/759770725 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2920064dd0 con 0x7f2930111de0 2024-04-26T12:29:44.946 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:44.945+0000 7f2f325f1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:29:44.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.991+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "09f70d93-7270-42cb-8c52-5450d8b43f08", "id": 1} v 0) -- 0x7f2930116790 con 0x7f2930111de0 2024-04-26T12:29:44.993 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:44.992+0000 7f2f325f1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:29:44.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.992+0000 7f292cff9640 1 -- 172.21.15.170:0/759770725 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09f70d93-7270-42cb-8c52-5450d8b43f08", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2920053020 con 0x7f2930111de0 2024-04-26T12:29:44.993 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T12:29:44.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.993+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 msgr2=0x7f29301ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:44.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.993+0000 7f293662e640 1 --2- 172.21.15.170:0/759770725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301ac240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2920009720 tx=0x7f29200046c0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.993+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 shutdown_connections 2024-04-26T12:29:44.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.993+0000 7f293662e640 1 --2- 172.21.15.170:0/759770725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2930111de0 0x7f29301ac240 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:44.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.993+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 >> 172.21.15.170:0/759770725 conn(0x7f293006e960 msgr2=0x7f293010ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:44.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.993+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 shutdown_connections 2024-04-26T12:29:44.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:44.993+0000 7f293662e640 1 -- 172.21.15.170:0/759770725 wait complete. 2024-04-26T12:29:45.004 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 87ce142d-2672-47e3-a4fc-29bd7e850b2f 2 2024-04-26T12:29:45.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.099+0000 7f3f4cdd4640 1 Processor -- start 2024-04-26T12:29:45.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.099+0000 7f3f4cdd4640 1 -- start start 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.100+0000 7f3f4cdd4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f4811aa60 0x7f3f4811ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.100+0000 7f3f4cdd4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4811d390 con 0x7f3f48111de0 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.100+0000 7f3f4cdd4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4811e590 con 0x7f3f4811aa60 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.100+0000 7f3f45d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f4811aa60 0x7f3f4811ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.100+0000 7f3f4659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3f48111de0 0x7f3f481121c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:34152/0 (socket says 172.21.15.170:34152) 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.100+0000 7f3f4659c640 1 -- 172.21.15.170:0/147243263 learned_addr learned my addr 172.21.15.170:0/147243263 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.101+0000 7f3f45d9b640 1 -- 172.21.15.170:0/147243263 >> v1:172.21.15.132:6789/0 conn(0x7f3f48111de0 legacy=0x7f3f481121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.101+0000 7f3f4559a640 1 -- 172.21.15.170:0/147243263 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034663232 0 0) 0x7f3f4811d390 con 0x7f3f48111de0 2024-04-26T12:29:45.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.101+0000 7f3f45d9b640 1 -- 172.21.15.170:0/147243263 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4811e740 con 0x7f3f4811aa60 2024-04-26T12:29:45.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.101+0000 7f3f45d9b640 1 --2- 172.21.15.170:0/147243263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4811aa60 0x7f3f4811ce50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009720 tx=0x7f3f3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177368a555e94a0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:45.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.101+0000 7f3f4559a640 1 -- 172.21.15.170:0/147243263 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0316d0 con 0x7f3f4811aa60 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4559a640 1 -- 172.21.15.170:0/147243263 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3c037070 con 0x7f3f4811aa60 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4559a640 1 -- 172.21.15.170:0/147243263 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f3c0319c0 con 0x7f3f4811aa60 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/147243263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4811aa60 msgr2=0x7f3f4811ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4cdd4640 1 --2- 172.21.15.170:0/147243263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4811aa60 0x7f3f4811ce50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009720 tx=0x7f3f3c02b840 comp rx=0 tx=0).stop 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/147243263 shutdown_connections 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4cdd4640 1 --2- 172.21.15.170:0/147243263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f4811aa60 0x7f3f4811ce50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/147243263 >> 172.21.15.170:0/147243263 conn(0x7f3f4806e960 msgr2=0x7f3f4810fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/147243263 shutdown_connections 2024-04-26T12:29:45.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.102+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/147243263 wait complete. 2024-04-26T12:29:45.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.103+0000 7f3f4cdd4640 1 Processor -- start 2024-04-26T12:29:45.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.103+0000 7f3f4cdd4640 1 -- start start 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.103+0000 7f3f4cdd4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48111de0 0x7f3f481ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.103+0000 7f3f4cdd4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4811da40 con 0x7f3f48111de0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f4659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48111de0 0x7f3f481ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f4659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48111de0 0x7f3f481ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41894/0 (socket says 172.21.15.170:41894) 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f4659c640 1 -- 172.21.15.170:0/3584047935 learned_addr learned my addr 172.21.15.170:0/3584047935 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f4659c640 1 -- 172.21.15.170:0/3584047935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f481ac8b0 con 0x7f3f48111de0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f4659c640 1 --2- 172.21.15.170:0/3584047935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48111de0 0x7f3f481ac2e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c420 tx=0x7f3f3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f36ffd640 1 -- 172.21.15.170:0/3584047935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38018070 con 0x7f3f48111de0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f36ffd640 1 -- 172.21.15.170:0/3584047935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f380074d0 con 0x7f3f48111de0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f481acb40 con 0x7f3f48111de0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f36ffd640 1 -- 172.21.15.170:0/3584047935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38004950 con 0x7f3f48111de0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f481a65d0 con 0x7f3f48111de0 2024-04-26T12:29:45.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f36ffd640 1 -- 172.21.15.170:0/3584047935 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f3801b070 con 0x7f3f48111de0 2024-04-26T12:29:45.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.104+0000 7f3f36ffd640 1 -- 172.21.15.170:0/3584047935 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3f3801d440 con 0x7f3f48111de0 2024-04-26T12:29:45.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.105+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4804fe80 con 0x7f3f48111de0 2024-04-26T12:29:45.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.107+0000 7f3f36ffd640 1 -- 172.21.15.170:0/3584047935 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3f38022070 con 0x7f3f48111de0 2024-04-26T12:29:45.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.179+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "87ce142d-2672-47e3-a4fc-29bd7e850b2f", "id": 2} v 0) -- 0x7f3f481acd70 con 0x7f3f48111de0 2024-04-26T12:29:45.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.180+0000 7f3f36ffd640 1 -- 172.21.15.170:0/3584047935 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87ce142d-2672-47e3-a4fc-29bd7e850b2f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f3f3801d710 con 0x7f3f48111de0 2024-04-26T12:29:45.181 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-04-26T12:29:45.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.181+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48111de0 msgr2=0x7f3f481ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.181+0000 7f3f4cdd4640 1 --2- 172.21.15.170:0/3584047935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48111de0 0x7f3f481ac2e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800c420 tx=0x7f3f3800c8e0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.181+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 shutdown_connections 2024-04-26T12:29:45.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.181+0000 7f3f4cdd4640 1 --2- 172.21.15.170:0/3584047935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f48111de0 0x7f3f481ac2e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.181+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 >> 172.21.15.170:0/3584047935 conn(0x7f3f4806e960 msgr2=0x7f3f48115680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:45.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.181+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 shutdown_connections 2024-04-26T12:29:45.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.181+0000 7f3f4cdd4640 1 -- 172.21.15.170:0/3584047935 wait complete. 2024-04-26T12:29:45.192 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 10a2c4a7-0c41-40a3-a637-9ded1c128461 3 2024-04-26T12:29:45.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd233ce6640 1 Processor -- start 2024-04-26T12:29:45.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd233ce6640 1 -- start start 2024-04-26T12:29:45.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd233ce6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd22c11aa60 0x7fd22c11ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:45.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd233ce6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd22c11d390 con 0x7fd22c111de0 2024-04-26T12:29:45.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd233ce6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd22c11e590 con 0x7fd22c11aa60 2024-04-26T12:29:45.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd231281640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd22c11aa60 0x7fd22c11ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:45.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd231281640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd22c11aa60 0x7fd22c11ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41900/0 (socket says 172.21.15.170:41900) 2024-04-26T12:29:45.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.286+0000 7fd231281640 1 -- 172.21.15.170:0/2356423004 learned_addr learned my addr 172.21.15.170:0/2356423004 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:29:45.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.287+0000 7fd231281640 1 -- 172.21.15.170:0/2356423004 >> v1:172.21.15.132:6789/0 conn(0x7fd22c111de0 legacy=0x7fd22c1121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.287+0000 7fd231281640 1 -- 172.21.15.170:0/2356423004 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22c11e740 con 0x7fd22c11aa60 2024-04-26T12:29:45.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.287+0000 7fd230a80640 1 -- 172.21.15.170:0/2356423004 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424226985 0 0) 0x7fd22c11d390 con 0x7fd22c111de0 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.287+0000 7fd231281640 1 --2- 172.21.15.170:0/2356423004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c11aa60 0x7fd22c11ce50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0097f0 tx=0x7fd21c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217c3d66c155d8c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.287+0000 7fd230a80640 1 -- 172.21.15.170:0/2356423004 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21c035020 con 0x7fd22c11aa60 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.287+0000 7fd230a80640 1 -- 172.21.15.170:0/2356423004 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21c0317a0 con 0x7fd22c11aa60 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd230a80640 1 -- 172.21.15.170:0/2356423004 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd21c031aa0 con 0x7fd22c11aa60 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd233ce6640 1 -- 172.21.15.170:0/2356423004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c11aa60 msgr2=0x7fd22c11ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd233ce6640 1 --2- 172.21.15.170:0/2356423004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c11aa60 0x7fd22c11ce50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0097f0 tx=0x7fd21c02b910 comp rx=0 tx=0).stop 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd233ce6640 1 -- 172.21.15.170:0/2356423004 shutdown_connections 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd233ce6640 1 --2- 172.21.15.170:0/2356423004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c11aa60 0x7fd22c11ce50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd233ce6640 1 -- 172.21.15.170:0/2356423004 >> 172.21.15.170:0/2356423004 conn(0x7fd22c06e960 msgr2=0x7fd22c10fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:45.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd233ce6640 1 -- 172.21.15.170:0/2356423004 shutdown_connections 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.288+0000 7fd233ce6640 1 -- 172.21.15.170:0/2356423004 wait complete. 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.289+0000 7fd233ce6640 1 Processor -- start 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.289+0000 7fd233ce6640 1 -- start start 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.289+0000 7fd233ce6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c111de0 0x7fd22c1ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.289+0000 7fd233ce6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c11da40 con 0x7fd22c111de0 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.289+0000 7fd231a82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c111de0 0x7fd22c1ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.289+0000 7fd231a82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c111de0 0x7fd22c1ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41916/0 (socket says 172.21.15.170:41916) 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.289+0000 7fd231a82640 1 -- 172.21.15.170:0/1929282364 learned_addr learned my addr 172.21.15.170:0/1929282364 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd231a82640 1 -- 172.21.15.170:0/1929282364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22c1ac8b0 con 0x7fd22c111de0 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd231a82640 1 --2- 172.21.15.170:0/1929282364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c111de0 0x7fd22c1ac2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c3e0 tx=0x7fd22800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd2227fc640 1 -- 172.21.15.170:0/1929282364 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd228017070 con 0x7fd22c111de0 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd2227fc640 1 -- 172.21.15.170:0/1929282364 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228005430 con 0x7fd22c111de0 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22c1acb40 con 0x7fd22c111de0 2024-04-26T12:29:45.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd2227fc640 1 -- 172.21.15.170:0/1929282364 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd228003760 con 0x7fd22c111de0 2024-04-26T12:29:45.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22c1a65d0 con 0x7fd22c111de0 2024-04-26T12:29:45.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd2227fc640 1 -- 172.21.15.170:0/1929282364 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd22801a070 con 0x7fd22c111de0 2024-04-26T12:29:45.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.290+0000 7fd2227fc640 1 -- 172.21.15.170:0/1929282364 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fd228003900 con 0x7fd22c111de0 2024-04-26T12:29:45.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.291+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd22c04fe80 con 0x7fd22c111de0 2024-04-26T12:29:45.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.293+0000 7fd2227fc640 1 -- 172.21.15.170:0/1929282364 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd228021070 con 0x7fd22c111de0 2024-04-26T12:29:45.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.364+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10a2c4a7-0c41-40a3-a637-9ded1c128461", "id": 3} v 0) -- 0x7fd22c1acd70 con 0x7fd22c111de0 2024-04-26T12:29:45.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.367+0000 7fd2227fc640 1 -- 172.21.15.170:0/1929282364 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10a2c4a7-0c41-40a3-a637-9ded1c128461", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fd228003c80 con 0x7fd22c111de0 2024-04-26T12:29:45.369 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-04-26T12:29:45.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.368+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c111de0 msgr2=0x7fd22c1ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.368+0000 7fd233ce6640 1 --2- 172.21.15.170:0/1929282364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c111de0 0x7fd22c1ac2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c3e0 tx=0x7fd22800c8a0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.368+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 shutdown_connections 2024-04-26T12:29:45.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.368+0000 7fd233ce6640 1 --2- 172.21.15.170:0/1929282364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd22c111de0 0x7fd22c1ac2e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.368+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 >> 172.21.15.170:0/1929282364 conn(0x7fd22c06e960 msgr2=0x7fd22c115680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:45.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.369+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 shutdown_connections 2024-04-26T12:29:45.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:29:45.369+0000 7fd233ce6640 1 -- 172.21.15.170:0/1929282364 wait complete. 2024-04-26T12:29:45.380 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:29:45.380 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:29:45.383 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:29:45.383 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:29:45.383 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:29:45.385 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:29:45.386 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:29:45.386 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:29:45.388 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:29:45.388 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T12:29:45.388 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T12:29:45.390 INFO:tasks.ceph.osd.3:Started 2024-04-26T12:29:45.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:29:45.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.495+0000 7fcad9515640 1 Processor -- start 2024-04-26T12:29:45.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.495+0000 7fcad9515640 1 -- start start 2024-04-26T12:29:45.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.495+0000 7fcad9515640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcad408d810 0x7fcad408dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:45.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.495+0000 7fcad9515640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad406d7a0 con 0x7fcad408e130 2024-04-26T12:29:45.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.495+0000 7fcad9515640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fcad40730d0 con 0x7fcad408d810 2024-04-26T12:29:45.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.496+0000 7fcad2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcad408d810 0x7fcad408dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:45.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.496+0000 7fcad2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcad408d810 0x7fcad408dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42244/0 (socket says 172.21.15.132:42244) 2024-04-26T12:29:45.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.496+0000 7fcad27fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcad408e130 0x7fcad412a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50636/0 (socket says 172.21.15.132:50636) 2024-04-26T12:29:45.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.496+0000 7fcad2ffd640 1 -- 172.21.15.132:0/1761336534 learned_addr learned my addr 172.21.15.132:0/1761336534 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:45.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.496+0000 7fcad2ffd640 1 -- 172.21.15.132:0/1761336534 >> v1:172.21.15.132:6789/0 conn(0x7fcad408e130 legacy=0x7fcad412a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.496+0000 7fcad2ffd640 1 -- 172.21.15.132:0/1761336534 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad406e620 con 0x7fcad408d810 2024-04-26T12:29:45.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad2ffd640 1 --2- 172.21.15.132:0/1761336534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad408dbf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcac400ba90 tx=0x7fcac402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e106d0e508e14a27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:45.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad1ffb640 1 -- 172.21.15.132:0/1761336534 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcac403b070 con 0x7fcad408d810 2024-04-26T12:29:45.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad1ffb640 1 -- 172.21.15.132:0/1761336534 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac402edc0 con 0x7fcad408d810 2024-04-26T12:29:45.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad1ffb640 1 -- 172.21.15.132:0/1761336534 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcac4036590 con 0x7fcad408d810 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad9515640 1 -- 172.21.15.132:0/1761336534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 msgr2=0x7fcad408dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad9515640 1 --2- 172.21.15.132:0/1761336534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad408dbf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcac400ba90 tx=0x7fcac402e0e0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad9515640 1 -- 172.21.15.132:0/1761336534 shutdown_connections 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad9515640 1 --2- 172.21.15.132:0/1761336534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad408dbf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad9515640 1 -- 172.21.15.132:0/1761336534 >> 172.21.15.132:0/1761336534 conn(0x7fcad409b7b0 msgr2=0x7fcad409bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad9515640 1 -- 172.21.15.132:0/1761336534 shutdown_connections 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.497+0000 7fcad9515640 1 -- 172.21.15.132:0/1761336534 wait complete. 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.498+0000 7fcad9515640 1 Processor -- start 2024-04-26T12:29:45.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.498+0000 7fcad9515640 1 -- start start 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad9515640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad41bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad9515640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcad408cf80 con 0x7fcad408d810 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad41bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad41bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42246/0 (socket says 172.21.15.132:42246) 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad2ffd640 1 -- 172.21.15.132:0/1622944567 learned_addr learned my addr 172.21.15.132:0/1622944567 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad2ffd640 1 -- 172.21.15.132:0/1622944567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad4098e50 con 0x7fcad408d810 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad2ffd640 1 --2- 172.21.15.132:0/1622944567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad41bf0a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcac400ba90 tx=0x7fcac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcabb7fe640 1 -- 172.21.15.132:0/1622944567 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcac4045070 con 0x7fcad408d810 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcabb7fe640 1 -- 172.21.15.132:0/1622944567 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac4040590 con 0x7fcad408d810 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad41a6e60 con 0x7fcad408d810 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcabb7fe640 1 -- 172.21.15.132:0/1622944567 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcac403b040 con 0x7fcad408d810 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.499+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad41bf5e0 con 0x7fcad408d810 2024-04-26T12:29:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.500+0000 7fcabb7fe640 1 -- 172.21.15.132:0/1622944567 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcac4048070 con 0x7fcad408d810 2024-04-26T12:29:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.500+0000 7fcabb7fe640 1 -- 172.21.15.132:0/1622944567 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcac404acd0 con 0x7fcad408d810 2024-04-26T12:29:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.500+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad4062ed0 con 0x7fcad408d810 2024-04-26T12:29:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.502+0000 7fcabb7fe640 1 -- 172.21.15.132:0/1622944567 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcac402ed70 con 0x7fcad408d810 2024-04-26T12:29:45.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.561+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcad4072570 con 0x7fcad408d810 2024-04-26T12:29:45.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.562+0000 7fcabb7fe640 1 -- 172.21.15.132:0/1622944567 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fcac404a7c0 con 0x7fcad408d810 2024-04-26T12:29:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:29:45.563 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"fsid":"9f7de4b1-7365-4f06-b9fa-64d18aa7a81a","created":"2024-04-26T12:29:44.344147+0000","modified":"2024-04-26T12:29:45.365550+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:29:45.365550+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8400be6-015a-46df-8e1a-eda2d0564826","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09f70d93-7270-42cb-8c52-5450d8b43f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87ce142d-2672-47e3-a4fc-29bd7e850b2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10a2c4a7-0c41-40a3-a637-9ded1c128461","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:29:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.562+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 msgr2=0x7fcad41bf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.562+0000 7fcad9515640 1 --2- 172.21.15.132:0/1622944567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad41bf0a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcac400ba90 tx=0x7fcac40046c0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.562+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 shutdown_connections 2024-04-26T12:29:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.562+0000 7fcad9515640 1 --2- 172.21.15.132:0/1622944567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcad408d810 0x7fcad41bf0a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.562+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 >> 172.21.15.132:0/1622944567 conn(0x7fcad409b7b0 msgr2=0x7fcad408ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.562+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 shutdown_connections 2024-04-26T12:29:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:45.563+0000 7fcad9515640 1 -- 172.21.15.132:0/1622944567 wait complete. 2024-04-26T12:29:45.575 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:29:45.575 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:29:45.735 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:45.734+0000 7f2f325f1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:29:45.821 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:45.820+0000 7f2f325f1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:29:45.862 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:45.861+0000 7f2f325f1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:29:45.974 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-04-26T12:29:45.973+0000 7f6fc1bb4640 -1 Falling back to public interface 2024-04-26T12:29:45.976 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-26T12:29:45.975+0000 7fac67eb1640 -1 Falling back to public interface 2024-04-26T12:29:45.978 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:29:45.978 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-04-26T12:29:45.977+0000 7f5099419640 -1 Falling back to public interface 2024-04-26T12:29:45.990 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-04-26T12:29:45.989+0000 7fa7a7d85640 -1 Falling back to public interface 2024-04-26T12:29:46.034 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:46.033+0000 7f2f325f1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:29:46.073 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.071+0000 7fa15f1f7640 1 Processor -- start 2024-04-26T12:29:46.073 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.071+0000 7fa15f1f7640 1 -- start start 2024-04-26T12:29:46.073 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa15f1f7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa158131700 0x7fa158133af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:46.073 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa15f1f7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa158092df0 con 0x7fa158091bd0 2024-04-26T12:29:46.074 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa15f1f7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa158092a10 con 0x7fa158131700 2024-04-26T12:29:46.074 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa15cf93640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa158091bd0 0x7fa158091fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50646/0 (socket says 172.21.15.132:50646) 2024-04-26T12:29:46.074 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa15cf93640 1 -- 172.21.15.132:0/1908889497 learned_addr learned my addr 172.21.15.132:0/1908889497 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:29:46.074 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa157fff640 1 --2- 172.21.15.132:0/1908889497 >> v2:172.21.15.132:3300/0 conn(0x7fa158131700 0x7fa158133af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:46.074 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa157fff640 1 -- 172.21.15.132:0/1908889497 >> v1:172.21.15.132:6789/0 conn(0x7fa158091bd0 legacy=0x7fa158091fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:46.074 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa1577fe640 1 -- 172.21.15.132:0/1908889497 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874252080 0 0) 0x7fa158092df0 con 0x7fa158091bd0 2024-04-26T12:29:46.074 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.072+0000 7fa157fff640 1 -- 172.21.15.132:0/1908889497 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15806dc10 con 0x7fa158131700 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.073+0000 7fa157fff640 1 --2- 172.21.15.132:0/1908889497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158131700 0x7fa158133af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa148009750 tx=0x7fa14802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25ae642721e0f65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.073+0000 7fa1577fe640 1 -- 172.21.15.132:0/1908889497 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa148035020 con 0x7fa158131700 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.073+0000 7fa1577fe640 1 -- 172.21.15.132:0/1908889497 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa148031760 con 0x7fa158131700 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.073+0000 7fa1577fe640 1 -- 172.21.15.132:0/1908889497 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa148031a60 con 0x7fa158131700 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 -- 172.21.15.132:0/1908889497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158131700 msgr2=0x7fa158133af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 --2- 172.21.15.132:0/1908889497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158131700 0x7fa158133af0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa148009750 tx=0x7fa14802b8d0 comp rx=0 tx=0).stop 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 -- 172.21.15.132:0/1908889497 shutdown_connections 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 --2- 172.21.15.132:0/1908889497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158131700 0x7fa158133af0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 -- 172.21.15.132:0/1908889497 >> 172.21.15.132:0/1908889497 conn(0x7fa15809fd70 msgr2=0x7fa1580a0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 -- 172.21.15.132:0/1908889497 shutdown_connections 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 -- 172.21.15.132:0/1908889497 wait complete. 2024-04-26T12:29:46.076 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.074+0000 7fa15f1f7640 1 Processor -- start 2024-04-26T12:29:46.077 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.075+0000 7fa15f1f7640 1 -- start start 2024-04-26T12:29:46.078 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.075+0000 7fa15f1f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158091bd0 0x7fa1581c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:46.078 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.075+0000 7fa15f1f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa158134030 con 0x7fa158091bd0 2024-04-26T12:29:46.078 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.075+0000 7fa15cf93640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158091bd0 0x7fa1581c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.075+0000 7fa15cf93640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158091bd0 0x7fa1581c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42266/0 (socket says 172.21.15.132:42266) 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.075+0000 7fa15cf93640 1 -- 172.21.15.132:0/4041065968 learned_addr learned my addr 172.21.15.132:0/4041065968 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.075+0000 7fa15cf93640 1 -- 172.21.15.132:0/4041065968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15812f060 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa15cf93640 1 --2- 172.21.15.132:0/4041065968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158091bd0 0x7fa1581c30e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c840 tx=0x7fa15000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa1557fa640 1 -- 172.21.15.132:0/4041065968 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa150018070 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa1557fa640 1 -- 172.21.15.132:0/4041065968 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15000a660 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa1557fa640 1 -- 172.21.15.132:0/4041065968 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa15000a980 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15812e2a0 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa158095d00 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa1557fa640 1 -- 172.21.15.132:0/4041065968 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa15001b070 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.076+0000 7fa1557fa640 1 -- 172.21.15.132:0/4041065968 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa1500078d0 con 0x7fa158091bd0 2024-04-26T12:29:46.079 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.077+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa158062ed0 con 0x7fa158091bd0 2024-04-26T12:29:46.080 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.079+0000 7fa1557fa640 1 -- 172.21.15.132:0/4041065968 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa150022070 con 0x7fa158091bd0 2024-04-26T12:29:46.090 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:46.090+0000 7f2f325f1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:29:46.139 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.138+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa15804f630 con 0x7fa158091bd0 2024-04-26T12:29:46.139 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.138+0000 7fa1557fa640 1 -- 172.21.15.132:0/4041065968 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fa15000ac30 con 0x7fa158091bd0 2024-04-26T12:29:46.140 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-26T12:29:46.140 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":6,"fsid":"9f7de4b1-7365-4f06-b9fa-64d18aa7a81a","created":"2024-04-26T12:29:44.344147+0000","modified":"2024-04-26T12:29:45.365550+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:29:45.365550+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8400be6-015a-46df-8e1a-eda2d0564826","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"09f70d93-7270-42cb-8c52-5450d8b43f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87ce142d-2672-47e3-a4fc-29bd7e850b2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10a2c4a7-0c41-40a3-a637-9ded1c128461","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:29:46.141 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.139+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158091bd0 msgr2=0x7fa1581c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:46.141 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.139+0000 7fa15f1f7640 1 --2- 172.21.15.132:0/4041065968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158091bd0 0x7fa1581c30e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c840 tx=0x7fa15000cd00 comp rx=0 tx=0).stop 2024-04-26T12:29:46.141 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.139+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 shutdown_connections 2024-04-26T12:29:46.141 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.139+0000 7fa15f1f7640 1 --2- 172.21.15.132:0/4041065968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa158091bd0 0x7fa1581c30e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:46.141 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.139+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 >> 172.21.15.132:0/4041065968 conn(0x7fa15809fd70 msgr2=0x7fa158131ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:46.141 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.139+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 shutdown_connections 2024-04-26T12:29:46.141 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:46.139+0000 7fa15f1f7640 1 -- 172.21.15.132:0/4041065968 wait complete. 2024-04-26T12:29:46.143 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:46.142+0000 7f2f325f1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:29:46.150 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-26T12:29:46.254 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:46.253+0000 7f2f325f1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:29:46.632 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:46.631+0000 7f2f325f1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:29:46.891 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:46.891+0000 7f2f325f1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:29:46.943 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:46.942+0000 7f2f325f1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:29:47.059 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.058+0000 7f2f325f1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:29:47.331 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.330+0000 7f2f325f1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:29:47.379 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.379+0000 7f2f325f1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:29:47.532 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.531+0000 7f2f325f1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:29:47.667 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.666+0000 7f2f325f1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:29:47.716 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.715+0000 7f2f325f1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:29:47.786 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.785+0000 7f2f325f1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:29:47.833 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:47.831+0000 7f2f325f1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:29:48.300 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:48.299+0000 7f2f325f1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:29:48.414 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:48.413+0000 7f2f325f1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:29:49.413 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-26T12:29:49.412+0000 7fac67eb1640 -1 osd.0 0 log_to_monitors true 2024-04-26T12:29:49.422 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T12:29:49.421+0000 7f2ed3a2d640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-26T12:29:49.463 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-04-26T12:29:49.462+0000 7f6fc1bb4640 -1 osd.2 0 log_to_monitors true 2024-04-26T12:29:49.484 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-04-26T12:29:49.483+0000 7fa7a7d85640 -1 osd.3 0 log_to_monitors true 2024-04-26T12:29:49.502 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-04-26T12:29:49.501+0000 7f5099419640 -1 osd.1 0 log_to_monitors true 2024-04-26T12:29:51.195 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-04-26T12:29:51.194+0000 7f6fbd327640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:29:51.205 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-04-26T12:29:51.204+0000 7f6fb5959640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:29:51.309 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-26T12:29:51.308+0000 7fac63624640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:29:51.326 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-26T12:29:51.325+0000 7fac5bc56640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:29:52.417 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-04-26T12:29:52.416+0000 7fa7a34f8640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T12:29:52.430 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-04-26T12:29:52.426+0000 7f50944c5640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:29:52.433 INFO:tasks.ceph.osd.3.smithi170.stderr:2024-04-26T12:29:52.432+0000 7fa79bb2a640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:29:52.455 INFO:tasks.ceph.osd.1.smithi170.stderr:2024-04-26T12:29:52.448+0000 7f508caf7640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:29:52.555 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:29:52.653 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.651+0000 7fc660693640 1 Processor -- start 2024-04-26T12:29:52.653 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.651+0000 7fc660693640 1 -- start start 2024-04-26T12:29:52.654 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc660693640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc65806f4f0 0x7fc658133950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:52.655 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc660693640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc65806fcf0 con 0x7fc65812eb50 2024-04-26T12:29:52.655 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc660693640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc65812e860 con 0x7fc65806f4f0 2024-04-26T12:29:52.655 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc65dc2e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc65806f4f0 0x7fc658133950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:52.655 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc65e42f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc65812eb50 0x7fc65812ef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50648/0 (socket says 172.21.15.132:50648) 2024-04-26T12:29:52.655 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc65e42f640 1 -- 172.21.15.132:0/3884725559 learned_addr learned my addr 172.21.15.132:0/3884725559 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:29:52.656 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc65dc2e640 1 -- 172.21.15.132:0/3884725559 >> v1:172.21.15.132:6789/0 conn(0x7fc65812eb50 legacy=0x7fc65812ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:52.656 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.652+0000 7fc65dc2e640 1 -- 172.21.15.132:0/3884725559 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65806e7c0 con 0x7fc65806f4f0 2024-04-26T12:29:52.656 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.653+0000 7fc65dc2e640 1 --2- 172.21.15.132:0/3884725559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc658133950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc654009720 tx=0x7fc65402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5dcaedeff6d166 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:52.656 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.653+0000 7fc65d42d640 1 -- 172.21.15.132:0/3884725559 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc654035020 con 0x7fc65806f4f0 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.653+0000 7fc65d42d640 1 -- 172.21.15.132:0/3884725559 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc654031760 con 0x7fc65806f4f0 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.653+0000 7fc65d42d640 1 -- 172.21.15.132:0/3884725559 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc654031a60 con 0x7fc65806f4f0 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.654+0000 7fc660693640 1 -- 172.21.15.132:0/3884725559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 msgr2=0x7fc658133950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.654+0000 7fc660693640 1 --2- 172.21.15.132:0/3884725559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc658133950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc654009720 tx=0x7fc65402b8d0 comp rx=0 tx=0).stop 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.654+0000 7fc660693640 1 -- 172.21.15.132:0/3884725559 shutdown_connections 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.654+0000 7fc660693640 1 --2- 172.21.15.132:0/3884725559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc658133950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.654+0000 7fc660693640 1 -- 172.21.15.132:0/3884725559 >> 172.21.15.132:0/3884725559 conn(0x7fc65809eac0 msgr2=0x7fc65809eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:52.658 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.654+0000 7fc660693640 1 -- 172.21.15.132:0/3884725559 shutdown_connections 2024-04-26T12:29:52.659 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.654+0000 7fc660693640 1 -- 172.21.15.132:0/3884725559 wait complete. 2024-04-26T12:29:52.659 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc660693640 1 Processor -- start 2024-04-26T12:29:52.659 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc660693640 1 -- start start 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc660693640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc65809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc660693640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc658134220 con 0x7fc65806f4f0 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc65e42f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc65809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc65e42f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc65809aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42292/0 (socket says 172.21.15.132:42292) 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc65e42f640 1 -- 172.21.15.132:0/2820495863 learned_addr learned my addr 172.21.15.132:0/2820495863 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc65e42f640 1 -- 172.21.15.132:0/2820495863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc658129e70 con 0x7fc65806f4f0 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.655+0000 7fc65e42f640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc65809aa70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c380 tx=0x7fc64800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.656+0000 7fc64effd640 1 -- 172.21.15.132:0/2820495863 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc648005c10 con 0x7fc65806f4f0 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.656+0000 7fc64effd640 1 -- 172.21.15.132:0/2820495863 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc648005db0 con 0x7fc65806f4f0 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.656+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc658071c30 con 0x7fc65806f4f0 2024-04-26T12:29:52.662 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.656+0000 7fc64effd640 1 -- 172.21.15.132:0/2820495863 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc648004930 con 0x7fc65806f4f0 2024-04-26T12:29:52.663 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.656+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65812ace0 con 0x7fc65806f4f0 2024-04-26T12:29:52.663 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.656+0000 7fc64effd640 1 -- 172.21.15.132:0/2820495863 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7fc64801a020 con 0x7fc65806f4f0 2024-04-26T12:29:52.663 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.657+0000 7fc64effd640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc63c037fd0 0x7fc63c03a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:52.663 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.657+0000 7fc64effd640 1 -- 172.21.15.132:0/2820495863 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2183+0+0 (secure 0 0 0) 0x7fc64804a100 con 0x7fc65806f4f0 2024-04-26T12:29:52.663 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.657+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6581299d0 con 0x7fc65806f4f0 2024-04-26T12:29:52.663 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.657+0000 7fc65dc2e640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc63c037fd0 0x7fc63c03a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:52.663 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.657+0000 7fc65dc2e640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc63c037fd0 0x7fc63c03a490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc654036000 tx=0x7fc654008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:52.664 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.662+0000 7fc64effd640 1 -- 172.21.15.132:0/2820495863 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc6480127f0 con 0x7fc65806f4f0 2024-04-26T12:29:52.837 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.835+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc658062ed0 con 0x7fc65806f4f0 2024-04-26T12:29:52.838 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.836+0000 7fc64effd640 1 -- 172.21.15.132:0/2820495863 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+5134 (secure 0 0 0) 0x7fc648012a50 con 0x7fc65806f4f0 2024-04-26T12:29:52.838 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-26T12:29:52.839 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":9,"fsid":"9f7de4b1-7365-4f06-b9fa-64d18aa7a81a","created":"2024-04-26T12:29:44.344147+0000","modified":"2024-04-26T12:29:51.474838+0000","last_up_change":"2024-04-26T12:29:51.474838+0000","last_in_change":"2024-04-26T12:29:45.365550+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8400be6-015a-46df-8e1a-eda2d0564826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6801","nonce":965566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6803","nonce":965566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6807","nonce":965566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6805","nonce":965566727}]},"public_addr":"172.21.15.132:6801/965566727","cluster_addr":"172.21.15.132:6803/965566727","heartbeat_back_addr":"172.21.15.132:6807/965566727","heartbeat_front_addr":"172.21.15.132:6805/965566727","state":["exists","up"]},{"osd":1,"uuid":"09f70d93-7270-42cb-8c52-5450d8b43f08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87ce142d-2672-47e3-a4fc-29bd7e850b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6801","nonce":1189813177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6803","nonce":1189813177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6807","nonce":1189813177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6805","nonce":1189813177}]},"public_addr":"172.21.15.170:6801/1189813177","cluster_addr":"172.21.15.170:6803/1189813177","heartbeat_back_addr":"172.21.15.170:6807/1189813177","heartbeat_front_addr":"172.21.15.170:6805/1189813177","state":["exists","up"]},{"osd":3,"uuid":"10a2c4a7-0c41-40a3-a637-9ded1c128461","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:29:52.839 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc63c037fd0 msgr2=0x7fc63c03a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc63c037fd0 0x7fc63c03a490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc654036000 tx=0x7fc654008030 comp rx=0 tx=0).stop 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 msgr2=0x7fc65809aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc65809aa70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c380 tx=0x7fc64800c840 comp rx=0 tx=0).stop 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 shutdown_connections 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc63c037fd0 0x7fc63c03a490 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 --2- 172.21.15.132:0/2820495863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc65806f4f0 0x7fc65809aa70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 >> 172.21.15.132:0/2820495863 conn(0x7fc65809eac0 msgr2=0x7fc65809bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 shutdown_connections 2024-04-26T12:29:52.841 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:52.838+0000 7fc660693640 1 -- 172.21.15.132:0/2820495863 wait complete. 2024-04-26T12:29:52.849 DEBUG:teuthology.misc:2 of 4 OSDs are up 2024-04-26T12:29:59.252 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:29:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.351+0000 7fd9a8696640 1 Processor -- start 2024-04-26T12:29:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.351+0000 7fd9a8696640 1 -- start start 2024-04-26T12:29:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.351+0000 7fd9a8696640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9a006e790 0x7fd9a0130530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.351+0000 7fd9a8696640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a006d810 con 0x7fd9a009bb50 2024-04-26T12:29:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.351+0000 7fd9a8696640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a006d5e0 con 0x7fd9a006e790 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.351+0000 7fd9a6432640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd9a009bb50 0x7fd9a006dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48774/0 (socket says 172.21.15.132:48774) 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.351+0000 7fd9a6432640 1 -- 172.21.15.132:0/1256765578 learned_addr learned my addr 172.21.15.132:0/1256765578 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.352+0000 7fd9a5c31640 1 --2- 172.21.15.132:0/1256765578 >> v2:172.21.15.132:3300/0 conn(0x7fd9a006e790 0x7fd9a0130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.352+0000 7fd9a5430640 1 -- 172.21.15.132:0/1256765578 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350600743 0 0) 0x7fd9a006d810 con 0x7fd9a009bb50 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.352+0000 7fd9a5430640 1 -- 172.21.15.132:0/1256765578 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c003520 con 0x7fd9a009bb50 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.352+0000 7fd9a5c31640 1 -- 172.21.15.132:0/1256765578 >> v1:172.21.15.132:6789/0 conn(0x7fd9a009bb50 legacy=0x7fd9a006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.352+0000 7fd9a5c31640 1 -- 172.21.15.132:0/1256765578 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a006e350 con 0x7fd9a006e790 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a5c31640 1 --2- 172.21.15.132:0/1256765578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a0130530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd990009740 tx=0x7fd99002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f478cbf27cadbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a5430640 1 -- 172.21.15.132:0/1256765578 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd990035020 con 0x7fd9a006e790 2024-04-26T12:29:59.355 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a5430640 1 -- 172.21.15.132:0/1256765578 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd990031760 con 0x7fd9a006e790 2024-04-26T12:29:59.355 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a5430640 1 -- 172.21.15.132:0/1256765578 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd990031a60 con 0x7fd9a006e790 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a8696640 1 -- 172.21.15.132:0/1256765578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 msgr2=0x7fd9a0130530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a8696640 1 --2- 172.21.15.132:0/1256765578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a0130530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd990009740 tx=0x7fd99002b8d0 comp rx=0 tx=0).stop 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a8696640 1 -- 172.21.15.132:0/1256765578 shutdown_connections 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a8696640 1 --2- 172.21.15.132:0/1256765578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a0130530 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a8696640 1 -- 172.21.15.132:0/1256765578 >> 172.21.15.132:0/1256765578 conn(0x7fd9a009ab30 msgr2=0x7fd9a009af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a8696640 1 -- 172.21.15.132:0/1256765578 shutdown_connections 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.353+0000 7fd9a8696640 1 -- 172.21.15.132:0/1256765578 wait complete. 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.354+0000 7fd9a8696640 1 Processor -- start 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.354+0000 7fd9a8696640 1 -- start start 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a8696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a01bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:59.357 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a8696640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0130a70 con 0x7fd9a006e790 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a6432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a01bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a6432640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a01bfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60160/0 (socket says 172.21.15.132:60160) 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a6432640 1 -- 172.21.15.132:0/2478705797 learned_addr learned my addr 172.21.15.132:0/2478705797 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a6432640 1 -- 172.21.15.132:0/2478705797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a008d9a0 con 0x7fd9a006e790 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a6432640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a01bfd20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c480 tx=0x7fd99c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd996ffd640 1 -- 172.21.15.132:0/2478705797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd99c017070 con 0x7fd9a006e790 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd996ffd640 1 -- 172.21.15.132:0/2478705797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99c005c10 con 0x7fd9a006e790 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a008d560 con 0x7fd9a006e790 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd996ffd640 1 -- 172.21.15.132:0/2478705797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd99c007070 con 0x7fd9a006e790 2024-04-26T12:29:59.358 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.355+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a01c0440 con 0x7fd9a006e790 2024-04-26T12:29:59.359 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.356+0000 7fd996ffd640 1 -- 172.21.15.132:0/2478705797 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd99c01a070 con 0x7fd9a006e790 2024-04-26T12:29:59.359 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.356+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a0062ed0 con 0x7fd9a006e790 2024-04-26T12:29:59.359 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.356+0000 7fd996ffd640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd984038060 0x7fd98403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:59.359 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.357+0000 7fd996ffd640 1 -- 172.21.15.132:0/2478705797 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7fd99c04a110 con 0x7fd9a006e790 2024-04-26T12:29:59.359 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.357+0000 7fd9a5c31640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd984038060 0x7fd98403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:59.359 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.357+0000 7fd9a5c31640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd984038060 0x7fd98403a520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd990036000 tx=0x7fd990008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:59.362 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.361+0000 7fd996ffd640 1 -- 172.21.15.132:0/2478705797 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd99c01a790 con 0x7fd9a006e790 2024-04-26T12:29:59.536 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.535+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9a0124fc0 con 0x7fd9a006e790 2024-04-26T12:29:59.537 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.536+0000 7fd996ffd640 1 -- 172.21.15.132:0/2478705797 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7989 (secure 0 0 0) 0x7fd99c01a9b0 con 0x7fd9a006e790 2024-04-26T12:29:59.537 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-26T12:29:59.537 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":12,"fsid":"9f7de4b1-7365-4f06-b9fa-64d18aa7a81a","created":"2024-04-26T12:29:44.344147+0000","modified":"2024-04-26T12:29:55.419529+0000","last_up_change":"2024-04-26T12:29:53.417591+0000","last_in_change":"2024-04-26T12:29:45.365550+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:29:52.451035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8400be6-015a-46df-8e1a-eda2d0564826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6801","nonce":965566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6803","nonce":965566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6807","nonce":965566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6805","nonce":965566727}]},"public_addr":"172.21.15.132:6801/965566727","cluster_addr":"172.21.15.132:6803/965566727","heartbeat_back_addr":"172.21.15.132:6807/965566727","heartbeat_front_addr":"172.21.15.132:6805/965566727","state":["exists","up"]},{"osd":1,"uuid":"09f70d93-7270-42cb-8c52-5450d8b43f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6809","nonce":2372702203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6811","nonce":2372702203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6815","nonce":2372702203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6813","nonce":2372702203}]},"public_addr":"172.21.15.170:6809/2372702203","cluster_addr":"172.21.15.170:6811/2372702203","heartbeat_back_addr":"172.21.15.170:6815/2372702203","heartbeat_front_addr":"172.21.15.170:6813/2372702203","state":["exists","up"]},{"osd":2,"uuid":"87ce142d-2672-47e3-a4fc-29bd7e850b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6801","nonce":1189813177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6803","nonce":1189813177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6807","nonce":1189813177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6805","nonce":1189813177}]},"public_addr":"172.21.15.170:6801/1189813177","cluster_addr":"172.21.15.170:6803/1189813177","heartbeat_back_addr":"172.21.15.170:6807/1189813177","heartbeat_front_addr":"172.21.15.170:6805/1189813177","state":["exists","up"]},{"osd":3,"uuid":"10a2c4a7-0c41-40a3-a637-9ded1c128461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6817","nonce":2349137764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6819","nonce":2349137764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6823","nonce":2349137764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6821","nonce":2349137764}]},"public_addr":"172.21.15.170:6817/2349137764","cluster_addr":"172.21.15.170:6819/2349137764","heartbeat_back_addr":"172.21.15.170:6823/2349137764","heartbeat_front_addr":"172.21.15.170:6821/2349137764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.386095+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.547314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:51.195588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.528970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd984038060 msgr2=0x7fd98403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd984038060 0x7fd98403a520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd990036000 tx=0x7fd990008030 comp rx=0 tx=0).stop 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 msgr2=0x7fd9a01bfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a01bfd20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c480 tx=0x7fd99c00c940 comp rx=0 tx=0).stop 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 shutdown_connections 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd984038060 0x7fd98403a520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 --2- 172.21.15.132:0/2478705797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9a006e790 0x7fd9a01bfd20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 >> 172.21.15.132:0/2478705797 conn(0x7fd9a009ab30 msgr2=0x7fd9a0125b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 shutdown_connections 2024-04-26T12:29:59.540 INFO:teuthology.misc.health.smithi132.stderr:2024-04-26T12:29:59.538+0000 7fd9a8696640 1 -- 172.21.15.132:0/2478705797 wait complete. 2024-04-26T12:29:59.549 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-26T12:29:59.549 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:29:59.549 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41b4c5c640 1 Processor -- start 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41b4c5c640 1 -- start start 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41b4c5c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41b0095d80 0x7f41b0096160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41b4c5c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41b009c060 con 0x7f41b00966a0 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41b4c5c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f41b009bb30 con 0x7f41b0095d80 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41ae59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41b0095d80 0x7f41b0096160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41add9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f41b00966a0 0x7f41b0121510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48788/0 (socket says 172.21.15.132:48788) 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.644+0000 7f41add9b640 1 -- 172.21.15.132:0/416892825 learned_addr learned my addr 172.21.15.132:0/416892825 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.645+0000 7f41ae59c640 1 -- 172.21.15.132:0/416892825 >> v1:172.21.15.132:6789/0 conn(0x7f41b00966a0 legacy=0x7f41b0121510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.645+0000 7f41ae59c640 1 -- 172.21.15.132:0/416892825 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b0090d40 con 0x7f41b0095d80 2024-04-26T12:29:59.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.645+0000 7f41ad59a640 1 -- 172.21.15.132:0/416892825 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738889109 0 0) 0x7f41b009c060 con 0x7f41b00966a0 2024-04-26T12:29:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.645+0000 7f41ae59c640 1 --2- 172.21.15.132:0/416892825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b0096160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009720 tx=0x7f41a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19628722c1dd0e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.645+0000 7f41ad59a640 1 -- 172.21.15.132:0/416892825 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a00316d0 con 0x7f41b0095d80 2024-04-26T12:29:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.645+0000 7f41ad59a640 1 -- 172.21.15.132:0/416892825 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a0037070 con 0x7f41b0095d80 2024-04-26T12:29:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.645+0000 7f41ad59a640 1 -- 172.21.15.132:0/416892825 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a00319c0 con 0x7f41b0095d80 2024-04-26T12:29:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.646+0000 7f41b4c5c640 1 -- 172.21.15.132:0/416892825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 msgr2=0x7f41b0096160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:29:59.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.646+0000 7f41b4c5c640 1 --2- 172.21.15.132:0/416892825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b0096160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009720 tx=0x7f41a002b840 comp rx=0 tx=0).stop 2024-04-26T12:29:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.646+0000 7f41b4c5c640 1 -- 172.21.15.132:0/416892825 shutdown_connections 2024-04-26T12:29:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.646+0000 7f41b4c5c640 1 --2- 172.21.15.132:0/416892825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b0096160 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:29:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.646+0000 7f41b4c5c640 1 -- 172.21.15.132:0/416892825 >> 172.21.15.132:0/416892825 conn(0x7f41b009a980 msgr2=0x7f41b009ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:29:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.646+0000 7f41b4c5c640 1 -- 172.21.15.132:0/416892825 shutdown_connections 2024-04-26T12:29:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.646+0000 7f41b4c5c640 1 -- 172.21.15.132:0/416892825 wait complete. 2024-04-26T12:29:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.647+0000 7f41b4c5c640 1 Processor -- start 2024-04-26T12:29:59.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.647+0000 7f41b4c5c640 1 -- start start 2024-04-26T12:29:59.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.647+0000 7f41b4c5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:59.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.647+0000 7f41b4c5c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0121da0 con 0x7f41b0095d80 2024-04-26T12:29:59.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f41ae59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:59.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f41ae59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b006de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60172/0 (socket says 172.21.15.132:60172) 2024-04-26T12:29:59.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f41ae59c640 1 -- 172.21.15.132:0/3863042591 learned_addr learned my addr 172.21.15.132:0/3863042591 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:29:59.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f41ae59c640 1 -- 172.21.15.132:0/3863042591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b00716a0 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f41ae59c640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b006de50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41a0034040 tx=0x7f41a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f419effd640 1 -- 172.21.15.132:0/3863042591 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a0032770 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f419effd640 1 -- 172.21.15.132:0/3863042591 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a0032910 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b00916f0 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f419effd640 1 -- 172.21.15.132:0/3863042591 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41a0032c30 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.648+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b0070230 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.649+0000 7f419effd640 1 -- 172.21.15.132:0/3863042591 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f41a004c060 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.649+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b0062ed0 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.649+0000 7f419effd640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4190038060 0x7f419003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.649+0000 7f419effd640 1 -- 172.21.15.132:0/3863042591 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f41a002f050 con 0x7f41b0095d80 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.649+0000 7f41add9b640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4190038060 0x7f419003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:29:59.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.650+0000 7f41add9b640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4190038060 0x7f419003a520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:29:59.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.654+0000 7f419effd640 1 -- 172.21.15.132:0/3863042591 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f41a0040070 con 0x7f41b0095d80 2024-04-26T12:29:59.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:29:59.826+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f41b00713f0 con 0x7f41b0095d80 2024-04-26T12:30:00.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.433+0000 7f419effd640 1 -- 172.21.15.132:0/3863042591 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7f41a003a380 con 0x7f41b0095d80 2024-04-26T12:30:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'rbd' created 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4190038060 msgr2=0x7f419003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4190038060 0x7f419003a520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4007970 comp rx=0 tx=0).stop 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 msgr2=0x7f41b006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b006de50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41a0034040 tx=0x7f41a00046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 shutdown_connections 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4190038060 0x7f419003a520 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 --2- 172.21.15.132:0/3863042591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41b0095d80 0x7f41b006de50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 >> 172.21.15.132:0/3863042591 conn(0x7f41b009a980 msgr2=0x7f41b0124d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:00.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 shutdown_connections 2024-04-26T12:30:00.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.435+0000 7f41b4c5c640 1 -- 172.21.15.132:0/3863042591 wait complete. 2024-04-26T12:30:00.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f04a203f640 1 Processor -- start 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f04a203f640 1 -- start start 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f04a203f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f049c06de90 0x7f049c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f04a203f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049c06d7a0 con 0x7f049c121740 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f04a203f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f049c06b230 con 0x7f049c06de90 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f049c06de90 0x7f049c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f049c121740 0x7f049c121ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48792/0 (socket says 172.21.15.132:48792) 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049affd640 1 -- 172.21.15.132:0/180165128 learned_addr learned my addr 172.21.15.132:0/180165128 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049b7fe640 1 -- 172.21.15.132:0/180165128 >> v1:172.21.15.132:6789/0 conn(0x7f049c121740 legacy=0x7f049c121ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049b7fe640 1 -- 172.21.15.132:0/180165128 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c06da40 con 0x7f049c06de90 2024-04-26T12:30:00.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049a7fc640 1 -- 172.21.15.132:0/180165128 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690093646 0 0) 0x7f049c06d7a0 con 0x7f049c121740 2024-04-26T12:30:00.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049b7fe640 1 --2- 172.21.15.132:0/180165128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c06e270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f048c009720 tx=0x7f048c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72579ca3e2aad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:00.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049a7fc640 1 -- 172.21.15.132:0/180165128 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f048c0316d0 con 0x7f049c06de90 2024-04-26T12:30:00.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049a7fc640 1 -- 172.21.15.132:0/180165128 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c037070 con 0x7f049c06de90 2024-04-26T12:30:00.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.550+0000 7f049a7fc640 1 -- 172.21.15.132:0/180165128 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f048c0319c0 con 0x7f049c06de90 2024-04-26T12:30:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.551+0000 7f04a203f640 1 -- 172.21.15.132:0/180165128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 msgr2=0x7f049c06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.551+0000 7f04a203f640 1 --2- 172.21.15.132:0/180165128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c06e270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f048c009720 tx=0x7f048c02b840 comp rx=0 tx=0).stop 2024-04-26T12:30:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.551+0000 7f04a203f640 1 -- 172.21.15.132:0/180165128 shutdown_connections 2024-04-26T12:30:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.551+0000 7f04a203f640 1 --2- 172.21.15.132:0/180165128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c06e270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.551+0000 7f04a203f640 1 -- 172.21.15.132:0/180165128 >> 172.21.15.132:0/180165128 conn(0x7f049c09b610 msgr2=0x7f049c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:00.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.551+0000 7f04a203f640 1 -- 172.21.15.132:0/180165128 shutdown_connections 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.551+0000 7f04a203f640 1 -- 172.21.15.132:0/180165128 wait complete. 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.552+0000 7f04a203f640 1 Processor -- start 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.552+0000 7f04a203f640 1 -- start start 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.552+0000 7f04a203f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c08b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.552+0000 7f04a203f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f049c06efc0 con 0x7f049c06de90 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c08b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c08b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60190/0 (socket says 172.21.15.132:60190) 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f049b7fe640 1 -- 172.21.15.132:0/26360134 learned_addr learned my addr 172.21.15.132:0/26360134 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f049b7fe640 1 -- 172.21.15.132:0/26360134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c124db0 con 0x7f049c06de90 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f049b7fe640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c08b3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f048c034040 tx=0x7f048c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f0483fff640 1 -- 172.21.15.132:0/26360134 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f048c032770 con 0x7f049c06de90 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f0483fff640 1 -- 172.21.15.132:0/26360134 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c032910 con 0x7f049c06de90 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c1269e0 con 0x7f049c06de90 2024-04-26T12:30:00.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f0483fff640 1 -- 172.21.15.132:0/26360134 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f048c032c30 con 0x7f049c06de90 2024-04-26T12:30:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.553+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c127100 con 0x7f049c06de90 2024-04-26T12:30:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.554+0000 7f0483fff640 1 -- 172.21.15.132:0/26360134 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f048c04c060 con 0x7f049c06de90 2024-04-26T12:30:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.554+0000 7f0483fff640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0488038060 0x7f048803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.554+0000 7f0483fff640 1 -- 172.21.15.132:0/26360134 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7f048c02f050 con 0x7f049c06de90 2024-04-26T12:30:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.554+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c062ed0 con 0x7f049c06de90 2024-04-26T12:30:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.554+0000 7f049affd640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0488038060 0x7f048803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:00.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.555+0000 7f049affd640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0488038060 0x7f048803a520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0490000c00 tx=0x7f0490007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:00.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.559+0000 7f0483fff640 1 -- 172.21.15.132:0/26360134 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f049c124db0 con 0x7f049c06de90 2024-04-26T12:30:00.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:00.734+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f049c06c240 con 0x7f049c06de90 2024-04-26T12:30:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.433+0000 7f0483fff640 1 -- 172.21.15.132:0/26360134 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 173+0+0 (secure 0 0 0) 0x7f048c053030 con 0x7f049c06de90 2024-04-26T12:30:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0488038060 msgr2=0x7f048803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0488038060 0x7f048803a520 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0490000c00 tx=0x7f0490007970 comp rx=0 tx=0).stop 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 msgr2=0x7f049c08b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c08b3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f048c034040 tx=0x7f048c0046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 shutdown_connections 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0488038060 0x7f048803a520 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 --2- 172.21.15.132:0/26360134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f049c06de90 0x7f049c08b3a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 >> 172.21.15.132:0/26360134 conn(0x7f049c09b610 msgr2=0x7f049c08d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.436+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 shutdown_connections 2024-04-26T12:30:01.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.437+0000 7f04a203f640 1 -- 172.21.15.132:0/26360134 wait complete. 2024-04-26T12:30:01.451 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:30:01.451 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:30:01.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:30:01.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:30:01.452 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:30:01.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe49e66d640 1 Processor -- start 2024-04-26T12:30:01.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe49e66d640 1 -- start start 2024-04-26T12:30:01.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe49e66d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe49812ef80 0x7fe49812b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:01.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe49e66d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe498094650 con 0x7fe49812eba0 2024-04-26T12:30:01.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe49e66d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe498094f40 con 0x7fe49812ef80 2024-04-26T12:30:01.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe4977fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe49812ef80 0x7fe49812b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe497fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe49812eba0 0x7fe49812ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48802/0 (socket says 172.21.15.132:48802) 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.550+0000 7fe497fff640 1 -- 172.21.15.132:0/429212550 learned_addr learned my addr 172.21.15.132:0/429212550 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.549+0000 7fe4977fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe49812ef80 0x7fe49812b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60192/0 (socket says 172.21.15.132:60192) 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.550+0000 7fe4977fe640 1 -- 172.21.15.132:0/429212550 >> v1:172.21.15.132:6789/0 conn(0x7fe49812eba0 legacy=0x7fe49812ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.550+0000 7fe4977fe640 1 -- 172.21.15.132:0/429212550 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49812e980 con 0x7fe49812ef80 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.550+0000 7fe496ffd640 1 -- 172.21.15.132:0/429212550 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596452641 0 0) 0x7fe498094650 con 0x7fe49812eba0 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.550+0000 7fe4977fe640 1 --2- 172.21.15.132:0/429212550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812ef80 0x7fe49812b580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009720 tx=0x7fe48c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c280fe5c3d4721 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe496ffd640 1 -- 172.21.15.132:0/429212550 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe48c0316d0 con 0x7fe49812ef80 2024-04-26T12:30:01.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe496ffd640 1 -- 172.21.15.132:0/429212550 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe48c037070 con 0x7fe49812ef80 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe496ffd640 1 -- 172.21.15.132:0/429212550 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe48c0319c0 con 0x7fe49812ef80 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe49e66d640 1 -- 172.21.15.132:0/429212550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812ef80 msgr2=0x7fe49812b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe49e66d640 1 --2- 172.21.15.132:0/429212550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812ef80 0x7fe49812b580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009720 tx=0x7fe48c02b840 comp rx=0 tx=0).stop 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe49e66d640 1 -- 172.21.15.132:0/429212550 shutdown_connections 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe49e66d640 1 --2- 172.21.15.132:0/429212550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812ef80 0x7fe49812b580 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe49e66d640 1 -- 172.21.15.132:0/429212550 >> 172.21.15.132:0/429212550 conn(0x7fe49809b7b0 msgr2=0x7fe49809bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe49e66d640 1 -- 172.21.15.132:0/429212550 shutdown_connections 2024-04-26T12:30:01.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.551+0000 7fe49e66d640 1 -- 172.21.15.132:0/429212550 wait complete. 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.552+0000 7fe49e66d640 1 Processor -- start 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.552+0000 7fe49e66d640 1 -- start start 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.552+0000 7fe49e66d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812eba0 0x7fe498089f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.552+0000 7fe49e66d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe49808edd0 con 0x7fe49812eba0 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe497fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812eba0 0x7fe498089f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe497fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812eba0 0x7fe498089f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60204/0 (socket says 172.21.15.132:60204) 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe497fff640 1 -- 172.21.15.132:0/3436314152 learned_addr learned my addr 172.21.15.132:0/3436314152 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe497fff640 1 -- 172.21.15.132:0/3436314152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49808cb80 con 0x7fe49812eba0 2024-04-26T12:30:01.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe497fff640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812eba0 0x7fe498089f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c420 tx=0x7fe48800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe494ff9640 1 -- 172.21.15.132:0/3436314152 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe488018070 con 0x7fe49812eba0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe494ff9640 1 -- 172.21.15.132:0/3436314152 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4880074d0 con 0x7fe49812eba0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49808b580 con 0x7fe49812eba0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe494ff9640 1 -- 172.21.15.132:0/3436314152 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe488004950 con 0x7fe49812eba0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.553+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49808dcb0 con 0x7fe49812eba0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.554+0000 7fe494ff9640 1 -- 172.21.15.132:0/3436314152 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe48801b070 con 0x7fe49812eba0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.554+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49808c9b0 con 0x7fe49812eba0 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.554+0000 7fe494ff9640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe484038060 0x7fe48403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:01.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.554+0000 7fe494ff9640 1 -- 172.21.15.132:0/3436314152 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7fe48804a2d0 con 0x7fe49812eba0 2024-04-26T12:30:01.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.554+0000 7fe4977fe640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe484038060 0x7fe48403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:01.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.555+0000 7fe4977fe640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe484038060 0x7fe48403a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe48c036000 tx=0x7fe48c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:01.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.559+0000 7fe494ff9640 1 -- 172.21.15.132:0/3436314152 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe488011980 con 0x7fe49812eba0 2024-04-26T12:30:01.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.776+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe498062ed0 con 0x7fe49812eba0 2024-04-26T12:30:01.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.778+0000 7fe494ff9640 1 -- 172.21.15.132:0/3436314152 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87206 (secure 0 0 0) 0x7fe4880374c0 con 0x7fe49812eba0 2024-04-26T12:30:01.781 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:30:01.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe484038060 msgr2=0x7fe48403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe484038060 0x7fe48403a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe48c036000 tx=0x7fe48c008030 comp rx=0 tx=0).stop 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812eba0 msgr2=0x7fe498089f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812eba0 0x7fe498089f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c420 tx=0x7fe48800c8e0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 shutdown_connections 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe484038060 0x7fe48403a520 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 --2- 172.21.15.132:0/3436314152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe49812eba0 0x7fe498089f60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 >> 172.21.15.132:0/3436314152 conn(0x7fe49809b7b0 msgr2=0x7fe49812bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 shutdown_connections 2024-04-26T12:30:01.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.780+0000 7fe49e66d640 1 -- 172.21.15.132:0/3436314152 wait complete. 2024-04-26T12:30:01.792 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2720307558},{"type":"v1","addr":"172.21.15.170:6825","nonce":2720307558}]},"active_addr":"172.21.15.170:6825/2720307558","active_change":"2024-04-26T12:29:48.415370+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2337727252}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2732120137}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3202398863}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":120460708}]}]} 2024-04-26T12:30:01.795 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:30:01.795 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:30:01.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:01.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.890+0000 7f9998ba4640 1 Processor -- start 2024-04-26T12:30:01.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.890+0000 7f9998ba4640 1 -- start start 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f9998ba4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9994091b50 0x7f9994091f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f9998ba4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99940928f0 con 0x7f9994092470 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f9998ba4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9994092d40 con 0x7f9994091b50 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f999259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9994091b50 0x7f9994091f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f998bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9994092470 0x7f999412e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48814/0 (socket says 172.21.15.132:48814) 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f998bfff640 1 -- 172.21.15.132:0/2140925493 learned_addr learned my addr 172.21.15.132:0/2140925493 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f999259c640 1 -- 172.21.15.132:0/2140925493 >> v1:172.21.15.132:6789/0 conn(0x7f9994092470 legacy=0x7f999412e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.891+0000 7f999259c640 1 -- 172.21.15.132:0/2140925493 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999406e120 con 0x7f9994091b50 2024-04-26T12:30:01.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.892+0000 7f999259c640 1 --2- 172.21.15.132:0/2140925493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f9994091f30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9984009720 tx=0x7f998402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b196ba2d76eea29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.892+0000 7f9991d9b640 1 -- 172.21.15.132:0/2140925493 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9984035020 con 0x7f9994091b50 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.892+0000 7f9991d9b640 1 -- 172.21.15.132:0/2140925493 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9984031760 con 0x7f9994091b50 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.892+0000 7f9991d9b640 1 -- 172.21.15.132:0/2140925493 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9984031a60 con 0x7f9994091b50 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.893+0000 7f9998ba4640 1 -- 172.21.15.132:0/2140925493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 msgr2=0x7f9994091f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.893+0000 7f9998ba4640 1 --2- 172.21.15.132:0/2140925493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f9994091f30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9984009720 tx=0x7f998402b8d0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.893+0000 7f9998ba4640 1 -- 172.21.15.132:0/2140925493 shutdown_connections 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.893+0000 7f9998ba4640 1 --2- 172.21.15.132:0/2140925493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f9994091f30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.893+0000 7f9998ba4640 1 -- 172.21.15.132:0/2140925493 >> 172.21.15.132:0/2140925493 conn(0x7f999409fdd0 msgr2=0x7f99940a01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.893+0000 7f9998ba4640 1 -- 172.21.15.132:0/2140925493 shutdown_connections 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.893+0000 7f9998ba4640 1 -- 172.21.15.132:0/2140925493 wait complete. 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f9998ba4640 1 Processor -- start 2024-04-26T12:30:01.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f9998ba4640 1 -- start start 2024-04-26T12:30:01.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f9998ba4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f99941264b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:01.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f9998ba4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f999412ed10 con 0x7f9994091b50 2024-04-26T12:30:01.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f999259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f99941264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:01.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f999259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f99941264b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60230/0 (socket says 172.21.15.132:60230) 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f999259c640 1 -- 172.21.15.132:0/3006892476 learned_addr learned my addr 172.21.15.132:0/3006892476 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f999259c640 1 -- 172.21.15.132:0/3006892476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9994127360 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f999259c640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f99941264b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9984009720 tx=0x7f99840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.894+0000 7f998affd640 1 -- 172.21.15.132:0/3006892476 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f998403be40 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.895+0000 7f998affd640 1 -- 172.21.15.132:0/3006892476 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99840453f0 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.895+0000 7f998affd640 1 -- 172.21.15.132:0/3006892476 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99840456f0 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.895+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9994128fd0 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.895+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99941269f0 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.895+0000 7f998affd640 1 -- 172.21.15.132:0/3006892476 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f998404c060 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.895+0000 7f998affd640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9974038060 0x7f997403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.896+0000 7f998affd640 1 -- 172.21.15.132:0/3006892476 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7f998406d000 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.895+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9994062ed0 con 0x7f9994091b50 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.896+0000 7f998bfff640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9974038060 0x7f997403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:01.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.896+0000 7f998bfff640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9974038060 0x7f997403a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f997c000f60 tx=0x7f997c007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:01.900+0000 7f998affd640 1 -- 172.21.15.132:0/3006892476 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9984040070 con 0x7f9994091b50 2024-04-26T12:30:02.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.076+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f999406c240 con 0x7f9994091b50 2024-04-26T12:30:02.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.077+0000 7f998affd640 1 -- 172.21.15.132:0/3006892476 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9770 (secure 0 0 0) 0x7f99840393b0 con 0x7f9994091b50 2024-04-26T12:30:02.078 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:30:02.078 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"fsid":"9f7de4b1-7365-4f06-b9fa-64d18aa7a81a","created":"2024-04-26T12:29:44.344147+0000","modified":"2024-04-26T12:30:01.433694+0000","last_up_change":"2024-04-26T12:29:53.417591+0000","last_in_change":"2024-04-26T12:29:45.365550+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:29:52.451035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:29:59.844405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8400be6-015a-46df-8e1a-eda2d0564826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6801","nonce":965566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6803","nonce":965566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6807","nonce":965566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6805","nonce":965566727}]},"public_addr":"172.21.15.132:6801/965566727","cluster_addr":"172.21.15.132:6803/965566727","heartbeat_back_addr":"172.21.15.132:6807/965566727","heartbeat_front_addr":"172.21.15.132:6805/965566727","state":["exists","up"]},{"osd":1,"uuid":"09f70d93-7270-42cb-8c52-5450d8b43f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6809","nonce":2372702203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6811","nonce":2372702203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6815","nonce":2372702203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6813","nonce":2372702203}]},"public_addr":"172.21.15.170:6809/2372702203","cluster_addr":"172.21.15.170:6811/2372702203","heartbeat_back_addr":"172.21.15.170:6815/2372702203","heartbeat_front_addr":"172.21.15.170:6813/2372702203","state":["exists","up"]},{"osd":2,"uuid":"87ce142d-2672-47e3-a4fc-29bd7e850b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6801","nonce":1189813177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6803","nonce":1189813177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6807","nonce":1189813177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6805","nonce":1189813177}]},"public_addr":"172.21.15.170:6801/1189813177","cluster_addr":"172.21.15.170:6803/1189813177","heartbeat_back_addr":"172.21.15.170:6807/1189813177","heartbeat_front_addr":"172.21.15.170:6805/1189813177","state":["exists","up"]},{"osd":3,"uuid":"10a2c4a7-0c41-40a3-a637-9ded1c128461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6817","nonce":2349137764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6819","nonce":2349137764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6823","nonce":2349137764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6821","nonce":2349137764}]},"public_addr":"172.21.15.170:6817/2349137764","cluster_addr":"172.21.15.170:6819/2349137764","heartbeat_back_addr":"172.21.15.170:6823/2349137764","heartbeat_front_addr":"172.21.15.170:6821/2349137764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.386095+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.547314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:51.195588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.528970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9974038060 msgr2=0x7f997403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9974038060 0x7f997403a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f997c000f60 tx=0x7f997c007a80 comp rx=0 tx=0).stop 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 msgr2=0x7f99941264b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f99941264b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9984009720 tx=0x7f99840046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 shutdown_connections 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9974038060 0x7f997403a520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 --2- 172.21.15.132:0/3006892476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9994091b50 0x7f99941264b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 >> 172.21.15.132:0/3006892476 conn(0x7f999409fdd0 msgr2=0x7f999412d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 shutdown_connections 2024-04-26T12:30:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.079+0000 7f9998ba4640 1 -- 172.21.15.132:0/3006892476 wait complete. 2024-04-26T12:30:02.091 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:30:02.092 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.185+0000 7f6237123640 1 Processor -- start 2024-04-26T12:30:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.185+0000 7f6237123640 1 -- start start 2024-04-26T12:30:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.185+0000 7f6237123640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62301280d0 0x7f62301284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.185+0000 7f6237123640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623006b3f0 con 0x7f623012b180 2024-04-26T12:30:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.185+0000 7f6237123640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f6230127c80 con 0x7f62301280d0 2024-04-26T12:30:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.186+0000 7f6234ebf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62301280d0 0x7f62301284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.186+0000 7f622ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f623012b180 0x7f623012b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48818/0 (socket says 172.21.15.132:48818) 2024-04-26T12:30:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.186+0000 7f622ffff640 1 -- 172.21.15.132:0/121926063 learned_addr learned my addr 172.21.15.132:0/121926063 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.186+0000 7f6234ebf640 1 -- 172.21.15.132:0/121926063 >> v1:172.21.15.132:6789/0 conn(0x7f623012b180 legacy=0x7f623012b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.186+0000 7f6234ebf640 1 -- 172.21.15.132:0/121926063 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623006ef00 con 0x7f62301280d0 2024-04-26T12:30:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.186+0000 7f6234ebf640 1 --2- 172.21.15.132:0/121926063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301284b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6224009720 tx=0x7f622402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a6b8505a8533fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f622f7fe640 1 -- 172.21.15.132:0/121926063 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62240316d0 con 0x7f62301280d0 2024-04-26T12:30:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f622f7fe640 1 -- 172.21.15.132:0/121926063 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224037070 con 0x7f62301280d0 2024-04-26T12:30:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f622f7fe640 1 -- 172.21.15.132:0/121926063 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62240319c0 con 0x7f62301280d0 2024-04-26T12:30:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f6237123640 1 -- 172.21.15.132:0/121926063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 msgr2=0x7f62301284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f6237123640 1 --2- 172.21.15.132:0/121926063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301284b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6224009720 tx=0x7f622402b840 comp rx=0 tx=0).stop 2024-04-26T12:30:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f6237123640 1 -- 172.21.15.132:0/121926063 shutdown_connections 2024-04-26T12:30:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f6237123640 1 --2- 172.21.15.132:0/121926063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301284b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f6237123640 1 -- 172.21.15.132:0/121926063 >> 172.21.15.132:0/121926063 conn(0x7f623009b7b0 msgr2=0x7f623009bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f6237123640 1 -- 172.21.15.132:0/121926063 shutdown_connections 2024-04-26T12:30:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.187+0000 7f6237123640 1 -- 172.21.15.132:0/121926063 wait complete. 2024-04-26T12:30:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.188+0000 7f6237123640 1 Processor -- start 2024-04-26T12:30:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.188+0000 7f6237123640 1 -- start start 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6237123640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6237123640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f623008d030 con 0x7f62301280d0 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6234ebf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6234ebf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301bdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60252/0 (socket says 172.21.15.132:60252) 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6234ebf640 1 -- 172.21.15.132:0/2923759477 learned_addr learned my addr 172.21.15.132:0/2923759477 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6234ebf640 1 -- 172.21.15.132:0/2923759477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6230070ea0 con 0x7f62301280d0 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6234ebf640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301bdcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6224034040 tx=0x7f62240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f622d7fa640 1 -- 172.21.15.132:0/2923759477 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224032770 con 0x7f62301280d0 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f622d7fa640 1 -- 172.21.15.132:0/2923759477 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224032930 con 0x7f62301280d0 2024-04-26T12:30:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623006f900 con 0x7f62301280d0 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f622d7fa640 1 -- 172.21.15.132:0/2923759477 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224032c50 con 0x7f62301280d0 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.189+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62300707d0 con 0x7f62301280d0 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.190+0000 7f622d7fa640 1 -- 172.21.15.132:0/2923759477 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f622404c060 con 0x7f62301280d0 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.190+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6230125190 con 0x7f62301280d0 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.190+0000 7f622d7fa640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6214038060 0x7f621403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.190+0000 7f622d7fa640 1 -- 172.21.15.132:0/2923759477 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7f622402f050 con 0x7f62301280d0 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.191+0000 7f622ffff640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6214038060 0x7f621403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.191+0000 7f622ffff640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6214038060 0x7f621403a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f621c007fd0 tx=0x7f621c007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.195+0000 7f622d7fa640 1 -- 172.21.15.132:0/2923759477 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6230070ea0 con 0x7f62301280d0 2024-04-26T12:30:02.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.367+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6230062ed0 con 0x7f62301280d0 2024-04-26T12:30:02.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.368+0000 7f622d7fa640 1 -- 172.21.15.132:0/2923759477 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9770 (secure 0 0 0) 0x7f6224040070 con 0x7f62301280d0 2024-04-26T12:30:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:30:02.369 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"fsid":"9f7de4b1-7365-4f06-b9fa-64d18aa7a81a","created":"2024-04-26T12:29:44.344147+0000","modified":"2024-04-26T12:30:01.433694+0000","last_up_change":"2024-04-26T12:29:53.417591+0000","last_in_change":"2024-04-26T12:29:45.365550+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:29:52.451035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:29:59.844405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8400be6-015a-46df-8e1a-eda2d0564826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6801","nonce":965566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6803","nonce":965566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6807","nonce":965566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6805","nonce":965566727}]},"public_addr":"172.21.15.132:6801/965566727","cluster_addr":"172.21.15.132:6803/965566727","heartbeat_back_addr":"172.21.15.132:6807/965566727","heartbeat_front_addr":"172.21.15.132:6805/965566727","state":["exists","up"]},{"osd":1,"uuid":"09f70d93-7270-42cb-8c52-5450d8b43f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6809","nonce":2372702203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6811","nonce":2372702203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6815","nonce":2372702203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6813","nonce":2372702203}]},"public_addr":"172.21.15.170:6809/2372702203","cluster_addr":"172.21.15.170:6811/2372702203","heartbeat_back_addr":"172.21.15.170:6815/2372702203","heartbeat_front_addr":"172.21.15.170:6813/2372702203","state":["exists","up"]},{"osd":2,"uuid":"87ce142d-2672-47e3-a4fc-29bd7e850b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6801","nonce":1189813177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6803","nonce":1189813177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6807","nonce":1189813177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6805","nonce":1189813177}]},"public_addr":"172.21.15.170:6801/1189813177","cluster_addr":"172.21.15.170:6803/1189813177","heartbeat_back_addr":"172.21.15.170:6807/1189813177","heartbeat_front_addr":"172.21.15.170:6805/1189813177","state":["exists","up"]},{"osd":3,"uuid":"10a2c4a7-0c41-40a3-a637-9ded1c128461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6817","nonce":2349137764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6819","nonce":2349137764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6823","nonce":2349137764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6821","nonce":2349137764}]},"public_addr":"172.21.15.170:6817/2349137764","cluster_addr":"172.21.15.170:6819/2349137764","heartbeat_back_addr":"172.21.15.170:6823/2349137764","heartbeat_front_addr":"172.21.15.170:6821/2349137764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.386095+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.547314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:51.195588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.528970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:02.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6214038060 msgr2=0x7f621403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6214038060 0x7f621403a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f621c007fd0 tx=0x7f621c007ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 msgr2=0x7f62301bdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301bdcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6224034040 tx=0x7f62240046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 shutdown_connections 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6214038060 0x7f621403a520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 --2- 172.21.15.132:0/2923759477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62301280d0 0x7f62301bdcb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 >> 172.21.15.132:0/2923759477 conn(0x7f623009b7b0 msgr2=0x7f62301b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 shutdown_connections 2024-04-26T12:30:02.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.370+0000 7f6237123640 1 -- 172.21.15.132:0/2923759477 wait complete. 2024-04-26T12:30:02.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:30:02.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:30:02.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:30:02.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T12:30:02.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7fd26d567640 1 Processor -- start 2024-04-26T12:30:02.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7f1515e0f640 1 Processor -- start 2024-04-26T12:30:02.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7fe0c2c31640 1 Processor -- start 2024-04-26T12:30:02.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7f1515e0f640 1 -- start start 2024-04-26T12:30:02.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7ff2bc4c8640 1 Processor -- start 2024-04-26T12:30:02.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7fe0c2c31640 1 -- start start 2024-04-26T12:30:02.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7ff2bc4c8640 1 -- start start 2024-04-26T12:30:02.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7fd26d567640 1 -- start start 2024-04-26T12:30:02.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7f1515e0f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f151006f540 0x7f15101336d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7f1515e0f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151006fcb0 con 0x7f1510099d40 2024-04-26T12:30:02.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7f1515e0f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f151006fe80 con 0x7f151006f540 2024-04-26T12:30:02.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7fd26d567640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd268115890 0x7fd268137f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.484+0000 7fe0c2c31640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0bc099c50 0x7fe0bc09a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fe0c2c31640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0bc072610 con 0x7fe0bc09a570 2024-04-26T12:30:02.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fe0c2c31640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe0bc0723e0 con 0x7fe0bc099c50 2024-04-26T12:30:02.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd26d567640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd268115ca0 con 0x7fd268114da0 2024-04-26T12:30:02.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7ff2bc4c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2b4093fe0 0x7ff2b4131940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7ff2bc4c8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b406cd70 con 0x7ff2b40934f0 2024-04-26T12:30:02.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7ff2bc4c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b406dca0 con 0x7ff2b4093fe0 2024-04-26T12:30:02.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1510099d40 0x7f151009a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48834/0 (socket says 172.21.15.132:48834) 2024-04-26T12:30:02.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150f7fe640 1 -- 172.21.15.132:0/649813113 learned_addr learned my addr 172.21.15.132:0/649813113 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:02.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd26d567640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd268115f30 con 0x7fd268115890 2024-04-26T12:30:02.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd266ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd268114da0 0x7fd268115180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48842/0 (socket says 172.21.15.132:48842) 2024-04-26T12:30:02.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd266ffd640 1 -- 172.21.15.132:0/3813888613 learned_addr learned my addr 172.21.15.132:0/3813888613 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:02.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fe0c09cd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0bc099c50 0x7fe0bc09a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fe0c09cd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0bc099c50 0x7fe0bc09a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60264/0 (socket says 172.21.15.132:60264) 2024-04-26T12:30:02.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fe0c09cd640 1 -- 172.21.15.132:0/3173256483 learned_addr learned my addr 172.21.15.132:0/3173256483 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279296985 0 0) 0x7f151006fcb0 con 0x7f1510099d40 2024-04-26T12:30:02.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd2667fc640 1 --2- 172.21.15.132:0/3813888613 >> v2:172.21.15.132:3300/0 conn(0x7fd268115890 0x7fd268137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14f8003520 con 0x7f1510099d40 2024-04-26T12:30:02.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd265ffb640 1 -- 172.21.15.132:0/3813888613 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907756343 0 0) 0x7fd268115ca0 con 0x7fd268114da0 2024-04-26T12:30:02.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150effd640 1 --2- 172.21.15.132:0/649813113 >> v2:172.21.15.132:3300/0 conn(0x7f151006f540 0x7f15101336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd265ffb640 1 -- 172.21.15.132:0/3813888613 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd250003520 con 0x7fd268114da0 2024-04-26T12:30:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7ff2ba264640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff2b40934f0 0x7ff2b40938d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48852/0 (socket says 172.21.15.132:48852) 2024-04-26T12:30:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 876745485 0 0) 0x7f14f8003520 con 0x7f1510099d40 2024-04-26T12:30:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7ff2ba264640 1 -- 172.21.15.132:0/2072720649 learned_addr learned my addr 172.21.15.132:0/2072720649 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:02.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7ff2b9a63640 1 --2- 172.21.15.132:0/2072720649 >> v2:172.21.15.132:3300/0 conn(0x7ff2b4093fe0 0x7ff2b4131940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fe0c09cd640 1 -- 172.21.15.132:0/3173256483 >> v1:172.21.15.132:6789/0 conn(0x7fe0bc09a570 legacy=0x7fe0bc12c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T12:30:02.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fe0c09cd640 1 -- 172.21.15.132:0/3173256483 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc071750 con 0x7fe0bc099c50 2024-04-26T12:30:02.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 >> v2:172.21.15.132:3300/0 conn(0x7f151006f540 msgr2=0x7f15101336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T12:30:02.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 --2- 172.21.15.132:0/649813113 >> v2:172.21.15.132:3300/0 conn(0x7f151006f540 0x7f15101336d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150effd640 1 --2- 172.21.15.132:0/649813113 >> v2:172.21.15.132:3300/0 conn(0x7f151006f540 0x7f15101336d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T12:30:02.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151009a830 con 0x7f1510099d40 2024-04-26T12:30:02.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1243349309 0 0) 0x7f15000015a0 con 0x7f1510099d40 2024-04-26T12:30:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 >> v1:172.21.15.132:6789/0 conn(0x7f1510099d40 legacy=0x7f151009a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 --2- 172.21.15.132:0/649813113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f14f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f151006fe80 con 0x7f14f8003a00 2024-04-26T12:30:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd265ffb640 1 -- 172.21.15.132:0/3813888613 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 676091818 0 0) 0x7fd250003520 con 0x7fd268114da0 2024-04-26T12:30:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd2667fc640 1 -- 172.21.15.132:0/3813888613 >> v1:172.21.15.132:6789/0 conn(0x7fd268114da0 legacy=0x7fd268115180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.485+0000 7fd2667fc640 1 -- 172.21.15.132:0/3813888613 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2681165f0 con 0x7fd268115890 2024-04-26T12:30:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7f150f7fe640 1 --2- 172.21.15.132:0/649813113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f14f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7ff2b9262640 1 -- 172.21.15.132:0/2072720649 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647930199 0 0) 0x7ff2b406cd70 con 0x7ff2b40934f0 2024-04-26T12:30:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7ff2b9262640 1 -- 172.21.15.132:0/2072720649 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a0003520 con 0x7ff2b40934f0 2024-04-26T12:30:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7ff2b9262640 1 -- 172.21.15.132:0/2072720649 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3032059374 0 0) 0x7ff2a0003520 con 0x7ff2b40934f0 2024-04-26T12:30:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7ff2b9a63640 1 -- 172.21.15.132:0/2072720649 >> v1:172.21.15.132:6789/0 conn(0x7ff2b40934f0 legacy=0x7ff2b40938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7ff2b9a63640 1 -- 172.21.15.132:0/2072720649 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b409dc40 con 0x7ff2b4093fe0 2024-04-26T12:30:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7fd2667fc640 1 --2- 172.21.15.132:0/3813888613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268115890 0x7fd268137f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009720 tx=0x7fd25c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c78e03f15b1afb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7fd265ffb640 1 -- 172.21.15.132:0/3813888613 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd25c037070 con 0x7fd268115890 2024-04-26T12:30:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7fd265ffb640 1 -- 172.21.15.132:0/3813888613 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25c030510 con 0x7fd268115890 2024-04-26T12:30:02.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7fd265ffb640 1 -- 172.21.15.132:0/3813888613 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2580015a0 con 0x7fd268115890 2024-04-26T12:30:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7fe0c09cd640 1 --2- 172.21.15.132:0/3173256483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc09a030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00097f0 tx=0x7fe0b002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239d4fb5cb4392cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.486+0000 7f150f7fe640 1 -- 172.21.15.132:0/649813113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f8003520 con 0x7f14f8003a00 2024-04-26T12:30:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fe0bb7fe640 1 -- 172.21.15.132:0/3173256483 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b002e070 con 0x7fe0bc099c50 2024-04-26T12:30:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fe0bb7fe640 1 -- 172.21.15.132:0/3173256483 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b0037070 con 0x7fe0bc099c50 2024-04-26T12:30:02.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fe0bb7fe640 1 -- 172.21.15.132:0/3173256483 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b0031730 con 0x7fe0bc099c50 2024-04-26T12:30:02.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7ff2b9a63640 1 --2- 172.21.15.132:0/2072720649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b4093fe0 0x7ff2b4131940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009720 tx=0x7ff2a402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db8eace779c4dcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7ff2b9262640 1 -- 172.21.15.132:0/2072720649 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2a4037070 con 0x7ff2b4093fe0 2024-04-26T12:30:02.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7ff2b9262640 1 -- 172.21.15.132:0/2072720649 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a4030510 con 0x7ff2b4093fe0 2024-04-26T12:30:02.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fd26d567640 1 -- 172.21.15.132:0/3813888613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268115890 msgr2=0x7fd268137f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fd26d567640 1 --2- 172.21.15.132:0/3813888613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268115890 0x7fd268137f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009720 tx=0x7fd25c02b710 comp rx=0 tx=0).stop 2024-04-26T12:30:02.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7ff2b9262640 1 -- 172.21.15.132:0/2072720649 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b00015a0 con 0x7ff2b4093fe0 2024-04-26T12:30:02.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fd26d567640 1 -- 172.21.15.132:0/3813888613 shutdown_connections 2024-04-26T12:30:02.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fd26d567640 1 --2- 172.21.15.132:0/3813888613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268115890 0x7fd268137f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fd26d567640 1 -- 172.21.15.132:0/3813888613 >> 172.21.15.132:0/3813888613 conn(0x7fd26809b430 msgr2=0x7fd26809b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fd26d567640 1 -- 172.21.15.132:0/3813888613 shutdown_connections 2024-04-26T12:30:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7fd26d567640 1 -- 172.21.15.132:0/3813888613 wait complete. 2024-04-26T12:30:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.487+0000 7f150f7fe640 1 --2- 172.21.15.132:0/649813113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f14f8003e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1500007f40 tx=0x7f14f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728381b86580ceb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1500007be0 con 0x7f14f8003a00 2024-04-26T12:30:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fe0c2c31640 1 -- 172.21.15.132:0/3173256483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 msgr2=0x7fe0bc09a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/3173256483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc09a030 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00097f0 tx=0x7fe0b002b880 comp rx=0 tx=0).stop 2024-04-26T12:30:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500030070 con 0x7f14f8003a00 2024-04-26T12:30:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7f150e7fc640 1 -- 172.21.15.132:0/649813113 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f150002cbd0 con 0x7f14f8003a00 2024-04-26T12:30:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fe0c2c31640 1 -- 172.21.15.132:0/3173256483 shutdown_connections 2024-04-26T12:30:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/3173256483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc09a030 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fe0c2c31640 1 -- 172.21.15.132:0/3173256483 >> 172.21.15.132:0/3173256483 conn(0x7fe0bc09b330 msgr2=0x7fe0bc09b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fe0c2c31640 1 -- 172.21.15.132:0/3173256483 shutdown_connections 2024-04-26T12:30:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fe0c2c31640 1 -- 172.21.15.132:0/3173256483 wait complete. 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2072720649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b4093fe0 msgr2=0x7ff2b4131940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2072720649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b4093fe0 0x7ff2b4131940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4009720 tx=0x7ff2a402b710 comp rx=0 tx=0).stop 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2072720649 shutdown_connections 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2072720649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b4093fe0 0x7ff2b4131940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2072720649 >> 172.21.15.132:0/2072720649 conn(0x7ff2b409a480 msgr2=0x7ff2b409d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2072720649 shutdown_connections 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2072720649 wait complete. 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7f1515e0f640 1 -- 172.21.15.132:0/649813113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 msgr2=0x7f14f8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7f1515e0f640 1 --2- 172.21.15.132:0/649813113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f14f8003e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1500007f40 tx=0x7f14f8005830 comp rx=0 tx=0).stop 2024-04-26T12:30:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.488+0000 7fd26d567640 1 Processor -- start 2024-04-26T12:30:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fd26d567640 1 -- start start 2024-04-26T12:30:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7f1515e0f640 1 -- 172.21.15.132:0/649813113 shutdown_connections 2024-04-26T12:30:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7f1515e0f640 1 --2- 172.21.15.132:0/649813113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f14f8003e00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7f1515e0f640 1 --2- 172.21.15.132:0/649813113 >> v2:172.21.15.132:3300/0 conn(0x7f151006f540 0x7f15101336d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7f1515e0f640 1 -- 172.21.15.132:0/649813113 >> 172.21.15.132:0/649813113 conn(0x7f151009b330 msgr2=0x7f151009b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7f1515e0f640 1 -- 172.21.15.132:0/649813113 shutdown_connections 2024-04-26T12:30:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7f1515e0f640 1 -- 172.21.15.132:0/649813113 wait complete. 2024-04-26T12:30:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fe0c2c31640 1 Processor -- start 2024-04-26T12:30:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fe0c2c31640 1 -- start start 2024-04-26T12:30:02.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fd26d567640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268114da0 0x7fd2681aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fd26d567640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd268116b20 con 0x7fd268114da0 2024-04-26T12:30:02.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fd266ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268114da0 0x7fd2681aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fd266ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268114da0 0x7fd2681aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60306/0 (socket says 172.21.15.132:60306) 2024-04-26T12:30:02.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fd266ffd640 1 -- 172.21.15.132:0/4045004247 learned_addr learned my addr 172.21.15.132:0/4045004247 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7fd266ffd640 1 -- 172.21.15.132:0/4045004247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2681adb60 con 0x7fd268114da0 2024-04-26T12:30:02.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.489+0000 7f1515e0f640 1 Processor -- start 2024-04-26T12:30:02.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fd266ffd640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268114da0 0x7fd2681aa650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd258001710 tx=0x7fd25800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fe0c2c31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc1c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fe0c2c31640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc12cc30 con 0x7fe0bc099c50 2024-04-26T12:30:02.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7f1515e0f640 1 -- start start 2024-04-26T12:30:02.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7ff2bc4c8640 1 Processor -- start 2024-04-26T12:30:02.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fe0c09cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc1c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fe0c09cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc1c1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60318/0 (socket says 172.21.15.132:60318) 2024-04-26T12:30:02.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fe0c09cd640 1 -- 172.21.15.132:0/4103010489 learned_addr learned my addr 172.21.15.132:0/4103010489 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2580058d0 con 0x7fd268114da0 2024-04-26T12:30:02.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7ff2bc4c8640 1 -- start start 2024-04-26T12:30:02.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd258005a70 con 0x7fd268114da0 2024-04-26T12:30:02.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2681ba8f0 con 0x7fd268114da0 2024-04-26T12:30:02.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd258005d90 con 0x7fd268114da0 2024-04-26T12:30:02.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2681ade70 con 0x7fd268114da0 2024-04-26T12:30:02.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fe0c09cd640 1 -- 172.21.15.132:0/4103010489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc11b600 con 0x7fe0bc099c50 2024-04-26T12:30:02.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7f1515e0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f15101190b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7ff2bc4c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b40934f0 0x7ff2b41c1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7ff2bc4c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b4132000 con 0x7ff2b40934f0 2024-04-26T12:30:02.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7f1515e0f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1510133e20 con 0x7f14f8003a00 2024-04-26T12:30:02.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.490+0000 7fe0c09cd640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc1c1200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000c00 tx=0x7fe0b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b00327b0 con 0x7fe0bc099c50 2024-04-26T12:30:02.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7f150f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f15101190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc11ce40 con 0x7fe0bc099c50 2024-04-26T12:30:02.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7f150f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f15101190b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60328/0 (socket says 172.21.15.132:60328) 2024-04-26T12:30:02.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7f150f7fe640 1 -- 172.21.15.132:0/78271540 learned_addr learned my addr 172.21.15.132:0/78271540 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7ff2ba264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b40934f0 0x7ff2b41c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b0032970 con 0x7fe0bc099c50 2024-04-26T12:30:02.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7ff2ba264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b40934f0 0x7ff2b41c1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60332/0 (socket says 172.21.15.132:60332) 2024-04-26T12:30:02.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0b0032c90 con 0x7fe0bc099c50 2024-04-26T12:30:02.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7ff2ba264640 1 -- 172.21.15.132:0/2932427159 learned_addr learned my addr 172.21.15.132:0/2932427159 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1c1740 con 0x7fe0bc099c50 2024-04-26T12:30:02.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2681ba4f0 con 0x7fd268114da0 2024-04-26T12:30:02.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7f150f7fe640 1 -- 172.21.15.132:0/78271540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151011a810 con 0x7f14f8003a00 2024-04-26T12:30:02.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd258007070 con 0x7fd268114da0 2024-04-26T12:30:02.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7fd24f7fe640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd2540380b0 0x7fd25403a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.491+0000 7ff2ba264640 1 -- 172.21.15.132:0/2932427159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b4073570 con 0x7ff2b40934f0 2024-04-26T12:30:02.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fd25804ae10 con 0x7fd268114da0 2024-04-26T12:30:02.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7f150f7fe640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f15101190b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f150002c550 tx=0x7f150002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fd24f7fe640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd25403d830 0x7fd25403fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe0b004e430 con 0x7fe0bc099c50 2024-04-26T12:30:02.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd25801de70 con 0x7fd25403d830 2024-04-26T12:30:02.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd258011600 con 0x7fd268114da0 2024-04-26T12:30:02.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7ff2ba264640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b40934f0 0x7ff2b41c1320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c6b0 tx=0x7ff2b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fd2667fc640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd2540380b0 0x7fd25403a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fd2677fe640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd25403d830 0x7fd25403fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0b97fa640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe0a0038090 0x7fe0a003a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe09c000f80 con 0x7fe0bc099c50 2024-04-26T12:30:02.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fe0b006cf30 con 0x7fe0bc099c50 2024-04-26T12:30:02.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1500046070 con 0x7f14f8003a00 2024-04-26T12:30:02.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500004d70 con 0x7f14f8003a00 2024-04-26T12:30:02.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1500007070 con 0x7f14f8003a00 2024-04-26T12:30:02.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b0017070 con 0x7ff2b40934f0 2024-04-26T12:30:02.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1510132ec0 con 0x7f14f8003a00 2024-04-26T12:30:02.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b00058d0 con 0x7ff2b40934f0 2024-04-26T12:30:02.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b41238d0 con 0x7ff2b40934f0 2024-04-26T12:30:02.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0b97fa640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7fe0a003d810 0x7fe0a003fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0b0034e50 con 0x7fe0a003d810 2024-04-26T12:30:02.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b4123be0 con 0x7ff2b40934f0 2024-04-26T12:30:02.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151011c050 con 0x7f14f8003a00 2024-04-26T12:30:02.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fe0b0030920 con 0x7fe0bc099c50 2024-04-26T12:30:02.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0bbfff640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe0a0038090 0x7fe0a003a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7fd2677fe640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd25403d830 0x7fd25403fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7fe0c11ce640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7fe0a003d810 0x7fe0a003fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7fd2667fc640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd2540380b0 0x7fd25403a570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd25c034000 tx=0x7fd25c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7fe0c11ce640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7fe0a003d810 0x7fe0a003fc50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.492+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2b0005bf0 con 0x7ff2b40934f0 2024-04-26T12:30:02.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff2b001a070 con 0x7ff2b40934f0 2024-04-26T12:30:02.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15100685e0 con 0x7f14f8003a00 2024-04-26T12:30:02.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7ff2aaffd640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff298038060 0x7ff29803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff29c000f80 con 0x7ff2b40934f0 2024-04-26T12:30:02.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd25801de70 con 0x7fd25403d830 2024-04-26T12:30:02.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.493+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7ff2b004a360 con 0x7ff2b40934f0 2024-04-26T12:30:02.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7ff2b9a63640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff298038060 0x7ff29803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7ff2aaffd640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7ff29803d7e0 0x7ff29803fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2980402f0 con 0x7ff29803d7e0 2024-04-26T12:30:02.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ff2b00106c0 con 0x7ff2b40934f0 2024-04-26T12:30:02.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7fe0bbfff640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe0a0038090 0x7fe0a003a550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc09a9c0 tx=0x7fe0a8007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7ff2baa65640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7ff29803d7e0 0x7ff29803fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1500007210 con 0x7f14f8003a00 2024-04-26T12:30:02.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0b0034e50 con 0x7fe0a003d810 2024-04-26T12:30:02.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7f14f7fff640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f14fc0380b0 0x7f14fc03a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7ff2baa65640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7ff29803d7e0 0x7ff29803fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7ff2b9a63640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff298038060 0x7ff29803a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4034000 tx=0x7ff2a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f150006d4a0 con 0x7f14f8003a00 2024-04-26T12:30:02.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7f14f7fff640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f14fc03d830 0x7f14fc03fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1500007740 con 0x7f14fc03d830 2024-04-26T12:30:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f150006d7a0 con 0x7f14f8003a00 2024-04-26T12:30:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.494+0000 7f150effd640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f14fc0380b0 0x7f14fc03a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.495+0000 7f150ffff640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f14fc03d830 0x7f14fc03fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.495+0000 7f150effd640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f14fc0380b0 0x7f14fc03a570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1510072680 tx=0x7f1504008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.495+0000 7f150ffff640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f14fc03d830 0x7f14fc03fc70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.495+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2980402f0 con 0x7ff29803d7e0 2024-04-26T12:30:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.496+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1500007740 con 0x7f14fc03d830 2024-04-26T12:30:02.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.508+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe09c002c70 con 0x7fe0a003d810 2024-04-26T12:30:02.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0b97fa640 1 -- 172.21.15.132:0/4103010489 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe09c002c70 con 0x7fe0a003d810 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7fe0a003d810 msgr2=0x7fe0a003fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7fe0a003d810 0x7fe0a003fc50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe0a0038090 msgr2=0x7fe0a003a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe0a0038090 0x7fe0a003a550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc09a9c0 tx=0x7fe0a8007a30 comp rx=0 tx=0).stop 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 msgr2=0x7fe0bc1c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc1c1200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0000c00 tx=0x7fe0b00046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 shutdown_connections 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7fe0a003d810 0x7fe0a003fc50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe0a0038090 0x7fe0a003a550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 --2- 172.21.15.132:0/4103010489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc099c50 0x7fe0bc1c1200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 >> 172.21.15.132:0/4103010489 conn(0x7fe0bc09b330 msgr2=0x7fe0bc128740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 shutdown_connections 2024-04-26T12:30:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.509+0000 7fe0c2c31640 1 -- 172.21.15.132:0/4103010489 wait complete. 2024-04-26T12:30:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff29c002bf0 con 0x7ff29803d7e0 2024-04-26T12:30:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2aaffd640 1 -- 172.21.15.132:0/2932427159 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff29c002bf0 con 0x7ff29803d7e0 2024-04-26T12:30:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7ff29803d7e0 msgr2=0x7ff29803fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7ff29803d7e0 0x7ff29803fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff298038060 msgr2=0x7ff29803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff298038060 0x7ff29803a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4034000 tx=0x7ff2a4008030 comp rx=0 tx=0).stop 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b40934f0 msgr2=0x7ff2b41c1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b40934f0 0x7ff2b41c1320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c6b0 tx=0x7ff2b000cb70 comp rx=0 tx=0).stop 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 shutdown_connections 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7ff29803d7e0 0x7ff29803fc20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff298038060 0x7ff29803a520 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 --2- 172.21.15.132:0/2932427159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b40934f0 0x7ff2b41c1320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.510+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 >> 172.21.15.132:0/2932427159 conn(0x7ff2b409a480 msgr2=0x7ff2b4070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.511+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 shutdown_connections 2024-04-26T12:30:02.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.511+0000 7ff2bc4c8640 1 -- 172.21.15.132:0/2932427159 wait complete. 2024-04-26T12:30:02.536 INFO:teuthology.orchestra.run.smithi132.stdout:42949672965 2024-04-26T12:30:02.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:30:02.537 INFO:teuthology.orchestra.run.smithi132.stdout:38654705670 2024-04-26T12:30:02.537 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.525+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd268062ed0 con 0x7fd25403d830 2024-04-26T12:30:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd24f7fe640 1 -- 172.21.15.132:0/4045004247 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd268062ed0 con 0x7fd25403d830 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd25403d830 msgr2=0x7fd25403fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd25403d830 0x7fd25403fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd2540380b0 msgr2=0x7fd25403a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd2540380b0 0x7fd25403a570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd25c034000 tx=0x7fd25c008030 comp rx=0 tx=0).stop 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268114da0 msgr2=0x7fd2681aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268114da0 0x7fd2681aa650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd258001710 tx=0x7fd25800cb80 comp rx=0 tx=0).stop 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 shutdown_connections 2024-04-26T12:30:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd25403d830 0x7fd25403fc70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd2540380b0 0x7fd25403a570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 --2- 172.21.15.132:0/4045004247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd268114da0 0x7fd2681aa650 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 >> 172.21.15.132:0/4045004247 conn(0x7fd26809b430 msgr2=0x7fd2681bab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 shutdown_connections 2024-04-26T12:30:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.526+0000 7fd26d567640 1 -- 172.21.15.132:0/4045004247 wait complete. 2024-04-26T12:30:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.527+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f151011be50 con 0x7f14fc03d830 2024-04-26T12:30:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.527+0000 7f14f7fff640 1 -- 172.21.15.132:0/78271540 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f151011be50 con 0x7f14fc03d830 2024-04-26T12:30:02.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f14fc03d830 msgr2=0x7f14fc03fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f14fc03d830 0x7f14fc03fc70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f14fc0380b0 msgr2=0x7f14fc03a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f14fc0380b0 0x7f14fc03a570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1510072680 tx=0x7f1504008040 comp rx=0 tx=0).stop 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 msgr2=0x7f15101190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f15101190b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f150002c550 tx=0x7f150002e070 comp rx=0 tx=0).stop 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 shutdown_connections 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f14fc03d830 0x7f14fc03fc70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f14fc0380b0 0x7f14fc03a570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 --2- 172.21.15.132:0/78271540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14f8003a00 0x7f15101190b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 >> 172.21.15.132:0/78271540 conn(0x7f151009b330 msgr2=0x7f1510071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 shutdown_connections 2024-04-26T12:30:02.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.528+0000 7f1515e0f640 1 -- 172.21.15.132:0/78271540 wait complete. 2024-04-26T12:30:02.543 INFO:teuthology.orchestra.run.smithi132.stdout:38654705669 2024-04-26T12:30:02.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:02.544 INFO:teuthology.orchestra.run.smithi132.stdout:42949672965 2024-04-26T12:30:02.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:02.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc165ed2640 1 Processor -- start 2024-04-26T12:30:02.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc165ed2640 1 -- start start 2024-04-26T12:30:02.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc165ed2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc1600996e0 0x7fc160133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc165ed2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc160099b00 con 0x7fc160098bf0 2024-04-26T12:30:02.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc165ed2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc16009e050 con 0x7fc1600996e0 2024-04-26T12:30:02.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc15f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc160098bf0 0x7fc160098fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48854/0 (socket says 172.21.15.132:48854) 2024-04-26T12:30:02.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc15f7fe640 1 -- 172.21.15.132:0/3400777154 learned_addr learned my addr 172.21.15.132:0/3400777154 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:02.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.641+0000 7fc15effd640 1 --2- 172.21.15.132:0/3400777154 >> v2:172.21.15.132:3300/0 conn(0x7fc1600996e0 0x7fc160133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.642+0000 7fc15effd640 1 -- 172.21.15.132:0/3400777154 >> v1:172.21.15.132:6789/0 conn(0x7fc160098bf0 legacy=0x7fc160098fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.642+0000 7fc15e7fc640 1 -- 172.21.15.132:0/3400777154 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760018183 0 0) 0x7fc160099b00 con 0x7fc160098bf0 2024-04-26T12:30:02.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.642+0000 7fc15effd640 1 -- 172.21.15.132:0/3400777154 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16009a790 con 0x7fc1600996e0 2024-04-26T12:30:02.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.643+0000 7fc15effd640 1 --2- 172.21.15.132:0/3400777154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1600996e0 0x7fc160133a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc15402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4908ff4e3740080f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.643+0000 7fc15e7fc640 1 -- 172.21.15.132:0/3400777154 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1540316d0 con 0x7fc1600996e0 2024-04-26T12:30:02.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.643+0000 7fc15e7fc640 1 -- 172.21.15.132:0/3400777154 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc154037070 con 0x7fc1600996e0 2024-04-26T12:30:02.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.643+0000 7fc15e7fc640 1 -- 172.21.15.132:0/3400777154 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1540319c0 con 0x7fc1600996e0 2024-04-26T12:30:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.644+0000 7fc165ed2640 1 -- 172.21.15.132:0/3400777154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1600996e0 msgr2=0x7fc160133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.644+0000 7fc165ed2640 1 --2- 172.21.15.132:0/3400777154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1600996e0 0x7fc160133a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc15402b840 comp rx=0 tx=0).stop 2024-04-26T12:30:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.644+0000 7fc165ed2640 1 -- 172.21.15.132:0/3400777154 shutdown_connections 2024-04-26T12:30:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.644+0000 7fc165ed2640 1 --2- 172.21.15.132:0/3400777154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1600996e0 0x7fc160133a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.644+0000 7fc165ed2640 1 -- 172.21.15.132:0/3400777154 >> 172.21.15.132:0/3400777154 conn(0x7fc1600a0d10 msgr2=0x7fc16009d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.644+0000 7fc165ed2640 1 -- 172.21.15.132:0/3400777154 shutdown_connections 2024-04-26T12:30:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.644+0000 7fc165ed2640 1 -- 172.21.15.132:0/3400777154 wait complete. 2024-04-26T12:30:02.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.645+0000 7fc165ed2640 1 Processor -- start 2024-04-26T12:30:02.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.646+0000 7fc165ed2640 1 -- start start 2024-04-26T12:30:02.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.646+0000 7fc165ed2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc160098bf0 0x7fc160132850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.646+0000 7fc165ed2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc16009a140 con 0x7fc160098bf0 2024-04-26T12:30:02.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.646+0000 7fc15f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc160098bf0 0x7fc160132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc15f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc160098bf0 0x7fc160132850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60348/0 (socket says 172.21.15.132:60348) 2024-04-26T12:30:02.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc15f7fe640 1 -- 172.21.15.132:0/2564945331 learned_addr learned my addr 172.21.15.132:0/2564945331 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc15f7fe640 1 -- 172.21.15.132:0/2564945331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1600725a0 con 0x7fc160098bf0 2024-04-26T12:30:02.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc15f7fe640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc160098bf0 0x7fc160132850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c420 tx=0x7fc15000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc147fff640 1 -- 172.21.15.132:0/2564945331 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc150018070 con 0x7fc160098bf0 2024-04-26T12:30:02.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc147fff640 1 -- 172.21.15.132:0/2564945331 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1500074d0 con 0x7fc160098bf0 2024-04-26T12:30:02.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc147fff640 1 -- 172.21.15.132:0/2564945331 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc150004950 con 0x7fc160098bf0 2024-04-26T12:30:02.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1601261a0 con 0x7fc160098bf0 2024-04-26T12:30:02.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.647+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc160132d90 con 0x7fc160098bf0 2024-04-26T12:30:02.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.648+0000 7fc147fff640 1 -- 172.21.15.132:0/2564945331 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc15001b070 con 0x7fc160098bf0 2024-04-26T12:30:02.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.649+0000 7fc147fff640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc14c038060 0x7fc14c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.649+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16009bab0 con 0x7fc160098bf0 2024-04-26T12:30:02.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.649+0000 7fc147fff640 1 -- 172.21.15.132:0/2564945331 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fc15004a2c0 con 0x7fc160098bf0 2024-04-26T12:30:02.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.649+0000 7fc15effd640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc14c038060 0x7fc14c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.650+0000 7fc15effd640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc14c038060 0x7fc14c03a520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc154008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.657+0000 7fc147fff640 1 -- 172.21.15.132:0/2564945331 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc16009bab0 con 0x7fc160098bf0 2024-04-26T12:30:02.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c7d15640 1 Processor -- start 2024-04-26T12:30:02.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c7d15640 1 -- start start 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c7d15640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2c012f140 0x7fe2c01337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c7d15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c012e770 con 0x7fe2c0092ab0 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c7d15640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c006e3a0 con 0x7fe2c012f140 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c52b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2c012f140 0x7fe2c01337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c52b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2c012f140 0x7fe2c01337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60360/0 (socket says 172.21.15.132:60360) 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c5ab1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe2c0092ab0 0x7fe2c012ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48864/0 (socket says 172.21.15.132:48864) 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.688+0000 7fe2c52b0640 1 -- 172.21.15.132:0/236777053 learned_addr learned my addr 172.21.15.132:0/236777053 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.689+0000 7fe2c52b0640 1 -- 172.21.15.132:0/236777053 >> v1:172.21.15.132:6789/0 conn(0x7fe2c0092ab0 legacy=0x7fe2c012ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.689+0000 7fe2c52b0640 1 -- 172.21.15.132:0/236777053 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c006de80 con 0x7fe2c012f140 2024-04-26T12:30:02.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe2c52b0640 1 --2- 172.21.15.132:0/236777053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c012f140 0x7fe2c01337c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00097f0 tx=0x7fe2b002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93869e76882de99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe2c4aaf640 1 -- 172.21.15.132:0/236777053 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2b0037070 con 0x7fe2c012f140 2024-04-26T12:30:02.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe2c4aaf640 1 -- 172.21.15.132:0/236777053 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b0004160 con 0x7fe2c012f140 2024-04-26T12:30:02.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe2c4aaf640 1 -- 172.21.15.132:0/236777053 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2b00044a0 con 0x7fe2c012f140 2024-04-26T12:30:02.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe23f6eb640 1 Processor -- start 2024-04-26T12:30:02.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe23f6eb640 1 -- start start 2024-04-26T12:30:02.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe2c7d15640 1 -- 172.21.15.132:0/236777053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c012f140 msgr2=0x7fe2c01337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.690+0000 7fe2c7d15640 1 --2- 172.21.15.132:0/236777053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c012f140 0x7fe2c01337c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00097f0 tx=0x7fe2b002b7e0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23f6eb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2380996e0 0x7fe238133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23f6eb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe238099b00 con 0x7fe238098bf0 2024-04-26T12:30:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe2c7d15640 1 -- 172.21.15.132:0/236777053 shutdown_connections 2024-04-26T12:30:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe2c7d15640 1 --2- 172.21.15.132:0/236777053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c012f140 0x7fe2c01337c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe2c7d15640 1 -- 172.21.15.132:0/236777053 >> 172.21.15.132:0/236777053 conn(0x7fe2c00a0fc0 msgr2=0x7fe2c0090380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23f6eb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe23809e050 con 0x7fe2380996e0 2024-04-26T12:30:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23cc86640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2380996e0 0x7fe238133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23cc86640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2380996e0 0x7fe238133a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60372/0 (socket says 172.21.15.132:60372) 2024-04-26T12:30:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23cc86640 1 -- 172.21.15.132:0/2309088000 learned_addr learned my addr 172.21.15.132:0/2309088000 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe2c7d15640 1 -- 172.21.15.132:0/236777053 shutdown_connections 2024-04-26T12:30:02.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe2c7d15640 1 -- 172.21.15.132:0/236777053 wait complete. 2024-04-26T12:30:02.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23cc86640 1 -- 172.21.15.132:0/2309088000 >> v1:172.21.15.132:6789/0 conn(0x7fe238098bf0 legacy=0x7fe238098fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe23cc86640 1 -- 172.21.15.132:0/2309088000 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23809a790 con 0x7fe2380996e0 2024-04-26T12:30:02.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.691+0000 7fe22ffff640 1 -- 172.21.15.132:0/2309088000 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702274237 0 0) 0x7fe238099b00 con 0x7fe238098bf0 2024-04-26T12:30:02.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe2c7d15640 1 Processor -- start 2024-04-26T12:30:02.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe2c7d15640 1 -- start start 2024-04-26T12:30:02.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe23cc86640 1 --2- 172.21.15.132:0/2309088000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2380996e0 0x7fe238133a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097f0 tx=0x7fe22802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be8d3c095c9d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe22ffff640 1 -- 172.21.15.132:0/2309088000 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe228035020 con 0x7fe2380996e0 2024-04-26T12:30:02.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe22ffff640 1 -- 172.21.15.132:0/2309088000 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2280317a0 con 0x7fe2380996e0 2024-04-26T12:30:02.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe22ffff640 1 -- 172.21.15.132:0/2309088000 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe228031aa0 con 0x7fe2380996e0 2024-04-26T12:30:02.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe2c7d15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c0092ab0 0x7fe2c01c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe2c5ab1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c0092ab0 0x7fe2c01c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe2c5ab1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c0092ab0 0x7fe2c01c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60388/0 (socket says 172.21.15.132:60388) 2024-04-26T12:30:02.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe2c5ab1640 1 -- 172.21.15.132:0/2041534216 learned_addr learned my addr 172.21.15.132:0/2041534216 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.692+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c0134090 con 0x7fe2c0092ab0 2024-04-26T12:30:02.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe2c5ab1640 1 -- 172.21.15.132:0/2041534216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c0132d80 con 0x7fe2c0092ab0 2024-04-26T12:30:02.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe23f6eb640 1 -- 172.21.15.132:0/2309088000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2380996e0 msgr2=0x7fe238133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe23f6eb640 1 --2- 172.21.15.132:0/2309088000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2380996e0 0x7fe238133a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097f0 tx=0x7fe22802b910 comp rx=0 tx=0).stop 2024-04-26T12:30:02.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe23f6eb640 1 -- 172.21.15.132:0/2309088000 shutdown_connections 2024-04-26T12:30:02.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe23f6eb640 1 --2- 172.21.15.132:0/2309088000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2380996e0 0x7fe238133a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe23f6eb640 1 -- 172.21.15.132:0/2309088000 >> 172.21.15.132:0/2309088000 conn(0x7fe2380a0d10 msgr2=0x7fe23809d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe2c5ab1640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c0092ab0 0x7fe2c01c33b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c700 tx=0x7fe2bc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe23f6eb640 1 -- 172.21.15.132:0/2309088000 shutdown_connections 2024-04-26T12:30:02.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe23f6eb640 1 -- 172.21.15.132:0/2309088000 wait complete. 2024-04-26T12:30:02.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe2b67fc640 1 -- 172.21.15.132:0/2041534216 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc018070 con 0x7fe2c0092ab0 2024-04-26T12:30:02.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe2b67fc640 1 -- 172.21.15.132:0/2041534216 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc007220 con 0x7fe2c0092ab0 2024-04-26T12:30:02.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe2b67fc640 1 -- 172.21.15.132:0/2041534216 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2bc007540 con 0x7fe2c0092ab0 2024-04-26T12:30:02.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c006f100 con 0x7fe2c0092ab0 2024-04-26T12:30:02.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.693+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c01c38f0 con 0x7fe2c0092ab0 2024-04-26T12:30:02.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.694+0000 7fe23f6eb640 1 Processor -- start 2024-04-26T12:30:02.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.694+0000 7fe23f6eb640 1 -- start start 2024-04-26T12:30:02.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.694+0000 7fe2b67fc640 1 -- 172.21.15.132:0/2041534216 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe2bc01b070 con 0x7fe2c0092ab0 2024-04-26T12:30:02.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.694+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c0062ed0 con 0x7fe2c0092ab0 2024-04-26T12:30:02.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.694+0000 7fe2b67fc640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2a4038060 0x7fe2a403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.694+0000 7fe23f6eb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe238098bf0 0x7fe2380709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.694+0000 7fe2b67fc640 1 -- 172.21.15.132:0/2041534216 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fe2bc04a590 con 0x7fe2c0092ab0 2024-04-26T12:30:02.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.695+0000 7fe23f6eb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe23809a140 con 0x7fe238098bf0 2024-04-26T12:30:02.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.695+0000 7fe23d487640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe238098bf0 0x7fe2380709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.695+0000 7fe23d487640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe238098bf0 0x7fe2380709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60398/0 (socket says 172.21.15.132:60398) 2024-04-26T12:30:02.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.695+0000 7fe23d487640 1 -- 172.21.15.132:0/521515725 learned_addr learned my addr 172.21.15.132:0/521515725 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.695+0000 7fe2c52b0640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2a4038060 0x7fe2a403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.695+0000 7fe23d487640 1 -- 172.21.15.132:0/521515725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238072730 con 0x7fe238098bf0 2024-04-26T12:30:02.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.695+0000 7fe2c52b0640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2a4038060 0x7fe2a403a520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0034000 tx=0x7fe2b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.696+0000 7fe23d487640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe238098bf0 0x7fe2380709d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c3e0 tx=0x7fe23400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.699+0000 7fe2b67fc640 1 -- 172.21.15.132:0/2041534216 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe2bc010300 con 0x7fe2c0092ab0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.699+0000 7fe22dffb640 1 -- 172.21.15.132:0/521515725 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe234017070 con 0x7fe238098bf0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.699+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe238096440 con 0x7fe238098bf0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.699+0000 7fe22dffb640 1 -- 172.21.15.132:0/521515725 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe234005430 con 0x7fe238098bf0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.699+0000 7fe22dffb640 1 -- 172.21.15.132:0/521515725 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe234003760 con 0x7fe238098bf0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.699+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23808a240 con 0x7fe238098bf0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.700+0000 7fe22dffb640 1 -- 172.21.15.132:0/521515725 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe23401a070 con 0x7fe238098bf0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.700+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe238062ed0 con 0x7fe238098bf0 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.701+0000 7fe22dffb640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe21c0380b0 0x7fe21c03a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.701+0000 7fe22dffb640 1 -- 172.21.15.132:0/521515725 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fe23404a3f0 con 0x7fe238098bf0 2024-04-26T12:30:02.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.701+0000 7fe23cc86640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe21c0380b0 0x7fe21c03a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.701+0000 7fe23cc86640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe21c0380b0 0x7fe21c03a570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097f0 tx=0x7fe228008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.704+0000 7f1a75c31640 1 Processor -- start 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.704+0000 7f1a75c31640 1 -- start start 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a75c31640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a70092ab0 0x7f1a7012ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a75c31640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7012e770 con 0x7f1a7012ef70 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a75c31640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7006e3a0 con 0x7f1a70092ab0 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a6f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a70092ab0 0x7f1a7012ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a6effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1a7012ef70 0x7f1a7012afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48886/0 (socket says 172.21.15.132:48886) 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a6effd640 1 -- 172.21.15.132:0/1990312470 learned_addr learned my addr 172.21.15.132:0/1990312470 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a6f7fe640 1 -- 172.21.15.132:0/1990312470 >> v1:172.21.15.132:6789/0 conn(0x7f1a7012ef70 legacy=0x7f1a7012afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7f1a6f7fe640 1 -- 172.21.15.132:0/1990312470 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7006de80 con 0x7f1a70092ab0 2024-04-26T12:30:02.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.705+0000 7fe22dffb640 1 -- 172.21.15.132:0/521515725 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe23401a730 con 0x7fe238098bf0 2024-04-26T12:30:02.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.706+0000 7f1a6f7fe640 1 --2- 172.21.15.132:0/1990312470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a7012ea30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009720 tx=0x7f1a6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809849eb19daee61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.706+0000 7f1a6e7fc640 1 -- 172.21.15.132:0/1990312470 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60035020 con 0x7f1a70092ab0 2024-04-26T12:30:02.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.706+0000 7f1a6e7fc640 1 -- 172.21.15.132:0/1990312470 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a60031760 con 0x7f1a70092ab0 2024-04-26T12:30:02.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.706+0000 7f1a6e7fc640 1 -- 172.21.15.132:0/1990312470 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a60031a60 con 0x7f1a70092ab0 2024-04-26T12:30:02.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.707+0000 7f1a75c31640 1 -- 172.21.15.132:0/1990312470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 msgr2=0x7f1a7012ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.707+0000 7f1a75c31640 1 --2- 172.21.15.132:0/1990312470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a7012ea30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009720 tx=0x7f1a6002b8d0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.707+0000 7f1a75c31640 1 -- 172.21.15.132:0/1990312470 shutdown_connections 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.707+0000 7f1a75c31640 1 --2- 172.21.15.132:0/1990312470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a7012ea30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.707+0000 7f1a75c31640 1 -- 172.21.15.132:0/1990312470 >> 172.21.15.132:0/1990312470 conn(0x7f1a700a0fc0 msgr2=0x7f1a70090380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.707+0000 7f1a75c31640 1 -- 172.21.15.132:0/1990312470 shutdown_connections 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.707+0000 7f1a75c31640 1 -- 172.21.15.132:0/1990312470 wait complete. 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.708+0000 7f1a75c31640 1 Processor -- start 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.709+0000 7f1a75c31640 1 -- start start 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.709+0000 7f1a75c31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a701c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.709+0000 7f1a75c31640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7012ba80 con 0x7f1a70092ab0 2024-04-26T12:30:02.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.709+0000 7f1a6f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a701c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.709+0000 7f1a6f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a701c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60412/0 (socket says 172.21.15.132:60412) 2024-04-26T12:30:02.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.709+0000 7f1a6f7fe640 1 -- 172.21.15.132:0/2926364179 learned_addr learned my addr 172.21.15.132:0/2926364179 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:02.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.710+0000 7f1a6f7fe640 1 -- 172.21.15.132:0/2926364179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a70092660 con 0x7f1a70092ab0 2024-04-26T12:30:02.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.710+0000 7f1a6f7fe640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a701c33f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009720 tx=0x7f1a600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.710+0000 7f1a57fff640 1 -- 172.21.15.132:0/2926364179 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a6003b980 con 0x7f1a70092ab0 2024-04-26T12:30:02.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.710+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a70095420 con 0x7f1a70092ab0 2024-04-26T12:30:02.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.710+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a701c3930 con 0x7f1a70092ab0 2024-04-26T12:30:02.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.710+0000 7f1a57fff640 1 -- 172.21.15.132:0/2926364179 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6003bb40 con 0x7f1a70092ab0 2024-04-26T12:30:02.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.710+0000 7f1a57fff640 1 -- 172.21.15.132:0/2926364179 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a6003be60 con 0x7f1a70092ab0 2024-04-26T12:30:02.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.711+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a50005080 con 0x7f1a70092ab0 2024-04-26T12:30:02.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.711+0000 7f1a57fff640 1 -- 172.21.15.132:0/2926364179 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a6004c060 con 0x7f1a70092ab0 2024-04-26T12:30:02.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.711+0000 7f1a57fff640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1a5c038060 0x7f1a5c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:02.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.712+0000 7f1a57fff640 1 -- 172.21.15.132:0/2926364179 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f1a6006ccf0 con 0x7f1a70092ab0 2024-04-26T12:30:02.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.712+0000 7f1a6effd640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1a5c038060 0x7f1a5c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:02.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.712+0000 7f1a6effd640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1a5c038060 0x7f1a5c03a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a64005880 tx=0x7f1a64007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:02.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.721+0000 7f1a57fff640 1 -- 172.21.15.132:0/2926364179 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1a70092660 con 0x7f1a70092ab0 2024-04-26T12:30:02.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.862+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc160062ed0 con 0x7fc160098bf0 2024-04-26T12:30:02.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.862+0000 7fc147fff640 1 -- 172.21.15.132:0/2564945331 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc150011980 con 0x7fc160098bf0 2024-04-26T12:30:02.863 INFO:teuthology.orchestra.run.smithi132.stdout:42949672964 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc14c038060 msgr2=0x7fc14c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc14c038060 0x7fc14c03a520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc154009720 tx=0x7fc154008030 comp rx=0 tx=0).stop 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc160098bf0 msgr2=0x7fc160132850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc160098bf0 0x7fc160132850 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c420 tx=0x7fc15000c8e0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 shutdown_connections 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc14c038060 0x7fc14c03a520 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 --2- 172.21.15.132:0/2564945331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc160098bf0 0x7fc160132850 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 >> 172.21.15.132:0/2564945331 conn(0x7fc1600a0d10 msgr2=0x7fc160090380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 shutdown_connections 2024-04-26T12:30:02.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.864+0000 7fc165ed2640 1 -- 172.21.15.132:0/2564945331 wait complete. 2024-04-26T12:30:02.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-04-26T12:30:02.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.885+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe2c0092880 con 0x7fe2c0092ab0 2024-04-26T12:30:02.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.885+0000 7fe2b67fc640 1 -- 172.21.15.132:0/2041534216 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe2bc01be30 con 0x7fe2c0092ab0 2024-04-26T12:30:02.887 INFO:teuthology.orchestra.run.smithi132.stdout:42949672964 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2a4038060 msgr2=0x7fe2a403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2a4038060 0x7fe2a403a520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0034000 tx=0x7fe2b0008030 comp rx=0 tx=0).stop 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c0092ab0 msgr2=0x7fe2c01c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c0092ab0 0x7fe2c01c33b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c700 tx=0x7fe2bc00cbc0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 shutdown_connections 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2a4038060 0x7fe2a403a520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 --2- 172.21.15.132:0/2041534216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2c0092ab0 0x7fe2c01c33b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 >> 172.21.15.132:0/2041534216 conn(0x7fe2c00a0fc0 msgr2=0x7fe2c012aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 shutdown_connections 2024-04-26T12:30:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.887+0000 7fe2c7d15640 1 -- 172.21.15.132:0/2041534216 wait complete. 2024-04-26T12:30:02.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.894+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe23808a5e0 con 0x7fe238098bf0 2024-04-26T12:30:02.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.895+0000 7fe22dffb640 1 -- 172.21.15.132:0/521515725 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe23401a990 con 0x7fe238098bf0 2024-04-26T12:30:02.896 INFO:teuthology.orchestra.run.smithi132.stdout:38654705668 2024-04-26T12:30:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe21c0380b0 msgr2=0x7fe21c03a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe21c0380b0 0x7fe21c03a570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe2280097f0 tx=0x7fe228008030 comp rx=0 tx=0).stop 2024-04-26T12:30:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe238098bf0 msgr2=0x7fe2380709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe238098bf0 0x7fe2380709d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c3e0 tx=0x7fe23400c8a0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 shutdown_connections 2024-04-26T12:30:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe21c0380b0 0x7fe21c03a570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 --2- 172.21.15.132:0/521515725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe238098bf0 0x7fe2380709d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 >> 172.21.15.132:0/521515725 conn(0x7fe2380a0d10 msgr2=0x7fe23812ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 shutdown_connections 2024-04-26T12:30:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.897+0000 7fe23f6eb640 1 -- 172.21.15.132:0/521515725 wait complete. 2024-04-26T12:30:02.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-04-26T12:30:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.903+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1a50005370 con 0x7f1a70092ab0 2024-04-26T12:30:02.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.903+0000 7f1a57fff640 1 -- 172.21.15.132:0/2926364179 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a60040070 con 0x7f1a70092ab0 2024-04-26T12:30:02.905 INFO:teuthology.orchestra.run.smithi132.stdout:38654705667 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.905+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1a5c038060 msgr2=0x7f1a5c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.905+0000 7f1a75c31640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1a5c038060 0x7f1a5c03a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a64005880 tx=0x7f1a64007a80 comp rx=0 tx=0).stop 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.905+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 msgr2=0x7f1a701c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.905+0000 7f1a75c31640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a701c33f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009720 tx=0x7f1a600046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.906+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 shutdown_connections 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.906+0000 7f1a75c31640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1a5c038060 0x7f1a5c03a520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.906+0000 7f1a75c31640 1 --2- 172.21.15.132:0/2926364179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a70092ab0 0x7f1a701c33f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.906+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 >> 172.21.15.132:0/2926364179 conn(0x7f1a700a0fc0 msgr2=0x7f1a70128540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.906+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 shutdown_connections 2024-04-26T12:30:02.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:02.906+0000 7f1a75c31640 1 -- 172.21.15.132:0/2926364179 wait complete. 2024-04-26T12:30:02.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-04-26T12:30:02.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2024-04-26T12:30:03.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:30:03.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:03.910 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:03.918 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f72861ce640 1 Processor -- start 2024-04-26T12:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f72861ce640 1 -- start start 2024-04-26T12:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f72861ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7280092ab0 0x7f728012ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f72861ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728012e770 con 0x7f728012ef70 2024-04-26T12:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f72861ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f728006e3a0 con 0x7f7280092ab0 2024-04-26T12:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f727f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7280092ab0 0x7f728012ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f727effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f728012ef70 0x7f728012afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48894/0 (socket says 172.21.15.132:48894) 2024-04-26T12:30:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.990+0000 7f727effd640 1 -- 172.21.15.132:0/2558832022 learned_addr learned my addr 172.21.15.132:0/2558832022 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.991+0000 7f727f7fe640 1 -- 172.21.15.132:0/2558832022 >> v1:172.21.15.132:6789/0 conn(0x7f728012ef70 legacy=0x7f728012afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.991+0000 7f727f7fe640 1 -- 172.21.15.132:0/2558832022 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728006de80 con 0x7f7280092ab0 2024-04-26T12:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.992+0000 7f727f7fe640 1 --2- 172.21.15.132:0/2558832022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f728012ea30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7270009720 tx=0x7f727002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d072e3dd0bee06a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.992+0000 7f727e7fc640 1 -- 172.21.15.132:0/2558832022 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7270035020 con 0x7f7280092ab0 2024-04-26T12:30:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.992+0000 7f727e7fc640 1 -- 172.21.15.132:0/2558832022 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270031760 con 0x7f7280092ab0 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.992+0000 7f727e7fc640 1 -- 172.21.15.132:0/2558832022 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7270031a60 con 0x7f7280092ab0 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.993+0000 7f72861ce640 1 -- 172.21.15.132:0/2558832022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 msgr2=0x7f728012ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.993+0000 7f72861ce640 1 --2- 172.21.15.132:0/2558832022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f728012ea30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7270009720 tx=0x7f727002b8d0 comp rx=0 tx=0).stop 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.993+0000 7f72861ce640 1 -- 172.21.15.132:0/2558832022 shutdown_connections 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.993+0000 7f72861ce640 1 --2- 172.21.15.132:0/2558832022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f728012ea30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.993+0000 7f72861ce640 1 -- 172.21.15.132:0/2558832022 >> 172.21.15.132:0/2558832022 conn(0x7f72800a0fc0 msgr2=0x7f7280090380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.993+0000 7f72861ce640 1 -- 172.21.15.132:0/2558832022 shutdown_connections 2024-04-26T12:30:03.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.993+0000 7f72861ce640 1 -- 172.21.15.132:0/2558832022 wait complete. 2024-04-26T12:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.994+0000 7f72861ce640 1 Processor -- start 2024-04-26T12:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.994+0000 7f72861ce640 1 -- start start 2024-04-26T12:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.995+0000 7f72861ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f72801c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.995+0000 7f72861ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f728012ba80 con 0x7f7280092ab0 2024-04-26T12:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.995+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f72801c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.995+0000 7f727f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f72801c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60440/0 (socket says 172.21.15.132:60440) 2024-04-26T12:30:03.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.995+0000 7f727f7fe640 1 -- 172.21.15.132:0/2489926517 learned_addr learned my addr 172.21.15.132:0/2489926517 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:03.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.995+0000 7f727f7fe640 1 -- 172.21.15.132:0/2489926517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7280092660 con 0x7f7280092ab0 2024-04-26T12:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.996+0000 7f727f7fe640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f72801c33f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7270009720 tx=0x7f72700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.996+0000 7f7267fff640 1 -- 172.21.15.132:0/2489926517 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727003b980 con 0x7f7280092ab0 2024-04-26T12:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.996+0000 7f7267fff640 1 -- 172.21.15.132:0/2489926517 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727003bb40 con 0x7f7280092ab0 2024-04-26T12:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.996+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7280095420 con 0x7f7280092ab0 2024-04-26T12:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.996+0000 7f7267fff640 1 -- 172.21.15.132:0/2489926517 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f727003be60 con 0x7f7280092ab0 2024-04-26T12:30:03.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.996+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72801c3930 con 0x7f7280092ab0 2024-04-26T12:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.997+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7280094460 con 0x7f7280092ab0 2024-04-26T12:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.997+0000 7f7267fff640 1 -- 172.21.15.132:0/2489926517 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f727004c060 con 0x7f7280092ab0 2024-04-26T12:30:03.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.997+0000 7f7267fff640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f726c038060 0x7f726c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.997+0000 7f7267fff640 1 -- 172.21.15.132:0/2489926517 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f727006cd70 con 0x7f7280092ab0 2024-04-26T12:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.998+0000 7f727effd640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f726c038060 0x7f726c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:03.998+0000 7f727effd640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f726c038060 0x7f726c03a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7274005880 tx=0x7f7274007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.006+0000 7f7267fff640 1 -- 172.21.15.132:0/2489926517 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7280092660 con 0x7f7280092ab0 2024-04-26T12:30:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.027+0000 7efe2b8e6640 1 Processor -- start 2024-04-26T12:30:04.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7f83c1406640 1 Processor -- start 2024-04-26T12:30:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7efe2b8e6640 1 -- start start 2024-04-26T12:30:04.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7f83c1406640 1 -- start start 2024-04-26T12:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7efe2b8e6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe2406dbb0 0x7efe2406df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7efe2b8e6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe2406ef30 con 0x7efe24121640 2024-04-26T12:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7efe2b8e6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7efe2406e8e0 con 0x7efe2406dbb0 2024-04-26T12:30:04.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7f83c1406640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83bc12c200 0x7f83bc12c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7efe29682640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe2406dbb0 0x7efe2406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7f83c1406640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83bc09a3d0 con 0x7f83bc12cb20 2024-04-26T12:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7efe29682640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe2406dbb0 0x7efe2406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60442/0 (socket says 172.21.15.132:60442) 2024-04-26T12:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7efe29682640 1 -- 172.21.15.132:0/1575091609 learned_addr learned my addr 172.21.15.132:0/1575091609 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.028+0000 7f83c1406640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc072330 con 0x7f83bc12c200 2024-04-26T12:30:04.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7f83baffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83bc12c200 0x7f83bc12c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7f83ba7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f83bc12cb20 0x7f83bc128ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48920/0 (socket says 172.21.15.132:48920) 2024-04-26T12:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7f83ba7fc640 1 -- 172.21.15.132:0/2407997391 learned_addr learned my addr 172.21.15.132:0/2407997391 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7efe29682640 1 -- 172.21.15.132:0/1575091609 >> v1:172.21.15.132:6789/0 conn(0x7efe24121640 legacy=0x7efe24121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7efe1bfff640 1 -- 172.21.15.132:0/1575091609 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541662720 0 0) 0x7efe14001110 con 0x7efe24121640 2024-04-26T12:30:04.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7efe29682640 1 -- 172.21.15.132:0/1575091609 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2406d710 con 0x7efe2406dbb0 2024-04-26T12:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7f83baffd640 1 -- 172.21.15.132:0/2407997391 >> v1:172.21.15.132:6789/0 conn(0x7f83bc12cb20 legacy=0x7f83bc128ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.029+0000 7f83baffd640 1 -- 172.21.15.132:0/2407997391 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc072670 con 0x7f83bc12c200 2024-04-26T12:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7efe29682640 1 --2- 172.21.15.132:0/1575091609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe2406df90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe200097f0 tx=0x7efe2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd003cf841479864 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f83baffd640 1 --2- 172.21.15.132:0/2407997391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc12c5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009720 tx=0x7f83ac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f0511410f56668 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7efe1bfff640 1 -- 172.21.15.132:0/1575091609 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe20035020 con 0x7efe2406dbb0 2024-04-26T12:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f561d0c8640 1 Processor -- start 2024-04-26T12:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7efe1bfff640 1 -- 172.21.15.132:0/1575091609 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe200317a0 con 0x7efe2406dbb0 2024-04-26T12:30:04.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7efe1bfff640 1 -- 172.21.15.132:0/1575091609 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe20031aa0 con 0x7efe2406dbb0 2024-04-26T12:30:04.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f561d0c8640 1 -- start start 2024-04-26T12:30:04.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f83b9ffb640 1 -- 172.21.15.132:0/2407997391 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ac0316d0 con 0x7f83bc12c200 2024-04-26T12:30:04.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f83b9ffb640 1 -- 172.21.15.132:0/2407997391 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac037070 con 0x7f83bc12c200 2024-04-26T12:30:04.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f83b9ffb640 1 -- 172.21.15.132:0/2407997391 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ac0319c0 con 0x7f83bc12c200 2024-04-26T12:30:04.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f561d0c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56180996e0 0x7f5618133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f561d0c8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5618099b00 con 0x7f5618098bf0 2024-04-26T12:30:04.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.030+0000 7f561d0c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f561809e050 con 0x7f56180996e0 2024-04-26T12:30:04.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f5616d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5618098bf0 0x7f5618098fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48924/0 (socket says 172.21.15.132:48924) 2024-04-26T12:30:04.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f5616d9d640 1 -- 172.21.15.132:0/2879105192 learned_addr learned my addr 172.21.15.132:0/2879105192 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f561659c640 1 --2- 172.21.15.132:0/2879105192 >> v2:172.21.15.132:3300/0 conn(0x7f56180996e0 0x7f5618133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7efe2b8e6640 1 -- 172.21.15.132:0/1575091609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 msgr2=0x7efe2406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7efe2b8e6640 1 --2- 172.21.15.132:0/1575091609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe2406df90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe200097f0 tx=0x7efe2002b910 comp rx=0 tx=0).stop 2024-04-26T12:30:04.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7efe2b8e6640 1 -- 172.21.15.132:0/1575091609 shutdown_connections 2024-04-26T12:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f561659c640 1 -- 172.21.15.132:0/2879105192 >> v1:172.21.15.132:6789/0 conn(0x7f5618098bf0 legacy=0x7f5618098fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f561659c640 1 -- 172.21.15.132:0/2879105192 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561809a790 con 0x7f56180996e0 2024-04-26T12:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7efe2b8e6640 1 --2- 172.21.15.132:0/1575091609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe2406df90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7efe2b8e6640 1 -- 172.21.15.132:0/1575091609 >> 172.21.15.132:0/1575091609 conn(0x7efe2409b560 msgr2=0x7efe2409b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f83c1406640 1 -- 172.21.15.132:0/2407997391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 msgr2=0x7f83bc12c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f83c1406640 1 --2- 172.21.15.132:0/2407997391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc12c5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009720 tx=0x7f83ac02b840 comp rx=0 tx=0).stop 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f83c1406640 1 -- 172.21.15.132:0/2407997391 shutdown_connections 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f83c1406640 1 --2- 172.21.15.132:0/2407997391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc12c5e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f83c1406640 1 -- 172.21.15.132:0/2407997391 >> 172.21.15.132:0/2407997391 conn(0x7f83bc09b430 msgr2=0x7f83bc09b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f83c1406640 1 -- 172.21.15.132:0/2407997391 shutdown_connections 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7efe2b8e6640 1 -- 172.21.15.132:0/1575091609 shutdown_connections 2024-04-26T12:30:04.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7efe2b8e6640 1 -- 172.21.15.132:0/1575091609 wait complete. 2024-04-26T12:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.031+0000 7f83c1406640 1 -- 172.21.15.132:0/2407997391 wait complete. 2024-04-26T12:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7f561659c640 1 --2- 172.21.15.132:0/2879105192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56180996e0 0x7f5618133a70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f560c009720 tx=0x7f560c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d3cafbe617f7dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7f5615d9b640 1 -- 172.21.15.132:0/2879105192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f560c0316d0 con 0x7f56180996e0 2024-04-26T12:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7f5615d9b640 1 -- 172.21.15.132:0/2879105192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c037070 con 0x7f56180996e0 2024-04-26T12:30:04.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7f5615d9b640 1 -- 172.21.15.132:0/2879105192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f560c0319c0 con 0x7f56180996e0 2024-04-26T12:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7efe2b8e6640 1 Processor -- start 2024-04-26T12:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7efe2b8e6640 1 -- start start 2024-04-26T12:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7f83c1406640 1 Processor -- start 2024-04-26T12:30:04.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.032+0000 7f83c1406640 1 -- start start 2024-04-26T12:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f561d0c8640 1 -- 172.21.15.132:0/2879105192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56180996e0 msgr2=0x7f5618133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f561d0c8640 1 --2- 172.21.15.132:0/2879105192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56180996e0 0x7f5618133a70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f560c009720 tx=0x7f560c02b840 comp rx=0 tx=0).stop 2024-04-26T12:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe2b8e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe24073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe2b8e6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efe2406f370 con 0x7efe2406dbb0 2024-04-26T12:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f561d0c8640 1 -- 172.21.15.132:0/2879105192 shutdown_connections 2024-04-26T12:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f561d0c8640 1 --2- 172.21.15.132:0/2879105192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56180996e0 0x7f5618133a70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f561d0c8640 1 -- 172.21.15.132:0/2879105192 >> 172.21.15.132:0/2879105192 conn(0x7f56180a0d10 msgr2=0x7f561809d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f83c1406640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f83c1406640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc071e10 con 0x7f83bc12c200 2024-04-26T12:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f561d0c8640 1 -- 172.21.15.132:0/2879105192 shutdown_connections 2024-04-26T12:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe29682640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe24073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe29682640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe24073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60474/0 (socket says 172.21.15.132:60474) 2024-04-26T12:30:04.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f561d0c8640 1 -- 172.21.15.132:0/2879105192 wait complete. 2024-04-26T12:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe29682640 1 -- 172.21.15.132:0/416456465 learned_addr learned my addr 172.21.15.132:0/416456465 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f83baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f83baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc06e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60490/0 (socket says 172.21.15.132:60490) 2024-04-26T12:30:04.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f83baffd640 1 -- 172.21.15.132:0/3225901950 learned_addr learned my addr 172.21.15.132:0/3225901950 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe29682640 1 -- 172.21.15.132:0/416456465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe24124d50 con 0x7efe2406dbb0 2024-04-26T12:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe29682640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe24073150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe20000c00 tx=0x7efe200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f83baffd640 1 -- 172.21.15.132:0/3225901950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc1292b0 con 0x7f83bc12c200 2024-04-26T12:30:04.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe19ffb640 1 -- 172.21.15.132:0/416456465 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe2003ad00 con 0x7efe2406dbb0 2024-04-26T12:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7f83baffd640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc06e0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83ac034040 tx=0x7f83ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.034+0000 7f83a37fe640 1 -- 172.21.15.132:0/3225901950 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ac032770 con 0x7f83bc12c200 2024-04-26T12:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.034+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83bc11dbf0 con 0x7f83bc12c200 2024-04-26T12:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.034+0000 7f83a37fe640 1 -- 172.21.15.132:0/3225901950 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac032910 con 0x7f83bc12c200 2024-04-26T12:30:04.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.034+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83bc06e630 con 0x7f83bc12c200 2024-04-26T12:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe19ffb640 1 -- 172.21.15.132:0/416456465 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe200443f0 con 0x7efe2406dbb0 2024-04-26T12:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.033+0000 7efe19ffb640 1 -- 172.21.15.132:0/416456465 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe20044710 con 0x7efe2406dbb0 2024-04-26T12:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.034+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2406fe90 con 0x7efe2406dbb0 2024-04-26T12:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.034+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe240715a0 con 0x7efe2406dbb0 2024-04-26T12:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.034+0000 7f561d0c8640 1 Processor -- start 2024-04-26T12:30:04.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.035+0000 7f561d0c8640 1 -- start start 2024-04-26T12:30:04.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.035+0000 7f83a37fe640 1 -- 172.21.15.132:0/3225901950 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ac032770 con 0x7f83bc12c200 2024-04-26T12:30:04.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.035+0000 7f561d0c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5618098bf0 0x7f5618072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.035+0000 7f561d0c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f561809a140 con 0x7f5618098bf0 2024-04-26T12:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.035+0000 7f5616d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5618098bf0 0x7f5618072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.035+0000 7f5616d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5618098bf0 0x7f5618072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60496/0 (socket says 172.21.15.132:60496) 2024-04-26T12:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.035+0000 7f5616d9d640 1 -- 172.21.15.132:0/1505216533 learned_addr learned my addr 172.21.15.132:0/1505216533 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7f5616d9d640 1 -- 172.21.15.132:0/1505216533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561806ff20 con 0x7f5618098bf0 2024-04-26T12:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7efe19ffb640 1 -- 172.21.15.132:0/416456465 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efe2004b060 con 0x7efe2406dbb0 2024-04-26T12:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe24062ed0 con 0x7efe2406dbb0 2024-04-26T12:30:04.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7f5616d9d640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5618098bf0 0x7f5618072180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f560800c380 tx=0x7f560800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7efe19ffb640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efe08038060 0x7efe0803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7efe19ffb640 1 -- 172.21.15.132:0/416456465 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7efe2006d1d0 con 0x7efe2406dbb0 2024-04-26T12:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83bc11cb80 con 0x7f83bc12c200 2024-04-26T12:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7f83a37fe640 1 -- 172.21.15.132:0/3225901950 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f83ac032ac0 con 0x7f83bc12c200 2024-04-26T12:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7f83a37fe640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f83a80381f0 0x7f83a803a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7efe28e81640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efe08038060 0x7efe0803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7f83a37fe640 1 -- 172.21.15.132:0/3225901950 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f83ac02f050 con 0x7f83bc12c200 2024-04-26T12:30:04.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.036+0000 7f83ba7fc640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f83a80381f0 0x7f83a803a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.037+0000 7efe28e81640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efe08038060 0x7efe0803a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe14000f60 tx=0x7efe14001350 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.037+0000 7f83ba7fc640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f83a80381f0 0x7f83a803a6b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83b0007fd0 tx=0x7f83b0007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.040+0000 7f55ff7fe640 1 -- 172.21.15.132:0/1505216533 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5608005c10 con 0x7f5618098bf0 2024-04-26T12:30:04.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.040+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5618071c00 con 0x7f5618098bf0 2024-04-26T12:30:04.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.040+0000 7efe19ffb640 1 -- 172.21.15.132:0/416456465 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efe2003f070 con 0x7efe2406dbb0 2024-04-26T12:30:04.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.041+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56180726c0 con 0x7f5618098bf0 2024-04-26T12:30:04.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.041+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5618062ed0 con 0x7f5618098bf0 2024-04-26T12:30:04.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.045+0000 7f55ff7fe640 1 -- 172.21.15.132:0/1505216533 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5608005db0 con 0x7f5618098bf0 2024-04-26T12:30:04.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.045+0000 7f55ff7fe640 1 -- 172.21.15.132:0/1505216533 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5608004930 con 0x7f5618098bf0 2024-04-26T12:30:04.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.045+0000 7f83a37fe640 1 -- 172.21.15.132:0/3225901950 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f83ac040070 con 0x7f83bc12c200 2024-04-26T12:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.046+0000 7f55ff7fe640 1 -- 172.21.15.132:0/1505216533 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f560801a020 con 0x7f5618098bf0 2024-04-26T12:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.046+0000 7f55ff7fe640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5604038010 0x7f560403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.046+0000 7f55ff7fe640 1 -- 172.21.15.132:0/1505216533 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f560804af80 con 0x7f5618098bf0 2024-04-26T12:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.046+0000 7f561659c640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5604038010 0x7f560403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.047+0000 7f561659c640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5604038010 0x7f560403a4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f560c009720 tx=0x7f560c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:04.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.050+0000 7f55ff7fe640 1 -- 172.21.15.132:0/1505216533 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5608021070 con 0x7f5618098bf0 2024-04-26T12:30:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.194+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7280062ed0 con 0x7f7280092ab0 2024-04-26T12:30:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.194+0000 7f7267fff640 1 -- 172.21.15.132:0/2489926517 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7270040070 con 0x7f7280092ab0 2024-04-26T12:30:04.196 INFO:teuthology.orchestra.run.smithi132.stdout:42949672964 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f726c038060 msgr2=0x7f726c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f726c038060 0x7f726c03a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7274005880 tx=0x7f7274007a80 comp rx=0 tx=0).stop 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 msgr2=0x7f72801c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f72801c33f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7270009720 tx=0x7f72700046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 shutdown_connections 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f726c038060 0x7f726c03a520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 --2- 172.21.15.132:0/2489926517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7280092ab0 0x7f72801c33f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 >> 172.21.15.132:0/2489926517 conn(0x7f72800a0fc0 msgr2=0x7f7280128540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 shutdown_connections 2024-04-26T12:30:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.197+0000 7f72861ce640 1 -- 172.21.15.132:0/2489926517 wait complete. 2024-04-26T12:30:04.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.3 2024-04-26T12:30:04.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.228+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efe2406c240 con 0x7efe2406dbb0 2024-04-26T12:30:04.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.228+0000 7efe19ffb640 1 -- 172.21.15.132:0/416456465 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe2004dca0 con 0x7efe2406dbb0 2024-04-26T12:30:04.230 INFO:teuthology.orchestra.run.smithi132.stdout:42949672964 2024-04-26T12:30:04.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efe08038060 msgr2=0x7efe0803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efe08038060 0x7efe0803a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe14000f60 tx=0x7efe14001350 comp rx=0 tx=0).stop 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 msgr2=0x7efe24073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe24073150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe20000c00 tx=0x7efe200046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 shutdown_connections 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efe08038060 0x7efe0803a520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 --2- 172.21.15.132:0/416456465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe2406dbb0 0x7efe24073150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 >> 172.21.15.132:0/416456465 conn(0x7efe2409b560 msgr2=0x7efe2408d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 shutdown_connections 2024-04-26T12:30:04.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.231+0000 7efe2b8e6640 1 -- 172.21.15.132:0/416456465 wait complete. 2024-04-26T12:30:04.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-04-26T12:30:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.253+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f83bc062ed0 con 0x7f83bc12c200 2024-04-26T12:30:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.253+0000 7f83a37fe640 1 -- 172.21.15.132:0/3225901950 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83ac052020 con 0x7f83bc12c200 2024-04-26T12:30:04.255 INFO:teuthology.orchestra.run.smithi132.stdout:38654705668 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f83a80381f0 msgr2=0x7f83a803a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f83a80381f0 0x7f83a803a6b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83b0007fd0 tx=0x7f83b0007ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 msgr2=0x7f83bc06e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc06e0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83ac034040 tx=0x7f83ac0046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 shutdown_connections 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f83a80381f0 0x7f83a803a6b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 --2- 172.21.15.132:0/3225901950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83bc12c200 0x7f83bc06e0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 >> 172.21.15.132:0/3225901950 conn(0x7f83bc09b430 msgr2=0x7f83bc12bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:04.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 shutdown_connections 2024-04-26T12:30:04.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.255+0000 7f83c1406640 1 -- 172.21.15.132:0/3225901950 wait complete. 2024-04-26T12:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.258+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5618070fb0 con 0x7f5618098bf0 2024-04-26T12:30:04.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.258+0000 7f55ff7fe640 1 -- 172.21.15.132:0/1505216533 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56080127f0 con 0x7f5618098bf0 2024-04-26T12:30:04.260 INFO:teuthology.orchestra.run.smithi132.stdout:38654705667 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.260+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5604038010 msgr2=0x7f560403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.260+0000 7f561d0c8640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5604038010 0x7f560403a4d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f560c009720 tx=0x7f560c008030 comp rx=0 tx=0).stop 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5618098bf0 msgr2=0x7f5618072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5618098bf0 0x7f5618072180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f560800c380 tx=0x7f560800c840 comp rx=0 tx=0).stop 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 shutdown_connections 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5604038010 0x7f560403a4d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 --2- 172.21.15.132:0/1505216533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5618098bf0 0x7f5618072180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:04.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 >> 172.21.15.132:0/1505216533 conn(0x7f56180a0d10 msgr2=0x7f561808e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 shutdown_connections 2024-04-26T12:30:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:04.261+0000 7f561d0c8640 1 -- 172.21.15.132:0/1505216533 wait complete. 2024-04-26T12:30:04.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-04-26T12:30:04.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2024-04-26T12:30:05.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:30:05.248 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:05.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:05.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:05.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff36acf2640 1 Processor -- start 2024-04-26T12:30:05.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff36acf2640 1 -- start start 2024-04-26T12:30:05.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff36acf2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff364070090 0x7ff364070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff36acf2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3640722d0 con 0x7ff3640709b0 2024-04-26T12:30:05.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff36acf2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff364072680 con 0x7ff364070090 2024-04-26T12:30:05.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff363fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff3640709b0 0x7ff364128e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33838/0 (socket says 172.21.15.132:33838) 2024-04-26T12:30:05.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff368a8e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff364070090 0x7ff364070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.326+0000 7ff363fff640 1 -- 172.21.15.132:0/2018679471 learned_addr learned my addr 172.21.15.132:0/2018679471 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:05.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.327+0000 7ff368a8e640 1 -- 172.21.15.132:0/2018679471 >> v1:172.21.15.132:6789/0 conn(0x7ff3640709b0 legacy=0x7ff364128e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.327+0000 7ff3637fe640 1 -- 172.21.15.132:0/2018679471 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904435996 0 0) 0x7ff3640722d0 con 0x7ff3640709b0 2024-04-26T12:30:05.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.327+0000 7ff368a8e640 1 -- 172.21.15.132:0/2018679471 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36409ddd0 con 0x7ff364070090 2024-04-26T12:30:05.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.328+0000 7ff368a8e640 1 --2- 172.21.15.132:0/2018679471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff364070470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff358009720 tx=0x7ff35802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee6d1e82c2525a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.328+0000 7ff3637fe640 1 -- 172.21.15.132:0/2018679471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358035020 con 0x7ff364070090 2024-04-26T12:30:05.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.328+0000 7ff3637fe640 1 -- 172.21.15.132:0/2018679471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff358031760 con 0x7ff364070090 2024-04-26T12:30:05.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.328+0000 7ff3637fe640 1 -- 172.21.15.132:0/2018679471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358031a60 con 0x7ff364070090 2024-04-26T12:30:05.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.329+0000 7ff36acf2640 1 -- 172.21.15.132:0/2018679471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 msgr2=0x7ff364070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.329+0000 7ff36acf2640 1 --2- 172.21.15.132:0/2018679471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff364070470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff358009720 tx=0x7ff35802b8d0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.329+0000 7ff36acf2640 1 -- 172.21.15.132:0/2018679471 shutdown_connections 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.329+0000 7ff36acf2640 1 --2- 172.21.15.132:0/2018679471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff364070470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.329+0000 7ff36acf2640 1 -- 172.21.15.132:0/2018679471 >> 172.21.15.132:0/2018679471 conn(0x7ff36409b600 msgr2=0x7ff36409ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.329+0000 7ff36acf2640 1 -- 172.21.15.132:0/2018679471 shutdown_connections 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.329+0000 7ff36acf2640 1 -- 172.21.15.132:0/2018679471 wait complete. 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.330+0000 7ff36acf2640 1 Processor -- start 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.330+0000 7ff36acf2640 1 -- start start 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.330+0000 7ff36acf2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff3641c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.330+0000 7ff36acf2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff36409e0d0 con 0x7ff364070090 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.330+0000 7ff368a8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff3641c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.330+0000 7ff368a8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff3641c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52508/0 (socket says 172.21.15.132:52508) 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.331+0000 7ff368a8e640 1 -- 172.21.15.132:0/1630744123 learned_addr learned my addr 172.21.15.132:0/1630744123 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.331+0000 7ff368a8e640 1 -- 172.21.15.132:0/1630744123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36411e750 con 0x7ff364070090 2024-04-26T12:30:05.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.331+0000 7ff368a8e640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff3641c13f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff35802b910 tx=0x7ff3580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.331+0000 7ff3617fa640 1 -- 172.21.15.132:0/1630744123 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff358004160 con 0x7ff364070090 2024-04-26T12:30:05.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.331+0000 7ff3617fa640 1 -- 172.21.15.132:0/1630744123 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff358004300 con 0x7ff364070090 2024-04-26T12:30:05.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.331+0000 7ff3617fa640 1 -- 172.21.15.132:0/1630744123 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff35803b870 con 0x7ff364070090 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.332+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff364129290 con 0x7ff364070090 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.332+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36411f5c0 con 0x7ff364070090 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.333+0000 7ff3617fa640 1 -- 172.21.15.132:0/1630744123 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff358038020 con 0x7ff364070090 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.333+0000 7ff3617fa640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff348038010 0x7ff34803a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.334+0000 7ff3617fa640 1 -- 172.21.15.132:0/1630744123 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7ff35806cf90 con 0x7ff364070090 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.334+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36411e2b0 con 0x7ff364070090 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.334+0000 7ff363fff640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff348038010 0x7ff34803a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.334+0000 7ff363fff640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff348038010 0x7ff34803a4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff350007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.343+0000 7ff3617fa640 1 -- 172.21.15.132:0/1630744123 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff358040070 con 0x7ff364070090 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.365+0000 7f03ddb7e640 1 Processor -- start 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03ddb7e640 1 -- start start 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03ddb7e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03d8099d40 0x7f03d809a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03ddb7e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d806fcb0 con 0x7f03d806f540 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03ddb7e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f03d806fe80 con 0x7f03d8099d40 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03d77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03d8099d40 0x7f03d809a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03d77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03d8099d40 0x7f03d809a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52520/0 (socket says 172.21.15.132:52520) 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03d6ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f03d806f540 0x7f03d812e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33852/0 (socket says 172.21.15.132:33852) 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03d77fe640 1 -- 172.21.15.132:0/3460708028 learned_addr learned my addr 172.21.15.132:0/3460708028 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03d77fe640 1 -- 172.21.15.132:0/3460708028 >> v1:172.21.15.132:6789/0 conn(0x7f03d806f540 legacy=0x7f03d812e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.366+0000 7f03d77fe640 1 -- 172.21.15.132:0/3460708028 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d809a660 con 0x7f03d8099d40 2024-04-26T12:30:05.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.368+0000 7f03d77fe640 1 --2- 172.21.15.132:0/3460708028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d8099d40 0x7f03d809a120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009e50 tx=0x7f03c802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252623d3c15c3f0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.368+0000 7f03d67fc640 1 -- 172.21.15.132:0/3460708028 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c802c8a0 con 0x7f03d8099d40 2024-04-26T12:30:05.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.368+0000 7f03d67fc640 1 -- 172.21.15.132:0/3460708028 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c802ca40 con 0x7f03d8099d40 2024-04-26T12:30:05.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.368+0000 7f03d67fc640 1 -- 172.21.15.132:0/3460708028 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c802cd40 con 0x7f03d8099d40 2024-04-26T12:30:05.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.369+0000 7f03ddb7e640 1 -- 172.21.15.132:0/3460708028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d8099d40 msgr2=0x7f03d809a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.369+0000 7f03ddb7e640 1 --2- 172.21.15.132:0/3460708028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d8099d40 0x7f03d809a120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009e50 tx=0x7f03c802bf80 comp rx=0 tx=0).stop 2024-04-26T12:30:05.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.369+0000 7f03ddb7e640 1 -- 172.21.15.132:0/3460708028 shutdown_connections 2024-04-26T12:30:05.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.369+0000 7f03ddb7e640 1 --2- 172.21.15.132:0/3460708028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d8099d40 0x7f03d809a120 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.369+0000 7f03ddb7e640 1 -- 172.21.15.132:0/3460708028 >> 172.21.15.132:0/3460708028 conn(0x7f03d809b330 msgr2=0x7f03d809b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.369+0000 7f03ddb7e640 1 -- 172.21.15.132:0/3460708028 shutdown_connections 2024-04-26T12:30:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.369+0000 7f03ddb7e640 1 -- 172.21.15.132:0/3460708028 wait complete. 2024-04-26T12:30:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.370+0000 7f03ddb7e640 1 Processor -- start 2024-04-26T12:30:05.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.370+0000 7f03ddb7e640 1 -- start start 2024-04-26T12:30:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03ddb7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d806f540 0x7f03d81c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03ddb7e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f03d812ea80 con 0x7f03d806f540 2024-04-26T12:30:05.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03d77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d806f540 0x7f03d81c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03d77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d806f540 0x7f03d81c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52528/0 (socket says 172.21.15.132:52528) 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03d77fe640 1 -- 172.21.15.132:0/398998693 learned_addr learned my addr 172.21.15.132:0/398998693 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03d77fe640 1 -- 172.21.15.132:0/398998693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d8123890 con 0x7f03d806f540 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03d77fe640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d806f540 0x7f03d81c34d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03c8000f80 tx=0x7f03c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03bffff640 1 -- 172.21.15.132:0/398998693 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c8043020 con 0x7f03d806f540 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03bffff640 1 -- 172.21.15.132:0/398998693 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c803e660 con 0x7f03d806f540 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.371+0000 7f03bffff640 1 -- 172.21.15.132:0/398998693 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03c803e980 con 0x7f03d806f540 2024-04-26T12:30:05.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.372+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d81242a0 con 0x7f03d806f540 2024-04-26T12:30:05.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.372+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d8124940 con 0x7f03d806f540 2024-04-26T12:30:05.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.373+0000 7f03bffff640 1 -- 172.21.15.132:0/398998693 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f03c8046020 con 0x7f03d806f540 2024-04-26T12:30:05.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.373+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d80685e0 con 0x7f03d806f540 2024-04-26T12:30:05.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.373+0000 7f03bffff640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03c4038010 0x7f03c403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.374+0000 7f03bffff640 1 -- 172.21.15.132:0/398998693 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f03c803a040 con 0x7f03d806f540 2024-04-26T12:30:05.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.374+0000 7f03d6ffd640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03c4038010 0x7f03c403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.374+0000 7f03d6ffd640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03c4038010 0x7f03c403a4d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f03d8072680 tx=0x7f03cc007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.378+0000 7f03bffff640 1 -- 172.21.15.132:0/398998693 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f03d8124940 con 0x7f03d806f540 2024-04-26T12:30:05.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.409+0000 7f1897dc2640 1 Processor -- start 2024-04-26T12:30:05.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.409+0000 7f1897dc2640 1 -- start start 2024-04-26T12:30:05.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1897dc2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1890099d40 0x7f189009a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1897dc2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189006fcb0 con 0x7f189006f540 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1897dc2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f189006fe80 con 0x7f1890099d40 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1895b5e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1890099d40 0x7f189009a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1895b5e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1890099d40 0x7f189009a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52530/0 (socket says 172.21.15.132:52530) 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f189535d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f189006f540 0x7f189012e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33856/0 (socket says 172.21.15.132:33856) 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1895b5e640 1 -- 172.21.15.132:0/2473063246 learned_addr learned my addr 172.21.15.132:0/2473063246 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1895b5e640 1 -- 172.21.15.132:0/2473063246 >> v1:172.21.15.132:6789/0 conn(0x7f189006f540 legacy=0x7f189012e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1895b5e640 1 -- 172.21.15.132:0/2473063246 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189009a660 con 0x7f1890099d40 2024-04-26T12:30:05.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.410+0000 7f1894b5c640 1 -- 172.21.15.132:0/2473063246 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491559665 0 0) 0x7f189006fcb0 con 0x7f189006f540 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.411+0000 7f1895b5e640 1 --2- 172.21.15.132:0/2473063246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1890099d40 0x7f189009a120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097f0 tx=0x7f188c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e84afe9b85ff899 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.411+0000 7f1894b5c640 1 -- 172.21.15.132:0/2473063246 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188c035020 con 0x7f1890099d40 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.411+0000 7f1894b5c640 1 -- 172.21.15.132:0/2473063246 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c0317a0 con 0x7f1890099d40 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.411+0000 7f1894b5c640 1 -- 172.21.15.132:0/2473063246 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188c035020 con 0x7f1890099d40 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.412+0000 7f1897dc2640 1 -- 172.21.15.132:0/2473063246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1890099d40 msgr2=0x7f189009a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.412+0000 7f1897dc2640 1 --2- 172.21.15.132:0/2473063246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1890099d40 0x7f189009a120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f188c0097f0 tx=0x7f188c02b910 comp rx=0 tx=0).stop 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.412+0000 7f1897dc2640 1 -- 172.21.15.132:0/2473063246 shutdown_connections 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.412+0000 7f1897dc2640 1 --2- 172.21.15.132:0/2473063246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1890099d40 0x7f189009a120 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.412+0000 7f1897dc2640 1 -- 172.21.15.132:0/2473063246 >> 172.21.15.132:0/2473063246 conn(0x7f189009b330 msgr2=0x7f189009b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.412+0000 7f1897dc2640 1 -- 172.21.15.132:0/2473063246 shutdown_connections 2024-04-26T12:30:05.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.412+0000 7f1897dc2640 1 -- 172.21.15.132:0/2473063246 wait complete. 2024-04-26T12:30:05.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1897dc2640 1 Processor -- start 2024-04-26T12:30:05.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1897dc2640 1 -- start start 2024-04-26T12:30:05.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1897dc2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f189006f540 0x7f18901bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1897dc2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f189012ee50 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1895b5e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f189006f540 0x7f18901bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1895b5e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f189006f540 0x7f18901bfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52540/0 (socket says 172.21.15.132:52540) 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1895b5e640 1 -- 172.21.15.132:0/2676777156 learned_addr learned my addr 172.21.15.132:0/2676777156 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.413+0000 7f1895b5e640 1 -- 172.21.15.132:0/2676777156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189011fe50 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.414+0000 7f1895b5e640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f189006f540 0x7f18901bfa40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f188c009910 tx=0x7f188c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.414+0000 7f18867fc640 1 -- 172.21.15.132:0/2676777156 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188c035020 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.414+0000 7f18867fc640 1 -- 172.21.15.132:0/2676777156 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c03bb00 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.414+0000 7f18867fc640 1 -- 172.21.15.132:0/2676777156 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f188c03be20 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.414+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1890121b30 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.414+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18901c0160 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.415+0000 7f18867fc640 1 -- 172.21.15.132:0/2676777156 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f188c04c060 con 0x7f189006f540 2024-04-26T12:30:05.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.415+0000 7f18867fc640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1874038060 0x7f187403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.415+0000 7f18867fc640 1 -- 172.21.15.132:0/2676777156 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f188c06cf40 con 0x7f189006f540 2024-04-26T12:30:05.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.415+0000 7f189535d640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1874038060 0x7f187403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.415+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18900685e0 con 0x7f189006f540 2024-04-26T12:30:05.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.416+0000 7f189535d640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1874038060 0x7f187403a520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1880000c00 tx=0x7f1880007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.420+0000 7f18867fc640 1 -- 172.21.15.132:0/2676777156 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f188c040070 con 0x7f189006f540 2024-04-26T12:30:05.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.438+0000 7fb23fb9f640 1 Processor -- start 2024-04-26T12:30:05.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.439+0000 7fb23fb9f640 1 -- start start 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.439+0000 7fb23fb9f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb23808df90 0x7fb23812fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.439+0000 7fb23fb9f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23806e1f0 con 0x7fb238099210 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.439+0000 7fb23fb9f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb23809a040 con 0x7fb23808df90 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.439+0000 7fb23d13a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb23808df90 0x7fb23812fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.439+0000 7fb23d93b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb238099210 0x7fb2380995f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33866/0 (socket says 172.21.15.132:33866) 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.439+0000 7fb23d93b640 1 -- 172.21.15.132:0/922782234 learned_addr learned my addr 172.21.15.132:0/922782234 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.440+0000 7fb23d13a640 1 -- 172.21.15.132:0/922782234 >> v1:172.21.15.132:6789/0 conn(0x7fb238099210 legacy=0x7fb2380995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.440+0000 7fb23d13a640 1 -- 172.21.15.132:0/922782234 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23808e890 con 0x7fb23808df90 2024-04-26T12:30:05.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.440+0000 7fb23d13a640 1 --2- 172.21.15.132:0/922782234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb23812fb20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb228009060 tx=0x7fb22802cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191203a3f71254c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.440+0000 7fb23c939640 1 -- 172.21.15.132:0/922782234 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb22802e850 con 0x7fb23808df90 2024-04-26T12:30:05.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.441+0000 7fb23c939640 1 -- 172.21.15.132:0/922782234 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22802e9f0 con 0x7fb23808df90 2024-04-26T12:30:05.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.441+0000 7fb23c939640 1 -- 172.21.15.132:0/922782234 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb22802ecf0 con 0x7fb23808df90 2024-04-26T12:30:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.441+0000 7fb23fb9f640 1 -- 172.21.15.132:0/922782234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 msgr2=0x7fb23812fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.441+0000 7fb23fb9f640 1 --2- 172.21.15.132:0/922782234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb23812fb20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb228009060 tx=0x7fb22802cb60 comp rx=0 tx=0).stop 2024-04-26T12:30:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.441+0000 7fb23fb9f640 1 -- 172.21.15.132:0/922782234 shutdown_connections 2024-04-26T12:30:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.441+0000 7fb23fb9f640 1 --2- 172.21.15.132:0/922782234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb23812fb20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.441+0000 7fb23fb9f640 1 -- 172.21.15.132:0/922782234 >> 172.21.15.132:0/922782234 conn(0x7fb23809b560 msgr2=0x7fb23809b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.442+0000 7fb23fb9f640 1 -- 172.21.15.132:0/922782234 shutdown_connections 2024-04-26T12:30:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.442+0000 7fb23fb9f640 1 -- 172.21.15.132:0/922782234 wait complete. 2024-04-26T12:30:05.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.443+0000 7fb23fb9f640 1 Processor -- start 2024-04-26T12:30:05.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.443+0000 7fb23fb9f640 1 -- start start 2024-04-26T12:30:05.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.444+0000 7fb23fb9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb238094f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.444+0000 7fb23fb9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb238099d00 con 0x7fb23808df90 2024-04-26T12:30:05.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.444+0000 7fb23d93b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb238094f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb23d93b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb238094f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52568/0 (socket says 172.21.15.132:52568) 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb23d93b640 1 -- 172.21.15.132:0/1463229490 learned_addr learned my addr 172.21.15.132:0/1463229490 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb23d93b640 1 -- 172.21.15.132:0/1463229490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb238097cc0 con 0x7fb23808df90 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb23d93b640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb238094f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c4a0 tx=0x7fb23400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb22e7fc640 1 -- 172.21.15.132:0/1463229490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234017070 con 0x7fb23808df90 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb22e7fc640 1 -- 172.21.15.132:0/1463229490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb234005c10 con 0x7fb23808df90 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb238098150 con 0x7fb23808df90 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb22e7fc640 1 -- 172.21.15.132:0/1463229490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234007070 con 0x7fb23808df90 2024-04-26T12:30:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.445+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb238095690 con 0x7fb23808df90 2024-04-26T12:30:05.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.446+0000 7fb22e7fc640 1 -- 172.21.15.132:0/1463229490 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb23401a070 con 0x7fb23808df90 2024-04-26T12:30:05.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.446+0000 7fb22e7fc640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb21c038060 0x7fb21c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.446+0000 7fb22e7fc640 1 -- 172.21.15.132:0/1463229490 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fb23404a200 con 0x7fb23808df90 2024-04-26T12:30:05.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.446+0000 7fb23d13a640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb21c038060 0x7fb21c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.447+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb238062ed0 con 0x7fb23808df90 2024-04-26T12:30:05.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.447+0000 7fb23d13a640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb21c038060 0x7fb21c03a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb228037000 tx=0x7fb228008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.451+0000 7fb22e7fc640 1 -- 172.21.15.132:0/1463229490 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb23401b3b0 con 0x7fb23808df90 2024-04-26T12:30:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.588+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff364062ed0 con 0x7ff364070090 2024-04-26T12:30:05.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.588+0000 7ff3617fa640 1 -- 172.21.15.132:0/1630744123 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3580393b0 con 0x7ff364070090 2024-04-26T12:30:05.590 INFO:teuthology.orchestra.run.smithi132.stdout:42949672966 2024-04-26T12:30:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.590+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff348038010 msgr2=0x7ff34803a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.590+0000 7ff36acf2640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff348038010 0x7ff34803a4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff350007970 comp rx=0 tx=0).stop 2024-04-26T12:30:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 msgr2=0x7ff3641c13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff3641c13f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff35802b910 tx=0x7ff3580046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 shutdown_connections 2024-04-26T12:30:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff348038010 0x7ff34803a4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 --2- 172.21.15.132:0/1630744123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff364070090 0x7ff3641c13f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 >> 172.21.15.132:0/1630744123 conn(0x7ff36409b600 msgr2=0x7ff364099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 shutdown_connections 2024-04-26T12:30:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.591+0000 7ff36acf2640 1 -- 172.21.15.132:0/1630744123 wait complete. 2024-04-26T12:30:05.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.3 2024-04-26T12:30:05.607 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:05.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.639+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f03d8062ed0 con 0x7f03d806f540 2024-04-26T12:30:05.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.640+0000 7f03bffff640 1 -- 172.21.15.132:0/398998693 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f03c804d030 con 0x7f03d806f540 2024-04-26T12:30:05.641 INFO:teuthology.orchestra.run.smithi132.stdout:42949672966 2024-04-26T12:30:05.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03c4038010 msgr2=0x7f03c403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03c4038010 0x7f03c403a4d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f03d8072680 tx=0x7f03cc007a40 comp rx=0 tx=0).stop 2024-04-26T12:30:05.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d806f540 msgr2=0x7f03d81c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d806f540 0x7f03d81c34d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03c8000f80 tx=0x7f03c8004a40 comp rx=0 tx=0).stop 2024-04-26T12:30:05.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 shutdown_connections 2024-04-26T12:30:05.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03c4038010 0x7f03c403a4d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 --2- 172.21.15.132:0/398998693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d806f540 0x7f03d81c34d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 >> 172.21.15.132:0/398998693 conn(0x7f03d809b330 msgr2=0x7f03d811b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 shutdown_connections 2024-04-26T12:30:05.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.642+0000 7f03ddb7e640 1 -- 172.21.15.132:0/398998693 wait complete. 2024-04-26T12:30:05.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.651+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb23806c240 con 0x7fb23808df90 2024-04-26T12:30:05.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.651+0000 7fb22e7fc640 1 -- 172.21.15.132:0/1463229490 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb234010300 con 0x7fb23808df90 2024-04-26T12:30:05.653 INFO:teuthology.orchestra.run.smithi132.stdout:38654705670 2024-04-26T12:30:05.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.1 2024-04-26T12:30:05.654 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb21c038060 msgr2=0x7fb21c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb21c038060 0x7fb21c03a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb228037000 tx=0x7fb228008030 comp rx=0 tx=0).stop 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 msgr2=0x7fb238094f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb238094f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c4a0 tx=0x7fb23400c960 comp rx=0 tx=0).stop 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 shutdown_connections 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb21c038060 0x7fb21c03a520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 --2- 172.21.15.132:0/1463229490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb23808df90 0x7fb238094f70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 >> 172.21.15.132:0/1463229490 conn(0x7fb23809b560 msgr2=0x7fb2381b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 shutdown_connections 2024-04-26T12:30:05.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.653+0000 7fb23fb9f640 1 -- 172.21.15.132:0/1463229490 wait complete. 2024-04-26T12:30:05.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-04-26T12:30:05.665 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:05.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.685+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1890062ed0 con 0x7f189006f540 2024-04-26T12:30:05.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.685+0000 7f18867fc640 1 -- 172.21.15.132:0/2676777156 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f188c004210 con 0x7f189006f540 2024-04-26T12:30:05.687 INFO:teuthology.orchestra.run.smithi132.stdout:38654705669 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1874038060 msgr2=0x7f187403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1874038060 0x7f187403a520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1880000c00 tx=0x7f1880007910 comp rx=0 tx=0).stop 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f189006f540 msgr2=0x7f18901bfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f189006f540 0x7f18901bfa40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f188c009910 tx=0x7f188c0046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 shutdown_connections 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1874038060 0x7f187403a520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 --2- 172.21.15.132:0/2676777156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f189006f540 0x7f18901bfa40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.687+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 >> 172.21.15.132:0/2676777156 conn(0x7f189009b330 msgr2=0x7f1890071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.688+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 shutdown_connections 2024-04-26T12:30:05.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.688+0000 7f1897dc2640 1 -- 172.21.15.132:0/2676777156 wait complete. 2024-04-26T12:30:05.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-04-26T12:30:05.699 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:05.699 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:30:05.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:05.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.833+0000 7fab59ce6640 1 Processor -- start 2024-04-26T12:30:05.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.833+0000 7fab59ce6640 1 -- start start 2024-04-26T12:30:05.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.833+0000 7fab59ce6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab541280d0 0x7fab541284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.833+0000 7fab59ce6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5406b3f0 con 0x7fab5412b180 2024-04-26T12:30:05.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.833+0000 7fab59ce6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fab54127c80 con 0x7fab541280d0 2024-04-26T12:30:05.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.833+0000 7fab537fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab541280d0 0x7fab541284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.834+0000 7fab52ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fab5412b180 0x7fab5412b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33878/0 (socket says 172.21.15.132:33878) 2024-04-26T12:30:05.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.834+0000 7fab537fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab541280d0 0x7fab541284b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52578/0 (socket says 172.21.15.132:52578) 2024-04-26T12:30:05.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.834+0000 7fab52ffd640 1 -- 172.21.15.132:0/2702484279 learned_addr learned my addr 172.21.15.132:0/2702484279 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:05.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.834+0000 7fab537fe640 1 -- 172.21.15.132:0/2702484279 >> v1:172.21.15.132:6789/0 conn(0x7fab5412b180 legacy=0x7fab5412b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.834+0000 7fab537fe640 1 -- 172.21.15.132:0/2702484279 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5406ef00 con 0x7fab541280d0 2024-04-26T12:30:05.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.834+0000 7fab527fc640 1 -- 172.21.15.132:0/2702484279 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003538557 0 0) 0x7fab5406b3f0 con 0x7fab5412b180 2024-04-26T12:30:05.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab537fe640 1 --2- 172.21.15.132:0/2702484279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab541284b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab44009720 tx=0x7fab4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc039c4cb2146a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab527fc640 1 -- 172.21.15.132:0/2702484279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab440316d0 con 0x7fab541280d0 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab527fc640 1 -- 172.21.15.132:0/2702484279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab44037070 con 0x7fab541280d0 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab527fc640 1 -- 172.21.15.132:0/2702484279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab440319c0 con 0x7fab541280d0 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab59ce6640 1 -- 172.21.15.132:0/2702484279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 msgr2=0x7fab541284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab59ce6640 1 --2- 172.21.15.132:0/2702484279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab541284b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fab44009720 tx=0x7fab4402b840 comp rx=0 tx=0).stop 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab59ce6640 1 -- 172.21.15.132:0/2702484279 shutdown_connections 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab59ce6640 1 --2- 172.21.15.132:0/2702484279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab541284b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab59ce6640 1 -- 172.21.15.132:0/2702484279 >> 172.21.15.132:0/2702484279 conn(0x7fab5409b7b0 msgr2=0x7fab5409bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab59ce6640 1 -- 172.21.15.132:0/2702484279 shutdown_connections 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.835+0000 7fab59ce6640 1 -- 172.21.15.132:0/2702484279 wait complete. 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.836+0000 7fab59ce6640 1 Processor -- start 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.836+0000 7fab59ce6640 1 -- start start 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab59ce6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab540716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab59ce6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fab5408d030 con 0x7fab541280d0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab540716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab540716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52592/0 (socket says 172.21.15.132:52592) 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab537fe640 1 -- 172.21.15.132:0/2729713538 learned_addr learned my addr 172.21.15.132:0/2729713538 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab537fe640 1 -- 172.21.15.132:0/2729713538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab54072fb0 con 0x7fab541280d0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab537fe640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab540716a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab44034040 tx=0x7fab44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab3bfff640 1 -- 172.21.15.132:0/2729713538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab4404b070 con 0x7fab541280d0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab3bfff640 1 -- 172.21.15.132:0/2729713538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab44031cb0 con 0x7fab541280d0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab3bfff640 1 -- 172.21.15.132:0/2729713538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab44032430 con 0x7fab541280d0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab54121e20 con 0x7fab541280d0 2024-04-26T12:30:05.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.837+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab54071dc0 con 0x7fab541280d0 2024-04-26T12:30:05.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.838+0000 7fab3bfff640 1 -- 172.21.15.132:0/2729713538 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fab4404e070 con 0x7fab541280d0 2024-04-26T12:30:05.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.838+0000 7fab3bfff640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab40038060 0x7fab4003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:05.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.838+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab54062ed0 con 0x7fab541280d0 2024-04-26T12:30:05.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.838+0000 7fab3bfff640 1 -- 172.21.15.132:0/2729713538 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fab44043050 con 0x7fab541280d0 2024-04-26T12:30:05.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.839+0000 7fab52ffd640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab40038060 0x7fab4003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:05.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.839+0000 7fab52ffd640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab40038060 0x7fab4003a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab48000c00 tx=0x7fab48007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:05.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:05.843+0000 7fab3bfff640 1 -- 172.21.15.132:0/2729713538 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fab4404e520 con 0x7fab541280d0 2024-04-26T12:30:06.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.014+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab5406c240 con 0x7fab40038060 2024-04-26T12:30:06.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.015+0000 7fab3bfff640 1 -- 172.21.15.132:0/2729713538 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31820 (secure 0 0 0) 0x7fab5406c240 con 0x7fab40038060 2024-04-26T12:30:06.017 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:30:06.017 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab40038060 msgr2=0x7fab4003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab40038060 0x7fab4003a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab48000c00 tx=0x7fab48007910 comp rx=0 tx=0).stop 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 msgr2=0x7fab540716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab540716a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab44034040 tx=0x7fab44004730 comp rx=0 tx=0).stop 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 shutdown_connections 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab40038060 0x7fab4003a520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 --2- 172.21.15.132:0/2729713538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab541280d0 0x7fab540716a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 >> 172.21.15.132:0/2729713538 conn(0x7fab5409b7b0 msgr2=0x7fab541b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 shutdown_connections 2024-04-26T12:30:06.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.017+0000 7fab59ce6640 1 -- 172.21.15.132:0/2729713538 wait complete. 2024-04-26T12:30:06.029 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:30:04.421368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":134712,"kb_used_data":1656,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377352648,"statfs":{"total":386547056640,"available":386409111552,"internally_reserved":0,"allocated":1695744,"data_stored":1337208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":136177431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000612"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367841+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:30:03.367841+0000","last_peered":"2024-04-26T12:30:03.367841+0000","last_clean":"2024-04-26T12:30:03.367841+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:30:03.367841+0000","last_undegraded":"2024-04-26T12:30:03.367841+0000","last_fullsized":"2024-04-26T12:30:03.367841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:40.435075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:01.441185+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:30:01.441185+0000","last_peered":"2024-04-26T12:30:01.441185+0000","last_clean":"2024-04-26T12:30:01.441185+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:01.441185+0000","last_undegraded":"2024-04-26T12:30:01.441185+0000","last_fullsized":"2024-04-26T12:30:01.441185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:47.677843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367776+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:30:03.367776+0000","last_peered":"2024-04-26T12:30:03.367776+0000","last_clean":"2024-04-26T12:30:03.367776+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:30:03.367776+0000","last_undegraded":"2024-04-26T12:30:03.367776+0000","last_fullsized":"2024-04-26T12:30:03.367776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:20.349910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:01.441210+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:30:01.441210+0000","last_peered":"2024-04-26T12:30:01.441210+0000","last_clean":"2024-04-26T12:30:01.441210+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:01.441210+0000","last_undegraded":"2024-04-26T12:30:01.441210+0000","last_fullsized":"2024-04-26T12:30:01.441210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.414656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367759+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:30:03.367759+0000","last_peered":"2024-04-26T12:30:03.367759+0000","last_clean":"2024-04-26T12:30:03.367759+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:30:03.367759+0000","last_undegraded":"2024-04-26T12:30:03.367759+0000","last_fullsized":"2024-04-26T12:30:03.367759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:36.069601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:02.439417+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:30:02.439417+0000","last_peered":"2024-04-26T12:30:02.439417+0000","last_clean":"2024-04-26T12:30:02.439417+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:30:02.439417+0000","last_undegraded":"2024-04-26T12:30:02.439417+0000","last_fullsized":"2024-04-26T12:30:02.439417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:40.531155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367767+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:30:03.367767+0000","last_peered":"2024-04-26T12:30:03.367767+0000","last_clean":"2024-04-26T12:30:03.367767+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:30:03.367767+0000","last_undegraded":"2024-04-26T12:30:03.367767+0000","last_fullsized":"2024-04-26T12:30:03.367767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:20.023037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367816+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:30:03.367816+0000","last_peered":"2024-04-26T12:30:03.367816+0000","last_clean":"2024-04-26T12:30:03.367816+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:30:03.367816+0000","last_undegraded":"2024-04-26T12:30:03.367816+0000","last_fullsized":"2024-04-26T12:30:03.367816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.762234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":168,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:02.474621+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:30:02.474621+0000","last_peered":"2024-04-26T12:30:02.474621+0000","last_clean":"2024-04-26T12:30:02.474621+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:30:02.474621+0000","last_undegraded":"2024-04-26T12:30:02.474621+0000","last_fullsized":"2024-04-26T12:30:02.474621+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:34.223814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35468,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336372,"statfs":{"total":96636764160,"available":96600444928,"internally_reserved":0,"allocated":131072,"data_stored":41128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36044,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335796,"statfs":{"total":96636764160,"available":96599855104,"internally_reserved":0,"allocated":716800,"data_stored":627476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36056,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335784,"statfs":{"total":96636764160,"available":96599842816,"internally_reserved":0,"allocated":724992,"data_stored":631496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":37108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:06.030 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:06.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.124+0000 7f2299fa6640 1 Processor -- start 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.124+0000 7f2299fa6640 1 -- start start 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f2299fa6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22940927d0 0x7f2294133cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f2299fa6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f229406d950 con 0x7f2294091ce0 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f2299fa6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f229406e330 con 0x7f22940927d0 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f2292ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22940927d0 0x7f2294133cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f22937fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2294091ce0 0x7f22940920c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33894/0 (socket says 172.21.15.132:33894) 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f2292ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22940927d0 0x7f2294133cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52596/0 (socket says 172.21.15.132:52596) 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f22937fe640 1 -- 172.21.15.132:0/952611839 learned_addr learned my addr 172.21.15.132:0/952611839 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f2292ffd640 1 -- 172.21.15.132:0/952611839 >> v1:172.21.15.132:6789/0 conn(0x7f2294091ce0 legacy=0x7f22940920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.125+0000 7f2292ffd640 1 -- 172.21.15.132:0/952611839 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2294092c80 con 0x7f22940927d0 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.126+0000 7f2292ffd640 1 --2- 172.21.15.132:0/952611839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22940927d0 0x7f2294133cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2288009720 tx=0x7f228802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e727fa8a49212a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.126+0000 7f22927fc640 1 -- 172.21.15.132:0/952611839 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22880316d0 con 0x7f22940927d0 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.126+0000 7f22927fc640 1 -- 172.21.15.132:0/952611839 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2288037070 con 0x7f22940927d0 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.126+0000 7f22927fc640 1 -- 172.21.15.132:0/952611839 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22880319c0 con 0x7f22940927d0 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 -- 172.21.15.132:0/952611839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22940927d0 msgr2=0x7f2294133cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 --2- 172.21.15.132:0/952611839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22940927d0 0x7f2294133cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2288009720 tx=0x7f228802b840 comp rx=0 tx=0).stop 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 -- 172.21.15.132:0/952611839 shutdown_connections 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 --2- 172.21.15.132:0/952611839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22940927d0 0x7f2294133cb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 -- 172.21.15.132:0/952611839 >> 172.21.15.132:0/952611839 conn(0x7f22940a0040 msgr2=0x7f2294090380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 -- 172.21.15.132:0/952611839 shutdown_connections 2024-04-26T12:30:06.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 -- 172.21.15.132:0/952611839 wait complete. 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.127+0000 7f2299fa6640 1 Processor -- start 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f2299fa6640 1 -- start start 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f2299fa6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2294091ce0 0x7f22941328c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f2299fa6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2294134400 con 0x7f2294091ce0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f22937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2294091ce0 0x7f22941328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f22937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2294091ce0 0x7f22941328c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52604/0 (socket says 172.21.15.132:52604) 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f22937fe640 1 -- 172.21.15.132:0/4200313967 learned_addr learned my addr 172.21.15.132:0/4200313967 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f22937fe640 1 -- 172.21.15.132:0/4200313967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2294072ec0 con 0x7f2294091ce0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f22937fe640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2294091ce0 0x7f22941328c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f228400c4a0 tx=0x7f228400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f227bfff640 1 -- 172.21.15.132:0/4200313967 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2284017070 con 0x7f2294091ce0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.128+0000 7f227bfff640 1 -- 172.21.15.132:0/4200313967 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2284005c10 con 0x7f2294091ce0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.129+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2294126280 con 0x7f2294091ce0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.129+0000 7f227bfff640 1 -- 172.21.15.132:0/4200313967 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2284007070 con 0x7f2294091ce0 2024-04-26T12:30:06.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.129+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f229409cf90 con 0x7f2294091ce0 2024-04-26T12:30:06.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.129+0000 7f227bfff640 1 -- 172.21.15.132:0/4200313967 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f228401a070 con 0x7f2294091ce0 2024-04-26T12:30:06.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.129+0000 7f227bfff640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2280038060 0x7f228003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.129+0000 7f227bfff640 1 -- 172.21.15.132:0/4200313967 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f228404a210 con 0x7f2294091ce0 2024-04-26T12:30:06.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.130+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2294062ed0 con 0x7f2294091ce0 2024-04-26T12:30:06.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.130+0000 7f2292ffd640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2280038060 0x7f228003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.130+0000 7f2292ffd640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2280038060 0x7f228003a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2288036000 tx=0x7f2288008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.134+0000 7f227bfff640 1 -- 172.21.15.132:0/4200313967 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2284007210 con 0x7f2294091ce0 2024-04-26T12:30:06.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.301+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2294072ca0 con 0x7f2280038060 2024-04-26T12:30:06.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.303+0000 7f227bfff640 1 -- 172.21.15.132:0/4200313967 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31820 (secure 0 0 0) 0x7f2294072ca0 con 0x7f2280038060 2024-04-26T12:30:06.304 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:30:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:30:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2280038060 msgr2=0x7f228003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2280038060 0x7f228003a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2288036000 tx=0x7f2288008030 comp rx=0 tx=0).stop 2024-04-26T12:30:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2294091ce0 msgr2=0x7f22941328c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2294091ce0 0x7f22941328c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f228400c4a0 tx=0x7f228400c960 comp rx=0 tx=0).stop 2024-04-26T12:30:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 shutdown_connections 2024-04-26T12:30:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2280038060 0x7f228003a520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 --2- 172.21.15.132:0/4200313967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2294091ce0 0x7f22941328c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 >> 172.21.15.132:0/4200313967 conn(0x7f22940a0040 msgr2=0x7f2294071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 shutdown_connections 2024-04-26T12:30:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.305+0000 7f2299fa6640 1 -- 172.21.15.132:0/4200313967 wait complete. 2024-04-26T12:30:06.317 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:30:04.421368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":134712,"kb_used_data":1656,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377352648,"statfs":{"total":386547056640,"available":386409111552,"internally_reserved":0,"allocated":1695744,"data_stored":1337208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":136177431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000612"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367841+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:30:03.367841+0000","last_peered":"2024-04-26T12:30:03.367841+0000","last_clean":"2024-04-26T12:30:03.367841+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:30:03.367841+0000","last_undegraded":"2024-04-26T12:30:03.367841+0000","last_fullsized":"2024-04-26T12:30:03.367841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:40.435075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:01.441185+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:30:01.441185+0000","last_peered":"2024-04-26T12:30:01.441185+0000","last_clean":"2024-04-26T12:30:01.441185+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:01.441185+0000","last_undegraded":"2024-04-26T12:30:01.441185+0000","last_fullsized":"2024-04-26T12:30:01.441185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:47.677843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367776+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:30:03.367776+0000","last_peered":"2024-04-26T12:30:03.367776+0000","last_clean":"2024-04-26T12:30:03.367776+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:30:03.367776+0000","last_undegraded":"2024-04-26T12:30:03.367776+0000","last_fullsized":"2024-04-26T12:30:03.367776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:20.349910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:01.441210+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:30:01.441210+0000","last_peered":"2024-04-26T12:30:01.441210+0000","last_clean":"2024-04-26T12:30:01.441210+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:01.441210+0000","last_undegraded":"2024-04-26T12:30:01.441210+0000","last_fullsized":"2024-04-26T12:30:01.441210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:09.414656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367759+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:30:03.367759+0000","last_peered":"2024-04-26T12:30:03.367759+0000","last_clean":"2024-04-26T12:30:03.367759+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:30:03.367759+0000","last_undegraded":"2024-04-26T12:30:03.367759+0000","last_fullsized":"2024-04-26T12:30:03.367759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:36.069601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:02.439417+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:30:02.439417+0000","last_peered":"2024-04-26T12:30:02.439417+0000","last_clean":"2024-04-26T12:30:02.439417+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:30:02.439417+0000","last_undegraded":"2024-04-26T12:30:02.439417+0000","last_fullsized":"2024-04-26T12:30:02.439417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:40.531155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367767+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:30:03.367767+0000","last_peered":"2024-04-26T12:30:03.367767+0000","last_clean":"2024-04-26T12:30:03.367767+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:30:03.367767+0000","last_undegraded":"2024-04-26T12:30:03.367767+0000","last_fullsized":"2024-04-26T12:30:03.367767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:20.023037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:03.367816+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:30:03.367816+0000","last_peered":"2024-04-26T12:30:03.367816+0000","last_clean":"2024-04-26T12:30:03.367816+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:30:03.367816+0000","last_undegraded":"2024-04-26T12:30:03.367816+0000","last_fullsized":"2024-04-26T12:30:03.367816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.762234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":168,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:02.474621+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:30:02.474621+0000","last_peered":"2024-04-26T12:30:02.474621+0000","last_clean":"2024-04-26T12:30:02.474621+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:30:02.474621+0000","last_undegraded":"2024-04-26T12:30:02.474621+0000","last_fullsized":"2024-04-26T12:30:02.474621+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:34.223814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35468,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336372,"statfs":{"total":96636764160,"available":96600444928,"internally_reserved":0,"allocated":131072,"data_stored":41128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36044,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335796,"statfs":{"total":96636764160,"available":96599855104,"internally_reserved":0,"allocated":716800,"data_stored":627476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36056,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335784,"statfs":{"total":96636764160,"available":96599842816,"internally_reserved":0,"allocated":724992,"data_stored":631496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":37108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:06.317 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:30:06.318 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:30:06.318 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:30:06.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:30:06.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.411+0000 7fe5f3bfb640 1 Processor -- start 2024-04-26T12:30:06.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.411+0000 7fe5f3bfb640 1 -- start start 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f3bfb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5ec091b50 0x7fe5ec091f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f3bfb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5ec0928f0 con 0x7fe5ec092470 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f3bfb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe5ec092d40 con 0x7fe5ec091b50 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f1997640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5ec091b50 0x7fe5ec091f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f1196640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe5ec092470 0x7fe5ec12e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33902/0 (socket says 172.21.15.132:33902) 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f1196640 1 -- 172.21.15.132:0/1638158680 learned_addr learned my addr 172.21.15.132:0/1638158680 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f1997640 1 -- 172.21.15.132:0/1638158680 >> v1:172.21.15.132:6789/0 conn(0x7fe5ec092470 legacy=0x7fe5ec12e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f1997640 1 -- 172.21.15.132:0/1638158680 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ec06e120 con 0x7fe5ec091b50 2024-04-26T12:30:06.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.412+0000 7fe5f0995640 1 -- 172.21.15.132:0/1638158680 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972944118 0 0) 0x7fe5ec0928f0 con 0x7fe5ec092470 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.413+0000 7fe5f1997640 1 --2- 172.21.15.132:0/1638158680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec091f30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009720 tx=0x7fe5dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1b6c0548357f94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.413+0000 7fe5f0995640 1 -- 172.21.15.132:0/1638158680 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5dc035020 con 0x7fe5ec091b50 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.413+0000 7fe5f0995640 1 -- 172.21.15.132:0/1638158680 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5dc031760 con 0x7fe5ec091b50 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.413+0000 7fe5f0995640 1 -- 172.21.15.132:0/1638158680 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5dc031a60 con 0x7fe5ec091b50 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/1638158680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 msgr2=0x7fe5ec091f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 --2- 172.21.15.132:0/1638158680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec091f30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009720 tx=0x7fe5dc02b8d0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/1638158680 shutdown_connections 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 --2- 172.21.15.132:0/1638158680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec091f30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/1638158680 >> 172.21.15.132:0/1638158680 conn(0x7fe5ec09fdd0 msgr2=0x7fe5ec0a01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/1638158680 shutdown_connections 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/1638158680 wait complete. 2024-04-26T12:30:06.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 Processor -- start 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.414+0000 7fe5f3bfb640 1 -- start start 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f3bfb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f3bfb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ec12ed10 con 0x7fe5ec091b50 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f1997640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f1997640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52628/0 (socket says 172.21.15.132:52628) 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f1997640 1 -- 172.21.15.132:0/923340074 learned_addr learned my addr 172.21.15.132:0/923340074 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f1997640 1 -- 172.21.15.132:0/923340074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ec095780 con 0x7fe5ec091b50 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f1997640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec071680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009720 tx=0x7fe5dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5e27fc640 1 -- 172.21.15.132:0/923340074 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5dc03cc30 con 0x7fe5ec091b50 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5e27fc640 1 -- 172.21.15.132:0/923340074 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5dc03cdd0 con 0x7fe5ec091b50 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ec072f40 con 0x7fe5ec091b50 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.415+0000 7fe5e27fc640 1 -- 172.21.15.132:0/923340074 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5dc004160 con 0x7fe5ec091b50 2024-04-26T12:30:06.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.416+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ec095ab0 con 0x7fe5ec091b50 2024-04-26T12:30:06.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.416+0000 7fe5e27fc640 1 -- 172.21.15.132:0/923340074 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe5dc038020 con 0x7fe5ec091b50 2024-04-26T12:30:06.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.416+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ec06c890 con 0x7fe5ec091b50 2024-04-26T12:30:06.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.416+0000 7fe5e27fc640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5d0038060 0x7fe5d003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.416+0000 7fe5e27fc640 1 -- 172.21.15.132:0/923340074 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fe5dc06d6d0 con 0x7fe5ec091b50 2024-04-26T12:30:06.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.417+0000 7fe5f1196640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5d0038060 0x7fe5d003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.417+0000 7fe5f1196640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5d0038060 0x7fe5d003a520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e8007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.421+0000 7fe5e27fc640 1 -- 172.21.15.132:0/923340074 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe5ec06c890 con 0x7fe5ec091b50 2024-04-26T12:30:06.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.632+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe5ec072800 con 0x7fe5ec091b50 2024-04-26T12:30:06.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.632+0000 7fe5e27fc640 1 -- 172.21.15.132:0/923340074 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe5dc041070 con 0x7fe5ec091b50 2024-04-26T12:30:06.634 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:30:06.634 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:30:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5d0038060 msgr2=0x7fe5d003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5d0038060 0x7fe5d003a520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8000c00 tx=0x7fe5e8007970 comp rx=0 tx=0).stop 2024-04-26T12:30:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 msgr2=0x7fe5ec071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec071680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc009720 tx=0x7fe5dc0046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 shutdown_connections 2024-04-26T12:30:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5d0038060 0x7fe5d003a520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 --2- 172.21.15.132:0/923340074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5ec091b50 0x7fe5ec071680 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 >> 172.21.15.132:0/923340074 conn(0x7fe5ec09fdd0 msgr2=0x7fe5ec127e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 shutdown_connections 2024-04-26T12:30:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:30:06.635+0000 7fe5f3bfb640 1 -- 172.21.15.132:0/923340074 wait complete. 2024-04-26T12:30:06.647 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:30:06.647 INFO:teuthology.run_tasks:Running task rgw... 2024-04-26T12:30:06.662 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-26T12:30:06.662 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-26T12:30:06.662 INFO:tasks.rgw:Creating data pools 2024-04-26T12:30:06.662 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-26T12:30:06.662 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-04-26T12:30:06.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.774+0000 7fe844f60640 1 Processor -- start 2024-04-26T12:30:06.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.774+0000 7fe844f60640 1 -- start start 2024-04-26T12:30:06.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe844f60640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe84006cf70 0x7fe84006d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe844f60640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84006da70 con 0x7fe840119b60 2024-04-26T12:30:06.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe844f60640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe84011e680 con 0x7fe84006cf70 2024-04-26T12:30:06.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe83e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe84006cf70 0x7fe84006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe83e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe84006cf70 0x7fe84006d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38594/0 (socket says 172.21.15.170:38594) 2024-04-26T12:30:06.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe83dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe840119b60 0x7fe84011bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43400/0 (socket says 172.21.15.170:43400) 2024-04-26T12:30:06.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe83e59c640 1 -- 172.21.15.170:0/1924964380 learned_addr learned my addr 172.21.15.170:0/1924964380 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:06.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe83e59c640 1 -- 172.21.15.170:0/1924964380 >> v1:172.21.15.132:6789/0 conn(0x7fe840119b60 legacy=0x7fe84011bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.775+0000 7fe83e59c640 1 -- 172.21.15.170:0/1924964380 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84011e800 con 0x7fe84006cf70 2024-04-26T12:30:06.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.776+0000 7fe83e59c640 1 --2- 172.21.15.170:0/1924964380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe84006d350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8300097f0 tx=0x7fe83002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbfb3eec87f6a5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.776+0000 7fe83d59a640 1 -- 172.21.15.170:0/1924964380 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe830035020 con 0x7fe84006cf70 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.776+0000 7fe83d59a640 1 -- 172.21.15.170:0/1924964380 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8300317a0 con 0x7fe84006cf70 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.776+0000 7fe83d59a640 1 -- 172.21.15.170:0/1924964380 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe830031aa0 con 0x7fe84006cf70 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.777+0000 7fe844f60640 1 -- 172.21.15.170:0/1924964380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 msgr2=0x7fe84006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.777+0000 7fe844f60640 1 --2- 172.21.15.170:0/1924964380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe84006d350 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8300097f0 tx=0x7fe83002b910 comp rx=0 tx=0).stop 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.777+0000 7fe844f60640 1 -- 172.21.15.170:0/1924964380 shutdown_connections 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.777+0000 7fe844f60640 1 --2- 172.21.15.170:0/1924964380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe84006d350 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.777+0000 7fe844f60640 1 -- 172.21.15.170:0/1924964380 >> 172.21.15.170:0/1924964380 conn(0x7fe840071020 msgr2=0x7fe84010dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.777+0000 7fe844f60640 1 -- 172.21.15.170:0/1924964380 shutdown_connections 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.777+0000 7fe844f60640 1 -- 172.21.15.170:0/1924964380 wait complete. 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.778+0000 7fe844f60640 1 Processor -- start 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.778+0000 7fe844f60640 1 -- start start 2024-04-26T12:30:06.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.778+0000 7fe844f60640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe8401a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.778+0000 7fe844f60640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe84011db90 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe83e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe8401a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe83e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe8401a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38606/0 (socket says 172.21.15.170:38606) 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe83e59c640 1 -- 172.21.15.170:0/493454258 learned_addr learned my addr 172.21.15.170:0/493454258 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe83e59c640 1 -- 172.21.15.170:0/493454258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8401a6ed0 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe83e59c640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe8401a6990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8300097f0 tx=0x7fe8300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe82effd640 1 -- 172.21.15.170:0/493454258 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe83003ad00 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe82effd640 1 -- 172.21.15.170:0/493454258 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8300443f0 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8401a7160 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe82effd640 1 -- 172.21.15.170:0/493454258 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8300446d0 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.779+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8401ab090 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.780+0000 7fe82effd640 1 -- 172.21.15.170:0/493454258 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe83004b060 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.780+0000 7fe82effd640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe820038060 0x7fe82003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.780+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84004fe80 con 0x7fe84006cf70 2024-04-26T12:30:06.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.780+0000 7fe82effd640 1 -- 172.21.15.170:0/493454258 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fe83006d1b0 con 0x7fe84006cf70 2024-04-26T12:30:06.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.780+0000 7fe83dd9b640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe820038060 0x7fe82003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:06.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.781+0000 7fe83dd9b640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe820038060 0x7fe82003a520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe840067e00 tx=0x7fe834007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:06.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.785+0000 7fe82effd640 1 -- 172.21.15.170:0/493454258 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe83003f070 con 0x7fe84006cf70 2024-04-26T12:30:06.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:06.967+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7fe840119b60 con 0x7fe84006cf70 2024-04-26T12:30:07.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.448+0000 7fe82effd640 1 -- 172.21.15.170:0/493454258 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v16) ==== 171+0+0 (secure 0 0 0) 0x7fe83004dca0 con 0x7fe84006cf70 2024-04-26T12:30:07.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe820038060 msgr2=0x7fe82003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:07.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe820038060 0x7fe82003a520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe840067e00 tx=0x7fe834007a00 comp rx=0 tx=0).stop 2024-04-26T12:30:07.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 msgr2=0x7fe8401a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:07.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe8401a6990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8300097f0 tx=0x7fe8300046c0 comp rx=0 tx=0).stop 2024-04-26T12:30:07.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 shutdown_connections 2024-04-26T12:30:07.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe820038060 0x7fe82003a520 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:07.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 --2- 172.21.15.170:0/493454258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe84006cf70 0x7fe8401a6990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:07.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 >> 172.21.15.170:0/493454258 conn(0x7fe840071020 msgr2=0x7fe840119f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:07.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 shutdown_connections 2024-04-26T12:30:07.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.450+0000 7fe844f60640 1 -- 172.21.15.170:0/493454258 wait complete. 2024-04-26T12:30:07.462 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.561+0000 7feb3a1f4640 1 Processor -- start 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.561+0000 7feb3a1f4640 1 -- start start 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.561+0000 7feb3a1f4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb3410df90 0x7feb3410e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.561+0000 7feb3a1f4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3410ea90 con 0x7feb34117920 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.561+0000 7feb3a1f4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7feb3411c440 con 0x7feb3410df90 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.562+0000 7feb337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb3410df90 0x7feb3410e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.562+0000 7feb32ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feb34117920 0x7feb34119d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43408/0 (socket says 172.21.15.170:43408) 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.562+0000 7feb337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb3410df90 0x7feb3410e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38622/0 (socket says 172.21.15.170:38622) 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.562+0000 7feb32ffd640 1 -- 172.21.15.170:0/170344222 learned_addr learned my addr 172.21.15.170:0/170344222 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:07.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.562+0000 7feb337fe640 1 -- 172.21.15.170:0/170344222 >> v1:172.21.15.132:6789/0 conn(0x7feb34117920 legacy=0x7feb34119d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:07.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.562+0000 7feb337fe640 1 -- 172.21.15.170:0/170344222 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3411c5c0 con 0x7feb3410df90 2024-04-26T12:30:07.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.563+0000 7feb337fe640 1 --2- 172.21.15.170:0/170344222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410e370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb24009d90 tx=0x7feb2402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5683e8d8827e8cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:07.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.563+0000 7feb327fc640 1 -- 172.21.15.170:0/170344222 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb24039070 con 0x7feb3410df90 2024-04-26T12:30:07.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.563+0000 7feb327fc640 1 -- 172.21.15.170:0/170344222 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2402cb10 con 0x7feb3410df90 2024-04-26T12:30:07.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.563+0000 7feb327fc640 1 -- 172.21.15.170:0/170344222 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb2402ce10 con 0x7feb3410df90 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.564+0000 7feb3a1f4640 1 -- 172.21.15.170:0/170344222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 msgr2=0x7feb3410e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.564+0000 7feb3a1f4640 1 --2- 172.21.15.170:0/170344222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410e370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb24009d90 tx=0x7feb2402beb0 comp rx=0 tx=0).stop 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.564+0000 7feb3a1f4640 1 -- 172.21.15.170:0/170344222 shutdown_connections 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.564+0000 7feb3a1f4640 1 --2- 172.21.15.170:0/170344222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410e370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.564+0000 7feb3a1f4640 1 -- 172.21.15.170:0/170344222 >> 172.21.15.170:0/170344222 conn(0x7feb3406f510 msgr2=0x7feb34071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.564+0000 7feb3a1f4640 1 -- 172.21.15.170:0/170344222 shutdown_connections 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.564+0000 7feb3a1f4640 1 -- 172.21.15.170:0/170344222 wait complete. 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb3a1f4640 1 Processor -- start 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb3a1f4640 1 -- start start 2024-04-26T12:30:07.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb3a1f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb3a1f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feb3411b950 con 0x7feb3410df90 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38636/0 (socket says 172.21.15.170:38636) 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb337fe640 1 -- 172.21.15.170:0/509300720 learned_addr learned my addr 172.21.15.170:0/509300720 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.565+0000 7feb337fe640 1 -- 172.21.15.170:0/509300720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3410fcd0 con 0x7feb3410df90 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.566+0000 7feb337fe640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410f790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb24037040 tx=0x7feb24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.566+0000 7feb1bfff640 1 -- 172.21.15.170:0/509300720 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb24044020 con 0x7feb3410df90 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.566+0000 7feb1bfff640 1 -- 172.21.15.170:0/509300720 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2403f5a0 con 0x7feb3410df90 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.566+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3410ff00 con 0x7feb3410df90 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.566+0000 7feb1bfff640 1 -- 172.21.15.170:0/509300720 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb24039040 con 0x7feb3410df90 2024-04-26T12:30:07.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.566+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb341103f0 con 0x7feb3410df90 2024-04-26T12:30:07.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.567+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3404fe80 con 0x7feb3410df90 2024-04-26T12:30:07.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.567+0000 7feb1bfff640 1 -- 172.21.15.170:0/509300720 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7feb24047020 con 0x7feb3410df90 2024-04-26T12:30:07.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.567+0000 7feb1bfff640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20038010 0x7feb2003a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:07.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.567+0000 7feb1bfff640 1 -- 172.21.15.170:0/509300720 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3797+0+0 (secure 0 0 0) 0x7feb2406df30 con 0x7feb3410df90 2024-04-26T12:30:07.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.567+0000 7feb32ffd640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20038010 0x7feb2003a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:07.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.567+0000 7feb32ffd640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20038010 0x7feb2003a4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feb34068b30 tx=0x7feb28007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:07.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.572+0000 7feb1bfff640 1 -- 172.21.15.170:0/509300720 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7feb2404e030 con 0x7feb3410df90 2024-04-26T12:30:07.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:07.746+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7feb34117920 con 0x7feb3410df90 2024-04-26T12:30:09.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.460+0000 7feb1bfff640 1 -- 172.21.15.170:0/509300720 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v18) ==== 227+0+0 (secure 0 0 0) 0x7feb24048c80 con 0x7feb3410df90 2024-04-26T12:30:09.460 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'default.rgw.buckets.data' created 2024-04-26T12:30:09.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.465+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20038010 msgr2=0x7feb2003a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:09.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.465+0000 7feb3a1f4640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20038010 0x7feb2003a4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feb34068b30 tx=0x7feb28007a80 comp rx=0 tx=0).stop 2024-04-26T12:30:09.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.465+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 msgr2=0x7feb3410f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:09.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.465+0000 7feb3a1f4640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410f790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb24037040 tx=0x7feb24004a40 comp rx=0 tx=0).stop 2024-04-26T12:30:09.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.467+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 shutdown_connections 2024-04-26T12:30:09.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.467+0000 7feb3a1f4640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20038010 0x7feb2003a4d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:09.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.467+0000 7feb3a1f4640 1 --2- 172.21.15.170:0/509300720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb3410df90 0x7feb3410f790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:09.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.467+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 >> 172.21.15.170:0/509300720 conn(0x7feb3406f510 msgr2=0x7feb3406fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:09.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.468+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 shutdown_connections 2024-04-26T12:30:09.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.469+0000 7feb3a1f4640 1 -- 172.21.15.170:0/509300720 wait complete. 2024-04-26T12:30:09.488 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-26T12:30:09.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.588+0000 7f13d2100640 1 Processor -- start 2024-04-26T12:30:09.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.588+0000 7f13d2100640 1 -- start start 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13d2100640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13cc1189c0 0x7f13cc11adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13d2100640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13cc11b2f0 con 0x7f13cc10df90 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13d2100640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f13cc11c4d0 con 0x7f13cc1189c0 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13caffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13cc1189c0 0x7f13cc11adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13cb7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f13cc10df90 0x7f13cc10e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43414/0 (socket says 172.21.15.170:43414) 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13cb7fe640 1 -- 172.21.15.170:0/1662469264 learned_addr learned my addr 172.21.15.170:0/1662469264 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13ca7fc640 1 -- 172.21.15.170:0/1662469264 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196568169 0 0) 0x7f13cc11b2f0 con 0x7f13cc10df90 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13ca7fc640 1 -- 172.21.15.170:0/1662469264 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b4003520 con 0x7f13cc10df90 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13caffd640 1 -- 172.21.15.170:0/1662469264 >> v1:172.21.15.132:6789/0 conn(0x7f13cc10df90 legacy=0x7f13cc10e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:09.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.589+0000 7f13caffd640 1 -- 172.21.15.170:0/1662469264 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc11c650 con 0x7f13cc1189c0 2024-04-26T12:30:09.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.590+0000 7f13caffd640 1 --2- 172.21.15.170:0/1662469264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc1189c0 0x7f13cc11adb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009720 tx=0x7f13c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9c21e04078bee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:09.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.590+0000 7f13ca7fc640 1 -- 172.21.15.170:0/1662469264 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c0035020 con 0x7f13cc1189c0 2024-04-26T12:30:09.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.590+0000 7f13ca7fc640 1 -- 172.21.15.170:0/1662469264 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c0031760 con 0x7f13cc1189c0 2024-04-26T12:30:09.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.590+0000 7f13ca7fc640 1 -- 172.21.15.170:0/1662469264 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13c0031a40 con 0x7f13cc1189c0 2024-04-26T12:30:09.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.591+0000 7f13d2100640 1 -- 172.21.15.170:0/1662469264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc1189c0 msgr2=0x7f13cc11adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:09.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.591+0000 7f13d2100640 1 --2- 172.21.15.170:0/1662469264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc1189c0 0x7f13cc11adb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009720 tx=0x7f13c002b8d0 comp rx=0 tx=0).stop 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.591+0000 7f13d2100640 1 -- 172.21.15.170:0/1662469264 shutdown_connections 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.591+0000 7f13d2100640 1 --2- 172.21.15.170:0/1662469264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc1189c0 0x7f13cc11adb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.591+0000 7f13d2100640 1 -- 172.21.15.170:0/1662469264 >> 172.21.15.170:0/1662469264 conn(0x7f13cc06f500 msgr2=0x7f13cc071920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.591+0000 7f13d2100640 1 -- 172.21.15.170:0/1662469264 shutdown_connections 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.591+0000 7f13d2100640 1 -- 172.21.15.170:0/1662469264 wait complete. 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.592+0000 7f13d2100640 1 Processor -- start 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.592+0000 7f13d2100640 1 -- start start 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.592+0000 7f13d2100640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc10df90 0x7f13cc1aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.592+0000 7f13d2100640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc11b9a0 con 0x7f13cc10df90 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.592+0000 7f13cb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc10df90 0x7f13cc1aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.592+0000 7f13cb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc10df90 0x7f13cc1aa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38644/0 (socket says 172.21.15.170:38644) 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.592+0000 7f13cb7fe640 1 -- 172.21.15.170:0/3838820245 learned_addr learned my addr 172.21.15.170:0/3838820245 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.593+0000 7f13cb7fe640 1 -- 172.21.15.170:0/3838820245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc1aa710 con 0x7f13cc10df90 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.593+0000 7f13cb7fe640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc10df90 0x7f13cc1aa140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c380 tx=0x7f13bc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:09.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.593+0000 7f13b3fff640 1 -- 172.21.15.170:0/3838820245 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc017070 con 0x7f13cc10df90 2024-04-26T12:30:09.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.593+0000 7f13b3fff640 1 -- 172.21.15.170:0/3838820245 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc005c10 con 0x7f13cc10df90 2024-04-26T12:30:09.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.593+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc1aa9a0 con 0x7f13cc10df90 2024-04-26T12:30:09.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.593+0000 7f13b3fff640 1 -- 172.21.15.170:0/3838820245 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13bc0070d0 con 0x7f13cc10df90 2024-04-26T12:30:09.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.593+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc1a43b0 con 0x7f13cc10df90 2024-04-26T12:30:09.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.594+0000 7f13b3fff640 1 -- 172.21.15.170:0/3838820245 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13bc01a070 con 0x7f13cc10df90 2024-04-26T12:30:09.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.594+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13cc04fe80 con 0x7f13cc10df90 2024-04-26T12:30:09.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.594+0000 7f13b3fff640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f13b8038060 0x7f13b803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:09.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.594+0000 7f13b3fff640 1 -- 172.21.15.170:0/3838820245 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4272+0+0 (secure 0 0 0) 0x7f13bc04a670 con 0x7f13cc10df90 2024-04-26T12:30:09.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.594+0000 7f13caffd640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f13b8038060 0x7f13b803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:09.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.594+0000 7f13caffd640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f13b8038060 0x7f13b803a520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13c0036000 tx=0x7f13c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:09.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.600+0000 7f13b3fff640 1 -- 172.21.15.170:0/3838820245 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f13bc010950 con 0x7f13cc10df90 2024-04-26T12:30:09.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:09.774+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f13cc1aabd0 con 0x7f13cc10df90 2024-04-26T12:30:10.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.462+0000 7f13b3fff640 1 -- 172.21.15.170:0/3838820245 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7f13bc010bb0 con 0x7f13cc10df90 2024-04-26T12:30:10.464 INFO:teuthology.orchestra.run.smithi170.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-26T12:30:10.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.466+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f13b8038060 msgr2=0x7f13b803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:10.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.466+0000 7f13d2100640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f13b8038060 0x7f13b803a520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13c0036000 tx=0x7f13c0008030 comp rx=0 tx=0).stop 2024-04-26T12:30:10.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.466+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc10df90 msgr2=0x7f13cc1aa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:10.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.466+0000 7f13d2100640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc10df90 0x7f13cc1aa140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c380 tx=0x7f13bc00c840 comp rx=0 tx=0).stop 2024-04-26T12:30:10.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.467+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 shutdown_connections 2024-04-26T12:30:10.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.467+0000 7f13d2100640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f13b8038060 0x7f13b803a520 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:10.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.467+0000 7f13d2100640 1 --2- 172.21.15.170:0/3838820245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13cc10df90 0x7f13cc1aa140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:10.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.467+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 >> 172.21.15.170:0/3838820245 conn(0x7f13cc06f500 msgr2=0x7f13cc071660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:10.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.467+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 shutdown_connections 2024-04-26T12:30:10.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.467+0000 7f13d2100640 1 -- 172.21.15.170:0/3838820245 wait complete. 2024-04-26T12:30:10.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-26T12:30:10.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.605+0000 7fbab884c640 1 Processor -- start 2024-04-26T12:30:10.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.605+0000 7fbab884c640 1 -- start start 2024-04-26T12:30:10.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.605+0000 7fbab884c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbab411ab40 0x7fbab411cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:10.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.605+0000 7fbab884c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab411d470 con 0x7fbab4111e20 2024-04-26T12:30:10.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.605+0000 7fbab884c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbab411e670 con 0x7fbab411ab40 2024-04-26T12:30:10.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.606+0000 7fbab1d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbab411ab40 0x7fbab411cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:10.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.606+0000 7fbab259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbab4111e20 0x7fbab4112200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43428/0 (socket says 172.21.15.170:43428) 2024-04-26T12:30:10.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.606+0000 7fbab259c640 1 -- 172.21.15.170:0/3164301359 learned_addr learned my addr 172.21.15.170:0/3164301359 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:10.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.606+0000 7fbab1d9b640 1 -- 172.21.15.170:0/3164301359 >> v1:172.21.15.132:6789/0 conn(0x7fbab4111e20 legacy=0x7fbab4112200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:10.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.606+0000 7fbab1d9b640 1 -- 172.21.15.170:0/3164301359 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab411e820 con 0x7fbab411ab40 2024-04-26T12:30:10.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.606+0000 7fbab159a640 1 -- 172.21.15.170:0/3164301359 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395427358 0 0) 0x7fbab411d470 con 0x7fbab4111e20 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.607+0000 7fbab1d9b640 1 --2- 172.21.15.170:0/3164301359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab411ab40 0x7fbab411cf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009720 tx=0x7fbaa802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b0e96e7a9a7c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.607+0000 7fbab159a640 1 -- 172.21.15.170:0/3164301359 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa80316d0 con 0x7fbab411ab40 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.607+0000 7fbab159a640 1 -- 172.21.15.170:0/3164301359 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa8037070 con 0x7fbab411ab40 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.607+0000 7fbab159a640 1 -- 172.21.15.170:0/3164301359 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa80319c0 con 0x7fbab411ab40 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.608+0000 7fbab884c640 1 -- 172.21.15.170:0/3164301359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab411ab40 msgr2=0x7fbab411cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.608+0000 7fbab884c640 1 --2- 172.21.15.170:0/3164301359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab411ab40 0x7fbab411cf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009720 tx=0x7fbaa802b840 comp rx=0 tx=0).stop 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.608+0000 7fbab884c640 1 -- 172.21.15.170:0/3164301359 shutdown_connections 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.608+0000 7fbab884c640 1 --2- 172.21.15.170:0/3164301359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab411ab40 0x7fbab411cf30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:10.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.608+0000 7fbab884c640 1 -- 172.21.15.170:0/3164301359 >> 172.21.15.170:0/3164301359 conn(0x7fbab406e960 msgr2=0x7fbab410fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:10.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.608+0000 7fbab884c640 1 -- 172.21.15.170:0/3164301359 shutdown_connections 2024-04-26T12:30:10.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.608+0000 7fbab884c640 1 -- 172.21.15.170:0/3164301359 wait complete. 2024-04-26T12:30:10.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab884c640 1 Processor -- start 2024-04-26T12:30:10.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab884c640 1 -- start start 2024-04-26T12:30:10.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab4111e20 0x7fbab41ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:10.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab884c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbab411db20 con 0x7fbab4111e20 2024-04-26T12:30:10.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab4111e20 0x7fbab41ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:10.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab4111e20 0x7fbab41ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38674/0 (socket says 172.21.15.170:38674) 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab259c640 1 -- 172.21.15.170:0/1192490530 learned_addr learned my addr 172.21.15.170:0/1192490530 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.609+0000 7fbab259c640 1 -- 172.21.15.170:0/1192490530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab41ac8e0 con 0x7fbab4111e20 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.610+0000 7fbab259c640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab4111e20 0x7fbab41ac310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400c840 tx=0x7fbaa400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.610+0000 7fbaa2ffd640 1 -- 172.21.15.170:0/1192490530 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa4018070 con 0x7fbab4111e20 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.610+0000 7fbaa2ffd640 1 -- 172.21.15.170:0/1192490530 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa400a660 con 0x7fbab4111e20 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.610+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab41acb70 con 0x7fbab4111e20 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.610+0000 7fbaa2ffd640 1 -- 172.21.15.170:0/1192490530 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaa400a980 con 0x7fbab4111e20 2024-04-26T12:30:10.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.610+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab41a6600 con 0x7fbab4111e20 2024-04-26T12:30:10.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.611+0000 7fbaa2ffd640 1 -- 172.21.15.170:0/1192490530 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbaa401b070 con 0x7fbab4111e20 2024-04-26T12:30:10.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.611+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab404fe80 con 0x7fbab4111e20 2024-04-26T12:30:10.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.611+0000 7fbaa2ffd640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fba94038060 0x7fba9403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:10.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.611+0000 7fbaa2ffd640 1 -- 172.21.15.170:0/1192490530 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4283+0+0 (secure 0 0 0) 0x7fbaa404a9f0 con 0x7fbab4111e20 2024-04-26T12:30:10.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.611+0000 7fbab1d9b640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fba94038060 0x7fba9403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:10.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.611+0000 7fbab1d9b640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fba94038060 0x7fba9403a520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8036000 tx=0x7fbaa8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:10.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.616+0000 7fbaa2ffd640 1 -- 172.21.15.170:0/1192490530 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbaa4011360 con 0x7fbab4111e20 2024-04-26T12:30:10.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:10.786+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fbab41acda0 con 0x7fbab4111e20 2024-04-26T12:30:11.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.466+0000 7fbaa2ffd640 1 -- 172.21.15.170:0/1192490530 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7fbaa400adb0 con 0x7fbab4111e20 2024-04-26T12:30:11.468 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'default.rgw.buckets.index' created 2024-04-26T12:30:11.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fba94038060 msgr2=0x7fba9403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:11.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fba94038060 0x7fba9403a520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8036000 tx=0x7fbaa8008030 comp rx=0 tx=0).stop 2024-04-26T12:30:11.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab4111e20 msgr2=0x7fbab41ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:11.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab4111e20 0x7fbab41ac310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400c840 tx=0x7fbaa400cd00 comp rx=0 tx=0).stop 2024-04-26T12:30:11.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 shutdown_connections 2024-04-26T12:30:11.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fba94038060 0x7fba9403a520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:11.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 --2- 172.21.15.170:0/1192490530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbab4111e20 0x7fbab41ac310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:11.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.469+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 >> 172.21.15.170:0/1192490530 conn(0x7fbab406e960 msgr2=0x7fbab4115830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:11.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.470+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 shutdown_connections 2024-04-26T12:30:11.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.470+0000 7fbab884c640 1 -- 172.21.15.170:0/1192490530 wait complete. 2024-04-26T12:30:11.492 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-26T12:30:11.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc75b0d2640 1 Processor -- start 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc75b0d2640 1 -- start start 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc75b0d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc754117810 0x7fc754119c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc75b0d2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc75411a140 con 0x7fc75410f930 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc75b0d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc75411b320 con 0x7fc754117810 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc753fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc754117810 0x7fc754119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc753fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc754117810 0x7fc754119c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38688/0 (socket says 172.21.15.170:38688) 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc753fff640 1 -- 172.21.15.170:0/3864195855 learned_addr learned my addr 172.21.15.170:0/3864195855 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:11.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.589+0000 7fc758e6e640 1 --1- 172.21.15.170:0/3864195855 >> v1:172.21.15.132:6789/0 conn(0x7fc75410f930 0x7fc75410fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43434/0 (socket says 172.21.15.170:43434) 2024-04-26T12:30:11.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.590+0000 7fc753fff640 1 -- 172.21.15.170:0/3864195855 >> v1:172.21.15.132:6789/0 conn(0x7fc75410f930 legacy=0x7fc75410fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:11.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.590+0000 7fc753fff640 1 -- 172.21.15.170:0/3864195855 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75411b4a0 con 0x7fc754117810 2024-04-26T12:30:11.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.590+0000 7fc753fff640 1 --2- 172.21.15.170:0/3864195855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc754117810 0x7fc754119c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7400097f0 tx=0x7fc74002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af1814e9efc9431 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:11.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc7537fe640 1 -- 172.21.15.170:0/3864195855 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc740035020 con 0x7fc754117810 2024-04-26T12:30:11.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc7537fe640 1 -- 172.21.15.170:0/3864195855 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7400317a0 con 0x7fc754117810 2024-04-26T12:30:11.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc7537fe640 1 -- 172.21.15.170:0/3864195855 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc740031aa0 con 0x7fc754117810 2024-04-26T12:30:11.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc75b0d2640 1 -- 172.21.15.170:0/3864195855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc754117810 msgr2=0x7fc754119c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc75b0d2640 1 --2- 172.21.15.170:0/3864195855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc754117810 0x7fc754119c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc7400097f0 tx=0x7fc74002b910 comp rx=0 tx=0).stop 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc75b0d2640 1 -- 172.21.15.170:0/3864195855 shutdown_connections 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc75b0d2640 1 --2- 172.21.15.170:0/3864195855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc754117810 0x7fc754119c00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc75b0d2640 1 -- 172.21.15.170:0/3864195855 >> 172.21.15.170:0/3864195855 conn(0x7fc75406f500 msgr2=0x7fc754071920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc75b0d2640 1 -- 172.21.15.170:0/3864195855 shutdown_connections 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.591+0000 7fc75b0d2640 1 -- 172.21.15.170:0/3864195855 wait complete. 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.592+0000 7fc75b0d2640 1 Processor -- start 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.592+0000 7fc75b0d2640 1 -- start start 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.592+0000 7fc75b0d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc75410f930 0x7fc7541a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.592+0000 7fc75b0d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc75411a830 con 0x7fc75410f930 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.592+0000 7fc758e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc75410f930 0x7fc7541a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.592+0000 7fc758e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc75410f930 0x7fc7541a5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:38702/0 (socket says 172.21.15.170:38702) 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.592+0000 7fc758e6e640 1 -- 172.21.15.170:0/1664666909 learned_addr learned my addr 172.21.15.170:0/1664666909 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:11.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.593+0000 7fc758e6e640 1 -- 172.21.15.170:0/1664666909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7541a5940 con 0x7fc75410f930 2024-04-26T12:30:11.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.593+0000 7fc758e6e640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc75410f930 0x7fc7541a5370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c340 tx=0x7fc748001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:11.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.593+0000 7fc7517fa640 1 -- 172.21.15.170:0/1664666909 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc748007410 con 0x7fc75410f930 2024-04-26T12:30:11.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.593+0000 7fc7517fa640 1 -- 172.21.15.170:0/1664666909 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7480075b0 con 0x7fc75410f930 2024-04-26T12:30:11.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.593+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7541a5b70 con 0x7fc75410f930 2024-04-26T12:30:11.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.593+0000 7fc7517fa640 1 -- 172.21.15.170:0/1664666909 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7480047e0 con 0x7fc75410f930 2024-04-26T12:30:11.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.593+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7541a6040 con 0x7fc75410f930 2024-04-26T12:30:11.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.594+0000 7fc7517fa640 1 -- 172.21.15.170:0/1664666909 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc74801a020 con 0x7fc75410f930 2024-04-26T12:30:11.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.594+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75404fe80 con 0x7fc75410f930 2024-04-26T12:30:11.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.595+0000 7fc7517fa640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc738038060 0x7fc73803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:11.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.595+0000 7fc7517fa640 1 -- 172.21.15.170:0/1664666909 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4647+0+0 (secure 0 0 0) 0x7fc74804ab20 con 0x7fc75410f930 2024-04-26T12:30:11.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.595+0000 7fc753fff640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc738038060 0x7fc73803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:11.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.595+0000 7fc753fff640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc738038060 0x7fc73803a520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc740036000 tx=0x7fc740008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:11.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.600+0000 7fc7517fa640 1 -- 172.21.15.170:0/1664666909 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc74801bc30 con 0x7fc75410f930 2024-04-26T12:30:11.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:11.776+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fc754117810 con 0x7fc75410f930 2024-04-26T12:30:12.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.468+0000 7fc7517fa640 1 -- 172.21.15.170:0/1664666909 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7fc748019d50 con 0x7fc75410f930 2024-04-26T12:30:12.471 INFO:teuthology.orchestra.run.smithi170.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-26T12:30:12.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc738038060 msgr2=0x7fc73803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc738038060 0x7fc73803a520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc740036000 tx=0x7fc740008030 comp rx=0 tx=0).stop 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc75410f930 msgr2=0x7fc7541a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc75410f930 0x7fc7541a5370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c340 tx=0x7fc748001e70 comp rx=0 tx=0).stop 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 shutdown_connections 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc738038060 0x7fc73803a520 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 --2- 172.21.15.170:0/1664666909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc75410f930 0x7fc7541a5370 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c340 tx=0x7fc748001e70 comp rx=0 tx=0).stop 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.472+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 >> 172.21.15.170:0/1664666909 conn(0x7fc75406f500 msgr2=0x7fc75406ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.473+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 shutdown_connections 2024-04-26T12:30:12.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:12.473+0000 7fc75b0d2640 1 -- 172.21.15.170:0/1664666909 wait complete. 2024-04-26T12:30:12.505 DEBUG:tasks.rgw:Pools created 2024-04-26T12:30:12.505 INFO:tasks.rgw:Starting rgw... 2024-04-26T12:30:12.506 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-26T12:30:12.506 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-26T12:30:12.506 DEBUG:teuthology.orchestra.run.smithi170:> sudo echo -n http://smithi170.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-26T12:30:12.531 INFO:teuthology.orchestra.run.smithi170.stdout:http://smithi170.front.sepia.ceph.com:80 2024-04-26T12:30:12.532 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-26T12:30:12.596 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-26T12:30:12.596 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-26T12:30:12.640 INFO:tasks.rgw.client.0:Started 2024-04-26T12:30:12.640 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi170.front.sepia.ceph.com:80/ 2024-04-26T12:30:12.640 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-04-26T12:30:12.668 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:30:12.668 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:30:12.668 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:30:12.669 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:30:12.669 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-04-26T12:30:13.669 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-04-26T12:30:13.691 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:30:13.691 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:30:13.692 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:30:13.693 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:30:13.693 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-04-26T12:30:15.694 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-04-26T12:30:15.716 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:30:15.716 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:30:15.717 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:30:15.718 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:30:15.718 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-04-26T12:30:19.718 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-04-26T12:30:19.741 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:30:19.741 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:30:19.741 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:30:19.742 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:30:19.742 INFO:teuthology.orchestra.run.smithi170.stderr:curl: (7) Failed to connect to smithi170.front.sepia.ceph.com port 80: Connection refused 2024-04-26T12:30:21.578 INFO:tasks.rgw.client.0.smithi170.stdout:2024-04-26T12:30:21.577+0000 7f687eb24880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-26T12:30:27.744 DEBUG:teuthology.orchestra.run.smithi170:> curl http://smithi170.front.sepia.ceph.com:80/ 2024-04-26T12:30:27.766 INFO:teuthology.orchestra.run.smithi170.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:30:27.766 INFO:teuthology.orchestra.run.smithi170.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:30:27.770 INFO:teuthology.orchestra.run.smithi170.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 62333 0 --:--:-- --:--:-- --:--:-- 93500 2024-04-26T12:30:27.770 INFO:teuthology.orchestra.run.smithi170.stdout:anonymous 2024-04-26T12:30:27.770 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-26T12:30:29.367 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-26T12:30:29.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-26T12:30:29.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-26T12:30:29.368 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-26T12:30:29.418 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:29.418 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:29.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c56698800 1 Processor -- start 2024-04-26T12:30:29.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c56698800 1 -- start start 2024-04-26T12:30:29.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c56698800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561097792df0 0x561097793210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c56698800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5610976410c0 con 0x561097793750 2024-04-26T12:30:29.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c56698800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5610976254d0 con 0x561097792df0 2024-04-26T12:30:29.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c5419e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561097792df0 0x561097793210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c5419e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561097792df0 0x561097793210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40620/0 (socket says 172.21.15.170:40620) 2024-04-26T12:30:29.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c5399d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x561097793750 0x561097793c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:45932/0 (socket says 172.21.15.170:45932) 2024-04-26T12:30:29.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.418+0000 7f2c5419e640 1 -- 172.21.15.170:0/2863227824 learned_addr learned my addr 172.21.15.170:0/2863227824 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.419+0000 7f2c5419e640 1 -- 172.21.15.170:0/2863227824 >> v1:172.21.15.132:6789/0 conn(0x561097793750 legacy=0x561097793c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.419+0000 7f2c5419e640 1 -- 172.21.15.170:0/2863227824 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561097652d40 con 0x561097792df0 2024-04-26T12:30:29.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c5419e640 1 --2- 172.21.15.170:0/2863227824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097793210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00a520 tx=0x7f2c4c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdde9e61cda0226 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c5319c640 1 -- 172.21.15.170:0/2863227824 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c057070 con 0x561097792df0 2024-04-26T12:30:29.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c5319c640 1 -- 172.21.15.170:0/2863227824 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c052570 con 0x561097792df0 2024-04-26T12:30:29.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c5319c640 1 -- 172.21.15.170:0/2863227824 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c052870 con 0x561097792df0 2024-04-26T12:30:29.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c56698800 1 -- 172.21.15.170:0/2863227824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 msgr2=0x561097793210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c56698800 1 --2- 172.21.15.170:0/2863227824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097793210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00a520 tx=0x7f2c4c01d010 comp rx=0 tx=0).stop 2024-04-26T12:30:29.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c56698800 1 -- 172.21.15.170:0/2863227824 shutdown_connections 2024-04-26T12:30:29.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c56698800 1 --2- 172.21.15.170:0/2863227824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097793210 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c56698800 1 -- 172.21.15.170:0/2863227824 >> 172.21.15.170:0/2863227824 conn(0x56109778e9d0 msgr2=0x561097790df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c56698800 1 -- 172.21.15.170:0/2863227824 shutdown_connections 2024-04-26T12:30:29.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.421+0000 7f2c56698800 1 -- 172.21.15.170:0/2863227824 wait complete. 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.435+0000 7f2c56698800 1 Processor -- start 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.435+0000 7f2c56698800 1 -- start start 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.435+0000 7f2c56698800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097887a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.435+0000 7f2c56698800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5610976dfb30 con 0x561097792df0 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097887a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097887a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40632/0 (socket says 172.21.15.170:40632) 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2c5419e640 1 -- 172.21.15.170:0/342835776 learned_addr learned my addr 172.21.15.170:0/342835776 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2c5419e640 1 -- 172.21.15.170:0/342835776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561097651590 con 0x561097792df0 2024-04-26T12:30:29.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2c5419e640 1 --2- 172.21.15.170:0/342835776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097887a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c055040 tx=0x7f2c4c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3a9c5946f473fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2b4260c640 1 -- 172.21.15.170:0/342835776 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c057040 con 0x561097792df0 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2b4260c640 1 -- 172.21.15.170:0/342835776 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c052870 con 0x561097792df0 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.436+0000 7f2b4260c640 1 -- 172.21.15.170:0/342835776 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c052b90 con 0x561097792df0 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 -- 172.21.15.170:0/342835776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 msgr2=0x561097887a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 --2- 172.21.15.170:0/342835776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097887a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c055040 tx=0x7f2c4c04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 -- 172.21.15.170:0/342835776 shutdown_connections 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 --2- 172.21.15.170:0/342835776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x561097887a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 -- 172.21.15.170:0/342835776 >> 172.21.15.170:0/342835776 conn(0x56109778e9d0 msgr2=0x561097883340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 -- 172.21.15.170:0/342835776 shutdown_connections 2024-04-26T12:30:29.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 -- 172.21.15.170:0/342835776 wait complete. 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.437+0000 7f2c56698800 1 Processor -- start 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c56698800 1 -- start start 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c56698800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x56109788f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c56698800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5610977945b0 con 0x561097792df0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x56109788f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x56109788f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40634/0 (socket says 172.21.15.170:40634) 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c5419e640 1 -- 172.21.15.170:0/443321445 learned_addr learned my addr 172.21.15.170:0/443321445 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c5419e640 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610976488f0 con 0x561097792df0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.438+0000 7f2c5419e640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x56109788f2d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c052540 tx=0x7f2c4c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.439+0000 7f2b40e09640 1 -- 172.21.15.170:0/443321445 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c073070 con 0x561097792df0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.439+0000 7f2b40e09640 1 -- 172.21.15.170:0/443321445 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c05d570 con 0x561097792df0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.439+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56109788f810 con 0x561097792df0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.439+0000 7f2b40e09640 1 -- 172.21.15.170:0/443321445 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c057070 con 0x561097792df0 2024-04-26T12:30:29.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.439+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109788fd30 con 0x561097792df0 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.440+0000 7f2b40e09640 1 -- 172.21.15.170:0/443321445 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c4c076070 con 0x561097792df0 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.440+0000 7f2b40e09640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b3c036950 0x7f2b3c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.440+0000 7f2b40e09640 1 -- 172.21.15.170:0/443321445 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2c4c08dd40 con 0x561097792df0 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.440+0000 7f2c5399d640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b3c036950 0x7f2b3c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.440+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561097793750 0x561097896340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.440+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561097896880 con 0x561097793750 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.440+0000 7f2c5499f640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561097793750 0x561097896340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.441+0000 7f2c5399d640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b3c036950 0x7f2b3c038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c48000f60 tx=0x7f2c48001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.441+0000 7f2c5499f640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561097793750 0x561097896340 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.441+0000 7f2c5499f640 1 -- 172.21.15.170:0/443321445 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x561097793750 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.441+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978938f0 con 0x561097793750 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.441+0000 7f2c5499f640 1 -- 172.21.15.170:0/443321445 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c4400a4a0 con 0x561097793750 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.441+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561097898b70 0x56109789af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.441+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56109789b600 con 0x561097898b70 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.442+0000 7f2c5419e640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561097898b70 0x56109789af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.442+0000 7f2c5419e640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561097898b70 0x56109789af60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.443+0000 7f2c5419e640 1 -- 172.21.15.170:0/443321445 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c4c075030 con 0x561097898b70 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.443+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561097897b20 con 0x561097793750 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.443+0000 7f2c5499f640 1 -- 172.21.15.170:0/443321445 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c4400a4a0 con 0x561097793750 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.443+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56109789cab0 0x56109789ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.443+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56109789f660 con 0x56109789cab0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.443+0000 7f2c5399d640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56109789cab0 0x56109789ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.443+0000 7f2c5399d640 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56109789cab0 0x56109789ef00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c5399d640 1 -- 172.21.15.170:0/443321445 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c4800f690 con 0x56109789cab0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c56698800 1 Processor -- start 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c56698800 1 -- start start 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c56698800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978adac0 0x5610978adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c56698800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561097685e60 con 0x5610978adac0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978adac0 0x5610978adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978adac0 0x5610978adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40636/0 (socket says 172.21.15.170:40636) 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.444+0000 7f2c5419e640 1 -- 172.21.15.170:0/992832187 learned_addr learned my addr 172.21.15.170:0/992832187 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.445+0000 7f2c5419e640 1 -- 172.21.15.170:0/992832187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610978ae420 con 0x5610978adac0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.445+0000 7f2c5419e640 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978adac0 0x5610978adee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c006b30 tx=0x7f2c4c079b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.445+0000 7f2b39ffb640 1 -- 172.21.15.170:0/992832187 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c007e30 con 0x5610978adac0 2024-04-26T12:30:29.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.445+0000 7f2b39ffb640 1 -- 172.21.15.170:0/992832187 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c007fd0 con 0x5610978adac0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.445+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610978aee90 con 0x5610978adac0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.445+0000 7f2b39ffb640 1 -- 172.21.15.170:0/992832187 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c0773b0 con 0x5610978adac0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.445+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610978af390 con 0x5610978adac0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.446+0000 7f2b39ffb640 1 -- 172.21.15.170:0/992832187 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c4c077550 con 0x5610978adac0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.446+0000 7f2b39ffb640 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b2c036950 0x7f2b2c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.446+0000 7f2b39ffb640 1 -- 172.21.15.170:0/992832187 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2c4c04c0e0 con 0x5610978adac0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.446+0000 7f2c5399d640 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b2c036950 0x7f2b2c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c56698800 1 Processor -- start 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c56698800 1 -- start start 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c5399d640 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b2c036950 0x7f2b2c038e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x561097893830 tx=0x7f2c4800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c56698800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c56698800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5610978880e0 con 0x5610978bac90 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978bb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40652/0 (socket says 172.21.15.170:40652) 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c5419e640 1 -- 172.21.15.170:0/2217328065 learned_addr learned my addr 172.21.15.170:0/2217328065 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.447+0000 7f2c5419e640 1 -- 172.21.15.170:0/2217328065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610978bb680 con 0x5610978bac90 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c5419e640 1 --2- 172.21.15.170:0/2217328065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978bb0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c05cf90 tx=0x7f2c4c060e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a4a0c453ded675 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2b337fe640 1 -- 172.21.15.170:0/2217328065 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c076d70 con 0x5610978bac90 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2b337fe640 1 -- 172.21.15.170:0/2217328065 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c05c750 con 0x5610978bac90 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2b337fe640 1 -- 172.21.15.170:0/2217328065 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c08d8c0 con 0x5610978bac90 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 -- 172.21.15.170:0/2217328065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 msgr2=0x5610978bb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 --2- 172.21.15.170:0/2217328065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978bb0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c05cf90 tx=0x7f2c4c060e90 comp rx=0 tx=0).stop 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 -- 172.21.15.170:0/2217328065 shutdown_connections 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 --2- 172.21.15.170:0/2217328065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978bb0b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 -- 172.21.15.170:0/2217328065 >> 172.21.15.170:0/2217328065 conn(0x5610978b6f60 msgr2=0x5610978b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 -- 172.21.15.170:0/2217328065 shutdown_connections 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 -- 172.21.15.170:0/2217328065 wait complete. 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.448+0000 7f2c56698800 1 Processor -- start 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c56698800 1 -- start start 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c56698800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c56698800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5610978bbce0 con 0x5610978bac90 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c5419e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978c2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40664/0 (socket says 172.21.15.170:40664) 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 learned_addr learned my addr 172.21.15.170:0/833094956 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610978c2550 con 0x5610978bac90 2024-04-26T12:30:29.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.449+0000 7f2c5419e640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978c2010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0068b0 tx=0x7f2c4c06ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.450+0000 7f2b31ffb640 1 -- 172.21.15.170:0/833094956 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c089480 con 0x5610978bac90 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.450+0000 7f2b31ffb640 1 -- 172.21.15.170:0/833094956 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c089620 con 0x5610978bac90 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.450+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610978c2550 con 0x5610978bac90 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.450+0000 7f2b31ffb640 1 -- 172.21.15.170:0/833094956 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4c08d490 con 0x5610978bac90 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.450+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610978c2550 con 0x5610978bac90 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2b31ffb640 1 -- 172.21.15.170:0/833094956 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c4c089810 con 0x5610978bac90 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2b31ffb640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b240368b0 0x7f2b24038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2b31ffb640 1 -- 172.21.15.170:0/833094956 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2c4c0ba920 con 0x5610978bac90 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2c5399d640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b240368b0 0x7f2b24038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5610978cd7a0 0x5610978cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d0390 con 0x5610978cd7a0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.451+0000 7f2c5499f640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5610978cd7a0 0x5610978cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c5399d640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b240368b0 0x7f2b24038d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x56109789fa60 tx=0x7f2c48010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c5499f640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5610978cd7a0 0x5610978cfc40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 20 realm 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d07a0 con 0x5610978cd7a0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d1040 con 0x5610978cd7a0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.452+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c56698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c56698800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5610978d2140 0x5610978d4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d4a70 con 0x5610978d2140 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c5419e640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5610978d2140 0x5610978d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.453+0000 7f2c5419e640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5610978d2140 0x5610978d4530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.454+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.454+0000 7f2c56698800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:29.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.454+0000 7f2c56698800 20 searching for the correct realm 2024-04-26T12:30:29.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.454+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5610978d6af0 0x5610978d8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.454+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d9680 con 0x5610978d6af0 2024-04-26T12:30:29.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.454+0000 7f2c5399d640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5610978d6af0 0x5610978d8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.454+0000 7f2c5399d640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5610978d6af0 0x5610978d8fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.455+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.455+0000 7f2c5399d640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2c4800f070 0x7f2c4802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.455+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d9680 con 0x7f2c4800f070 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.455+0000 7f2c5499f640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2c4800f070 0x7f2c4802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.455+0000 7f2c5499f640 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2c4800f070 0x7f2c4802e910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.455+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.455+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.456+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.456+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.456+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.456+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.456+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.456+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.457+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.458+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.458+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.458+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.458+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.458+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.458+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.459+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.460+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.461+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.461+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.461+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.461+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.461+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.461+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.462+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.462+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.462+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.462+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.462+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.462+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.463+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.463+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.463+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.463+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.463+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.463+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:29.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.464+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d53f0 con 0x5610978cd7a0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d53f0 con 0x5610978cd7a0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d53c0 con 0x7f2c4800f070 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 zone default found 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 4 Realm: () 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 zonegroup default 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978d57e0 con 0x5610978d2140 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.465+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978db4e0 con 0x5610978d6af0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978db880 con 0x5610978d6af0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 20 started sync module instance, tier type = 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:29.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.466+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978da980 con 0x7f2c4800f070 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.467+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.467+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94629262110112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978da980 con 0x7f2c4800f070 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.467+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dc0d0 con 0x5610978cd7a0 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.468+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94629262110112] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.469+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.469+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94629262108336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dc0d0 con 0x5610978cd7a0 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.469+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dca90 con 0x5610978d6af0 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.470+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94629262108336] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.470+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.470+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94629262113824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dc040 con 0x5610978d6af0 2024-04-26T12:30:29.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.470+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dd950 con 0x7f2c4800f070 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.472+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.472+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94629262120576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978de0d0 con 0x7f2c4800f070 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.472+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94629262113824] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.472+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dce80 con 0x5610978cd7a0 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.473+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94629262120576] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.473+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.473+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94629262124736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dce80 con 0x5610978cd7a0 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.473+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978df060 con 0x5610978d2140 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.474+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.474+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94629262125968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978df900 con 0x5610978d2140 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.474+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.474+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94629262124736] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.475+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94629262125968] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.475+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.475+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94629262130752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0770 con 0x5610978d2140 2024-04-26T12:30:29.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.475+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0fc0 con 0x5610978d2140 2024-04-26T12:30:29.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94629262130752] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94629262132976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0fc0 con 0x5610978d2140 2024-04-26T12:30:29.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 20 add_watcher() i=0 2024-04-26T12:30:29.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 20 add_watcher() i=1 2024-04-26T12:30:29.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 20 add_watcher() i=2 2024-04-26T12:30:29.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 20 add_watcher() i=3 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 20 add_watcher() i=4 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 20 add_watcher() i=5 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.476+0000 7f2c56698800 20 add_watcher() i=6 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.477+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94629262132976] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.477+0000 7f2c56698800 20 add_watcher() i=7 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.477+0000 7f2c56698800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.477+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5610978e43f0 con 0x5610978cd7a0 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.478+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.478+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94629262134496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978e1910 con 0x5610978cd7a0 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94629262134496] v30'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2b0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2c56698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2c56698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2c56698800 5 note: GC not initialized 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2b097e2640 20 reqs_thread_entry: start 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2c56698800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2c56698800 20 Filter name: none 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2a7affd640 20 reqs_thread_entry: start 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.479+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561097917180 con 0x5610978d6af0 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.480+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.480+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561097917180 con 0x5610978d6af0 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.480+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.480+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561097917180 con 0x5610978cd7a0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.480+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.480+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.481+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.482+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d2140 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.483+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.483+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.483+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.483+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d6af0 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.483+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.483+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.484+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.484+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.484+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.484+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.484+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.484+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d6af0 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x7f2c4800f070 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978cd7a0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978cd7a0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.485+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d6af0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x7f2c4800f070 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978cd7a0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.486+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d6af0 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x7f2c4800f070 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d2140 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.487+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978cd7a0 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.488+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.488+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x5610978d6af0 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.488+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.488+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5610978e0350 con 0x7f2c4800f070 2024-04-26T12:30:29.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.488+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.489+0000 7f2b0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.489+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94629262134496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.490+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94629262134496] v30'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.490+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94629262110112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x7f2c4800f070 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.491+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94629262110112] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.491+0000 7f2c56698800 20 remove_watcher() i=0 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.491+0000 7f2c56698800 2 removed watcher, disabling cache 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.491+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94629262108336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978cd7a0 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.492+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94629262108336] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.492+0000 7f2c56698800 20 remove_watcher() i=1 2024-04-26T12:30:29.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.492+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94629262113824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978d13e0 con 0x5610978d6af0 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.494+0000 7f2c5399d640 1 -- 172.21.15.170:0/833094956 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94629262113824] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c48037040 con 0x5610978d6af0 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.494+0000 7f2c56698800 20 remove_watcher() i=2 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.494+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94629262120576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dbc20 con 0x7f2c4800f070 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.495+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94629262120576] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x7f2c4800f070 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.495+0000 7f2c56698800 20 remove_watcher() i=3 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.495+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94629262124736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dd680 con 0x5610978cd7a0 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.496+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94629262124736] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4400a4a0 con 0x5610978cd7a0 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.496+0000 7f2c56698800 20 remove_watcher() i=4 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.496+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94629262125968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dbc20 con 0x5610978d2140 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.497+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94629262125968] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.497+0000 7f2c56698800 20 remove_watcher() i=5 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.497+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94629262130752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978de6c0 con 0x5610978d2140 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.498+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94629262130752] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.498+0000 7f2c56698800 20 remove_watcher() i=6 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.498+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94629262132976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5610978dd680 con 0x5610978d2140 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c5419e640 1 -- 172.21.15.170:0/833094956 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94629262132976] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c4c083030 con 0x5610978d2140 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 20 remove_watcher() i=7 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5610978d2140 msgr2=0x5610978d4530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5610978d2140 0x5610978d4530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5610978cd7a0 msgr2=0x5610978cfc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5610978cd7a0 0x5610978cfc40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2c4800f070 msgr2=0x7f2c4802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2c4800f070 0x7f2c4802e910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5610978d6af0 msgr2=0x5610978d8fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5610978d6af0 0x5610978d8fb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b240368b0 msgr2=0x7f2b24038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b240368b0 0x7f2b24038d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x56109789fa60 tx=0x7f2c48010000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 msgr2=0x5610978c2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/833094956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978bac90 0x5610978c2010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0068b0 tx=0x7f2c4c06ef40 comp rx=0 tx=0).stop 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 reap_dead start 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c5499f640 1 -- 172.21.15.170:0/833094956 reap_dead start 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 shutdown_connections 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 >> 172.21.15.170:0/833094956 conn(0x5610978b6f60 msgr2=0x5610978b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 shutdown_connections 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/833094956 wait complete. 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b2c036950 msgr2=0x7f2b2c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b2c036950 0x7f2b2c038e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x561097893830 tx=0x7f2c4800f000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978adac0 msgr2=0x5610978adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978adac0 0x5610978adee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c006b30 tx=0x7f2c4c079b40 comp rx=0 tx=0).stop 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 shutdown_connections 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b2c036950 0x7f2b2c038e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 --2- 172.21.15.170:0/992832187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5610978adac0 0x5610978adee0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.499+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 >> 172.21.15.170:0/992832187 conn(0x5610978a1b60 msgr2=0x5610978a1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 shutdown_connections 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/992832187 wait complete. 2024-04-26T12:30:29.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561097898b70 msgr2=0x56109789af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561097898b70 0x56109789af60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561097793750 msgr2=0x561097896340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561097793750 0x561097896340 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56109789cab0 msgr2=0x56109789ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56109789cab0 0x56109789ef00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b3c036950 msgr2=0x7f2b3c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2b3c036950 0x7f2b3c038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c48000f60 tx=0x7f2c48001370 comp rx=0 tx=0).stop 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 msgr2=0x56109788f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 --2- 172.21.15.170:0/443321445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561097792df0 0x56109788f2d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c052540 tx=0x7f2c4c003020 comp rx=0 tx=0).stop 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c5499f640 1 -- 172.21.15.170:0/443321445 reap_dead start 2024-04-26T12:30:29.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 shutdown_connections 2024-04-26T12:30:29.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 >> 172.21.15.170:0/443321445 conn(0x56109778e9d0 msgr2=0x561097886410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 shutdown_connections 2024-04-26T12:30:29.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.500+0000 7f2c56698800 1 -- 172.21.15.170:0/443321445 wait complete. 2024-04-26T12:30:29.606 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-04-26T12:30:29.606 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:30:29.606 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-26T12:30:29.606 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-26T12:30:29.607 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-26T12:30:29.650 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:29.654 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:29.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.650+0000 7f7e8d719800 1 Processor -- start 2024-04-26T12:30:29.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.650+0000 7f7e8d719800 1 -- start start 2024-04-26T12:30:29.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.650+0000 7f7e8d719800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559186ae0f70 0x559186ae3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.650+0000 7f7e8d719800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55918698d0c0 con 0x559186ae38a0 2024-04-26T12:30:29.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.650+0000 7f7e8d719800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5591869714d0 con 0x559186ae0f70 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.651+0000 7f7e8b218640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559186ae0f70 0x559186ae3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.651+0000 7f7e82a17640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559186ae38a0 0x559186ae5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:45934/0 (socket says 172.21.15.170:45934) 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.651+0000 7f7e82a17640 1 -- 172.21.15.170:0/698704125 learned_addr learned my addr 172.21.15.170:0/698704125 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.651+0000 7f7e8b218640 1 -- 172.21.15.170:0/698704125 >> v1:172.21.15.132:6789/0 conn(0x559186ae38a0 legacy=0x559186ae5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.651+0000 7f7e8b218640 1 -- 172.21.15.170:0/698704125 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918699ed40 con 0x559186ae0f70 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.653+0000 7f7e8b218640 1 --2- 172.21.15.170:0/698704125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186ae3360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00a470 tx=0x7f7e7c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7935d9639807e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.653+0000 7f7e8aa17640 1 -- 172.21.15.170:0/698704125 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c057070 con 0x559186ae0f70 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.653+0000 7f7e8aa17640 1 -- 172.21.15.170:0/698704125 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c052570 con 0x559186ae0f70 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.653+0000 7f7e8aa17640 1 -- 172.21.15.170:0/698704125 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c052870 con 0x559186ae0f70 2024-04-26T12:30:29.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.654+0000 7f7e8d719800 1 -- 172.21.15.170:0/698704125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 msgr2=0x559186ae3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.654+0000 7f7e8d719800 1 --2- 172.21.15.170:0/698704125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186ae3360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00a470 tx=0x7f7e7c01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.654+0000 7f7e8d719800 1 -- 172.21.15.170:0/698704125 shutdown_connections 2024-04-26T12:30:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.654+0000 7f7e8d719800 1 --2- 172.21.15.170:0/698704125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186ae3360 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.654+0000 7f7e8d719800 1 -- 172.21.15.170:0/698704125 >> 172.21.15.170:0/698704125 conn(0x559186ada9e0 msgr2=0x559186adce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.654+0000 7f7e8d719800 1 -- 172.21.15.170:0/698704125 shutdown_connections 2024-04-26T12:30:29.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.654+0000 7f7e8d719800 1 -- 172.21.15.170:0/698704125 wait complete. 2024-04-26T12:30:29.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.665+0000 7f7e8d719800 1 Processor -- start 2024-04-26T12:30:29.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.665+0000 7f7e8d719800 1 -- start start 2024-04-26T12:30:29.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.666+0000 7f7e8d719800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.666+0000 7f7e8d719800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559186a2bb40 con 0x559186ae0f70 2024-04-26T12:30:29.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.666+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.666+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40674/0 (socket says 172.21.15.170:40674) 2024-04-26T12:30:29.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.666+0000 7f7e8b218640 1 -- 172.21.15.170:0/2101126194 learned_addr learned my addr 172.21.15.170:0/2101126194 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.666+0000 7f7e8b218640 1 -- 172.21.15.170:0/2101126194 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55918699d590 con 0x559186ae0f70 2024-04-26T12:30:29.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.666+0000 7f7e8b218640 1 --2- 172.21.15.170:0/2101126194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd1710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c055040 tx=0x7f7e7c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df399234fc9dc53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7d7960a640 1 -- 172.21.15.170:0/2101126194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c057070 con 0x559186ae0f70 2024-04-26T12:30:29.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7d7960a640 1 -- 172.21.15.170:0/2101126194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c063070 con 0x559186ae0f70 2024-04-26T12:30:29.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7d7960a640 1 -- 172.21.15.170:0/2101126194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c052720 con 0x559186ae0f70 2024-04-26T12:30:29.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7e8d719800 1 -- 172.21.15.170:0/2101126194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 msgr2=0x559186bd1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2101126194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd1710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c055040 tx=0x7f7e7c04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7e8d719800 1 -- 172.21.15.170:0/2101126194 shutdown_connections 2024-04-26T12:30:29.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2101126194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd1710 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7e8d719800 1 -- 172.21.15.170:0/2101126194 >> 172.21.15.170:0/2101126194 conn(0x559186ada9e0 msgr2=0x559186bcd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7e8d719800 1 -- 172.21.15.170:0/2101126194 shutdown_connections 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.667+0000 7f7e8d719800 1 -- 172.21.15.170:0/2101126194 wait complete. 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8d719800 1 Processor -- start 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8d719800 1 -- start start 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8d719800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8d719800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559186ae7650 con 0x559186ae0f70 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40682/0 (socket says 172.21.15.170:40682) 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8b218640 1 -- 172.21.15.170:0/3511397975 learned_addr learned my addr 172.21.15.170:0/3511397975 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.668+0000 7f7e8b218640 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591869948f0 con 0x559186ae0f70 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.669+0000 7f7e8b218640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd8ef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c055040 tx=0x7f7e7c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.669+0000 7f7d77e07640 1 -- 172.21.15.170:0/3511397975 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c05e480 con 0x559186ae0f70 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.669+0000 7f7d77e07640 1 -- 172.21.15.170:0/3511397975 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c06c070 con 0x559186ae0f70 2024-04-26T12:30:29.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.669+0000 7f7d77e07640 1 -- 172.21.15.170:0/3511397975 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c05e750 con 0x559186ae0f70 2024-04-26T12:30:29.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.669+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559186bd9430 con 0x559186ae0f70 2024-04-26T12:30:29.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.669+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559186bd99b0 con 0x559186ae0f70 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7d77e07640 1 -- 172.21.15.170:0/3511397975 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e7c05e8f0 con 0x559186ae0f70 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7d77e07640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d70036900 0x7f7d70038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7d77e07640 1 -- 172.21.15.170:0/3511397975 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f7e7c08e990 con 0x559186ae0f70 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7e82a17640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d70036900 0x7f7d70038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186ae38a0 0x559186bdff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186be0530 con 0x559186ae38a0 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7e8ba19640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186ae38a0 0x559186bdff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7e82a17640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d70036900 0x7f7d70038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000f60 tx=0x7f7e740012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.670+0000 7f7e8ba19640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186ae38a0 0x559186bdff60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.671+0000 7f7e8ba19640 1 -- 172.21.15.170:0/3511397975 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186ae38a0 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.671+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186bdd510 con 0x559186ae38a0 2024-04-26T12:30:29.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.671+0000 7f7e8ba19640 1 -- 172.21.15.170:0/3511397975 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186ae38a0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.671+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186be2860 0x559186be4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.671+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186be52f0 con 0x559186be2860 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.671+0000 7f7e8b218640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186be2860 0x559186be4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.671+0000 7f7e8b218640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186be2860 0x559186be4c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.672+0000 7f7e8b218640 1 -- 172.21.15.170:0/3511397975 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e7c071990 con 0x559186be2860 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.672+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186be1810 con 0x559186ae38a0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.672+0000 7f7e8ba19640 1 -- 172.21.15.170:0/3511397975 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186ae38a0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.672+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559186be67a0 0x559186be8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.672+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186be9350 con 0x559186be67a0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.672+0000 7f7e82a17640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559186be67a0 0x559186be8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.673+0000 7f7e82a17640 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559186be67a0 0x559186be8bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.673+0000 7f7e82a17640 1 -- 172.21.15.170:0/3511397975 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e74009050 con 0x559186be67a0 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.673+0000 7f7e8d719800 1 Processor -- start 2024-04-26T12:30:29.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.673+0000 7f7e8d719800 1 -- start start 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.673+0000 7f7e8d719800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186bf77b0 0x559186bf7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.673+0000 7f7e8d719800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5591869d1e60 con 0x559186bf77b0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186bf77b0 0x559186bf7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186bf77b0 0x559186bf7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40690/0 (socket says 172.21.15.170:40690) 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7e8b218640 1 -- 172.21.15.170:0/3696313916 learned_addr learned my addr 172.21.15.170:0/3696313916 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7e8b218640 1 -- 172.21.15.170:0/3696313916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559186bf8110 con 0x559186bf77b0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7e8b218640 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186bf77b0 0x559186bf7bd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c052bb0 tx=0x7f7e7c067520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7d75602640 1 -- 172.21.15.170:0/3696313916 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c002ca0 con 0x559186bf77b0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7d75602640 1 -- 172.21.15.170:0/3696313916 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c058040 con 0x559186bf77b0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559186bf8b80 con 0x559186bf77b0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.674+0000 7f7d75602640 1 -- 172.21.15.170:0/3696313916 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c004280 con 0x559186bf77b0 2024-04-26T12:30:29.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.675+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559186bf9080 con 0x559186bf77b0 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.675+0000 7f7d75602640 1 -- 172.21.15.170:0/3696313916 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e7c095060 con 0x559186bf77b0 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.675+0000 7f7d75602640 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d64036950 0x7f7d64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.675+0000 7f7d75602640 1 -- 172.21.15.170:0/3696313916 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f7e7c098c60 con 0x559186bf77b0 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.675+0000 7f7e82a17640 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d64036950 0x7f7d64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e8d719800 1 Processor -- start 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e8d719800 1 -- start start 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e82a17640 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d64036950 0x7f7d64038e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400bf50 tx=0x7f7e7400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e8d719800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c04c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e8d719800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559186bd1dd0 con 0x559186c04870 2024-04-26T12:30:29.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c04c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c04c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40706/0 (socket says 172.21.15.170:40706) 2024-04-26T12:30:29.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.676+0000 7f7e8b218640 1 -- 172.21.15.170:0/2504715444 learned_addr learned my addr 172.21.15.170:0/2504715444 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8b218640 1 -- 172.21.15.170:0/2504715444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559186c05260 con 0x559186c04870 2024-04-26T12:30:29.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8b218640 1 --2- 172.21.15.170:0/2504715444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c04c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c062000 tx=0x7f7e7c08b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b5e75a39f88aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7d6effd640 1 -- 172.21.15.170:0/2504715444 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c0a5020 con 0x559186c04870 2024-04-26T12:30:29.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7d6effd640 1 -- 172.21.15.170:0/2504715444 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c04be60 con 0x559186c04870 2024-04-26T12:30:29.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7d6effd640 1 -- 172.21.15.170:0/2504715444 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c0021c0 con 0x559186c04870 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8d719800 1 -- 172.21.15.170:0/2504715444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 msgr2=0x559186c04c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2504715444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c04c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c062000 tx=0x7f7e7c08b490 comp rx=0 tx=0).stop 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8d719800 1 -- 172.21.15.170:0/2504715444 shutdown_connections 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2504715444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c04c90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8d719800 1 -- 172.21.15.170:0/2504715444 >> 172.21.15.170:0/2504715444 conn(0x559186c00bd0 msgr2=0x559186bfec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8d719800 1 -- 172.21.15.170:0/2504715444 shutdown_connections 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.677+0000 7f7e8d719800 1 -- 172.21.15.170:0/2504715444 wait complete. 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8d719800 1 Processor -- start 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8d719800 1 -- start start 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8d719800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c0bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8d719800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559186c05910 con 0x559186c04870 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c0bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8b218640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c0bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40714/0 (socket says 172.21.15.170:40714) 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 learned_addr learned my addr 172.21.15.170:0/2158592858 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.678+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559186c0c180 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.679+0000 7f7e8b218640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c0bc40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c098ef0 tx=0x7f7e7c060f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.679+0000 7f7d6d7fa640 1 -- 172.21.15.170:0/2158592858 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c0ba070 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.679+0000 7f7d6d7fa640 1 -- 172.21.15.170:0/2158592858 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c07e510 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.679+0000 7f7d6d7fa640 1 -- 172.21.15.170:0/2158592858 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e7c004620 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.679+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559186c0c180 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.679+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559186c0c180 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7d6d7fa640 1 -- 172.21.15.170:0/2158592858 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e7c0bd070 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7d6d7fa640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d54036950 0x7f7d54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7d6d7fa640 1 -- 172.21.15.170:0/2158592858 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f7e7c0b0030 con 0x559186c04870 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7e82a17640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d54036950 0x7f7d54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186c17200 0x559186c196c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c19e10 con 0x559186c17200 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7e82a17640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d54036950 0x7f7d54038e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e74001b60 tx=0x7f7e74010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.680+0000 7f7e8ba19640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186c17200 0x559186c196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8ba19640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186c17200 0x559186c196c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 20 realm 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1a220 con 0x559186c17200 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1aaf0 con 0x559186c17200 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.681+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.682+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.682+0000 7f7e8d719800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.682+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.682+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186c1bbf0 0x559186c1dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.682+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1e5f0 con 0x559186c1bbf0 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.682+0000 7f7e8b218640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186c1bbf0 0x559186c1dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.682+0000 7f7e8b218640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186c1bbf0 0x559186c1dfe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e8d719800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e8d719800 20 searching for the correct realm 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559186c20580 0x559186c22a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c23110 con 0x559186c20580 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e82a17640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559186c20580 0x559186c22a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e82a17640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559186c20580 0x559186c22a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e82a17640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7e74038040 0x7f7e7401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.683+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c23110 con 0x7f7e74038040 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.684+0000 7f7e8ba19640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7e74038040 0x7f7e7401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.684+0000 7f7e8ba19640 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7e74038040 0x7f7e7401bab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.684+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.684+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.685+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x7f7e74038040 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.686+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x7f7e74038040 2024-04-26T12:30:29.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.687+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.688+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.688+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.688+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.688+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.688+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.688+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.689+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.690+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.690+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x7f7e74038040 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.690+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.690+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.690+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.690+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x7f7e74038040 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.691+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c20580 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c1bbf0 2024-04-26T12:30:29.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x559186c17200 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559186c1ae90 con 0x7f7e74038040 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.692+0000 7f7e8d719800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1eeb0 con 0x559186c17200 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1eeb0 con 0x559186c17200 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1eeb0 con 0x7f7e74038040 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 zone default found 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 4 Realm: () 2024-04-26T12:30:29.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 zonegroup default 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.693+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c1f750 con 0x559186c1bbf0 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c24f70 con 0x559186c20580 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.694+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c25310 con 0x559186c20580 2024-04-26T12:30:29.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.695+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.695+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.695+0000 7f7e8d719800 20 started sync module instance, tier type = 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.695+0000 7f7e8d719800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.695+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c24410 con 0x7f7e74038040 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.696+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.696+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94083519498240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c24410 con 0x7f7e74038040 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.696+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c25cd0 con 0x559186c17200 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.697+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94083519498240] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.697+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.697+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94083519496512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c25cd0 con 0x559186c17200 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.697+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c26690 con 0x559186c20580 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.698+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.698+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94083519504864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c26f30 con 0x559186c20580 2024-04-26T12:30:29.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.698+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c279b0 con 0x7f7e74038040 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.698+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94083519496512] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.699+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.699+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94083519509664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c27dd0 con 0x7f7e74038040 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.699+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c28790 con 0x559186c17200 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.699+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94083519504864] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.700+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94083519509664] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.700+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.700+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94083519502368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c282e0 con 0x559186c17200 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.700+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c29030 con 0x559186c1bbf0 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.701+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.701+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94083519515520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c282e0 con 0x559186c1bbf0 2024-04-26T12:30:29.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.701+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c29f00 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.702+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94083519502368] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.702+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94083519515520] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.703+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.703+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94083519519216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c2a2f0 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.703+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c2ab80 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94083519519216] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94083519507072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c2ad60 con 0x559186c1bbf0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 20 add_watcher() i=0 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 20 add_watcher() i=1 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 20 add_watcher() i=2 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 20 add_watcher() i=3 2024-04-26T12:30:29.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 20 add_watcher() i=4 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 20 add_watcher() i=5 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.704+0000 7f7e8d719800 20 add_watcher() i=6 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.705+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94083519507072] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.705+0000 7f7e8d719800 20 add_watcher() i=7 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.705+0000 7f7e8d719800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.705+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c2e130 con 0x559186c17200 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.705+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.705+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94083519523920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c2b550 con 0x559186c17200 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.706+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94083519523920] v30'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.706+0000 7f7d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.706+0000 7f7e8d719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.706+0000 7f7e8d719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:29.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.706+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c36b00 con 0x559186c17200 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.707+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.707+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c37150 con 0x559186c1bbf0 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.709+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.709+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c37150 con 0x559186c20580 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.710+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.710+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c37c30 con 0x559186c17200 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.710+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.711+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c32800 con 0x7f7e74038040 2024-04-26T12:30:29.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.711+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.711+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c32770 con 0x559186c20580 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.712+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.712+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c38e10 con 0x559186c17200 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.714+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.714+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c348f0 con 0x559186c1bbf0 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.715+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.715+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c348f0 con 0x7f7e74038040 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.716+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.716+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c348f0 con 0x559186c20580 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.717+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.717+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x7f7e74038040 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.718+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.718+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c1bbf0 2024-04-26T12:30:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.719+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.719+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x7f7e74038040 2024-04-26T12:30:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.720+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.720+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c1bbf0 2024-04-26T12:30:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.721+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.721+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c17200 2024-04-26T12:30:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.722+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.722+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c20580 2024-04-26T12:30:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.723+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.723+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x7f7e74038040 2024-04-26T12:30:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.724+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.724+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c20580 2024-04-26T12:30:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.725+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.725+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39a00 con 0x559186c17200 2024-04-26T12:30:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.726+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.726+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39a00 con 0x559186c17200 2024-04-26T12:30:29.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.727+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.727+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39a00 con 0x559186c20580 2024-04-26T12:30:29.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.728+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.728+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39a00 con 0x7f7e74038040 2024-04-26T12:30:29.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.729+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.730+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c20580 2024-04-26T12:30:29.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.730+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.730+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c20580 2024-04-26T12:30:29.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.731+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.731+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c20580 2024-04-26T12:30:29.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.732+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.732+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c20580 2024-04-26T12:30:29.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.733+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.733+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39970 con 0x559186c1bbf0 2024-04-26T12:30:29.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.734+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.734+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c39b40 con 0x559186c20580 2024-04-26T12:30:29.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.735+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.735+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c34720 con 0x559186c1bbf0 2024-04-26T12:30:29.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.736+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.736+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c34720 con 0x559186c20580 2024-04-26T12:30:29.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.737+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.737+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c34720 con 0x559186c1bbf0 2024-04-26T12:30:29.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.738+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.738+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c34720 con 0x7f7e74038040 2024-04-26T12:30:29.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.739+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7d40fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 20 Filter name: none 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7cba7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559186c648d0 con 0x7f7e74038040 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.740+0000 7f7e8d719800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:30:29.742 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:30:29.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.741+0000 7f7d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:29.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.741+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94083519523920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c38e10 con 0x559186c17200 2024-04-26T12:30:29.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.742+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94083519523920] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.742+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94083519498240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186bc8d50 con 0x7f7e74038040 2024-04-26T12:30:29.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.743+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94083519498240] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.743+0000 7f7e8d719800 20 remove_watcher() i=0 2024-04-26T12:30:29.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.743+0000 7f7e8d719800 2 removed watcher, disabling cache 2024-04-26T12:30:29.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.743+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94083519496512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c24800 con 0x559186c17200 2024-04-26T12:30:29.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.745+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94083519496512] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.745+0000 7f7e8d719800 20 remove_watcher() i=1 2024-04-26T12:30:29.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.745+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94083519504864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c24800 con 0x559186c20580 2024-04-26T12:30:29.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.746+0000 7f7e82a17640 1 -- 172.21.15.170:0/2158592858 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94083519504864] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e74009050 con 0x559186c20580 2024-04-26T12:30:29.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.746+0000 7f7e8d719800 20 remove_watcher() i=2 2024-04-26T12:30:29.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.746+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94083519509664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c261e0 con 0x7f7e74038040 2024-04-26T12:30:29.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.747+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94083519509664] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x7f7e74038040 2024-04-26T12:30:29.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.747+0000 7f7e8d719800 20 remove_watcher() i=3 2024-04-26T12:30:29.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.747+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94083519502368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c274a0 con 0x559186c17200 2024-04-26T12:30:29.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.748+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94083519502368] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e8400a4a0 con 0x559186c17200 2024-04-26T12:30:29.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.748+0000 7f7e8d719800 20 remove_watcher() i=4 2024-04-26T12:30:29.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.748+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94083519515520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c261e0 con 0x559186c1bbf0 2024-04-26T12:30:29.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.749+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94083519515520] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.749+0000 7f7e8d719800 20 remove_watcher() i=5 2024-04-26T12:30:29.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.749+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94083519519216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c25820 con 0x559186c1bbf0 2024-04-26T12:30:29.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.750+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94083519519216] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.750+0000 7f7e8d719800 20 remove_watcher() i=6 2024-04-26T12:30:29.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.750+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94083519507072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559186c261e0 con 0x559186c1bbf0 2024-04-26T12:30:29.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8b218640 1 -- 172.21.15.170:0/2158592858 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94083519507072] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e7c0bc030 con 0x559186c1bbf0 2024-04-26T12:30:29.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 20 remove_watcher() i=7 2024-04-26T12:30:29.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186c1bbf0 msgr2=0x559186c1dfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186c1bbf0 0x559186c1dfe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186c17200 msgr2=0x559186c196c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186c17200 0x559186c196c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7e74038040 msgr2=0x7f7e7401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7e74038040 0x7f7e7401bab0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559186c20580 msgr2=0x559186c22a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559186c20580 0x559186c22a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d54036950 msgr2=0x7f7d54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d54036950 0x7f7d54038e10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e74001b60 tx=0x7f7e74010000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 msgr2=0x559186c0bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/2158592858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186c04870 0x559186c0bc40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c098ef0 tx=0x7f7e7c060f40 comp rx=0 tx=0).stop 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 reap_dead start 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8ba19640 1 -- 172.21.15.170:0/2158592858 reap_dead start 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 shutdown_connections 2024-04-26T12:30:29.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 >> 172.21.15.170:0/2158592858 conn(0x559186c00bd0 msgr2=0x559186bfe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 shutdown_connections 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/2158592858 wait complete. 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d64036950 msgr2=0x7f7d64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d64036950 0x7f7d64038e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400bf50 tx=0x7f7e7400f000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186bf77b0 msgr2=0x559186bf7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.753+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186bf77b0 0x559186bf7bd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c052bb0 tx=0x7f7e7c067520 comp rx=0 tx=0).stop 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 shutdown_connections 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d64036950 0x7f7d64038e10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3696313916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186bf77b0 0x559186bf7bd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 >> 172.21.15.170:0/3696313916 conn(0x559186beb850 msgr2=0x559186bebc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 shutdown_connections 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3696313916 wait complete. 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186be2860 msgr2=0x559186be4c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559186be2860 0x559186be4c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186ae38a0 msgr2=0x559186bdff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559186ae38a0 0x559186bdff60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559186be67a0 msgr2=0x559186be8bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559186be67a0 0x559186be8bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d70036900 msgr2=0x7f7d70038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7d70036900 0x7f7d70038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000f60 tx=0x7f7e740012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 msgr2=0x559186bd8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 --2- 172.21.15.170:0/3511397975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559186ae0f70 0x559186bd8ef0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c055040 tx=0x7f7e7c002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8ba19640 1 -- 172.21.15.170:0/3511397975 reap_dead start 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 shutdown_connections 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 >> 172.21.15.170:0/3511397975 conn(0x559186ada9e0 msgr2=0x559186bd0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 shutdown_connections 2024-04-26T12:30:29.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.754+0000 7f7e8d719800 1 -- 172.21.15.170:0/3511397975 wait complete. 2024-04-26T12:30:29.762 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:30:29.763 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-26T12:30:29.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-26T12:30:29.763 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-26T12:30:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:29.805 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.805+0000 7f1a4193e800 1 Processor -- start 2024-04-26T12:30:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.805+0000 7f1a4193e800 1 -- start start 2024-04-26T12:30:29.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.805+0000 7f1a4193e800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5635bb6807f0 0x5635bb682cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.805+0000 7f1a4193e800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635bb5290c0 con 0x5635bb5ef820 2024-04-26T12:30:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.805+0000 7f1a4193e800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5635bb50d4d0 con 0x5635bb6807f0 2024-04-26T12:30:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.806+0000 7f1a3ce3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5635bb6807f0 0x5635bb682cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.806+0000 7f1a3ce3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5635bb6807f0 0x5635bb682cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40726/0 (socket says 172.21.15.170:40726) 2024-04-26T12:30:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.806+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3619802771 learned_addr learned my addr 172.21.15.170:0/3619802771 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.806+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3619802771 >> v1:172.21.15.132:6789/0 conn(0x5635bb5ef820 legacy=0x5635bb67f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.806+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3619802771 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bb53ad40 con 0x5635bb6807f0 2024-04-26T12:30:29.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3619802771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb6807f0 0x5635bb682cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800a520 tx=0x7f1a2801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db154e9d3b8b6f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a37fff640 1 -- 172.21.15.170:0/3619802771 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a28057070 con 0x5635bb6807f0 2024-04-26T12:30:29.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a37fff640 1 -- 172.21.15.170:0/3619802771 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a28052570 con 0x5635bb6807f0 2024-04-26T12:30:29.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a37fff640 1 -- 172.21.15.170:0/3619802771 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a2804ae60 con 0x5635bb6807f0 2024-04-26T12:30:29.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a4193e800 1 -- 172.21.15.170:0/3619802771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb6807f0 msgr2=0x5635bb682cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3619802771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb6807f0 0x5635bb682cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800a520 tx=0x7f1a2801d010 comp rx=0 tx=0).stop 2024-04-26T12:30:29.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a4193e800 1 -- 172.21.15.170:0/3619802771 shutdown_connections 2024-04-26T12:30:29.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3619802771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb6807f0 0x5635bb682cb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a4193e800 1 -- 172.21.15.170:0/3619802771 >> 172.21.15.170:0/3619802771 conn(0x5635bb6769e0 msgr2=0x5635bb678e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.808+0000 7f1a4193e800 1 -- 172.21.15.170:0/3619802771 shutdown_connections 2024-04-26T12:30:29.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.809+0000 7f1a4193e800 1 -- 172.21.15.170:0/3619802771 wait complete. 2024-04-26T12:30:29.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.820+0000 7f1a4193e800 1 Processor -- start 2024-04-26T12:30:29.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.820+0000 7f1a4193e800 1 -- start start 2024-04-26T12:30:29.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.820+0000 7f1a4193e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb76d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.820+0000 7f1a4193e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5635bb5c7b40 con 0x5635bb5ef820 2024-04-26T12:30:29.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.820+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb76d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.821+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb76d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40736/0 (socket says 172.21.15.170:40736) 2024-04-26T12:30:29.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.821+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3335502431 learned_addr learned my addr 172.21.15.170:0/3335502431 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.821+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3335502431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bb539590 con 0x5635bb5ef820 2024-04-26T12:30:29.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.821+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/3335502431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb76d720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a38001d20 tx=0x7f1a3800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c026a03dcf2d1fdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.821+0000 7f192b606640 1 -- 172.21.15.170:0/3335502431 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3800f400 con 0x5635bb5ef820 2024-04-26T12:30:29.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.821+0000 7f192b606640 1 -- 172.21.15.170:0/3335502431 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3800f5a0 con 0x5635bb5ef820 2024-04-26T12:30:29.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.821+0000 7f192b606640 1 -- 172.21.15.170:0/3335502431 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3800f7d0 con 0x5635bb5ef820 2024-04-26T12:30:29.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 -- 172.21.15.170:0/3335502431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 msgr2=0x5635bb76d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3335502431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb76d720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a38001d20 tx=0x7f1a3800b5b0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 -- 172.21.15.170:0/3335502431 shutdown_connections 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3335502431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb76d720 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 -- 172.21.15.170:0/3335502431 >> 172.21.15.170:0/3335502431 conn(0x5635bb6769e0 msgr2=0x5635bb769040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 -- 172.21.15.170:0/3335502431 shutdown_connections 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 -- 172.21.15.170:0/3335502431 wait complete. 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 Processor -- start 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 -- start start 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb7750f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a4193e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5635bb683660 con 0x5635bb5ef820 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb7750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb7750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40752/0 (socket says 172.21.15.170:40752) 2024-04-26T12:30:29.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.822+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3225559885 learned_addr learned my addr 172.21.15.170:0/3225559885 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.823+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bb5308f0 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.823+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb7750f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5635bb76e4b0 tx=0x7f1a38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.823+0000 7f1929e03640 1 -- 172.21.15.170:0/3225559885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3801a690 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.823+0000 7f1929e03640 1 -- 172.21.15.170:0/3225559885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3801a830 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.823+0000 7f1929e03640 1 -- 172.21.15.170:0/3225559885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3801ab30 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.823+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635bb775630 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.823+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bb775bb0 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1929e03640 1 -- 172.21.15.170:0/3225559885 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a38017070 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1929e03640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1924036950 0x7f1924038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1929e03640 1 -- 172.21.15.170:0/3225559885 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1a38015020 con 0x5635bb5ef820 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1924036950 0x7f1924038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb6807f0 0x5635bb77c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb77c690 con 0x5635bb6807f0 2024-04-26T12:30:29.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1a3de40640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb6807f0 0x5635bb77c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.824+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1924036950 0x7f1924038e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a28054000 tx=0x7f1a2804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.825+0000 7f1a3de40640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb6807f0 0x5635bb77c110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.825+0000 7f1a3de40640 1 -- 172.21.15.170:0/3225559885 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb6807f0 2024-04-26T12:30:29.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.825+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7796e0 con 0x5635bb6807f0 2024-04-26T12:30:29.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.825+0000 7f1a3de40640 1 -- 172.21.15.170:0/3225559885 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb6807f0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.825+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb77e9a0 0x5635bb780d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.825+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb781430 con 0x5635bb77e9a0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.825+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb77e9a0 0x5635bb780d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.826+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb77e9a0 0x5635bb780d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.826+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3225559885 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a3802e070 con 0x5635bb77e9a0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.826+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb77d950 con 0x5635bb6807f0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.826+0000 7f1a3de40640 1 -- 172.21.15.170:0/3225559885 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb6807f0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.827+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5635bb7828e0 0x5635bb784d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.827+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb785490 con 0x5635bb7828e0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.827+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5635bb7828e0 0x5635bb784d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.827+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5635bb7828e0 0x5635bb784d30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.827+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3225559885 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a2805a040 con 0x5635bb7828e0 2024-04-26T12:30:29.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a4193e800 1 Processor -- start 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a4193e800 1 -- start start 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a4193e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb7938f0 0x5635bb793d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a4193e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5635bb56de60 con 0x5635bb7938f0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb7938f0 0x5635bb793d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb7938f0 0x5635bb793d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40758/0 (socket says 172.21.15.170:40758) 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a3d63f640 1 -- 172.21.15.170:0/209455809 learned_addr learned my addr 172.21.15.170:0/209455809 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a3d63f640 1 -- 172.21.15.170:0/209455809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bb794250 con 0x5635bb7938f0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb7938f0 0x5635bb793d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1a3804af80 tx=0x7f1a3801df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1922ffd640 1 -- 172.21.15.170:0/209455809 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3804c490 con 0x5635bb7938f0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1922ffd640 1 -- 172.21.15.170:0/209455809 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3804c630 con 0x5635bb7938f0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.828+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635bb794cc0 con 0x5635bb7938f0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.829+0000 7f1922ffd640 1 -- 172.21.15.170:0/209455809 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3804c910 con 0x5635bb7938f0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.829+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bb794cc0 con 0x5635bb7938f0 2024-04-26T12:30:29.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.829+0000 7f1922ffd640 1 -- 172.21.15.170:0/209455809 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a38044d10 con 0x5635bb7938f0 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.829+0000 7f1922ffd640 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1918036900 0x7f1918038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.829+0000 7f1922ffd640 1 -- 172.21.15.170:0/209455809 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1a38037020 con 0x5635bb7938f0 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.829+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1918036900 0x7f1918038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a4193e800 1 Processor -- start 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a4193e800 1 -- start start 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1918036900 0x7f1918038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5635bb779600 tx=0x7f1a28005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a4193e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb67cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a4193e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5635bb76dea0 con 0x5635bb67c730 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb67cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb67cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40766/0 (socket says 172.21.15.170:40766) 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a3d63f640 1 -- 172.21.15.170:0/525314103 learned_addr learned my addr 172.21.15.170:0/525314103 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a3d63f640 1 -- 172.21.15.170:0/525314103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bb67af10 con 0x5635bb67c730 2024-04-26T12:30:29.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.830+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/525314103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb67cb50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a3801bef0 tx=0x7f1a380194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e4fddcaa1ce8e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1920ff9640 1 -- 172.21.15.170:0/525314103 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a38027830 con 0x5635bb67c730 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1920ff9640 1 -- 172.21.15.170:0/525314103 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a38027a90 con 0x5635bb67c730 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1920ff9640 1 -- 172.21.15.170:0/525314103 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3803f120 con 0x5635bb67c730 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 -- 172.21.15.170:0/525314103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 msgr2=0x5635bb67cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 --2- 172.21.15.170:0/525314103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb67cb50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a3801bef0 tx=0x7f1a380194a0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 -- 172.21.15.170:0/525314103 shutdown_connections 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 --2- 172.21.15.170:0/525314103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb67cb50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 -- 172.21.15.170:0/525314103 >> 172.21.15.170:0/525314103 conn(0x5635bb79cc00 msgr2=0x5635bb79ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 -- 172.21.15.170:0/525314103 shutdown_connections 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 -- 172.21.15.170:0/525314103 wait complete. 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 Processor -- start 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.831+0000 7f1a4193e800 1 -- start start 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a4193e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb7a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a4193e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5635bb67b320 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb7a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a3d63f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb7a9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40780/0 (socket says 172.21.15.170:40780) 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 learned_addr learned my addr 172.21.15.170:0/3306478925 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bb7aa450 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb7a9f10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a3801bef0 tx=0x7f1a38014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f190effd640 1 -- 172.21.15.170:0/3306478925 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a3803dd50 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f190effd640 1 -- 172.21.15.170:0/3306478925 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3800e590 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635bb7aa450 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f190effd640 1 -- 172.21.15.170:0/3306478925 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a380410b0 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.832+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bb7aa450 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.833+0000 7f190effd640 1 -- 172.21.15.170:0/3306478925 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1a3806d070 con 0x5635bb67c730 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.833+0000 7f190effd640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1908036900 0x7f1908038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.833+0000 7f190effd640 1 -- 172.21.15.170:0/3306478925 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1a38071c80 con 0x5635bb67c730 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.833+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1908036900 0x7f1908038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1908036900 0x7f1908038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5635bb785890 tx=0x7f1a2804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb7b5660 0x5635bb7b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b8270 con 0x5635bb7b5660 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a3de40640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb7b5660 0x5635bb7b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a3de40640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb7b5660 0x5635bb7b7b20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a4193e800 20 realm 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.834+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b8680 con 0x5635bb7b5660 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b8f50 con 0x5635bb7b5660 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7b5660 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb7ba050 0x5635bb7bc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7bca50 con 0x5635bb7ba050 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.835+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb7ba050 0x5635bb7bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.836+0000 7f1a3d63f640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb7ba050 0x5635bb7bc440 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.836+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.836+0000 7f1a4193e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:29.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.836+0000 7f1a4193e800 20 searching for the correct realm 2024-04-26T12:30:29.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.836+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5635bb7bea00 0x5635bb7c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.836+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c1590 con 0x5635bb7bea00 2024-04-26T12:30:29.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.836+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5635bb7bea00 0x5635bb7c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.837+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5635bb7bea00 0x5635bb7c0ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.837+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.837+0000 7f1a3ce3e640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1a28074040 0x7f1a28081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.837+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c1590 con 0x7f1a28074040 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.837+0000 7f1a3de40640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1a28074040 0x7f1a28081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.837+0000 7f1a3de40640 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1a28074040 0x7f1a28081410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.838+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.838+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7ba050 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.838+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.838+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7b5660 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.838+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.838+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7b5660 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7ba050 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7ba050 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x7f1a28074040 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.839+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7bea00 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7b5660 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7ba050 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7b5660 2024-04-26T12:30:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.840+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x7f1a28074040 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7b92f0 con 0x5635bb7bea00 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7bea00 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7ba050 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.841+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7bea00 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7bea00 2024-04-26T12:30:29.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7b5660 2024-04-26T12:30:29.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7b5660 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7ba050 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.842+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7bea00 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x7f1a28074040 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7b5660 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7ba050 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.843+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7bea00 2024-04-26T12:30:29.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7ba050 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x7f1a28074040 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7bea00 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.844+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7ba050 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x5635bb7b5660 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1a2808e040 con 0x7f1a28074040 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:29.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7bd310 con 0x5635bb7b5660 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.845+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7bd310 con 0x5635bb7b5660 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7bd310 con 0x7f1a28074040 2024-04-26T12:30:29.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 zone default found 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 4 Realm: () 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 zonegroup default 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7bdbb0 con 0x5635bb7ba050 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c33f0 con 0x5635bb7bea00 2024-04-26T12:30:29.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.846+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c3790 con 0x5635bb7bea00 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a4193e800 20 started sync module instance, tier type = 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a4193e800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.847+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c2890 con 0x7f1a28074040 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.848+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.848+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94788778732720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c2890 con 0x7f1a28074040 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.848+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c3fe0 con 0x5635bb7b5660 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.849+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94788778732720] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.849+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.849+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94788778736912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c2890 con 0x5635bb7b5660 2024-04-26T12:30:29.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.849+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c4a30 con 0x5635bb7bea00 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.852+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94788778736912] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.852+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.852+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94788778730464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c2800 con 0x5635bb7bea00 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.852+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c58f0 con 0x7f1a28074040 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.853+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.853+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94788778743328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c6030 con 0x7f1a28074040 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.853+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c6b50 con 0x5635bb7b5660 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.854+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94788778743328] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.855+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94788778730464] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.858+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.858+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94788778741280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c6b10 con 0x5635bb7b5660 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.858+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c73f0 con 0x5635bb7ba050 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.860+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.860+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94788778749760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c6b10 con 0x5635bb7ba050 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.860+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c8300 con 0x5635bb7ba050 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.863+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94788778741280] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.866+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94788778749760] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.866+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.866+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94788778747424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c86a0 con 0x5635bb7ba050 2024-04-26T12:30:29.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.866+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c8f30 con 0x5635bb7ba050 2024-04-26T12:30:29.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.869+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94788778747424] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94788778753504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c9110 con 0x5635bb7ba050 2024-04-26T12:30:29.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 20 add_watcher() i=0 2024-04-26T12:30:29.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 20 add_watcher() i=1 2024-04-26T12:30:29.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 20 add_watcher() i=2 2024-04-26T12:30:29.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 20 add_watcher() i=3 2024-04-26T12:30:29.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 20 add_watcher() i=4 2024-04-26T12:30:29.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 20 add_watcher() i=5 2024-04-26T12:30:29.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.872+0000 7f1a4193e800 20 add_watcher() i=6 2024-04-26T12:30:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.874+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94788778753504] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.875+0000 7f1a4193e800 20 add_watcher() i=7 2024-04-26T12:30:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.875+0000 7f1a4193e800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.875+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7cc4e0 con 0x5635bb7b5660 2024-04-26T12:30:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.875+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.875+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94788778758144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c98d0 con 0x5635bb7b5660 2024-04-26T12:30:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.876+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94788778758144] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.876+0000 7f18f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.876+0000 7f1a4193e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.876+0000 7f1a4193e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.876+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d4e40 con 0x5635bb7b5660 2024-04-26T12:30:29.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.877+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.877+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d5470 con 0x5635bb7ba050 2024-04-26T12:30:29.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.880+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.880+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d5470 con 0x5635bb7bea00 2024-04-26T12:30:29.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.881+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.881+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d5f50 con 0x5635bb7b5660 2024-04-26T12:30:29.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.882+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.882+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x7f1a28074040 2024-04-26T12:30:29.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.883+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.883+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.884+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.884+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d6c80 con 0x5635bb7b5660 2024-04-26T12:30:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.885+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.885+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d6c80 con 0x5635bb7ba050 2024-04-26T12:30:29.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.891+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.891+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d6d10 con 0x7f1a28074040 2024-04-26T12:30:29.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.892+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.892+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d6de0 con 0x5635bb7bea00 2024-04-26T12:30:29.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.893+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.893+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d7300 con 0x7f1a28074040 2024-04-26T12:30:29.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.894+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.894+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d7300 con 0x5635bb7ba050 2024-04-26T12:30:29.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.895+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.895+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d7300 con 0x7f1a28074040 2024-04-26T12:30:29.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.896+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.896+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d7300 con 0x5635bb7ba050 2024-04-26T12:30:29.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.898+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.898+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d7300 con 0x5635bb7b5660 2024-04-26T12:30:29.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.899+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.899+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d7300 con 0x5635bb7bea00 2024-04-26T12:30:29.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.901+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.901+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x7f1a28074040 2024-04-26T12:30:29.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.902+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.902+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.903+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.903+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7b5660 2024-04-26T12:30:29.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.904+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.904+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7b5660 2024-04-26T12:30:29.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.905+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.905+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.907+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.907+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x7f1a28074040 2024-04-26T12:30:29.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.908+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.908+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.909+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.909+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.910+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.910+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.911+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.911+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.912+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.912+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7ba050 2024-04-26T12:30:29.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.913+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.913+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.914+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.914+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7ba050 2024-04-26T12:30:29.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.915+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.915+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7bea00 2024-04-26T12:30:29.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.916+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.916+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x5635bb7ba050 2024-04-26T12:30:29.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.917+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.917+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d2b70 con 0x7f1a28074040 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.918+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.918+0000 7f18f27e4640 20 reqs_thread_entry: start 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.918+0000 7f1a4193e800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.918+0000 7f1a4193e800 20 Filter name: none 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.918+0000 7f1863fff640 20 reqs_thread_entry: start 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.919+0000 7f1a4193e800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.919+0000 7f1a4193e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.919+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635bb802400 con 0x5635bb7ba050 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.919+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.919+0000 7f1a4193e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:29.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.919+0000 7f1a4193e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-26T12:30:29.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.919+0000 7f1a4193e800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:30:29.921 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:30:29.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.920+0000 7f18f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:29.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.920+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94788778758144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7d1a90 con 0x5635bb7b5660 2024-04-26T12:30:29.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.921+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94788778758144] v30'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.921+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94788778732720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c9000 con 0x7f1a28074040 2024-04-26T12:30:29.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.922+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94788778732720] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.922+0000 7f1a4193e800 20 remove_watcher() i=0 2024-04-26T12:30:29.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.922+0000 7f1a4193e800 2 removed watcher, disabling cache 2024-04-26T12:30:29.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.922+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94788778736912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c9000 con 0x5635bb7b5660 2024-04-26T12:30:29.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.923+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94788778736912] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.923+0000 7f1a4193e800 20 remove_watcher() i=1 2024-04-26T12:30:29.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.923+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94788778730464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c3d10 con 0x5635bb7bea00 2024-04-26T12:30:29.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.924+0000 7f1a3ce3e640 1 -- 172.21.15.170:0/3306478925 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94788778730464] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2807f070 con 0x5635bb7bea00 2024-04-26T12:30:29.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.924+0000 7f1a4193e800 20 remove_watcher() i=2 2024-04-26T12:30:29.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.924+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94788778743328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c9000 con 0x7f1a28074040 2024-04-26T12:30:29.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.925+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94788778743328] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x7f1a28074040 2024-04-26T12:30:29.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.925+0000 7f1a4193e800 20 remove_watcher() i=3 2024-04-26T12:30:29.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.925+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94788778741280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c23e0 con 0x5635bb7b5660 2024-04-26T12:30:29.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.926+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94788778741280] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5635bb7b5660 2024-04-26T12:30:29.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.926+0000 7f1a4193e800 20 remove_watcher() i=4 2024-04-26T12:30:29.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.926+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94788778749760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c3d10 con 0x5635bb7ba050 2024-04-26T12:30:29.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.927+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94788778749760] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.927+0000 7f1a4193e800 20 remove_watcher() i=5 2024-04-26T12:30:29.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.927+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94788778747424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c9000 con 0x5635bb7ba050 2024-04-26T12:30:29.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.928+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94788778747424] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.928+0000 7f1a4193e800 20 remove_watcher() i=6 2024-04-26T12:30:29.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.928+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94788778753504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635bb7c4e20 con 0x5635bb7ba050 2024-04-26T12:30:29.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a3d63f640 1 -- 172.21.15.170:0/3306478925 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94788778753504] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a38082040 con 0x5635bb7ba050 2024-04-26T12:30:29.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 20 remove_watcher() i=7 2024-04-26T12:30:29.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb7ba050 msgr2=0x5635bb7bc440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb7ba050 0x5635bb7bc440 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb7b5660 msgr2=0x5635bb7b7b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb7b5660 0x5635bb7b7b20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1a28074040 msgr2=0x7f1a28081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1a28074040 0x7f1a28081410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5635bb7bea00 msgr2=0x5635bb7c0ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5635bb7bea00 0x5635bb7c0ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1908036900 msgr2=0x7f1908038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1908036900 0x7f1908038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5635bb785890 tx=0x7f1a2804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 msgr2=0x5635bb7a9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3306478925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb67c730 0x5635bb7a9f10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a3801bef0 tx=0x7f1a38014f20 comp rx=0 tx=0).stop 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 reap_dead start 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a3de40640 1 -- 172.21.15.170:0/3306478925 reap_dead start 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 shutdown_connections 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 >> 172.21.15.170:0/3306478925 conn(0x5635bb79cc00 msgr2=0x5635bb79a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 shutdown_connections 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/3306478925 wait complete. 2024-04-26T12:30:29.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1918036900 msgr2=0x7f1918038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1918036900 0x7f1918038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5635bb779600 tx=0x7f1a28005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb7938f0 msgr2=0x5635bb793d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.929+0000 7f1a4193e800 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb7938f0 0x5635bb793d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1a3804af80 tx=0x7f1a3801df90 comp rx=0 tx=0).stop 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 shutdown_connections 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1918036900 0x7f1918038dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 --2- 172.21.15.170:0/209455809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb7938f0 0x5635bb793d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 >> 172.21.15.170:0/209455809 conn(0x5635bb787990 msgr2=0x5635bb787d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 shutdown_connections 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/209455809 wait complete. 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb77e9a0 msgr2=0x5635bb780d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5635bb77e9a0 0x5635bb780d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb6807f0 msgr2=0x5635bb77c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5635bb6807f0 0x5635bb77c110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5635bb7828e0 msgr2=0x5635bb784d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5635bb7828e0 0x5635bb784d30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1924036950 msgr2=0x7f1924038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1924036950 0x7f1924038e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a28054000 tx=0x7f1a2804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 msgr2=0x5635bb7750f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 --2- 172.21.15.170:0/3225559885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5635bb5ef820 0x5635bb7750f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5635bb76e4b0 tx=0x7f1a38000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a3de40640 1 -- 172.21.15.170:0/3225559885 reap_dead start 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 shutdown_connections 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 >> 172.21.15.170:0/3225559885 conn(0x5635bb6769e0 msgr2=0x5635bb76c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 shutdown_connections 2024-04-26T12:30:29.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:29.930+0000 7f1a4193e800 1 -- 172.21.15.170:0/3225559885 wait complete. 2024-04-26T12:30:29.938 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:30:29.939 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T12:30:29.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T12:30:29.939 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T12:30:30.021 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:30.021 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.021+0000 7fe88a12f800 1 Processor -- start 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.021+0000 7fe88a12f800 1 -- start start 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.021+0000 7fe88a12f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558adf9a8140 0x558adf9a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.021+0000 7fe88a12f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558adf8df0c0 con 0x558adf9a6c30 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.021+0000 7fe88a12f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x558adf8c34d0 con 0x558adf9a8140 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.021+0000 7fe885db5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558adf9a8140 0x558adf9a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.022+0000 7fe8855b4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x558adf9a6c30 0x558adfa3a430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:45952/0 (socket says 172.21.15.170:45952) 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.022+0000 7fe8855b4640 1 -- 172.21.15.170:0/1085498540 learned_addr learned my addr 172.21.15.170:0/1085498540 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.022+0000 7fe885db5640 1 -- 172.21.15.170:0/1085498540 >> v1:172.21.15.132:6789/0 conn(0x558adf9a6c30 legacy=0x558adfa3a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.022+0000 7fe884db3640 1 -- 172.21.15.170:0/1085498540 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959922627 0 0) 0x558adf8df0c0 con 0x558adf9a6c30 2024-04-26T12:30:30.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.022+0000 7fe885db5640 1 -- 172.21.15.170:0/1085498540 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adf8f0d40 con 0x558adf9a8140 2024-04-26T12:30:30.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe885db5640 1 --2- 172.21.15.170:0/1085498540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adf9a66f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe87800a470 tx=0x7fe87801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815da554d0ae582a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe884db3640 1 -- 172.21.15.170:0/1085498540 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878057070 con 0x558adf9a8140 2024-04-26T12:30:30.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe884db3640 1 -- 172.21.15.170:0/1085498540 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878052570 con 0x558adf9a8140 2024-04-26T12:30:30.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe884db3640 1 -- 172.21.15.170:0/1085498540 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878052870 con 0x558adf9a8140 2024-04-26T12:30:30.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe88a12f800 1 -- 172.21.15.170:0/1085498540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 msgr2=0x558adf9a66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe88a12f800 1 --2- 172.21.15.170:0/1085498540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adf9a66f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe87800a470 tx=0x7fe87801ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:30.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe88a12f800 1 -- 172.21.15.170:0/1085498540 shutdown_connections 2024-04-26T12:30:30.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe88a12f800 1 --2- 172.21.15.170:0/1085498540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adf9a66f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe88a12f800 1 -- 172.21.15.170:0/1085498540 >> 172.21.15.170:0/1085498540 conn(0x558adfa2db80 msgr2=0x558adfa2ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe88a12f800 1 -- 172.21.15.170:0/1085498540 shutdown_connections 2024-04-26T12:30:30.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.024+0000 7fe88a12f800 1 -- 172.21.15.170:0/1085498540 wait complete. 2024-04-26T12:30:30.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.036+0000 7fe88a12f800 1 Processor -- start 2024-04-26T12:30:30.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.036+0000 7fe88a12f800 1 -- start start 2024-04-26T12:30:30.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.036+0000 7fe88a12f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a6c30 0x558adfb25bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.036+0000 7fe88a12f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558adf97db40 con 0x558adf9a6c30 2024-04-26T12:30:30.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a6c30 0x558adfb25bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a6c30 0x558adfb25bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40798/0 (socket says 172.21.15.170:40798) 2024-04-26T12:30:30.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe885db5640 1 -- 172.21.15.170:0/373962041 learned_addr learned my addr 172.21.15.170:0/373962041 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe885db5640 1 -- 172.21.15.170:0/373962041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adf8ef590 con 0x558adf9a6c30 2024-04-26T12:30:30.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe885db5640 1 --2- 172.21.15.170:0/373962041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a6c30 0x558adfb25bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe878055040 tx=0x7fe87804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec598665a1aa8e69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe773e07640 1 -- 172.21.15.170:0/373962041 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878063070 con 0x558adf9a6c30 2024-04-26T12:30:30.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe773e07640 1 -- 172.21.15.170:0/373962041 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878058040 con 0x558adf9a6c30 2024-04-26T12:30:30.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.037+0000 7fe773e07640 1 -- 172.21.15.170:0/373962041 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878057070 con 0x558adf9a6c30 2024-04-26T12:30:30.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 -- 172.21.15.170:0/373962041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a6c30 msgr2=0x558adfb25bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 --2- 172.21.15.170:0/373962041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a6c30 0x558adfb25bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe878055040 tx=0x7fe87804c000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 -- 172.21.15.170:0/373962041 shutdown_connections 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 --2- 172.21.15.170:0/373962041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a6c30 0x558adfb25bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 -- 172.21.15.170:0/373962041 >> 172.21.15.170:0/373962041 conn(0x558adfa2db80 msgr2=0x558adfb214d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 -- 172.21.15.170:0/373962041 shutdown_connections 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 -- 172.21.15.170:0/373962041 wait complete. 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 Processor -- start 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 -- start start 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adfb2d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.038+0000 7fe88a12f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558adfa3de60 con 0x558adf9a8140 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adfb2d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adfb2d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40812/0 (socket says 172.21.15.170:40812) 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe885db5640 1 -- 172.21.15.170:0/4176609369 learned_addr learned my addr 172.21.15.170:0/4176609369 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe885db5640 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adf8e68f0 con 0x558adf9a8140 2024-04-26T12:30:30.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe885db5640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adfb2d750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe878005870 tx=0x7fe878002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe772604640 1 -- 172.21.15.170:0/4176609369 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878063070 con 0x558adf9a8140 2024-04-26T12:30:30.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe772604640 1 -- 172.21.15.170:0/4176609369 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87806f070 con 0x558adf9a8140 2024-04-26T12:30:30.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558adfb2dc90 con 0x558adf9a8140 2024-04-26T12:30:30.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe772604640 1 -- 172.21.15.170:0/4176609369 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878052c10 con 0x558adf9a8140 2024-04-26T12:30:30.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.039+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558adfb2e150 con 0x558adf9a8140 2024-04-26T12:30:30.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.040+0000 7fe772604640 1 -- 172.21.15.170:0/4176609369 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe87805e480 con 0x558adf9a8140 2024-04-26T12:30:30.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.040+0000 7fe772604640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe76c036950 0x7fe76c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.040+0000 7fe772604640 1 -- 172.21.15.170:0/4176609369 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe87808df90 con 0x558adf9a8140 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.040+0000 7fe8855b4640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe76c036950 0x7fe76c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.040+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb325a0 0x558adfb349f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.040+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb35060 con 0x558adfb325a0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.040+0000 7fe8865b6640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb325a0 0x558adfb349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe8855b4640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe76c036950 0x7fe76c038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000c00 tx=0x7fe87c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe8865b6640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb325a0 0x558adfb349f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe8865b6640 1 -- 172.21.15.170:0/4176609369 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb325a0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb31cd0 con 0x558adfb325a0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe8865b6640 1 -- 172.21.15.170:0/4176609369 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb325a0 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb37390 0x558adfb39780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb39e70 con 0x558adfb37390 2024-04-26T12:30:30.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.041+0000 7fe885db5640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb37390 0x558adfb39780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.042+0000 7fe885db5640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb37390 0x558adfb39780 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.042+0000 7fe885db5640 1 -- 172.21.15.170:0/4176609369 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe878073c90 con 0x558adfb37390 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.042+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb36340 con 0x558adfb325a0 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.042+0000 7fe8865b6640 1 -- 172.21.15.170:0/4176609369 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb325a0 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.042+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558adfb3b320 0x558adfb3d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.042+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb3ded0 con 0x558adfb3b320 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.042+0000 7fe8855b4640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558adfb3b320 0x558adfb3d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.043+0000 7fe8855b4640 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558adfb3b320 0x558adfb3d770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.043+0000 7fe8855b4640 1 -- 172.21.15.170:0/4176609369 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe87c00f670 con 0x558adfb3b320 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.043+0000 7fe88a12f800 1 Processor -- start 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.043+0000 7fe88a12f800 1 -- start start 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.043+0000 7fe88a12f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb4c330 0x558adfb4c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.043+0000 7fe88a12f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558adf923e60 con 0x558adfb4c330 2024-04-26T12:30:30.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb4c330 0x558adfb4c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb4c330 0x558adfb4c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40816/0 (socket says 172.21.15.170:40816) 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe885db5640 1 -- 172.21.15.170:0/1935305488 learned_addr learned my addr 172.21.15.170:0/1935305488 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe885db5640 1 -- 172.21.15.170:0/1935305488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adfb4cc90 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe885db5640 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb4c330 0x558adfb4c750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe87808c380 tx=0x7fe878009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe76b7fe640 1 -- 172.21.15.170:0/1935305488 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878073a20 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe76b7fe640 1 -- 172.21.15.170:0/1935305488 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878009ad0 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe76b7fe640 1 -- 172.21.15.170:0/1935305488 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878009db0 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558adfb4d700 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.044+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558adfb4dc00 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.045+0000 7fe76b7fe640 1 -- 172.21.15.170:0/1935305488 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe87805e770 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.045+0000 7fe76b7fe640 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe760036950 0x7fe760038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.045+0000 7fe76b7fe640 1 -- 172.21.15.170:0/1935305488 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe878002030 con 0x558adfb4c330 2024-04-26T12:30:30.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.045+0000 7fe8855b4640 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe760036950 0x7fe760038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.045+0000 7fe88a12f800 1 Processor -- start 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe88a12f800 1 -- start start 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe8855b4640 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe760036950 0x7fe760038e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x558adfb35940 tx=0x7fe87c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe88a12f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb59890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe88a12f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558adfb26270 con 0x558adfb59470 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb59890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb59890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40832/0 (socket says 172.21.15.170:40832) 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe885db5640 1 -- 172.21.15.170:0/2780659260 learned_addr learned my addr 172.21.15.170:0/2780659260 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe885db5640 1 -- 172.21.15.170:0/2780659260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adfb59e60 con 0x558adfb59470 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe885db5640 1 --2- 172.21.15.170:0/2780659260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb59890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe878080aa0 tx=0x7fe87808ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a960e7998ca1132 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.046+0000 7fe7697fa640 1 -- 172.21.15.170:0/2780659260 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8780aa020 con 0x558adfb59470 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe7697fa640 1 -- 172.21.15.170:0/2780659260 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87806a8d0 con 0x558adfb59470 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe7697fa640 1 -- 172.21.15.170:0/2780659260 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878054450 con 0x558adfb59470 2024-04-26T12:30:30.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 -- 172.21.15.170:0/2780659260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 msgr2=0x558adfb59890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 --2- 172.21.15.170:0/2780659260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb59890 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe878080aa0 tx=0x7fe87808ddf0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 -- 172.21.15.170:0/2780659260 shutdown_connections 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 --2- 172.21.15.170:0/2780659260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb59890 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 -- 172.21.15.170:0/2780659260 >> 172.21.15.170:0/2780659260 conn(0x558adfb55780 msgr2=0x558adfb537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 -- 172.21.15.170:0/2780659260 shutdown_connections 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 -- 172.21.15.170:0/2780659260 wait complete. 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 Processor -- start 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 -- start start 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.047+0000 7fe88a12f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558adfb5a4f0 con 0x558adfb59470 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe885db5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40842/0 (socket says 172.21.15.170:40842) 2024-04-26T12:30:30.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 learned_addr learned my addr 172.21.15.170:0/3880705700 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adfb60e00 con 0x558adfb59470 2024-04-26T12:30:30.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe885db5640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb608c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe878080aa0 tx=0x7fe87807ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe7577fe640 1 -- 172.21.15.170:0/3880705700 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8780bf070 con 0x558adfb59470 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe7577fe640 1 -- 172.21.15.170:0/3880705700 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878051800 con 0x558adfb59470 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558adfb60e00 con 0x558adfb59470 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.048+0000 7fe7577fe640 1 -- 172.21.15.170:0/3880705700 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878051ae0 con 0x558adfb59470 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.049+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558adfb60e00 con 0x558adfb59470 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.049+0000 7fe7577fe640 1 -- 172.21.15.170:0/3880705700 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe8780c2070 con 0x558adfb59470 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.049+0000 7fe7577fe640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe750036950 0x7fe750038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.049+0000 7fe7577fe640 1 -- 172.21.15.170:0/3880705700 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe8780b5030 con 0x558adfb59470 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.050+0000 7fe8855b4640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe750036950 0x7fe750038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.050+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.050+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb6bee0 0x558adfb6e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.050+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6eaf0 con 0x558adfb6bee0 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.050+0000 7fe8855b4640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe750036950 0x7fe750038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00ffd0 tx=0x7fe87c023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.050+0000 7fe8865b6640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb6bee0 0x558adfb6e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.050+0000 7fe8865b6640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb6bee0 0x558adfb6e3a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 realm 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6ef00 con 0x558adfb6bee0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6f7d0 con 0x558adfb6bee0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb708d0 0x558adfb72cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.051+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb732d0 con 0x558adfb708d0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe885db5640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb708d0 0x558adfb72cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe885db5640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb708d0 0x558adfb72cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe88a12f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe88a12f800 20 searching for the correct realm 2024-04-26T12:30:30.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558adfb75280 0x558adfb77740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb77e10 con 0x558adfb75280 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.052+0000 7fe8855b4640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558adfb75280 0x558adfb77740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.053+0000 7fe8855b4640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558adfb75280 0x558adfb77740 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.053+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.053+0000 7fe8855b4640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe87c02e910 0x7fe87c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.053+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb77e10 con 0x7fe87c02e910 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.053+0000 7fe8865b6640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe87c02e910 0x7fe87c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.054+0000 7fe8865b6640 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe87c02e910 0x7fe87c03a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.054+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.054+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.054+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.054+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.054+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.054+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x7fe87c02e910 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.055+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.056+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x7fe87c02e910 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.057+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.058+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x7fe87c02e910 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.059+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x7fe87c02e910 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.060+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb75280 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb708d0 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x558adfb6bee0 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558adfb6fb70 con 0x7fe87c02e910 2024-04-26T12:30:30.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.061+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb73b90 con 0x558adfb6bee0 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb73b90 con 0x558adfb6bee0 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb73b90 con 0x7fe87c02e910 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 zone default found 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 4 Realm: () 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 zonegroup default 2024-04-26T12:30:30.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb74430 con 0x558adfb708d0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.062+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb79c70 con 0x558adfb75280 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7a010 con 0x558adfb75280 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 20 started sync module instance, tier type = 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:30.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.063+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb79110 con 0x7fe87c02e910 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.064+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.064+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94054947198560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb79110 con 0x7fe87c02e910 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.064+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7a9d0 con 0x558adfb6bee0 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.065+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94054947198560] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.066+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.066+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94054947202816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb79110 con 0x558adfb6bee0 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.066+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7b420 con 0x558adfb75280 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.067+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94054947202816] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.067+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.067+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94054947196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb79080 con 0x558adfb75280 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.067+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7c1b0 con 0x7fe87c02e910 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.068+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.068+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94054947208384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7ca80 con 0x7fe87c02e910 2024-04-26T12:30:30.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.068+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7d550 con 0x558adfb6bee0 2024-04-26T12:30:30.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.069+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94054947196000] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.070+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.070+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94054947213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7d510 con 0x558adfb6bee0 2024-04-26T12:30:30.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.070+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7df90 con 0x558adfb708d0 2024-04-26T12:30:30.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.070+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94054947208384] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.072+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.072+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94054947216096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7e380 con 0x558adfb708d0 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.072+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7ed40 con 0x558adfb708d0 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.075+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94054947213376] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.078+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94054947216096] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.078+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.078+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94054947207184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7ed40 con 0x558adfb708d0 2024-04-26T12:30:30.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.078+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7f5e0 con 0x558adfb708d0 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.081+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94054947207184] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94054947219600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7f7e0 con 0x558adfb708d0 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 20 add_watcher() i=0 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 20 add_watcher() i=1 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 20 add_watcher() i=2 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 20 add_watcher() i=3 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 20 add_watcher() i=4 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 20 add_watcher() i=5 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.084+0000 7fe88a12f800 20 add_watcher() i=6 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.086+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94054947219600] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.086+0000 7fe88a12f800 20 add_watcher() i=7 2024-04-26T12:30:30.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.086+0000 7fe88a12f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:30.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.086+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfb829d0 con 0x558adfb6bee0 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.087+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.087+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94054947234656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7f770 con 0x558adfb6bee0 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.087+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94054947234656] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.088+0000 7fe7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.088+0000 7fe88a12f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.088+0000 7fe88a12f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.088+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb81dc0 con 0x558adfb6bee0 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.089+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.089+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8bc60 con 0x558adfb708d0 2024-04-26T12:30:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.092+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.092+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8bc60 con 0x558adfb75280 2024-04-26T12:30:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.093+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.093+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8c6a0 con 0x558adfb6bee0 2024-04-26T12:30:30.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.094+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.094+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8b100 con 0x7fe87c02e910 2024-04-26T12:30:30.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.095+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.095+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8b100 con 0x558adfb75280 2024-04-26T12:30:30.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.096+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.096+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8d880 con 0x558adfb6bee0 2024-04-26T12:30:30.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.097+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.097+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8d880 con 0x558adfb708d0 2024-04-26T12:30:30.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.100+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.100+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8d880 con 0x7fe87c02e910 2024-04-26T12:30:30.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.103+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.103+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8d990 con 0x558adfb75280 2024-04-26T12:30:30.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.104+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.104+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e000 con 0x7fe87c02e910 2024-04-26T12:30:30.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.105+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.105+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e000 con 0x558adfb708d0 2024-04-26T12:30:30.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.106+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.106+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e000 con 0x7fe87c02e910 2024-04-26T12:30:30.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.107+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.107+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e000 con 0x558adfb708d0 2024-04-26T12:30:30.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.109+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.109+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e090 con 0x558adfb6bee0 2024-04-26T12:30:30.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.110+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.110+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e090 con 0x558adfb75280 2024-04-26T12:30:30.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.112+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.112+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x7fe87c02e910 2024-04-26T12:30:30.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.113+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.113+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.114+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.114+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb6bee0 2024-04-26T12:30:30.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.116+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.116+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb6bee0 2024-04-26T12:30:30.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.117+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.117+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.118+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.118+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x7fe87c02e910 2024-04-26T12:30:30.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.119+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.119+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.121+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.121+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.121+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.122+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.122+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.122+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.123+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.123+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb708d0 2024-04-26T12:30:30.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.125+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.125+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.125+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.125+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb708d0 2024-04-26T12:30:30.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.127+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.128+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb75280 2024-04-26T12:30:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.130+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.130+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x558adfb708d0 2024-04-26T12:30:30.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.133+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.133+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb8e540 con 0x7fe87c02e910 2024-04-26T12:30:30.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe7367fc640 20 reqs_thread_entry: start 2024-04-26T12:30:30.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:30.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 20 Filter name: none 2024-04-26T12:30:30.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe6a7fff640 20 reqs_thread_entry: start 2024-04-26T12:30:30.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:30:30.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558adfbb9480 con 0x558adfb708d0 2024-04-26T12:30:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:30:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.136+0000 7fe88a12f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:30.139 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:30:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.137+0000 7fe7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.137+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94054947234656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfbb7bb0 con 0x558adfb6bee0 2024-04-26T12:30:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.138+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94054947234656] v30'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.138+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94054947198560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb82360 con 0x7fe87c02e910 2024-04-26T12:30:30.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.139+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94054947198560] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.139+0000 7fe88a12f800 20 remove_watcher() i=0 2024-04-26T12:30:30.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.139+0000 7fe88a12f800 2 removed watcher, disabling cache 2024-04-26T12:30:30.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.139+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94054947202816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb82360 con 0x558adfb6bee0 2024-04-26T12:30:30.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.141+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94054947202816] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.141+0000 7fe88a12f800 20 remove_watcher() i=1 2024-04-26T12:30:30.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.141+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94054947196000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7a700 con 0x558adfb75280 2024-04-26T12:30:30.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.142+0000 7fe8855b4640 1 -- 172.21.15.170:0/3880705700 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94054947196000] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87c037040 con 0x558adfb75280 2024-04-26T12:30:30.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.142+0000 7fe88a12f800 20 remove_watcher() i=2 2024-04-26T12:30:30.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.142+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94054947208384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb82360 con 0x7fe87c02e910 2024-04-26T12:30:30.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.143+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94054947208384] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x7fe87c02e910 2024-04-26T12:30:30.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.143+0000 7fe88a12f800 20 remove_watcher() i=3 2024-04-26T12:30:30.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.143+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94054947213376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb78c60 con 0x558adfb6bee0 2024-04-26T12:30:30.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.144+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94054947213376] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88000a4a0 con 0x558adfb6bee0 2024-04-26T12:30:30.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.144+0000 7fe88a12f800 20 remove_watcher() i=4 2024-04-26T12:30:30.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.144+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94054947216096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb7bcc0 con 0x558adfb708d0 2024-04-26T12:30:30.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.145+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94054947216096] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.145+0000 7fe88a12f800 20 remove_watcher() i=5 2024-04-26T12:30:30.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.145+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94054947207184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb82360 con 0x558adfb708d0 2024-04-26T12:30:30.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.146+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94054947207184] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.146+0000 7fe88a12f800 20 remove_watcher() i=6 2024-04-26T12:30:30.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.146+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94054947219600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558adfb78c60 con 0x558adfb708d0 2024-04-26T12:30:30.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.146+0000 7fe885db5640 1 -- 172.21.15.170:0/3880705700 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94054947219600] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe8780c1030 con 0x558adfb708d0 2024-04-26T12:30:30.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.146+0000 7fe88a12f800 20 remove_watcher() i=7 2024-04-26T12:30:30.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb708d0 msgr2=0x558adfb72cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb708d0 0x558adfb72cc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb6bee0 msgr2=0x558adfb6e3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb6bee0 0x558adfb6e3a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe87c02e910 msgr2=0x7fe87c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe87c02e910 0x7fe87c03a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558adfb75280 msgr2=0x558adfb77740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558adfb75280 0x558adfb77740 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe750036950 msgr2=0x7fe750038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe750036950 0x7fe750038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00ffd0 tx=0x7fe87c023040 comp rx=0 tx=0).stop 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 msgr2=0x558adfb608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe8865b6640 1 -- 172.21.15.170:0/3880705700 reap_dead start 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb608c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe878080aa0 tx=0x7fe87807ef80 comp rx=0 tx=0).stop 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 shutdown_connections 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/3880705700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb59470 0x558adfb608c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 >> 172.21.15.170:0/3880705700 conn(0x558adfb55780 msgr2=0x558adfb52de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 shutdown_connections 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/3880705700 wait complete. 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe760036950 msgr2=0x7fe760038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe760036950 0x7fe760038e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x558adfb35940 tx=0x7fe87c006000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb4c330 msgr2=0x558adfb4c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb4c330 0x558adfb4c750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe87808c380 tx=0x7fe878009700 comp rx=0 tx=0).stop 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 shutdown_connections 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe760036950 0x7fe760038e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 --2- 172.21.15.170:0/1935305488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adfb4c330 0x558adfb4c750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 >> 172.21.15.170:0/1935305488 conn(0x558adfb403d0 msgr2=0x558adfb407d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 shutdown_connections 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.147+0000 7fe88a12f800 1 -- 172.21.15.170:0/1935305488 wait complete. 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb37390 msgr2=0x558adfb39780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558adfb37390 0x558adfb39780 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb325a0 msgr2=0x558adfb349f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558adfb325a0 0x558adfb349f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558adfb3b320 msgr2=0x558adfb3d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558adfb3b320 0x558adfb3d770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe76c036950 msgr2=0x7fe76c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe76c036950 0x7fe76c038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000c00 tx=0x7fe87c0013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 msgr2=0x558adfb2d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 --2- 172.21.15.170:0/4176609369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558adf9a8140 0x558adfb2d750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe878005870 tx=0x7fe878002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe8865b6640 1 -- 172.21.15.170:0/4176609369 reap_dead start 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 shutdown_connections 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 >> 172.21.15.170:0/4176609369 conn(0x558adfa2db80 msgr2=0x558adfb245a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 shutdown_connections 2024-04-26T12:30:30.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.148+0000 7fe88a12f800 1 -- 172.21.15.170:0/4176609369 wait complete. 2024-04-26T12:30:30.156 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:30:30.156 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T12:30:30.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T12:30:30.157 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T12:30:30.240 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:30.240 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.239+0000 7f0125098800 1 Processor -- start 2024-04-26T12:30:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.239+0000 7f0125098800 1 -- start start 2024-04-26T12:30:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f0125098800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5631d89c9b10 0x5631d89cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f0125098800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631d88720c0 con 0x5631d89c6000 2024-04-26T12:30:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f0125098800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5631d88564d0 con 0x5631d89c9b10 2024-04-26T12:30:30.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f011a39d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5631d89c9b10 0x5631d89cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f0122b9e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5631d89c6000 0x5631d89c83f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:45962/0 (socket says 172.21.15.170:45962) 2024-04-26T12:30:30.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f0122b9e640 1 -- 172.21.15.170:0/4177517313 learned_addr learned my addr 172.21.15.170:0/4177517313 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:30.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f011a39d640 1 -- 172.21.15.170:0/4177517313 >> v1:172.21.15.132:6789/0 conn(0x5631d89c6000 legacy=0x5631d89c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.240+0000 7f011a39d640 1 -- 172.21.15.170:0/4177517313 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d8883d40 con 0x5631d89c9b10 2024-04-26T12:30:30.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.242+0000 7f011a39d640 1 --2- 172.21.15.170:0/4177517313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c9b10 0x5631d89cbf00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f010c00a470 tx=0x7f010c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413b7823c9ac2e45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.242+0000 7f012239d640 1 -- 172.21.15.170:0/4177517313 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010c057070 con 0x5631d89c9b10 2024-04-26T12:30:30.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.242+0000 7f012239d640 1 -- 172.21.15.170:0/4177517313 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c052570 con 0x5631d89c9b10 2024-04-26T12:30:30.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.242+0000 7f012239d640 1 -- 172.21.15.170:0/4177517313 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010c052870 con 0x5631d89c9b10 2024-04-26T12:30:30.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.243+0000 7f0125098800 1 -- 172.21.15.170:0/4177517313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c9b10 msgr2=0x5631d89cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.243+0000 7f0125098800 1 --2- 172.21.15.170:0/4177517313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c9b10 0x5631d89cbf00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f010c00a470 tx=0x7f010c01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:30.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.243+0000 7f0125098800 1 -- 172.21.15.170:0/4177517313 shutdown_connections 2024-04-26T12:30:30.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.243+0000 7f0125098800 1 --2- 172.21.15.170:0/4177517313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c9b10 0x5631d89cbf00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.243+0000 7f0125098800 1 -- 172.21.15.170:0/4177517313 >> 172.21.15.170:0/4177517313 conn(0x5631d89bf990 msgr2=0x5631d89c1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.243+0000 7f0125098800 1 -- 172.21.15.170:0/4177517313 shutdown_connections 2024-04-26T12:30:30.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.243+0000 7f0125098800 1 -- 172.21.15.170:0/4177517313 wait complete. 2024-04-26T12:30:30.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0125098800 1 Processor -- start 2024-04-26T12:30:30.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0125098800 1 -- start start 2024-04-26T12:30:30.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0125098800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8ab6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0125098800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631d8910b40 con 0x5631d89c6000 2024-04-26T12:30:30.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8ab6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8ab6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40848/0 (socket says 172.21.15.170:40848) 2024-04-26T12:30:30.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0122b9e640 1 -- 172.21.15.170:0/771263552 learned_addr learned my addr 172.21.15.170:0/771263552 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.255+0000 7f0122b9e640 1 -- 172.21.15.170:0/771263552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d8882590 con 0x5631d89c6000 2024-04-26T12:30:30.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.256+0000 7f0122b9e640 1 --2- 172.21.15.170:0/771263552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8ab6750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0114001de0 tx=0x7f011400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482d443d870282e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.256+0000 7f0010e09640 1 -- 172.21.15.170:0/771263552 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0114012020 con 0x5631d89c6000 2024-04-26T12:30:30.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.256+0000 7f0010e09640 1 -- 172.21.15.170:0/771263552 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011400e5a0 con 0x5631d89c6000 2024-04-26T12:30:30.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.256+0000 7f0010e09640 1 -- 172.21.15.170:0/771263552 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f011400e8c0 con 0x5631d89c6000 2024-04-26T12:30:30.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 -- 172.21.15.170:0/771263552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 msgr2=0x5631d8ab6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 --2- 172.21.15.170:0/771263552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8ab6750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0114001de0 tx=0x7f011400b6c0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 -- 172.21.15.170:0/771263552 shutdown_connections 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 --2- 172.21.15.170:0/771263552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8ab6750 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 -- 172.21.15.170:0/771263552 >> 172.21.15.170:0/771263552 conn(0x5631d89bf990 msgr2=0x5631d8ab2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 -- 172.21.15.170:0/771263552 shutdown_connections 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 -- 172.21.15.170:0/771263552 wait complete. 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 Processor -- start 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 -- start start 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8abe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0125098800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631d89ce750 con 0x5631d89c6000 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8abe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8abe0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40860/0 (socket says 172.21.15.170:40860) 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.257+0000 7f0122b9e640 1 -- 172.21.15.170:0/2470019685 learned_addr learned my addr 172.21.15.170:0/2470019685 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.258+0000 7f0122b9e640 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d88798f0 con 0x5631d89c6000 2024-04-26T12:30:30.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.258+0000 7f0122b9e640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8abe0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0114001de0 tx=0x7f0114000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.258+0000 7f000f606640 1 -- 172.21.15.170:0/2470019685 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0114012030 con 0x5631d89c6000 2024-04-26T12:30:30.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.258+0000 7f000f606640 1 -- 172.21.15.170:0/2470019685 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011401a7a0 con 0x5631d89c6000 2024-04-26T12:30:30.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.258+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631d8abe610 con 0x5631d89c6000 2024-04-26T12:30:30.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.258+0000 7f000f606640 1 -- 172.21.15.170:0/2470019685 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f011401aac0 con 0x5631d89c6000 2024-04-26T12:30:30.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.258+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631d8abeb30 con 0x5631d89c6000 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.259+0000 7f000f606640 1 -- 172.21.15.170:0/2470019685 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0114015020 con 0x5631d89c6000 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.259+0000 7f000f606640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0008036950 0x7f0008038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.259+0000 7f000f606640 1 -- 172.21.15.170:0/2470019685 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0114020070 con 0x5631d89c6000 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.259+0000 7f011a39d640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0008036950 0x7f0008038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.259+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d89c9b10 0x5631d8ac5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.259+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8ac5680 con 0x5631d89c9b10 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.259+0000 7f012339f640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d89c9b10 0x5631d8ac5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.260+0000 7f011a39d640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0008036950 0x7f0008038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f010c054000 tx=0x7f010c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.260+0000 7f012339f640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d89c9b10 0x5631d8ac5140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.260+0000 7f012339f640 1 -- 172.21.15.170:0/2470019685 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d89c9b10 2024-04-26T12:30:30.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.260+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8ac26f0 con 0x5631d89c9b10 2024-04-26T12:30:30.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.260+0000 7f012339f640 1 -- 172.21.15.170:0/2470019685 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d89c9b10 2024-04-26T12:30:30.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.260+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8ac7920 0x5631d8ac9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.260+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8aca400 con 0x5631d8ac7920 2024-04-26T12:30:30.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.261+0000 7f0122b9e640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8ac7920 0x5631d8ac9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.261+0000 7f0122b9e640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8ac7920 0x5631d8ac9d10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.261+0000 7f0122b9e640 1 -- 172.21.15.170:0/2470019685 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0114024980 con 0x5631d8ac7920 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.261+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8ac68d0 con 0x5631d89c9b10 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.262+0000 7f012339f640 1 -- 172.21.15.170:0/2470019685 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d89c9b10 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.262+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631d8acb8b0 0x5631d8acdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.262+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8ace460 con 0x5631d8acb8b0 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.262+0000 7f011a39d640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631d8acb8b0 0x5631d8acdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.262+0000 7f011a39d640 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631d8acb8b0 0x5631d8acdd00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.262+0000 7f011a39d640 1 -- 172.21.15.170:0/2470019685 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f010c052940 con 0x5631d8acb8b0 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0125098800 1 Processor -- start 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0125098800 1 -- start start 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0125098800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c5bc0 0x5631d89c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0125098800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631d88b6e60 con 0x5631d89c5bc0 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c5bc0 0x5631d89c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c5bc0 0x5631d89c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40862/0 (socket says 172.21.15.170:40862) 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0122b9e640 1 -- 172.21.15.170:0/3437779743 learned_addr learned my addr 172.21.15.170:0/3437779743 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0122b9e640 1 -- 172.21.15.170:0/3437779743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d89c4570 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f0122b9e640 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c5bc0 0x5631d89c4030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01140015f0 tx=0x7f0114018f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.263+0000 7f000ce01640 1 -- 172.21.15.170:0/3437779743 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f011403d020 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f000ce01640 1 -- 172.21.15.170:0/3437779743 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0114032070 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f000ce01640 1 -- 172.21.15.170:0/3437779743 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0114044720 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631d89c4800 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631d89c4d00 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f000ce01640 1 -- 172.21.15.170:0/3437779743 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f01140448c0 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f000ce01640 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efffc036950 0x7efffc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f000ce01640 1 -- 172.21.15.170:0/3437779743 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f01140194c0 con 0x5631d89c5bc0 2024-04-26T12:30:30.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.264+0000 7f011a39d640 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efffc036950 0x7efffc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0125098800 1 Processor -- start 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0125098800 1 -- start start 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f011a39d640 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efffc036950 0x7efffc038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5631d8ac5ed0 tx=0x7f010c005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0125098800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8aebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0125098800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631d8ab6ed0 con 0x5631d8aebba0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8aebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8aebfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40864/0 (socket says 172.21.15.170:40864) 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0122b9e640 1 -- 172.21.15.170:0/71758131 learned_addr learned my addr 172.21.15.170:0/71758131 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.265+0000 7f0122b9e640 1 -- 172.21.15.170:0/71758131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d8aec590 con 0x5631d8aebba0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0122b9e640 1 --2- 172.21.15.170:0/71758131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8aebfc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f011401af70 tx=0x7f0114022470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a645f020da1ac2a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f00067fc640 1 -- 172.21.15.170:0/71758131 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f011404c270 con 0x5631d8aebba0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f00067fc640 1 -- 172.21.15.170:0/71758131 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011401d0c0 con 0x5631d8aebba0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f00067fc640 1 -- 172.21.15.170:0/71758131 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f011404c410 con 0x5631d8aebba0 2024-04-26T12:30:30.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 -- 172.21.15.170:0/71758131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 msgr2=0x5631d8aebfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 --2- 172.21.15.170:0/71758131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8aebfc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f011401af70 tx=0x7f0114022470 comp rx=0 tx=0).stop 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 -- 172.21.15.170:0/71758131 shutdown_connections 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 --2- 172.21.15.170:0/71758131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8aebfc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 -- 172.21.15.170:0/71758131 >> 172.21.15.170:0/71758131 conn(0x5631d8ae7f00 msgr2=0x5631d8ae5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 -- 172.21.15.170:0/71758131 shutdown_connections 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 -- 172.21.15.170:0/71758131 wait complete. 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 Processor -- start 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.266+0000 7f0125098800 1 -- start start 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0125098800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8af2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0125098800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631d8aecc40 con 0x5631d8aebba0 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8af2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0122b9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8af2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40872/0 (socket says 172.21.15.170:40872) 2024-04-26T12:30:30.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 learned_addr learned my addr 172.21.15.170:0/665209423 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d8af34f0 con 0x5631d8aebba0 2024-04-26T12:30:30.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0122b9e640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8af2fb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0114050fb0 tx=0x7f0114019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0004ff9640 1 -- 172.21.15.170:0/665209423 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0114071070 con 0x5631d8aebba0 2024-04-26T12:30:30.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0004ff9640 1 -- 172.21.15.170:0/665209423 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01140490e0 con 0x5631d8aebba0 2024-04-26T12:30:30.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631d8af34f0 con 0x5631d8aebba0 2024-04-26T12:30:30.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.267+0000 7f0004ff9640 1 -- 172.21.15.170:0/665209423 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01140493c0 con 0x5631d8aebba0 2024-04-26T12:30:30.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.268+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631d8af34f0 con 0x5631d8aebba0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.268+0000 7f0004ff9640 1 -- 172.21.15.170:0/665209423 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0114074070 con 0x5631d8aebba0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f0004ff9640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7effec036950 0x7effec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f0004ff9640 1 -- 172.21.15.170:0/665209423 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0114077ca0 con 0x5631d8aebba0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f011a39d640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7effec036950 0x7effec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d8afe670 0x5631d8b00b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b01280 con 0x5631d8afe670 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f012339f640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d8afe670 0x5631d8b00b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f011a39d640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7effec036950 0x7effec038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f010c052fd0 tx=0x7f010c04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.269+0000 7f012339f640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d8afe670 0x5631d8b00b30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 realm 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b016e0 con 0x5631d8afe670 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b01f80 con 0x5631d8afe670 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8afe670 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8b03080 0x5631d8b05470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.270+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b05b10 con 0x5631d8b03080 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f0122b9e640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8b03080 0x5631d8b05470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f0122b9e640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8b03080 0x5631d8b05470 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f0125098800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f0125098800 20 searching for the correct realm 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631d8b07a70 0x5631d8b09f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0a580 con 0x5631d8b07a70 2024-04-26T12:30:30.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.271+0000 7f011a39d640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631d8b07a70 0x5631d8b09f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.272+0000 7f011a39d640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631d8b07a70 0x5631d8b09f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.272+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.272+0000 7f011a39d640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f010c076040 0x7f010c083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.272+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0a580 con 0x7f010c076040 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.272+0000 7f012339f640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f010c076040 0x7f010c083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.272+0000 7f012339f640 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f010c076040 0x7f010c083410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8b03080 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8afe670 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8afe670 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.273+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8b03080 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.274+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.274+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8b03080 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.274+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.274+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x7f010c076040 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.274+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.274+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8b07a70 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8afe670 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8b03080 2024-04-26T12:30:30.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8afe670 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.275+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x7f010c076040 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b02320 con 0x5631d8b07a70 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b07a70 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b03080 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.276+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b07a70 2024-04-26T12:30:30.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b07a70 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8afe670 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8afe670 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b03080 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.277+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b07a70 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.278+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.278+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x7f010c076040 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.278+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.278+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8afe670 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.278+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.278+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b03080 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b07a70 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b03080 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x7f010c076040 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b07a70 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.279+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8b03080 2024-04-26T12:30:30.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x5631d8afe670 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f010c090040 con 0x7f010c076040 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b06360 con 0x5631d8afe670 2024-04-26T12:30:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.280+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b06360 con 0x5631d8afe670 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b06360 con 0x7f010c076040 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 zone default found 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 4 Realm: () 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 zonegroup default 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b06c00 con 0x5631d8b03080 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.281+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0c3e0 con 0x5631d8b07a70 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0c780 con 0x5631d8b07a70 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f0125098800 20 started sync module instance, tier type = 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f0125098800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.282+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0b880 con 0x7f010c076040 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.283+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.283+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94772088847776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0b880 con 0x7f010c076040 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.283+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0d140 con 0x5631d8afe670 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.284+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94772088847776] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.284+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.284+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94772088845744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0d140 con 0x5631d8afe670 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.284+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0db00 con 0x5631d8b07a70 2024-04-26T12:30:30.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.285+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94772088845744] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.285+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.285+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94772088851600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0d0b0 con 0x5631d8b07a70 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.285+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0e9c0 con 0x7f010c076040 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.286+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.286+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94772088851600] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.286+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94772088858352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0f180 con 0x7f010c076040 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.286+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0df30 con 0x5631d8afe670 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.287+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.288+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94772088862576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0df30 con 0x5631d8afe670 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.288+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94772088858352] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.288+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b104f0 con 0x5631d8b03080 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.289+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.289+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94772088864832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0df30 con 0x5631d8b03080 2024-04-26T12:30:30.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.289+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b11420 con 0x5631d8b03080 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.289+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94772088862576] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.290+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94772088864832] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.290+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.290+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94772088863632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b117c0 con 0x5631d8b03080 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.290+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b12050 con 0x5631d8b03080 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94772088871776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b12840 con 0x5631d8b03080 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 20 add_watcher() i=0 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 20 add_watcher() i=1 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 20 add_watcher() i=2 2024-04-26T12:30:30.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 20 add_watcher() i=3 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 20 add_watcher() i=4 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 20 add_watcher() i=5 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94772088863632] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.291+0000 7f0125098800 20 add_watcher() i=6 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.292+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94772088871776] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.292+0000 7f0125098800 20 add_watcher() i=7 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.292+0000 7f0125098800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.292+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b10ee0 con 0x5631d8afe670 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.292+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.292+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94772088873680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b10ee0 con 0x5631d8afe670 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.293+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94772088873680] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.293+0000 7effd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.293+0000 7f0125098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:30.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.293+0000 7f0125098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:30.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.293+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1e2d0 con 0x5631d8afe670 2024-04-26T12:30:30.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.295+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.295+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1e9a0 con 0x5631d8b03080 2024-04-26T12:30:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.297+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.297+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1e9a0 con 0x5631d8b07a70 2024-04-26T12:30:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.298+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.298+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1f440 con 0x5631d8afe670 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.298+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.298+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1a070 con 0x7f010c076040 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.299+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.299+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1a010 con 0x5631d8b07a70 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.300+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.300+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b20170 con 0x5631d8afe670 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.302+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.302+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b20620 con 0x5631d8b03080 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.303+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.303+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b20620 con 0x7f010c076040 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.304+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.304+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b20620 con 0x5631d8b07a70 2024-04-26T12:30:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.305+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.305+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b190c0 con 0x7f010c076040 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.306+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.306+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b190c0 con 0x5631d8b03080 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.307+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.307+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b19090 con 0x7f010c076040 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.308+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.308+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18980 con 0x5631d8b03080 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.309+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.309+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18fd0 con 0x5631d8afe670 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.310+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.310+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.311+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.311+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x7f010c076040 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.312+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.312+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.313+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.313+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8afe670 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.315+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.315+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8afe670 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.315+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.315+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.317+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.317+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x7f010c076040 2024-04-26T12:30:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.318+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.318+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.319+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.319+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.320+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.320+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.320+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.320+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.321+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.321+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b03080 2024-04-26T12:30:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.323+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.323+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.324+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.324+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b03080 2024-04-26T12:30:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.325+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.325+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b07a70 2024-04-26T12:30:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.326+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.326+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x5631d8b03080 2024-04-26T12:30:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.327+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.327+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b18e30 con 0x7f010c076040 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.328+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.328+0000 7eff53fff640 20 reqs_thread_entry: start 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.328+0000 7f0125098800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f0125098800 20 Filter name: none 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7eff51ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f0125098800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f0125098800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b4ba70 con 0x5631d8afe670 2024-04-26T12:30:30.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f0125098800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f0125098800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-26T12:30:30.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.329+0000 7f0125098800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:30.331 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, user does not exist 2024-04-26T12:30:30.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.330+0000 7effd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.330+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94772088873680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1bf70 con 0x5631d8afe670 2024-04-26T12:30:30.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.331+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94772088873680] v30'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.331+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94772088847776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b1bf70 con 0x7f010c076040 2024-04-26T12:30:30.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.332+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94772088847776] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.332+0000 7f0125098800 20 remove_watcher() i=0 2024-04-26T12:30:30.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.332+0000 7f0125098800 2 removed watcher, disabling cache 2024-04-26T12:30:30.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.332+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94772088845744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0bda0 con 0x5631d8afe670 2024-04-26T12:30:30.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.333+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94772088845744] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.333+0000 7f0125098800 20 remove_watcher() i=1 2024-04-26T12:30:30.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.333+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94772088851600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0b5b0 con 0x5631d8b07a70 2024-04-26T12:30:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.334+0000 7f011a39d640 1 -- 172.21.15.170:0/665209423 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94772088851600] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f010c081070 con 0x5631d8b07a70 2024-04-26T12:30:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.334+0000 7f0125098800 20 remove_watcher() i=2 2024-04-26T12:30:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.334+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94772088858352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0cc90 con 0x7f010c076040 2024-04-26T12:30:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.335+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94772088858352] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x7f010c076040 2024-04-26T12:30:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.335+0000 7f0125098800 20 remove_watcher() i=3 2024-04-26T12:30:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.335+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94772088862576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0cc90 con 0x5631d8afe670 2024-04-26T12:30:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.336+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94772088862576] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f011c00a4a0 con 0x5631d8afe670 2024-04-26T12:30:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.336+0000 7f0125098800 20 remove_watcher() i=4 2024-04-26T12:30:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.336+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94772088864832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0f770 con 0x5631d8b03080 2024-04-26T12:30:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.337+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94772088864832] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.337+0000 7f0125098800 20 remove_watcher() i=5 2024-04-26T12:30:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.337+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94772088863632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0cc90 con 0x5631d8b03080 2024-04-26T12:30:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.338+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94772088863632] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.338+0000 7f0125098800 20 remove_watcher() i=6 2024-04-26T12:30:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.338+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94772088871776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631d8b0cc90 con 0x5631d8b03080 2024-04-26T12:30:30.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0122b9e640 1 -- 172.21.15.170:0/665209423 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94772088871776] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0114073030 con 0x5631d8b03080 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 20 remove_watcher() i=7 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8b03080 msgr2=0x5631d8b05470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8b03080 0x5631d8b05470 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d8afe670 msgr2=0x5631d8b00b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d8afe670 0x5631d8b00b30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f010c076040 msgr2=0x7f010c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f010c076040 0x7f010c083410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631d8b07a70 msgr2=0x5631d8b09f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631d8b07a70 0x5631d8b09f00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7effec036950 msgr2=0x7effec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7effec036950 0x7effec038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f010c052fd0 tx=0x7f010c04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 msgr2=0x5631d8af2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 --2- 172.21.15.170:0/665209423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d8aebba0 0x5631d8af2fb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0114050fb0 tx=0x7f0114019130 comp rx=0 tx=0).stop 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 reap_dead start 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f012339f640 1 -- 172.21.15.170:0/665209423 reap_dead start 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 shutdown_connections 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 >> 172.21.15.170:0/665209423 conn(0x5631d8ae7f00 msgr2=0x5631d8ae5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 shutdown_connections 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.339+0000 7f0125098800 1 -- 172.21.15.170:0/665209423 wait complete. 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efffc036950 msgr2=0x7efffc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efffc036950 0x7efffc038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5631d8ac5ed0 tx=0x7f010c005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c5bc0 msgr2=0x5631d89c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c5bc0 0x5631d89c4030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01140015f0 tx=0x7f0114018f80 comp rx=0 tx=0).stop 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 shutdown_connections 2024-04-26T12:30:30.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7efffc036950 0x7efffc038e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/3437779743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c5bc0 0x5631d89c4030 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 >> 172.21.15.170:0/3437779743 conn(0x5631d8ad0960 msgr2=0x5631d8ad0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 shutdown_connections 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/3437779743 wait complete. 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8ac7920 msgr2=0x5631d8ac9d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631d8ac7920 0x5631d8ac9d10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d89c9b10 msgr2=0x5631d8ac5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631d89c9b10 0x5631d8ac5140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631d8acb8b0 msgr2=0x5631d8acdd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631d8acb8b0 0x5631d8acdd00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0008036950 msgr2=0x7f0008038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0008036950 0x7f0008038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f010c054000 tx=0x7f010c04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 msgr2=0x5631d8abe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 --2- 172.21.15.170:0/2470019685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631d89c6000 0x5631d8abe0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0114001de0 tx=0x7f0114000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f012339f640 1 -- 172.21.15.170:0/2470019685 reap_dead start 2024-04-26T12:30:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 shutdown_connections 2024-04-26T12:30:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 >> 172.21.15.170:0/2470019685 conn(0x5631d89bf990 msgr2=0x5631d8ab5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 shutdown_connections 2024-04-26T12:30:30.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.340+0000 7f0125098800 1 -- 172.21.15.170:0/2470019685 wait complete. 2024-04-26T12:30:30.349 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T12:30:30.349 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:30:30.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:30:30.350 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-26T12:30:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.436+0000 7fa02321f800 1 Processor -- start 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.436+0000 7fa02321f800 1 -- start start 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa02321f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558822b7afb0 0x558822b7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa02321f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558822a270c0 con 0x558822b7d8e0 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa02321f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x558822a0b4d0 con 0x558822b7afb0 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa020d1e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558822b7afb0 0x558822b7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa020d1e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558822b7afb0 0x558822b7d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40874/0 (socket says 172.21.15.170:40874) 2024-04-26T12:30:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa020d1e640 1 -- 172.21.15.170:0/1545951939 learned_addr learned my addr 172.21.15.170:0/1545951939 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa020d1e640 1 -- 172.21.15.170:0/1545951939 >> v1:172.21.15.132:6789/0 conn(0x558822b7d8e0 legacy=0x558822b7fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa020d1e640 1 -- 172.21.15.170:0/1545951939 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822a38d40 con 0x558822b7afb0 2024-04-26T12:30:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.437+0000 7fa01bfff640 1 -- 172.21.15.170:0/1545951939 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474650672 0 0) 0x558822a270c0 con 0x558822b7d8e0 2024-04-26T12:30:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.439+0000 7fa020d1e640 1 --2- 172.21.15.170:0/1545951939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7d3a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa01000a520 tx=0x7fa01001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16188d2773545c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.439+0000 7fa01bfff640 1 -- 172.21.15.170:0/1545951939 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa010057070 con 0x558822b7afb0 2024-04-26T12:30:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.439+0000 7fa01bfff640 1 -- 172.21.15.170:0/1545951939 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa010052570 con 0x558822b7afb0 2024-04-26T12:30:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.439+0000 7fa01bfff640 1 -- 172.21.15.170:0/1545951939 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01004ae60 con 0x558822b7afb0 2024-04-26T12:30:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.440+0000 7fa02321f800 1 -- 172.21.15.170:0/1545951939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 msgr2=0x558822b7d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.440+0000 7fa02321f800 1 --2- 172.21.15.170:0/1545951939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7d3a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa01000a520 tx=0x7fa01001d010 comp rx=0 tx=0).stop 2024-04-26T12:30:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.440+0000 7fa02321f800 1 -- 172.21.15.170:0/1545951939 shutdown_connections 2024-04-26T12:30:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.440+0000 7fa02321f800 1 --2- 172.21.15.170:0/1545951939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7d3a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.440+0000 7fa02321f800 1 -- 172.21.15.170:0/1545951939 >> 172.21.15.170:0/1545951939 conn(0x558822b74a60 msgr2=0x558822b76e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.440+0000 7fa02321f800 1 -- 172.21.15.170:0/1545951939 shutdown_connections 2024-04-26T12:30:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.440+0000 7fa02321f800 1 -- 172.21.15.170:0/1545951939 wait complete. 2024-04-26T12:30:30.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.451+0000 7fa02321f800 1 Processor -- start 2024-04-26T12:30:30.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.451+0000 7fa02321f800 1 -- start start 2024-04-26T12:30:30.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.451+0000 7fa02321f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.451+0000 7fa02321f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558822ac5b60 con 0x558822b7afb0 2024-04-26T12:30:30.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7fa020d1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7fa020d1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40884/0 (socket says 172.21.15.170:40884) 2024-04-26T12:30:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7fa020d1e640 1 -- 172.21.15.170:0/3649252016 learned_addr learned my addr 172.21.15.170:0/3649252016 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7fa020d1e640 1 -- 172.21.15.170:0/3649252016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822a37590 con 0x558822b7afb0 2024-04-26T12:30:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7fa020d1e640 1 --2- 172.21.15.170:0/3649252016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7a8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa010055040 tx=0x7fa01004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21de38750120d6dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7f9f0ee0d640 1 -- 172.21.15.170:0/3649252016 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa010062070 con 0x558822b7afb0 2024-04-26T12:30:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7f9f0ee0d640 1 -- 172.21.15.170:0/3649252016 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa010052720 con 0x558822b7afb0 2024-04-26T12:30:30.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.452+0000 7f9f0ee0d640 1 -- 172.21.15.170:0/3649252016 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa010057040 con 0x558822b7afb0 2024-04-26T12:30:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 -- 172.21.15.170:0/3649252016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 msgr2=0x558822b7a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 --2- 172.21.15.170:0/3649252016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7a8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa010055040 tx=0x7fa01004c000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 -- 172.21.15.170:0/3649252016 shutdown_connections 2024-04-26T12:30:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 --2- 172.21.15.170:0/3649252016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822b7a8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 -- 172.21.15.170:0/3649252016 >> 172.21.15.170:0/3649252016 conn(0x558822b74a60 msgr2=0x558822c66ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 -- 172.21.15.170:0/3649252016 shutdown_connections 2024-04-26T12:30:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 -- 172.21.15.170:0/3649252016 wait complete. 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 Processor -- start 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 -- start start 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822c75060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa02321f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558822b816f0 con 0x558822b7afb0 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.453+0000 7fa020d1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822c75060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7fa020d1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822c75060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40894/0 (socket says 172.21.15.170:40894) 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7fa020d1e640 1 -- 172.21.15.170:0/19104032 learned_addr learned my addr 172.21.15.170:0/19104032 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7fa020d1e640 1 -- 172.21.15.170:0/19104032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822a2e8f0 con 0x558822b7afb0 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7fa020d1e640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822c75060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0100057e0 tx=0x7fa010002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7f9f0d60a640 1 -- 172.21.15.170:0/19104032 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa010057050 con 0x558822b7afb0 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7f9f0d60a640 1 -- 172.21.15.170:0/19104032 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa010067450 con 0x558822b7afb0 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558822c755a0 con 0x558822b7afb0 2024-04-26T12:30:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7f9f0d60a640 1 -- 172.21.15.170:0/19104032 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa010062040 con 0x558822b7afb0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.454+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558822c75b20 con 0x558822b7afb0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa02321f800 1 Processor -- start 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa02321f800 1 -- start start 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7f9f0d60a640 1 -- 172.21.15.170:0/19104032 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa010067750 con 0x558822b7afb0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa02321f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c82bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa02321f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558822a6be60 con 0x558822c827b0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7f9f0d60a640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9f08036900 0x7f9f08038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7f9f0d60a640 1 -- 172.21.15.170:0/19104032 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa01008e1b0 con 0x558822b7afb0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa02151f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c82bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa020d1e640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9f08036900 0x7f9f08038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa02151f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c82bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40908/0 (socket says 172.21.15.170:40908) 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.455+0000 7fa02151f640 1 -- 172.21.15.170:0/333869836 learned_addr learned my addr 172.21.15.170:0/333869836 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.456+0000 7fa02151f640 1 -- 172.21.15.170:0/333869836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822c83110 con 0x558822c827b0 2024-04-26T12:30:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.456+0000 7fa020d1e640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9f08036900 0x7f9f08038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa010052a50 tx=0x7fa0100529e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.456+0000 7fa02151f640 1 --2- 172.21.15.170:0/333869836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c82bd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00a430 tx=0x7fa01c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecda59c033417b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.456+0000 7f9f06ffd640 1 -- 172.21.15.170:0/333869836 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01c015070 con 0x558822c827b0 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.456+0000 7f9f06ffd640 1 -- 172.21.15.170:0/333869836 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01c001670 con 0x558822c827b0 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.456+0000 7f9f06ffd640 1 -- 172.21.15.170:0/333869836 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01c001990 con 0x558822c827b0 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 -- 172.21.15.170:0/333869836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 msgr2=0x558822c82bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 --2- 172.21.15.170:0/333869836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c82bd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00a430 tx=0x7fa01c00a8f0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 -- 172.21.15.170:0/333869836 shutdown_connections 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 --2- 172.21.15.170:0/333869836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c82bd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 -- 172.21.15.170:0/333869836 >> 172.21.15.170:0/333869836 conn(0x558822b7d8e0 msgr2=0x558822c7f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 -- 172.21.15.170:0/333869836 shutdown_connections 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 -- 172.21.15.170:0/333869836 wait complete. 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 Processor -- start 2024-04-26T12:30:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 -- start start 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c89c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02321f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558822c83aa0 con 0x558822c827b0 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02151f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c89c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02151f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c89c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40916/0 (socket says 172.21.15.170:40916) 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.457+0000 7fa02151f640 1 -- 172.21.15.170:0/2580276778 learned_addr learned my addr 172.21.15.170:0/2580276778 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.458+0000 7fa02151f640 1 -- 172.21.15.170:0/2580276778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822c8a190 con 0x558822c827b0 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.458+0000 7fa02151f640 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c89c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00a930 tx=0x7fa01c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.458+0000 7f9f057fa640 1 -- 172.21.15.170:0/2580276778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01c020020 con 0x558822c827b0 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.458+0000 7f9f057fa640 1 -- 172.21.15.170:0/2580276778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01c0108b0 con 0x558822c827b0 2024-04-26T12:30:30.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.458+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558822c8a420 con 0x558822c827b0 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.458+0000 7f9f057fa640 1 -- 172.21.15.170:0/2580276778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01c015040 con 0x558822c827b0 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.458+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558822c8d0d0 con 0x558822c827b0 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7f9f057fa640 1 -- 172.21.15.170:0/2580276778 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa01c023020 con 0x558822c827b0 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7f9f057fa640 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ef8036950 0x7f9ef8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7f9f057fa640 1 -- 172.21.15.170:0/2580276778 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa01c04bfe0 con 0x558822c827b0 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa01851d640 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ef8036950 0x7f9ef8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa02321f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa02321f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa02321f800 1 Processor -- start 2024-04-26T12:30:30.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa01851d640 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ef8036950 0x7f9ef8038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa008000f60 tx=0x7fa008001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa02321f800 1 -- start start 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa02321f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822ca4340 0x558822ca4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.459+0000 7fa02321f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558822b78eb0 con 0x558822ca4340 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7fa020d1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822ca4340 0x558822ca4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7fa020d1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822ca4340 0x558822ca4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40930/0 (socket says 172.21.15.170:40930) 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7fa020d1e640 1 -- 172.21.15.170:0/3387074853 learned_addr learned my addr 172.21.15.170:0/3387074853 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7fa020d1e640 1 -- 172.21.15.170:0/3387074853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558822ca4ca0 con 0x558822ca4340 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7fa020d1e640 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822ca4340 0x558822ca4760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa01008c5a0 tx=0x7fa01005b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7f9ee57e2640 1 -- 172.21.15.170:0/3387074853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa010092020 con 0x558822ca4340 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7f9ee57e2640 1 -- 172.21.15.170:0/3387074853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01005be20 con 0x558822ca4340 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558822ca5710 con 0x558822ca4340 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.460+0000 7f9ee57e2640 1 -- 172.21.15.170:0/3387074853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa010066840 con 0x558822ca4340 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.461+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558822ca5c10 con 0x558822ca4340 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.461+0000 7f9ee57e2640 1 -- 172.21.15.170:0/3387074853 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa010095020 con 0x558822ca4340 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.461+0000 7f9ee57e2640 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e5c036900 0x7f9e5c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.461+0000 7f9ee57e2640 1 -- 172.21.15.170:0/3387074853 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa010080070 con 0x558822ca4340 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.461+0000 7fa01851d640 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e5c036900 0x7f9e5c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.462+0000 7f9e66ffd640 20 reqs_thread_entry: start 2024-04-26T12:30:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.462+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558822cb1e00 0x558822cb4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.462+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558822cb4920 con 0x558822cb1e00 2024-04-26T12:30:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.462+0000 7fa01851d640 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e5c036900 0x7f9e5c038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x558822c7e6d0 tx=0x7fa008006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.462+0000 7fa02151f640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558822cb1e00 0x558822cb4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.462+0000 7fa02151f640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558822cb1e00 0x558822cb4250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.462+0000 7fa02151f640 1 -- 172.21.15.170:0/19104032 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa01c010d70 con 0x558822cb1e00 2024-04-26T12:30:30.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.463+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558822cb66f0 0x558822cb8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.463+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:2 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558822cb91d0 con 0x558822cb66f0 2024-04-26T12:30:30.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.463+0000 7fa020d1e640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558822cb66f0 0x558822cb8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.463+0000 7fa020d1e640 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558822cb66f0 0x558822cb8ae0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.463+0000 7fa020d1e640 1 -- 172.21.15.170:0/19104032 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(2 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa010064070 con 0x558822cb66f0 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.463+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558822cb5be0 con 0x558822cb66f0 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.465+0000 7fa020d1e640 1 -- 172.21.15.170:0/19104032 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [stat,call,call,writefull 0~993] v30'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fa010064070 con 0x558822cb66f0 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.465+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ef8036950 msgr2=0x7f9ef8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.465+0000 7fa02321f800 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ef8036950 0x7f9ef8038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa008000f60 tx=0x7fa008001370 comp rx=0 tx=0).stop 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.465+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 msgr2=0x558822c89c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.465+0000 7fa02321f800 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c89c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00a930 tx=0x7fa01c003370 comp rx=0 tx=0).stop 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 shutdown_connections 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ef8036950 0x7f9ef8038e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/2580276778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822c827b0 0x558822c89c50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 >> 172.21.15.170:0/2580276778 conn(0x558822b7d8e0 msgr2=0x558822c7c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 shutdown_connections 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/2580276778 wait complete. 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e5c036900 msgr2=0x7f9e5c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e5c036900 0x7f9e5c038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x558822c7e6d0 tx=0x7fa008006000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822ca4340 msgr2=0x558822ca4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822ca4340 0x558822ca4760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa01008c5a0 tx=0x7fa01005b940 comp rx=0 tx=0).stop 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 shutdown_connections 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e5c036900 0x7f9e5c038dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/3387074853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822ca4340 0x558822ca4760 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 >> 172.21.15.170:0/3387074853 conn(0x558822c98e10 msgr2=0x558822c99830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 shutdown_connections 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/3387074853 wait complete. 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558822cb66f0 msgr2=0x558822cb8ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558822cb66f0 0x558822cb8ae0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558822cb1e00 msgr2=0x558822cb4250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558822cb1e00 0x558822cb4250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9f08036900 msgr2=0x7f9f08038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9f08036900 0x7f9f08038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa010052a50 tx=0x7fa0100529e0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 msgr2=0x558822c75060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822c75060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa0100057e0 tx=0x7fa010002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 shutdown_connections 2024-04-26T12:30:30.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558822cb66f0 0x558822cb8ae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558822cb1e00 0x558822cb4250 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9f08036900 0x7f9f08038dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 --2- 172.21.15.170:0/19104032 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558822b7afb0 0x558822c75060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 >> 172.21.15.170:0/19104032 conn(0x558822b74a60 msgr2=0x558822b793b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 shutdown_connections 2024-04-26T12:30:30.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.466+0000 7fa02321f800 1 -- 172.21.15.170:0/19104032 wait complete. 2024-04-26T12:30:30.483 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T12:30:30.483 DEBUG:tasks.util.rgw: json result: {'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T12:30:30.485 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-26T12:30:30.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-26T12:30:30.485 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-26T12:30:30.526 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:30.526 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.526+0000 7f0ef683f800 1 Processor -- start 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.526+0000 7f0ef683f800 1 -- start start 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.526+0000 7f0ef683f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55cc78ae3950 0x55cc78ae5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.526+0000 7f0ef683f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cc7898c0c0 con 0x55cc78adf5b0 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.526+0000 7f0ef683f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55cc789704d0 con 0x55cc78ae3950 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.526+0000 7f0eebb3d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55cc78ae3950 0x55cc78ae5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.526+0000 7f0ef433e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55cc78adf5b0 0x55cc78adf9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:45972/0 (socket says 172.21.15.170:45972) 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.527+0000 7f0eebb3d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55cc78ae3950 0x55cc78ae5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40944/0 (socket says 172.21.15.170:40944) 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.527+0000 7f0ef433e640 1 -- 172.21.15.170:0/1230563978 learned_addr learned my addr 172.21.15.170:0/1230563978 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:30.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.527+0000 7f0eebb3d640 1 -- 172.21.15.170:0/1230563978 >> v1:172.21.15.132:6789/0 conn(0x55cc78adf5b0 legacy=0x55cc78adf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.527+0000 7f0ef3b3d640 1 -- 172.21.15.170:0/1230563978 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290299139 0 0) 0x55cc7898c0c0 con 0x55cc78adf5b0 2024-04-26T12:30:30.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.527+0000 7f0eebb3d640 1 -- 172.21.15.170:0/1230563978 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7899dd40 con 0x55cc78ae3950 2024-04-26T12:30:30.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/1230563978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78ae3950 0x55cc78ae5d40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00a470 tx=0x7f0edc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed16568f76c4394f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef3b3d640 1 -- 172.21.15.170:0/1230563978 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0edc057070 con 0x55cc78ae3950 2024-04-26T12:30:30.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef3b3d640 1 -- 172.21.15.170:0/1230563978 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0edc052570 con 0x55cc78ae3950 2024-04-26T12:30:30.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef3b3d640 1 -- 172.21.15.170:0/1230563978 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0edc052870 con 0x55cc78ae3950 2024-04-26T12:30:30.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef683f800 1 -- 172.21.15.170:0/1230563978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78ae3950 msgr2=0x55cc78ae5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef683f800 1 --2- 172.21.15.170:0/1230563978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78ae3950 0x55cc78ae5d40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00a470 tx=0x7f0edc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:30.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef683f800 1 -- 172.21.15.170:0/1230563978 shutdown_connections 2024-04-26T12:30:30.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef683f800 1 --2- 172.21.15.170:0/1230563978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78ae3950 0x55cc78ae5d40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef683f800 1 -- 172.21.15.170:0/1230563978 >> 172.21.15.170:0/1230563978 conn(0x55cc78adab70 msgr2=0x55cc78adcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef683f800 1 -- 172.21.15.170:0/1230563978 shutdown_connections 2024-04-26T12:30:30.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.529+0000 7f0ef683f800 1 -- 172.21.15.170:0/1230563978 wait complete. 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.541+0000 7f0ef683f800 1 Processor -- start 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.541+0000 7f0ef683f800 1 -- start start 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.541+0000 7f0ef683f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78a54ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.541+0000 7f0ef683f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cc78a2ab30 con 0x55cc78adf5b0 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.541+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78a54ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.541+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78a54ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40958/0 (socket says 172.21.15.170:40958) 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.541+0000 7f0ef433e640 1 -- 172.21.15.170:0/644814546 learned_addr learned my addr 172.21.15.170:0/644814546 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.542+0000 7f0ef433e640 1 -- 172.21.15.170:0/644814546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7899c590 con 0x55cc78adf5b0 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.542+0000 7f0ef433e640 1 --2- 172.21.15.170:0/644814546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78a54ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400b240 tx=0x7f0ee400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d75caf72afa0b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.542+0000 7f0de260c640 1 -- 172.21.15.170:0/644814546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4008070 con 0x55cc78adf5b0 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.542+0000 7f0de260c640 1 -- 172.21.15.170:0/644814546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee400d500 con 0x55cc78adf5b0 2024-04-26T12:30:30.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.542+0000 7f0de260c640 1 -- 172.21.15.170:0/644814546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee400d860 con 0x55cc78adf5b0 2024-04-26T12:30:30.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 -- 172.21.15.170:0/644814546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 msgr2=0x55cc78a54ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 --2- 172.21.15.170:0/644814546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78a54ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400b240 tx=0x7f0ee400b700 comp rx=0 tx=0).stop 2024-04-26T12:30:30.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 -- 172.21.15.170:0/644814546 shutdown_connections 2024-04-26T12:30:30.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 --2- 172.21.15.170:0/644814546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78a54ff0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 -- 172.21.15.170:0/644814546 >> 172.21.15.170:0/644814546 conn(0x55cc78adab70 msgr2=0x55cc78bcbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 -- 172.21.15.170:0/644814546 shutdown_connections 2024-04-26T12:30:30.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 -- 172.21.15.170:0/644814546 wait complete. 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 Processor -- start 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 -- start start 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78bda100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef683f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cc78ae6610 con 0x55cc78adf5b0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78bda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78bda100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40970/0 (socket says 172.21.15.170:40970) 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.543+0000 7f0ef433e640 1 -- 172.21.15.170:0/2690243272 learned_addr learned my addr 172.21.15.170:0/2690243272 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.544+0000 7f0ef433e640 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc789938f0 con 0x55cc78adf5b0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.544+0000 7f0ef433e640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78bda100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55cc78a54620 tx=0x7f0ee4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.544+0000 7f0de0e09640 1 -- 172.21.15.170:0/2690243272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4019870 con 0x55cc78adf5b0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.544+0000 7f0de0e09640 1 -- 172.21.15.170:0/2690243272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee4019a10 con 0x55cc78adf5b0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.544+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc78bda640 con 0x55cc78adf5b0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.544+0000 7f0de0e09640 1 -- 172.21.15.170:0/2690243272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4019d30 con 0x55cc78adf5b0 2024-04-26T12:30:30.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.544+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc78bdab60 con 0x55cc78adf5b0 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0de0e09640 1 -- 172.21.15.170:0/2690243272 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ee4017040 con 0x55cc78adf5b0 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0de0e09640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0ddc036950 0x7f0ddc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0de0e09640 1 -- 172.21.15.170:0/2690243272 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0ee4015020 con 0x55cc78adf5b0 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0ddc036950 0x7f0ddc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78ae3950 0x55cc78be1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78be16a0 con 0x55cc78ae3950 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0ef4b3f640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78ae3950 0x55cc78be1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0ddc036950 0x7f0ddc038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0edc054000 tx=0x7f0edc04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.545+0000 7f0ef4b3f640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78ae3950 0x55cc78be1120 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.546+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/2690243272 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78ae3950 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.546+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78bde6f0 con 0x55cc78ae3950 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.546+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/2690243272 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78ae3950 2024-04-26T12:30:30.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.546+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78be39d0 0x55cc78be5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.546+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78be6460 con 0x55cc78be39d0 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.546+0000 7f0ef433e640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78be39d0 0x55cc78be5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.546+0000 7f0ef433e640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78be39d0 0x55cc78be5dc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.547+0000 7f0ef433e640 1 -- 172.21.15.170:0/2690243272 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ee402d070 con 0x55cc78be39d0 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.547+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78be2980 con 0x55cc78ae3950 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.547+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/2690243272 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78ae3950 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.547+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cc78be7910 0x55cc78be9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.547+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78bea4c0 con 0x55cc78be7910 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.547+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cc78be7910 0x55cc78be9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.547+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cc78be7910 0x55cc78be9d60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0eebb3d640 1 -- 172.21.15.170:0/2690243272 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0edc0528e0 con 0x55cc78be7910 2024-04-26T12:30:30.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0ef683f800 1 Processor -- start 2024-04-26T12:30:30.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0ef683f800 1 -- start start 2024-04-26T12:30:30.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0ef683f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78bf8900 0x55cc78bf8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0ef683f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cc789d0e60 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78bf8900 0x55cc78bf8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78bf8900 0x55cc78bf8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40980/0 (socket says 172.21.15.170:40980) 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.548+0000 7f0ef433e640 1 -- 172.21.15.170:0/2170938181 learned_addr learned my addr 172.21.15.170:0/2170938181 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.549+0000 7f0ef433e640 1 -- 172.21.15.170:0/2170938181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc78bf9260 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.549+0000 7f0ef433e640 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78bf8900 0x55cc78bf8d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ee404b480 tx=0x7f0ee400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.549+0000 7f0dd9ffb640 1 -- 172.21.15.170:0/2170938181 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4044a50 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.549+0000 7f0dd9ffb640 1 -- 172.21.15.170:0/2170938181 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee4044bf0 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.549+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc78bf9cd0 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.549+0000 7f0dd9ffb640 1 -- 172.21.15.170:0/2170938181 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4044ed0 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.549+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc78bfa1d0 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0dd9ffb640 1 -- 172.21.15.170:0/2170938181 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ee403f1b0 con 0x55cc78bf8900 2024-04-26T12:30:30.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0dd9ffb640 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dcc036900 0x7f0dcc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0dd9ffb640 1 -- 172.21.15.170:0/2170938181 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0ee403cc50 con 0x55cc78bf8900 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dcc036900 0x7f0dcc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0ef683f800 1 Processor -- start 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0ef683f800 1 -- start start 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dcc036900 0x7f0dcc038dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55cc78bde610 tx=0x7f0edc005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0ef683f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c06030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.550+0000 7f0ef683f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cc78a53670 con 0x55cc78c05c10 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c06030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c06030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40988/0 (socket says 172.21.15.170:40988) 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0ef433e640 1 -- 172.21.15.170:0/3120698325 learned_addr learned my addr 172.21.15.170:0/3120698325 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0ef433e640 1 -- 172.21.15.170:0/3120698325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc78c06600 con 0x55cc78c05c10 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0ef433e640 1 --2- 172.21.15.170:0/3120698325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c06030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4033fb0 tx=0x7f0ee4026710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b551f3ff5992630 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0dd37fe640 1 -- 172.21.15.170:0/3120698325 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4044830 con 0x55cc78c05c10 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0dd37fe640 1 -- 172.21.15.170:0/3120698325 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee4027da0 con 0x55cc78c05c10 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.551+0000 7f0dd37fe640 1 -- 172.21.15.170:0/3120698325 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee40408d0 con 0x55cc78c05c10 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 -- 172.21.15.170:0/3120698325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 msgr2=0x55cc78c06030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3120698325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c06030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4033fb0 tx=0x7f0ee4026710 comp rx=0 tx=0).stop 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 -- 172.21.15.170:0/3120698325 shutdown_connections 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3120698325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c06030 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 -- 172.21.15.170:0/3120698325 >> 172.21.15.170:0/3120698325 conn(0x55cc78c01ee0 msgr2=0x55cc78bfff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 -- 172.21.15.170:0/3120698325 shutdown_connections 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 -- 172.21.15.170:0/3120698325 wait complete. 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 Processor -- start 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 -- start start 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c0ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef683f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cc78c06b50 con 0x55cc78c05c10 2024-04-26T12:30:30.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c0ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef433e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c0ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:40998/0 (socket says 172.21.15.170:40998) 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.552+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 learned_addr learned my addr 172.21.15.170:0/3321285790 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.553+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc78c0d380 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.553+0000 7f0ef433e640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c0ce40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4033fb0 tx=0x7f0ee404c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.553+0000 7f0dd1ffb640 1 -- 172.21.15.170:0/3321285790 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee4044830 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.553+0000 7f0dd1ffb640 1 -- 172.21.15.170:0/3321285790 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee406b030 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.553+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc78c0d380 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.553+0000 7f0dd1ffb640 1 -- 172.21.15.170:0/3321285790 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ee404c030 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.553+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc78c0d380 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0dd1ffb640 1 -- 172.21.15.170:0/3321285790 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ee401ca40 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0dd1ffb640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dc4036900 0x7f0dc4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0dd1ffb640 1 -- 172.21.15.170:0/3321285790 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0ee4071c80 con 0x55cc78c05c10 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dc4036900 0x7f0dc4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78c183f0 0x55cc78c1a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1b000 con 0x55cc78c183f0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0ef4b3f640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78c183f0 0x55cc78c1a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dc4036900 0x7f0dc4038dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0edc052fd0 tx=0x7f0edc04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.554+0000 7f0ef4b3f640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78c183f0 0x55cc78c1a8b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 realm 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1b410 con 0x55cc78c183f0 2024-04-26T12:30:30.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1bce0 con 0x55cc78c183f0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c183f0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78c1cb70 0x55cc78c1ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1f6c0 con 0x55cc78c1cb70 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.555+0000 7f0ef433e640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78c1cb70 0x55cc78c1ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0ef433e640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78c1cb70 0x55cc78c1ef60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0ef683f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0ef683f800 20 searching for the correct realm 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cc78c21770 0x55cc78c23c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c24300 con 0x55cc78c21770 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cc78c21770 0x55cc78c23c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.556+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cc78c21770 0x55cc78c23c30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.557+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.557+0000 7f0eebb3d640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0edc076040 0x7f0edc05e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.557+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c24300 con 0x7f0edc076040 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.557+0000 7f0ef4b3f640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0edc076040 0x7f0edc05e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.557+0000 7f0ef4b3f640 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0edc076040 0x7f0edc05e480 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.557+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.557+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c1cb70 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c183f0 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c183f0 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c1cb70 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.558+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c1cb70 2024-04-26T12:30:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x7f0edc076040 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c21770 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c183f0 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.559+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c1cb70 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c183f0 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x7f0edc076040 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c1c080 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.560+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c1cb70 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.561+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c183f0 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c183f0 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c1cb70 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c21770 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.562+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x7f0edc076040 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.563+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.563+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c183f0 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.563+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.563+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c1cb70 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.563+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.563+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c21770 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c1cb70 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x7f0edc076040 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c21770 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.564+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c1cb70 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x55cc78c183f0 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f0edc090040 con 0x7f0edc076040 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:30.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c20070 con 0x55cc78c183f0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.565+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c20070 con 0x55cc78c183f0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c20040 con 0x7f0edc076040 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 zone default found 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 4 Realm: () 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 zonegroup default 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c20460 con 0x55cc78c1cb70 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c20070 con 0x55cc78c21770 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.566+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c26160 con 0x55cc78c21770 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.567+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.567+0000 7f0ef683f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.567+0000 7f0ef683f800 20 started sync module instance, tier type = 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.567+0000 7f0ef683f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.567+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c25600 con 0x7f0edc076040 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.568+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.568+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94336687692576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c25600 con 0x7f0edc076040 2024-04-26T12:30:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.568+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c26b80 con 0x55cc78c183f0 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.569+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.569+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94336687692576] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.569+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94336687695472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c26b80 con 0x55cc78c183f0 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.569+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c25170 con 0x55cc78c21770 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.570+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94336687695472] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.570+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.570+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94336687697776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c27b20 con 0x55cc78c21770 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.570+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c283b0 con 0x7f0edc076040 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.571+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.571+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94336687701696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c28c50 con 0x7f0edc076040 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.571+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c29710 con 0x55cc78c183f0 2024-04-26T12:30:30.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.571+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94336687697776] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.572+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.572+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94336687706592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c296d0 con 0x55cc78c183f0 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.572+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2a120 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.572+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94336687701696] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.573+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.573+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94336687709296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2a4c0 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.573+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2aec0 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.573+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94336687706592] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.574+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94336687709296] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.574+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.574+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94336687699568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2b260 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.574+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2bab0 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94336687699568] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94336687715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2bed0 con 0x55cc78c1cb70 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 20 add_watcher() i=0 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 20 add_watcher() i=1 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 20 add_watcher() i=2 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 20 add_watcher() i=3 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 20 add_watcher() i=4 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 20 add_watcher() i=5 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.575+0000 7f0ef683f800 20 add_watcher() i=6 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.576+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94336687715840] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.576+0000 7f0ef683f800 20 add_watcher() i=7 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.576+0000 7f0ef683f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.576+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2f1f0 con 0x55cc78c183f0 2024-04-26T12:30:30.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.576+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.576+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94336687717264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c2c460 con 0x55cc78c183f0 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.577+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94336687717264] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.577+0000 7f0daa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.577+0000 7f0ef683f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.577+0000 7f0ef683f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef683f800 5 note: GC not initialized 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0da97e2640 20 reqs_thread_entry: start 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef683f800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef683f800 20 Filter name: none 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0d1affd640 20 reqs_thread_entry: start 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c62d80 con 0x55cc78c183f0 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c62d80 con 0x7f0edc076040 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.578+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c62d40 con 0x55cc78c183f0 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c62d40 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63290 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63250 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63250 con 0x55cc78c183f0 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.579+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63250 con 0x55cc78c183f0 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63200 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63200 con 0x55cc78c21770 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63200 con 0x55cc78c1cb70 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.580+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63200 con 0x55cc78c183f0 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63200 con 0x7f0edc076040 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63180 con 0x55cc78c21770 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63160 con 0x55cc78c1cb70 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.581+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63160 con 0x55cc78c1cb70 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63160 con 0x55cc78c21770 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c1cb70 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c21770 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.582+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.583+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c1cb70 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.583+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.583+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x7f0edc076040 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.583+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.583+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c1cb70 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c21770 2024-04-26T12:30:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.584+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c21770 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c21770 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c21770 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.585+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c1cb70 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.586+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.586+0000 7f0daa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.586+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94336687717264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.587+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94336687717264] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.587+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94336687692576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x7f0edc076040 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.588+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94336687692576] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.588+0000 7f0ef683f800 20 remove_watcher() i=0 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.588+0000 7f0ef683f800 2 removed watcher, disabling cache 2024-04-26T12:30:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.588+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94336687695472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.589+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94336687695472] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.589+0000 7f0ef683f800 20 remove_watcher() i=1 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.589+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94336687697776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c21770 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.590+0000 7f0eebb3d640 1 -- 172.21.15.170:0/3321285790 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94336687697776] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc081070 con 0x55cc78c21770 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.590+0000 7f0ef683f800 20 remove_watcher() i=2 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.590+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94336687701696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x7f0edc076040 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.591+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94336687701696] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x7f0edc076040 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.591+0000 7f0ef683f800 20 remove_watcher() i=3 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.591+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94336687706592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c183f0 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.592+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94336687706592] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eec00a4a0 con 0x55cc78c183f0 2024-04-26T12:30:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.592+0000 7f0ef683f800 20 remove_watcher() i=4 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.592+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94336687709296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c1cb70 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.593+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94336687709296] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.593+0000 7f0ef683f800 20 remove_watcher() i=5 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.593+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94336687699568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c1cb70 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.594+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94336687699568] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.594+0000 7f0ef683f800 20 remove_watcher() i=6 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.594+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94336687715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cc78c63140 con 0x55cc78c1cb70 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef433e640 1 -- 172.21.15.170:0/3321285790 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94336687715840] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ee4077070 con 0x55cc78c1cb70 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 20 remove_watcher() i=7 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78c1cb70 msgr2=0x55cc78c1ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78c1cb70 0x55cc78c1ef60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78c183f0 msgr2=0x55cc78c1a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78c183f0 0x55cc78c1a8b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0edc076040 msgr2=0x7f0edc05e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0edc076040 0x7f0edc05e480 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cc78c21770 msgr2=0x55cc78c23c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cc78c21770 0x55cc78c23c30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dc4036900 msgr2=0x7f0dc4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dc4036900 0x7f0dc4038dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0edc052fd0 tx=0x7f0edc04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 msgr2=0x55cc78c0ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 --2- 172.21.15.170:0/3321285790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78c05c10 0x55cc78c0ce40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4033fb0 tx=0x7f0ee404c4b0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 reap_dead start 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/3321285790 reap_dead start 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 shutdown_connections 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 >> 172.21.15.170:0/3321285790 conn(0x55cc78c01ee0 msgr2=0x55cc78bff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 shutdown_connections 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.595+0000 7f0ef683f800 1 -- 172.21.15.170:0/3321285790 wait complete. 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dcc036900 msgr2=0x7f0dcc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dcc036900 0x7f0dcc038dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55cc78bde610 tx=0x7f0edc005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78bf8900 msgr2=0x55cc78bf8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78bf8900 0x55cc78bf8d20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ee404b480 tx=0x7f0ee400ed40 comp rx=0 tx=0).stop 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 shutdown_connections 2024-04-26T12:30:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0dcc036900 0x7f0dcc038dc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2170938181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78bf8900 0x55cc78bf8d20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 >> 172.21.15.170:0/2170938181 conn(0x55cc78bec9a0 msgr2=0x55cc78becda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 shutdown_connections 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2170938181 wait complete. 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78be39d0 msgr2=0x55cc78be5dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cc78be39d0 0x55cc78be5dc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78ae3950 msgr2=0x55cc78be1120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cc78ae3950 0x55cc78be1120 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cc78be7910 msgr2=0x55cc78be9d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cc78be7910 0x55cc78be9d60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0ddc036950 msgr2=0x7f0ddc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0ddc036950 0x7f0ddc038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0edc054000 tx=0x7f0edc04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 msgr2=0x55cc78bda100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 --2- 172.21.15.170:0/2690243272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cc78adf5b0 0x55cc78bda100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55cc78a54620 tx=0x7f0ee4000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef4b3f640 1 -- 172.21.15.170:0/2690243272 reap_dead start 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 shutdown_connections 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 >> 172.21.15.170:0/2690243272 conn(0x55cc78adab70 msgr2=0x55cc78bcb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 shutdown_connections 2024-04-26T12:30:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.596+0000 7f0ef683f800 1 -- 172.21.15.170:0/2690243272 wait complete. 2024-04-26T12:30:30.618 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[],"summary":[]} 2024-04-26T12:30:30.618 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-26T12:30:30.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:30.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:30.619 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:30.700 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:30.700 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:30.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb045608800 1 Processor -- start 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb045608800 1 -- start start 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb045608800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559b01ac9020 0x559b01acb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb045608800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b019750c0 con 0x559b01acb950 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb045608800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x559b019594d0 con 0x559b01ac9020 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb043107640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559b01ac9020 0x559b01acb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb03bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559b01acb950 0x559b01acdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:45986/0 (socket says 172.21.15.170:45986) 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb043107640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559b01ac9020 0x559b01acb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41014/0 (socket says 172.21.15.170:41014) 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.700+0000 7fb03bfff640 1 -- 172.21.15.170:0/111705651 learned_addr learned my addr 172.21.15.170:0/111705651 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.701+0000 7fb043107640 1 -- 172.21.15.170:0/111705651 >> v1:172.21.15.132:6789/0 conn(0x559b01acb950 legacy=0x559b01acdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.701+0000 7fb043107640 1 -- 172.21.15.170:0/111705651 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b01986d40 con 0x559b01ac9020 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.702+0000 7fb043107640 1 --2- 172.21.15.170:0/111705651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01acb410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb03400a470 tx=0x7fb03401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b29e64e2afcf14 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb042906640 1 -- 172.21.15.170:0/111705651 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034057070 con 0x559b01ac9020 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb042906640 1 -- 172.21.15.170:0/111705651 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034052570 con 0x559b01ac9020 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb042906640 1 -- 172.21.15.170:0/111705651 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034052870 con 0x559b01ac9020 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb045608800 1 -- 172.21.15.170:0/111705651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 msgr2=0x559b01acb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb045608800 1 --2- 172.21.15.170:0/111705651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01acb410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb03400a470 tx=0x7fb03401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb045608800 1 -- 172.21.15.170:0/111705651 shutdown_connections 2024-04-26T12:30:30.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb045608800 1 --2- 172.21.15.170:0/111705651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01acb410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb045608800 1 -- 172.21.15.170:0/111705651 >> 172.21.15.170:0/111705651 conn(0x559b01ac2990 msgr2=0x559b01ac4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb045608800 1 -- 172.21.15.170:0/111705651 shutdown_connections 2024-04-26T12:30:30.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.703+0000 7fb045608800 1 -- 172.21.15.170:0/111705651 wait complete. 2024-04-26T12:30:30.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb045608800 1 Processor -- start 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb045608800 1 -- start start 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb045608800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01ac8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb045608800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559b01a13b40 con 0x559b01ac9020 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01ac8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01ac8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41018/0 (socket says 172.21.15.170:41018) 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb043107640 1 -- 172.21.15.170:0/2492420705 learned_addr learned my addr 172.21.15.170:0/2492420705 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.715+0000 7fb043107640 1 -- 172.21.15.170:0/2492420705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b01985590 con 0x559b01ac9020 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7fb043107640 1 --2- 172.21.15.170:0/2492420705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01ac8960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb034055040 tx=0x7fb03404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a345cd4beac13d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7faf3160a640 1 -- 172.21.15.170:0/2492420705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034057070 con 0x559b01ac9020 2024-04-26T12:30:30.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7faf3160a640 1 -- 172.21.15.170:0/2492420705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034063070 con 0x559b01ac9020 2024-04-26T12:30:30.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7faf3160a640 1 -- 172.21.15.170:0/2492420705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034052720 con 0x559b01ac9020 2024-04-26T12:30:30.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7fb045608800 1 -- 172.21.15.170:0/2492420705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 msgr2=0x559b01ac8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7fb045608800 1 --2- 172.21.15.170:0/2492420705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01ac8960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb034055040 tx=0x7fb03404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7fb045608800 1 -- 172.21.15.170:0/2492420705 shutdown_connections 2024-04-26T12:30:30.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7fb045608800 1 --2- 172.21.15.170:0/2492420705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01ac8960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7fb045608800 1 -- 172.21.15.170:0/2492420705 >> 172.21.15.170:0/2492420705 conn(0x559b01ac2990 msgr2=0x559b01bb4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.716+0000 7fb045608800 1 -- 172.21.15.170:0/2492420705 shutdown_connections 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb045608800 1 -- 172.21.15.170:0/2492420705 wait complete. 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb045608800 1 Processor -- start 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb045608800 1 -- start start 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb045608800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01bc31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb045608800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559b01ad1770 con 0x559b01ac9020 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01bc31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01bc31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41030/0 (socket says 172.21.15.170:41030) 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb043107640 1 -- 172.21.15.170:0/2820644463 learned_addr learned my addr 172.21.15.170:0/2820644463 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.717+0000 7fb043107640 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0197c8f0 con 0x559b01ac9020 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.718+0000 7fb043107640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01bc31b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb034055040 tx=0x7fb034002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.718+0000 7faf2fe07640 1 -- 172.21.15.170:0/2820644463 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034052d30 con 0x559b01ac9020 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.718+0000 7faf2fe07640 1 -- 172.21.15.170:0/2820644463 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03406c070 con 0x559b01ac9020 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.718+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b01bc36f0 con 0x559b01ac9020 2024-04-26T12:30:30.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.718+0000 7faf2fe07640 1 -- 172.21.15.170:0/2820644463 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03405e480 con 0x559b01ac9020 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.718+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b01bc3c10 con 0x559b01ac9020 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.718+0000 7faf2fe07640 1 -- 172.21.15.170:0/2820644463 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb034077060 con 0x559b01ac9020 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7faf2fe07640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf28036950 0x7faf28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7faf2fe07640 1 -- 172.21.15.170:0/2820644463 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb03408e470 con 0x559b01ac9020 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7fb03bfff640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf28036950 0x7faf28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01acb950 0x559b01bca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01bca7f0 con 0x559b01acb950 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7fb043908640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01acb950 0x559b01bca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7fb03bfff640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf28036950 0x7faf28038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000f60 tx=0x7fb02c0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7fb043908640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01acb950 0x559b01bca220 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.719+0000 7fb043908640 1 -- 172.21.15.170:0/2820644463 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01acb950 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.720+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01bc77f0 con 0x559b01acb950 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.720+0000 7fb043908640 1 -- 172.21.15.170:0/2820644463 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01acb950 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.720+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01bccb20 0x559b01bcef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.720+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01bcf5b0 con 0x559b01bccb20 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.720+0000 7fb043107640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01bccb20 0x559b01bcef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.720+0000 7fb043107640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01bccb20 0x559b01bcef10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.721+0000 7fb043107640 1 -- 172.21.15.170:0/2820644463 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb034009d30 con 0x559b01bccb20 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.721+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01bcbad0 con 0x559b01acb950 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.721+0000 7fb043908640 1 -- 172.21.15.170:0/2820644463 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01acb950 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.721+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559b01bd0a60 0x559b01bd2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.721+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01bd3610 con 0x559b01bd0a60 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.721+0000 7fb03bfff640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559b01bd0a60 0x559b01bd2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.721+0000 7fb03bfff640 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559b01bd0a60 0x559b01bd2eb0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb03bfff640 1 -- 172.21.15.170:0/2820644463 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb02c009050 con 0x559b01bd0a60 2024-04-26T12:30:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb045608800 1 Processor -- start 2024-04-26T12:30:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb045608800 1 -- start start 2024-04-26T12:30:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb045608800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01be1a70 0x559b01be1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb045608800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559b019b9e60 con 0x559b01be1a70 2024-04-26T12:30:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01be1a70 0x559b01be1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01be1a70 0x559b01be1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41046/0 (socket says 172.21.15.170:41046) 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.722+0000 7fb043107640 1 -- 172.21.15.170:0/2663588814 learned_addr learned my addr 172.21.15.170:0/2663588814 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.723+0000 7fb043107640 1 -- 172.21.15.170:0/2663588814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b01be23d0 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.723+0000 7fb043107640 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01be1a70 0x559b01be1e90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb03408c860 tx=0x7fb03408e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.723+0000 7faf2d602640 1 -- 172.21.15.170:0/2663588814 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034089070 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.723+0000 7faf2d602640 1 -- 172.21.15.170:0/2663588814 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034058040 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.723+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b01be2e40 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.723+0000 7faf2d602640 1 -- 172.21.15.170:0/2663588814 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03408b410 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.723+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b01be2e40 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7faf2d602640 1 -- 172.21.15.170:0/2663588814 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb03406e030 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7faf2d602640 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf1c036950 0x7faf1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7faf2d602640 1 -- 172.21.15.170:0/2663588814 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb034072070 con 0x559b01be1a70 2024-04-26T12:30:30.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7fb03bfff640 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf1c036950 0x7faf1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7fb045608800 1 Processor -- start 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7fb045608800 1 -- start start 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7fb03bfff640 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf1c036950 0x7faf1c038e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00bf50 tx=0x7fb02c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7fb045608800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01beeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.724+0000 7fb045608800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559b01ac6f20 con 0x559b01bee980 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01beeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01beeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41062/0 (socket says 172.21.15.170:41062) 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7fb043107640 1 -- 172.21.15.170:0/1424805145 learned_addr learned my addr 172.21.15.170:0/1424805145 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7fb043107640 1 -- 172.21.15.170:0/1424805145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b01bef370 con 0x559b01bee980 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7fb043107640 1 --2- 172.21.15.170:0/1424805145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01beeda0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb034050e50 tx=0x7fb034069d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec43bb28f47a505 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7faf26ffd640 1 -- 172.21.15.170:0/1424805145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034068ae0 con 0x559b01bee980 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7faf26ffd640 1 -- 172.21.15.170:0/1424805145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0340a0070 con 0x559b01bee980 2024-04-26T12:30:30.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.725+0000 7faf26ffd640 1 -- 172.21.15.170:0/1424805145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03406fb90 con 0x559b01bee980 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 -- 172.21.15.170:0/1424805145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 msgr2=0x559b01beeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 --2- 172.21.15.170:0/1424805145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01beeda0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb034050e50 tx=0x7fb034069d10 comp rx=0 tx=0).stop 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 -- 172.21.15.170:0/1424805145 shutdown_connections 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 --2- 172.21.15.170:0/1424805145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01beeda0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 -- 172.21.15.170:0/1424805145 >> 172.21.15.170:0/1424805145 conn(0x559b01beace0 msgr2=0x559b01be8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 -- 172.21.15.170:0/1424805145 shutdown_connections 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 -- 172.21.15.170:0/1424805145 wait complete. 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 Processor -- start 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 -- start start 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01bf5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb045608800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559b01befa20 con 0x559b01bee980 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01bf5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb043107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01bf5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41078/0 (socket says 172.21.15.170:41078) 2024-04-26T12:30:30.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.726+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 learned_addr learned my addr 172.21.15.170:0/304202645 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.727+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b01bf62c0 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.727+0000 7fb043107640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01bf5d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb03407b360 tx=0x7fb034094f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.727+0000 7faf257fa640 1 -- 172.21.15.170:0/304202645 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0340b4070 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.727+0000 7faf257fa640 1 -- 172.21.15.170:0/304202645 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034067900 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.727+0000 7faf257fa640 1 -- 172.21.15.170:0/304202645 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034067c00 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.727+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b01bf62c0 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.727+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b01bf62c0 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7faf257fa640 1 -- 172.21.15.170:0/304202645 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb0340b7070 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7faf257fa640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf0c036950 0x7faf0c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7faf257fa640 1 -- 172.21.15.170:0/304202645 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb0340ab030 con 0x559b01bee980 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7fb03bfff640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf0c036950 0x7faf0c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01c01450 0x559b01c03910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c04060 con 0x559b01c01450 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7fb043908640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01c01450 0x559b01c03910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.728+0000 7fb03bfff640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf0c036950 0x7faf0c038e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb02c001b60 tx=0x7fb02c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb043908640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01c01450 0x559b01c03910 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 realm 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c04470 con 0x559b01c01450 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c04d40 con 0x559b01c01450 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01c05bd0 0x559b01c07fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.729+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c08720 con 0x559b01c05bd0 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb043107640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01c05bd0 0x559b01c07fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb043107640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01c05bd0 0x559b01c07fc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb045608800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb045608800 20 searching for the correct realm 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559b01c0a7d0 0x559b01c0cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0d360 con 0x559b01c0a7d0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.730+0000 7fb03bfff640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559b01c0a7d0 0x559b01c0cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.731+0000 7fb03bfff640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559b01c0a7d0 0x559b01c0cc90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.731+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.731+0000 7fb03bfff640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb02c038040 0x7fb02c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.731+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0d360 con 0x7fb02c038040 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.731+0000 7fb043908640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb02c038040 0x7fb02c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.731+0000 7fb043908640 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb02c038040 0x7fb02c01bab0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.732+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x7fb02c038040 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.733+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x7fb02c038040 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.734+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.735+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.736+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x7fb02c038040 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.737+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.738+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.738+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x7fb02c038040 2024-04-26T12:30:30.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.738+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.738+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c0a7d0 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.738+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.738+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c05bd0 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x559b01c01450 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b01c050e0 con 0x7fb02c038040 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:30.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c090d0 con 0x559b01c01450 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.739+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c090d0 con 0x559b01c01450 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c090a0 con 0x7fb02c038040 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:30.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 zone default found 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 4 Realm: () 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 zonegroup default 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c094c0 con 0x559b01c05bd0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.740+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c090d0 con 0x559b01c0a7d0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0f1c0 con 0x559b01c0a7d0 2024-04-26T12:30:30.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb045608800 20 started sync module instance, tier type = 2024-04-26T12:30:30.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb045608800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:30.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.741+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0e660 con 0x7fb02c038040 2024-04-26T12:30:30.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.742+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.742+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94124237710016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0ecf0 con 0x7fb02c038040 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.742+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0fb80 con 0x559b01c01450 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.743+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94124237710016] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.743+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.743+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94124237711168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0fb80 con 0x559b01c01450 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.743+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c105d0 con 0x559b01c0a7d0 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.744+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94124237711168] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.744+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.744+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94124237715152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0faf0 con 0x559b01c0a7d0 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.744+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c114c0 con 0x7fb02c038040 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.745+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94124237715152] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.745+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.745+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94124237721616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c118e0 con 0x7fb02c038040 2024-04-26T12:30:30.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.745+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c122a0 con 0x559b01c01450 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.746+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.746+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94124237725168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c12210 con 0x559b01c01450 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.746+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c13230 con 0x559b01c05bd0 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.746+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94124237721616] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.747+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94124237725168] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.747+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.747+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94124237727376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c12d30 con 0x559b01c05bd0 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.747+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c13b00 con 0x559b01c05bd0 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.748+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94124237727376] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.751+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.751+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94124237731408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c13f20 con 0x559b01c05bd0 2024-04-26T12:30:30.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.751+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c148e0 con 0x559b01c05bd0 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94124237731408] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94124237732944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c148e0 con 0x559b01c05bd0 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 20 add_watcher() i=0 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 20 add_watcher() i=1 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 20 add_watcher() i=2 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 20 add_watcher() i=3 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 20 add_watcher() i=4 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 20 add_watcher() i=5 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.752+0000 7fb045608800 20 add_watcher() i=6 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.753+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94124237732944] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.753+0000 7fb045608800 20 add_watcher() i=7 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.753+0000 7fb045608800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.753+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c17ce0 con 0x559b01c01450 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.753+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.753+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94124237735424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c151a0 con 0x559b01c01450 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.754+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94124237735424] v30'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.754+0000 7faef9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.754+0000 7fb045608800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.754+0000 7fb045608800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.754+0000 7fb045608800 5 note: GC not initialized 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.754+0000 7faef8fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.754+0000 7fb045608800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.755+0000 7fb045608800 20 Filter name: none 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.755+0000 7fae727fc640 20 reqs_thread_entry: start 2024-04-26T12:30:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.755+0000 7fb045608800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.755+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b01c4aee0 con 0x559b01c01450 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.755+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.755+0000 7fb045608800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:could not fetch user info: no user info saved 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.756+0000 7faef9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.756+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94124237735424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c4aea0 con 0x559b01c01450 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.757+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94124237735424] v30'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.757+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94124237710016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c4aea0 con 0x7fb02c038040 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.758+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94124237710016] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.758+0000 7fb045608800 20 remove_watcher() i=0 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.758+0000 7fb045608800 2 removed watcher, disabling cache 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.758+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94124237711168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c4aea0 con 0x559b01c01450 2024-04-26T12:30:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.759+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94124237711168] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.759+0000 7fb045608800 20 remove_watcher() i=1 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.759+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94124237715152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c4aea0 con 0x559b01c0a7d0 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.760+0000 7fb03bfff640 1 -- 172.21.15.170:0/304202645 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94124237715152] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb02c009050 con 0x559b01c0a7d0 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.760+0000 7fb045608800 20 remove_watcher() i=2 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.760+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94124237721616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0f6d0 con 0x7fb02c038040 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.761+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94124237721616] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x7fb02c038040 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.761+0000 7fb045608800 20 remove_watcher() i=3 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.761+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94124237725168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c11010 con 0x559b01c01450 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.761+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94124237725168] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c00a4a0 con 0x559b01c01450 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.762+0000 7fb045608800 20 remove_watcher() i=4 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.762+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94124237727376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c0f6d0 con 0x559b01c05bd0 2024-04-26T12:30:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.762+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94124237727376] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.762+0000 7fb045608800 20 remove_watcher() i=5 2024-04-26T12:30:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.762+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94124237731408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c11df0 con 0x559b01c05bd0 2024-04-26T12:30:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.763+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94124237731408] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.763+0000 7fb045608800 20 remove_watcher() i=6 2024-04-26T12:30:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.763+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94124237732944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b01c11010 con 0x559b01c05bd0 2024-04-26T12:30:30.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:30:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb043107640 1 -- 172.21.15.170:0/304202645 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94124237732944] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0340b6030 con 0x559b01c05bd0 2024-04-26T12:30:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 20 remove_watcher() i=7 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01c05bd0 msgr2=0x559b01c07fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01c05bd0 0x559b01c07fc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01c01450 msgr2=0x559b01c03910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01c01450 0x559b01c03910 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb02c038040 msgr2=0x7fb02c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb02c038040 0x7fb02c01bab0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559b01c0a7d0 msgr2=0x559b01c0cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559b01c0a7d0 0x559b01c0cc90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf0c036950 msgr2=0x7faf0c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf0c036950 0x7faf0c038e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb02c001b60 tx=0x7fb02c010000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 msgr2=0x559b01bf5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb043908640 1 -- 172.21.15.170:0/304202645 reap_dead start 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.764+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01bf5d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb03407b360 tx=0x7fb034094f20 comp rx=0 tx=0).stop 2024-04-26T12:30:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 shutdown_connections 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/304202645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01bee980 0x559b01bf5d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 >> 172.21.15.170:0/304202645 conn(0x559b01beace0 msgr2=0x559b01be8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 shutdown_connections 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/304202645 wait complete. 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf1c036950 msgr2=0x7faf1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf1c036950 0x7faf1c038e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00bf50 tx=0x7fb02c00f000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01be1a70 msgr2=0x559b01be1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01be1a70 0x559b01be1e90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb03408c860 tx=0x7fb03408e110 comp rx=0 tx=0).stop 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 shutdown_connections 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf1c036950 0x7faf1c038e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2663588814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01be1a70 0x559b01be1e90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 >> 172.21.15.170:0/2663588814 conn(0x559b01bd5b10 msgr2=0x559b01bd5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 shutdown_connections 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2663588814 wait complete. 2024-04-26T12:30:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01bccb20 msgr2=0x559b01bcef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559b01bccb20 0x559b01bcef10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01acb950 msgr2=0x559b01bca220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559b01acb950 0x559b01bca220 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559b01bd0a60 msgr2=0x559b01bd2eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559b01bd0a60 0x559b01bd2eb0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf28036950 msgr2=0x7faf28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7faf28036950 0x7faf28038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000f60 tx=0x7fb02c0012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 msgr2=0x559b01bc31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 --2- 172.21.15.170:0/2820644463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559b01ac9020 0x559b01bc31b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb034055040 tx=0x7fb034002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb043908640 1 -- 172.21.15.170:0/2820644463 reap_dead start 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 shutdown_connections 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.765+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 >> 172.21.15.170:0/2820644463 conn(0x559b01ac2990 msgr2=0x559b01ac7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.766+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 shutdown_connections 2024-04-26T12:30:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.766+0000 7fb045608800 1 -- 172.21.15.170:0/2820644463 wait complete. 2024-04-26T12:30:30.778 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-26T12:30:30.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-26T12:30:30.778 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-26T12:30:30.868 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:30.868 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.867+0000 7f6c58c10800 1 Processor -- start 2024-04-26T12:30:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.867+0000 7f6c58c10800 1 -- start start 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c58c10800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ba3f293aa0 0x55ba3f295e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c58c10800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba3f13c0c0 con 0x55ba3f28ff90 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c58c10800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55ba3f1204d0 con 0x55ba3f293aa0 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c4bbbf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ba3f293aa0 0x55ba3f295e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c543c0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55ba3f28ff90 0x55ba3f292380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:45992/0 (socket says 172.21.15.170:45992) 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c543c0640 1 -- 172.21.15.170:0/3558278381 learned_addr learned my addr 172.21.15.170:0/3558278381 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/3558278381 >> v2:172.21.15.132:3300/0 conn(0x55ba3f293aa0 0x55ba3f295e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41090/0 (socket says 172.21.15.170:41090) 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/3558278381 >> v1:172.21.15.132:6789/0 conn(0x55ba3f28ff90 legacy=0x55ba3f292380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.868+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/3558278381 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3f14dd40 con 0x55ba3f293aa0 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.870+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/3558278381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f293aa0 0x55ba3f295e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00a470 tx=0x7f6c3c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26420394d7287e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.870+0000 7f6c53bbf640 1 -- 172.21.15.170:0/3558278381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c057070 con 0x55ba3f293aa0 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.870+0000 7f6c53bbf640 1 -- 172.21.15.170:0/3558278381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c052570 con 0x55ba3f293aa0 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.870+0000 7f6c53bbf640 1 -- 172.21.15.170:0/3558278381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3c052870 con 0x55ba3f293aa0 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.871+0000 7f6c58c10800 1 -- 172.21.15.170:0/3558278381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f293aa0 msgr2=0x55ba3f295e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.871+0000 7f6c58c10800 1 --2- 172.21.15.170:0/3558278381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f293aa0 0x55ba3f295e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00a470 tx=0x7f6c3c01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.871+0000 7f6c58c10800 1 -- 172.21.15.170:0/3558278381 shutdown_connections 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.871+0000 7f6c58c10800 1 --2- 172.21.15.170:0/3558278381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f293aa0 0x55ba3f295e90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.871+0000 7f6c58c10800 1 -- 172.21.15.170:0/3558278381 >> 172.21.15.170:0/3558278381 conn(0x55ba3f289980 msgr2=0x55ba3f28bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.871+0000 7f6c58c10800 1 -- 172.21.15.170:0/3558278381 shutdown_connections 2024-04-26T12:30:30.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.871+0000 7f6c58c10800 1 -- 172.21.15.170:0/3558278381 wait complete. 2024-04-26T12:30:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.882+0000 7f6c58c10800 1 Processor -- start 2024-04-26T12:30:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.882+0000 7f6c58c10800 1 -- start start 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.882+0000 7f6c58c10800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f380790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.882+0000 7f6c58c10800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba3f1daae0 con 0x55ba3f28ff90 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f380790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f380790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41092/0 (socket says 172.21.15.170:41092) 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6c543c0640 1 -- 172.21.15.170:0/1052876070 learned_addr learned my addr 172.21.15.170:0/1052876070 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6c543c0640 1 -- 172.21.15.170:0/1052876070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3f14c590 con 0x55ba3f28ff90 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6c543c0640 1 --2- 172.21.15.170:0/1052876070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f380790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6c44001de0 tx=0x7f6c4400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb8990363aabd47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6b4260c640 1 -- 172.21.15.170:0/1052876070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c44012020 con 0x55ba3f28ff90 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6b4260c640 1 -- 172.21.15.170:0/1052876070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4400e5a0 con 0x55ba3f28ff90 2024-04-26T12:30:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.883+0000 7f6b4260c640 1 -- 172.21.15.170:0/1052876070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4400e8c0 con 0x55ba3f28ff90 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 -- 172.21.15.170:0/1052876070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 msgr2=0x55ba3f380790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 --2- 172.21.15.170:0/1052876070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f380790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6c44001de0 tx=0x7f6c4400b6c0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 -- 172.21.15.170:0/1052876070 shutdown_connections 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 --2- 172.21.15.170:0/1052876070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f380790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 -- 172.21.15.170:0/1052876070 >> 172.21.15.170:0/1052876070 conn(0x55ba3f289980 msgr2=0x55ba3f37c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 -- 172.21.15.170:0/1052876070 shutdown_connections 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 -- 172.21.15.170:0/1052876070 wait complete. 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 Processor -- start 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.884+0000 7f6c58c10800 1 -- start start 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c58c10800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f388150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c58c10800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba3f2986e0 con 0x55ba3f28ff90 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f388150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f388150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41094/0 (socket says 172.21.15.170:41094) 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c543c0640 1 -- 172.21.15.170:0/483844423 learned_addr learned my addr 172.21.15.170:0/483844423 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c543c0640 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3f1438f0 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c543c0640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f388150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c010 tx=0x7f6c44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6b40e09640 1 -- 172.21.15.170:0/483844423 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c44012070 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6b40e09640 1 -- 172.21.15.170:0/483844423 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4401a7a0 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba3f388690 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6b40e09640 1 -- 172.21.15.170:0/483844423 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4401aa80 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.885+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba3f388bb0 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.886+0000 7f6b40e09640 1 -- 172.21.15.170:0/483844423 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6c44015020 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.886+0000 7f6b40e09640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b3c036900 0x7f6b3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.886+0000 7f6b40e09640 1 -- 172.21.15.170:0/483844423 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6c44020070 con 0x55ba3f28ff90 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.886+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b3c036900 0x7f6b3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.886+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f293aa0 0x55ba3f38f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.886+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f38f6b0 con 0x55ba3f293aa0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c54bc1640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f293aa0 0x55ba3f38f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b3c036900 0x7f6b3c038dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c054000 tx=0x7f6c3c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c54bc1640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f293aa0 0x55ba3f38f170 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c54bc1640 1 -- 172.21.15.170:0/483844423 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f293aa0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f38c740 con 0x55ba3f293aa0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c54bc1640 1 -- 172.21.15.170:0/483844423 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f293aa0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3919e0 0x55ba3f393dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.887+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3944c0 con 0x55ba3f3919e0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.888+0000 7f6c543c0640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3919e0 0x55ba3f393dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.888+0000 7f6c543c0640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3919e0 0x55ba3f393dd0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.888+0000 7f6c543c0640 1 -- 172.21.15.170:0/483844423 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3919e0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.888+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f390990 con 0x55ba3f293aa0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.888+0000 7f6c54bc1640 1 -- 172.21.15.170:0/483844423 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f293aa0 2024-04-26T12:30:30.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.888+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba3f395970 0x55ba3f397dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.888+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f398520 con 0x55ba3f395970 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.889+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba3f395970 0x55ba3f397dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.889+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba3f395970 0x55ba3f397dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.889+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/483844423 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c3c052a40 con 0x55ba3f395970 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.889+0000 7f6c58c10800 1 Processor -- start 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.889+0000 7f6c58c10800 1 -- start start 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c58c10800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28fb30 0x55ba3f28dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c58c10800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba3f180e60 con 0x55ba3f28fb30 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28fb30 0x55ba3f28dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28fb30 0x55ba3f28dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41102/0 (socket says 172.21.15.170:41102) 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c543c0640 1 -- 172.21.15.170:0/714547370 learned_addr learned my addr 172.21.15.170:0/714547370 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c543c0640 1 -- 172.21.15.170:0/714547370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3f28e4e0 con 0x55ba3f28fb30 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c543c0640 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28fb30 0x55ba3f28dfa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c4404acf0 tx=0x7f6c4402caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6b39ffb640 1 -- 172.21.15.170:0/714547370 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c44047260 con 0x55ba3f28fb30 2024-04-26T12:30:30.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6b39ffb640 1 -- 172.21.15.170:0/714547370 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c440490e0 con 0x55ba3f28fb30 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6b39ffb640 1 -- 172.21.15.170:0/714547370 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c440493e0 con 0x55ba3f28fb30 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba3f28e770 con 0x55ba3f28fb30 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.890+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba3f28ec70 con 0x55ba3f28fb30 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.891+0000 7f6b39ffb640 1 -- 172.21.15.170:0/714547370 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6c44044060 con 0x55ba3f28fb30 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.891+0000 7f6b39ffb640 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b2c036950 0x7f6b2c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.891+0000 7f6b39ffb640 1 -- 172.21.15.170:0/714547370 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6c44025420 con 0x55ba3f28fb30 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.891+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b2c036950 0x7f6b2c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c58c10800 1 Processor -- start 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c58c10800 1 -- start start 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b2c036950 0x7f6b2c038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55ba3f38ff90 tx=0x7f6c3c005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c58c10800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c58c10800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba3f380f10 con 0x55ba3f3b5d10 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41110/0 (socket says 172.21.15.170:41110) 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c543c0640 1 -- 172.21.15.170:0/2574471454 learned_addr learned my addr 172.21.15.170:0/2574471454 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c543c0640 1 -- 172.21.15.170:0/2574471454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3f3b6700 con 0x55ba3f3b5d10 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.892+0000 7f6c543c0640 1 --2- 172.21.15.170:0/2574471454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3b6130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6c44025100 tx=0x7f6c44025370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8088ebf438545feb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6b2b7fe640 1 -- 172.21.15.170:0/2574471454 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c4403d070 con 0x55ba3f3b5d10 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6b2b7fe640 1 -- 172.21.15.170:0/2574471454 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4405c070 con 0x55ba3f3b5d10 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6b2b7fe640 1 -- 172.21.15.170:0/2574471454 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c44024460 con 0x55ba3f3b5d10 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 -- 172.21.15.170:0/2574471454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 msgr2=0x55ba3f3b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 --2- 172.21.15.170:0/2574471454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3b6130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6c44025100 tx=0x7f6c44025370 comp rx=0 tx=0).stop 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 -- 172.21.15.170:0/2574471454 shutdown_connections 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 --2- 172.21.15.170:0/2574471454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3b6130 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 -- 172.21.15.170:0/2574471454 >> 172.21.15.170:0/2574471454 conn(0x55ba3f3b1fe0 msgr2=0x55ba3f3b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 -- 172.21.15.170:0/2574471454 shutdown_connections 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 -- 172.21.15.170:0/2574471454 wait complete. 2024-04-26T12:30:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 Processor -- start 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 -- start start 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3bd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.893+0000 7f6c58c10800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba3f3b6dd0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6c543c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3bd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41116/0 (socket says 172.21.15.170:41116) 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 learned_addr learned my addr 172.21.15.170:0/4189447772 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3f3bd6b0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6c543c0640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3bd170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401a6a0 tx=0x7f6c44025090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6b29ffb640 1 -- 172.21.15.170:0/4189447772 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c440226d0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba3f3bd6b0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6b29ffb640 1 -- 172.21.15.170:0/4189447772 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44022890 con 0x55ba3f3b5d10 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6b29ffb640 1 -- 172.21.15.170:0/4189447772 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c44022bb0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.894+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba3f3bd6b0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.895+0000 7f6b29ffb640 1 -- 172.21.15.170:0/4189447772 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6c4404c7c0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.895+0000 7f6b29ffb640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b1c036900 0x7f6b1c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.895+0000 7f6b29ffb640 1 -- 172.21.15.170:0/4189447772 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6c4406dca0 con 0x55ba3f3b5d10 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.895+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b1c036900 0x7f6b1c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b1c036900 0x7f6b1c038dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c052fd0 tx=0x7f6c3c04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f3c8870 0x55ba3f3cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cb480 con 0x55ba3f3c8870 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c54bc1640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f3c8870 0x55ba3f3cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c54bc1640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f3c8870 0x55ba3f3cad30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c58c10800 20 realm 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.896+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cb890 con 0x55ba3f3c8870 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc160 con 0x55ba3f3c8870 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3c8870 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3cd260 0x55ba3f3cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cfc60 con 0x55ba3f3cd260 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.897+0000 7f6c543c0640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3cd260 0x55ba3f3cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c543c0640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3cd260 0x55ba3f3cf650 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c58c10800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c58c10800 20 searching for the correct realm 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba3f3d1c10 0x55ba3f3d40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d47a0 con 0x55ba3f3d1c10 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba3f3d1c10 0x55ba3f3d40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.898+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba3f3d1c10 0x55ba3f3d40d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c4bbbf640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6c3c076040 0x7f6c3c083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d47a0 con 0x7f6c3c076040 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c54bc1640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6c3c076040 0x7f6c3c083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c54bc1640 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6c3c076040 0x7f6c3c083410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3cd260 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.899+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3c8870 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.900+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.900+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3c8870 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.900+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.900+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3cd260 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.900+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.900+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3cd260 2024-04-26T12:30:30.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x7f6c3c076040 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3d1c10 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3c8870 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.901+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3cd260 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3c8870 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x7f6c3c076040 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3cc500 con 0x55ba3f3d1c10 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.902+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3d1c10 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3cd260 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3d1c10 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3d1c10 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.903+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3c8870 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3c8870 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3cd260 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3d1c10 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.904+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x7f6c3c076040 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3c8870 2024-04-26T12:30:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3cd260 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3d1c10 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.905+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3cd260 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x7f6c3c076040 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3d1c10 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3cd260 2024-04-26T12:30:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.906+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x55ba3f3c8870 2024-04-26T12:30:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c3c090040 con 0x7f6c3c076040 2024-04-26T12:30:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d0520 con 0x55ba3f3c8870 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d0520 con 0x55ba3f3c8870 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.907+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d0520 con 0x7f6c3c076040 2024-04-26T12:30:30.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 zone default found 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 4 Realm: () 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 zonegroup default 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d0dc0 con 0x55ba3f3cd260 2024-04-26T12:30:30.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d6600 con 0x55ba3f3d1c10 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d69a0 con 0x55ba3f3d1c10 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.908+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.909+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.909+0000 7f6c58c10800 20 started sync module instance, tier type = 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.909+0000 7f6c58c10800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.909+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d5aa0 con 0x7f6c3c076040 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.910+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.910+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94258413264576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d5aa0 con 0x7f6c3c076040 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.910+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d71f0 con 0x55ba3f3c8870 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.911+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94258413264576] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.911+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.911+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94258413262800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d71f0 con 0x55ba3f3c8870 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.911+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d7bb0 con 0x55ba3f3d1c10 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.912+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94258413262800] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.912+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.912+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94258413268288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d7160 con 0x55ba3f3d1c10 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.912+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d8960 con 0x7f6c3c076040 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.913+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94258413268288] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.913+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.913+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94258413272992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d8d50 con 0x7f6c3c076040 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.913+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d9750 con 0x55ba3f3c8870 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.914+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94258413272992] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.914+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.914+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94258413274048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d9710 con 0x55ba3f3c8870 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.914+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3da160 con 0x55ba3f3cd260 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.915+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94258413274048] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.915+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.915+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94258413277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d9680 con 0x55ba3f3cd260 2024-04-26T12:30:30.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.915+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3daed0 con 0x55ba3f3cd260 2024-04-26T12:30:30.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.916+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94258413277792] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.916+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.916+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94258413283120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3db720 con 0x55ba3f3cd260 2024-04-26T12:30:30.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.916+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3dc0e0 con 0x55ba3f3cd260 2024-04-26T12:30:30.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94258413288496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3dc500 con 0x55ba3f3cd260 2024-04-26T12:30:30.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c58c10800 20 add_watcher() i=0 2024-04-26T12:30:30.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c58c10800 20 add_watcher() i=1 2024-04-26T12:30:30.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c58c10800 20 add_watcher() i=2 2024-04-26T12:30:30.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c58c10800 20 add_watcher() i=3 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c58c10800 20 add_watcher() i=4 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.917+0000 7f6c58c10800 20 add_watcher() i=5 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.918+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94258413283120] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.918+0000 7f6c58c10800 20 add_watcher() i=6 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.918+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94258413288496] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.918+0000 7f6c58c10800 20 add_watcher() i=7 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.918+0000 7f6c58c10800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.918+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3db270 con 0x55ba3f3c8870 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.919+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.919+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94258413289552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3db270 con 0x55ba3f3c8870 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94258413289552] v30'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6b0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6c58c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6c58c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6c58c10800 5 note: GC not initialized 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6b097e2640 20 reqs_thread_entry: start 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6c58c10800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6c58c10800 20 Filter name: none 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.920+0000 7f6a7affd640 20 reqs_thread_entry: start 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f412cf0 con 0x55ba3f3c8870 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:30.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f411330 con 0x55ba3f3c8870 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 20 rados->read ofs=0 len=0 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.921+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f411330 con 0x55ba3f3cd260 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.922+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.922+0000 7f6c58c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:30.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.922+0000 7f6c58c10800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.922+0000 7f6c58c10800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.922+0000 7f6c58c10800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.922+0000 7f6c58c10800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.922+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f411c20 con 0x55ba3f3c8870 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6c58c10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6c58c10800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6c58c10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94258413508464 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f4167d0 con 0x55ba3f3c8870 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify (1) cookie 94258413274048 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ba3f411fc0 con 0x55ba3f3c8870 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94258413274048 notifier 4299 bl.length()=567 2024-04-26T12:30:30.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6b2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6b2b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 notify.4 [notify cookie 94258413508464 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.923+0000 7f6b2b7fe640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6b18003ea0 con 0x55ba3f3c8870 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.924+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.924+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== watch-notify(notify_complete (2) cookie 94258413508464 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba3f4128a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.924+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f411770 con 0x55ba3f3c8870 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6c58c10800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6c58c10800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6c58c10800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94258413508464 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f4168f0 con 0x7f6c3c076040 2024-04-26T12:30:30.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== watch-notify(notify (1) cookie 94258413272992 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55ba3f4128a0 con 0x7f6c3c076040 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6b2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94258413272992 notifier 4299 bl.length()=169 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6b2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6b2affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6b2affd640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6a88003400 con 0x7f6c3c076040 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.925+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(69 notify.3 [notify cookie 94258413508464 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.926+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== watch-notify(notify_complete (2) cookie 94258413508464 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6c4c045710 con 0x7f6c3c076040 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.926+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.926+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f4148d0 con 0x55ba3f3cd260 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6c58c10800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6c58c10800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6c58c10800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94258413519552 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f416da0 con 0x7f6c3c076040 2024-04-26T12:30:30.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== watch-notify(notify (1) cookie 94258413272992 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f6c4c045710 con 0x7f6c3c076040 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94258413272992 notifier 4299 bl.length()=177 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6b2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6b2b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6b2b7fe640 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6b18003ea0 con 0x7f6c3c076040 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.927+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(72 notify.3 [notify cookie 94258413519552 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.928+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== watch-notify(notify_complete (2) cookie 94258413519552 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6c4c045bc0 con 0x7f6c3c076040 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.928+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.948 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:30.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.928+0000 7f6b0a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:30.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.928+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94258413289552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f414080 con 0x55ba3f3c8870 2024-04-26T12:30:30.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.929+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94258413289552] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.929+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94258413264576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3dc050 con 0x7f6c3c076040 2024-04-26T12:30:30.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.930+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94258413264576] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.930+0000 7f6c58c10800 20 remove_watcher() i=0 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.930+0000 7f6c58c10800 2 removed watcher, disabling cache 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.930+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94258413262800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3dc050 con 0x55ba3f3c8870 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.932+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94258413262800] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.932+0000 7f6c58c10800 20 remove_watcher() i=1 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.932+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94258413268288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d57d0 con 0x55ba3f3d1c10 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.933+0000 7f6c4bbbf640 1 -- 172.21.15.170:0/4189447772 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94258413268288] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c081070 con 0x55ba3f3d1c10 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.933+0000 7f6c58c10800 20 remove_watcher() i=2 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.933+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94258413272992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d6d40 con 0x7f6c3c076040 2024-04-26T12:30:30.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.934+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94258413272992] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x7f6c3c076040 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.934+0000 7f6c58c10800 20 remove_watcher() i=3 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.934+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94258413274048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d6d40 con 0x55ba3f3c8870 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.935+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94258413274048] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4c00a4a0 con 0x55ba3f3c8870 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.935+0000 7f6c58c10800 20 remove_watcher() i=4 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.935+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94258413277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d6d40 con 0x55ba3f3cd260 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.936+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94258413277792] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.936+0000 7f6c58c10800 20 remove_watcher() i=5 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.936+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94258413283120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3d6d40 con 0x55ba3f3cd260 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.937+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94258413283120] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.937+0000 7f6c58c10800 20 remove_watcher() i=6 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.937+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94258413288496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba3f3da730 con 0x55ba3f3cd260 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c543c0640 1 -- 172.21.15.170:0/4189447772 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94258413288496] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c4402b070 con 0x55ba3f3cd260 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 20 remove_watcher() i=7 2024-04-26T12:30:30.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3cd260 msgr2=0x55ba3f3cf650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3cd260 0x55ba3f3cf650 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f3c8870 msgr2=0x55ba3f3cad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f3c8870 0x55ba3f3cad30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6c3c076040 msgr2=0x7f6c3c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6c3c076040 0x7f6c3c083410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba3f3d1c10 msgr2=0x55ba3f3d40d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba3f3d1c10 0x55ba3f3d40d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b1c036900 msgr2=0x7f6b1c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b1c036900 0x7f6b1c038dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c052fd0 tx=0x7f6c3c04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 msgr2=0x55ba3f3bd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c54bc1640 1 -- 172.21.15.170:0/4189447772 reap_dead start 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3bd170 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6c4401a6a0 tx=0x7f6c44025090 comp rx=0 tx=0).stop 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 shutdown_connections 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/4189447772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f3b5d10 0x55ba3f3bd170 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 >> 172.21.15.170:0/4189447772 conn(0x55ba3f3b1fe0 msgr2=0x55ba3f3af640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 shutdown_connections 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/4189447772 wait complete. 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b2c036950 msgr2=0x7f6b2c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b2c036950 0x7f6b2c038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55ba3f38ff90 tx=0x7f6c3c005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28fb30 msgr2=0x55ba3f28dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28fb30 0x55ba3f28dfa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c4404acf0 tx=0x7f6c4402caa0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 shutdown_connections 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b2c036950 0x7f6b2c038e10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 --2- 172.21.15.170:0/714547370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28fb30 0x55ba3f28dfa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 >> 172.21.15.170:0/714547370 conn(0x55ba3f39a9e0 msgr2=0x55ba3f39ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 shutdown_connections 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.938+0000 7f6c58c10800 1 -- 172.21.15.170:0/714547370 wait complete. 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3919e0 msgr2=0x55ba3f393dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba3f3919e0 0x55ba3f393dd0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f293aa0 msgr2=0x55ba3f38f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba3f293aa0 0x55ba3f38f170 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba3f395970 msgr2=0x55ba3f397dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba3f395970 0x55ba3f397dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b3c036900 msgr2=0x7f6b3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6b3c036900 0x7f6b3c038dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c054000 tx=0x7f6c3c04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 msgr2=0x55ba3f388150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 --2- 172.21.15.170:0/483844423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba3f28ff90 0x55ba3f388150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c010 tx=0x7f6c44000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c54bc1640 1 -- 172.21.15.170:0/483844423 reap_dead start 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 shutdown_connections 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 >> 172.21.15.170:0/483844423 conn(0x55ba3f289980 msgr2=0x55ba3f37f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 shutdown_connections 2024-04-26T12:30:30.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:30.939+0000 7f6c58c10800 1 -- 172.21.15.170:0/483844423 wait complete. 2024-04-26T12:30:30.960 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:30.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-26T12:30:30.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-26T12:30:30.961 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-26T12:30:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.007+0000 7f263fb31800 1 Processor -- start 2024-04-26T12:30:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.007+0000 7f263fb31800 1 -- start start 2024-04-26T12:30:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263fb31800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558c4d22e400 0x558c4d22e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263fb31800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c4d0dc0c0 con 0x558c4d22f660 2024-04-26T12:30:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263fb31800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x558c4d0c04d0 con 0x558c4d22e400 2024-04-26T12:30:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263b82f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558c4d22e400 0x558c4d22e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263302e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x558c4d22f660 0x558c4d22fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46002/0 (socket says 172.21.15.170:46002) 2024-04-26T12:30:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263302e640 1 -- 172.21.15.170:0/1343892769 learned_addr learned my addr 172.21.15.170:0/1343892769 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263b82f640 1 -- 172.21.15.170:0/1343892769 >> v1:172.21.15.132:6789/0 conn(0x558c4d22f660 legacy=0x558c4d22fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263b02e640 1 -- 172.21.15.170:0/1343892769 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346169769 0 0) 0x558c4d0dc0c0 con 0x558c4d22f660 2024-04-26T12:30:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.008+0000 7f263b82f640 1 -- 172.21.15.170:0/1343892769 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4d0edd40 con 0x558c4d22e400 2024-04-26T12:30:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.010+0000 7f263b82f640 1 --2- 172.21.15.170:0/1343892769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d22e820 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48557109a18bda0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.010+0000 7f263b02e640 1 -- 172.21.15.170:0/1343892769 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c057070 con 0x558c4d22e400 2024-04-26T12:30:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.010+0000 7f263b02e640 1 -- 172.21.15.170:0/1343892769 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c052570 con 0x558c4d22e400 2024-04-26T12:30:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.010+0000 7f263b02e640 1 -- 172.21.15.170:0/1343892769 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c052870 con 0x558c4d22e400 2024-04-26T12:30:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.011+0000 7f263fb31800 1 -- 172.21.15.170:0/1343892769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 msgr2=0x558c4d22e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.011+0000 7f263fb31800 1 --2- 172.21.15.170:0/1343892769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d22e820 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f262c00a470 tx=0x7f262c01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.011+0000 7f263fb31800 1 -- 172.21.15.170:0/1343892769 shutdown_connections 2024-04-26T12:30:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.011+0000 7f263fb31800 1 --2- 172.21.15.170:0/1343892769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d22e820 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.011+0000 7f263fb31800 1 -- 172.21.15.170:0/1343892769 >> 172.21.15.170:0/1343892769 conn(0x558c4d229a00 msgr2=0x558c4d22be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.011+0000 7f263fb31800 1 -- 172.21.15.170:0/1343892769 shutdown_connections 2024-04-26T12:30:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.011+0000 7f263fb31800 1 -- 172.21.15.170:0/1343892769 wait complete. 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.022+0000 7f263fb31800 1 Processor -- start 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.022+0000 7f263fb31800 1 -- start start 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f263fb31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d31f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f263fb31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558c4d17ab60 con 0x558c4d22e400 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d31f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d31f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41140/0 (socket says 172.21.15.170:41140) 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f263b82f640 1 -- 172.21.15.170:0/964229599 learned_addr learned my addr 172.21.15.170:0/964229599 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f263b82f640 1 -- 172.21.15.170:0/964229599 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4d0ec590 con 0x558c4d22e400 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f263b82f640 1 --2- 172.21.15.170:0/964229599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d31f820 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f262c055040 tx=0x7f262c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f323e757a7c67154 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f2529e0b640 1 -- 172.21.15.170:0/964229599 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c063070 con 0x558c4d22e400 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f2529e0b640 1 -- 172.21.15.170:0/964229599 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c058040 con 0x558c4d22e400 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.023+0000 7f2529e0b640 1 -- 172.21.15.170:0/964229599 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c057070 con 0x558c4d22e400 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.024+0000 7f263fb31800 1 -- 172.21.15.170:0/964229599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 msgr2=0x558c4d31f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.024+0000 7f263fb31800 1 --2- 172.21.15.170:0/964229599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d31f820 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f262c055040 tx=0x7f262c04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.024+0000 7f263fb31800 1 -- 172.21.15.170:0/964229599 shutdown_connections 2024-04-26T12:30:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.024+0000 7f263fb31800 1 --2- 172.21.15.170:0/964229599 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d31f820 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.024+0000 7f263fb31800 1 -- 172.21.15.170:0/964229599 >> 172.21.15.170:0/964229599 conn(0x558c4d229a00 msgr2=0x558c4d31b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.024+0000 7f263fb31800 1 -- 172.21.15.170:0/964229599 shutdown_connections 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.024+0000 7f263fb31800 1 -- 172.21.15.170:0/964229599 wait complete. 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263fb31800 1 Processor -- start 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263fb31800 1 -- start start 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263fb31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d3282c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263fb31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558c4d237b00 con 0x558c4d22e400 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d3282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d3282c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41146/0 (socket says 172.21.15.170:41146) 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263b82f640 1 -- 172.21.15.170:0/1193070452 learned_addr learned my addr 172.21.15.170:0/1193070452 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263b82f640 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4d0e38f0 con 0x558c4d22e400 2024-04-26T12:30:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263b82f640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d3282c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f262c061040 tx=0x7f262c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f2523fff640 1 -- 172.21.15.170:0/1193070452 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c063030 con 0x558c4d22e400 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f2523fff640 1 -- 172.21.15.170:0/1193070452 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c052a60 con 0x558c4d22e400 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f2523fff640 1 -- 172.21.15.170:0/1193070452 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c052d40 con 0x558c4d22e400 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.025+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c4d328800 con 0x558c4d22e400 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.026+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4d328d20 con 0x558c4d22e400 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.026+0000 7f2523fff640 1 -- 172.21.15.170:0/1193070452 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f262c05e480 con 0x558c4d22e400 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.026+0000 7f2523fff640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2524036950 0x7f2524038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.026+0000 7f2523fff640 1 -- 172.21.15.170:0/1193070452 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f262c064070 con 0x558c4d22e400 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.026+0000 7f263302e640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2524036950 0x7f2524038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d22f660 0x558c4d32f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d32f8b0 con 0x558c4d22f660 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263c030640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d22f660 0x558c4d32f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263302e640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2524036950 0x7f2524038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2624000c00 tx=0x7f26240013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263c030640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d22f660 0x558c4d32f330 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263c030640 1 -- 172.21.15.170:0/1193070452 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d22f660 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d32c8e0 con 0x558c4d22f660 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.027+0000 7f263c030640 1 -- 172.21.15.170:0/1193070452 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d22f660 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.028+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d331b80 0x558c4d333f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.028+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d334610 con 0x558c4d331b80 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.028+0000 7f263b82f640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d331b80 0x558c4d333f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.028+0000 7f263b82f640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d331b80 0x558c4d333f70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.028+0000 7f263b82f640 1 -- 172.21.15.170:0/1193070452 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f262c070020 con 0x558c4d331b80 2024-04-26T12:30:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.028+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d330b30 con 0x558c4d22f660 2024-04-26T12:30:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.029+0000 7f263c030640 1 -- 172.21.15.170:0/1193070452 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d22f660 2024-04-26T12:30:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.029+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558c4d335ac0 0x558c4d337f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.029+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d338670 con 0x558c4d335ac0 2024-04-26T12:30:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.029+0000 7f263302e640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558c4d335ac0 0x558c4d337f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.029+0000 7f263302e640 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558c4d335ac0 0x558c4d337f10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.029+0000 7f263302e640 1 -- 172.21.15.170:0/1193070452 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f262400f670 con 0x558c4d335ac0 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263fb31800 1 Processor -- start 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263fb31800 1 -- start start 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263fb31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d346a60 0x558c4d346e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263fb31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558c4d120e60 con 0x558c4d346a60 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d346a60 0x558c4d346e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d346a60 0x558c4d346e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41160/0 (socket says 172.21.15.170:41160) 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263b82f640 1 -- 172.21.15.170:0/1661343352 learned_addr learned my addr 172.21.15.170:0/1661343352 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.030+0000 7f263b82f640 1 -- 172.21.15.170:0/1661343352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4d3473c0 con 0x558c4d346a60 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.031+0000 7f263b82f640 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d346a60 0x558c4d346e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f262c08c8b0 tx=0x7f262c05c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.031+0000 7f25217fa640 1 -- 172.21.15.170:0/1661343352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c08b120 con 0x558c4d346a60 2024-04-26T12:30:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.031+0000 7f25217fa640 1 -- 172.21.15.170:0/1661343352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c08b2c0 con 0x558c4d346a60 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.031+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c4d347e30 con 0x558c4d346a60 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.031+0000 7f25217fa640 1 -- 172.21.15.170:0/1661343352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c076a40 con 0x558c4d346a60 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.031+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4d347e30 con 0x558c4d346a60 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f25217fa640 1 -- 172.21.15.170:0/1661343352 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f262c087070 con 0x558c4d346a60 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f25217fa640 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2514036900 0x7f2514038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f25217fa640 1 -- 172.21.15.170:0/1661343352 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f262c0073e0 con 0x558c4d346a60 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263302e640 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2514036900 0x7f2514038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263fb31800 1 Processor -- start 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263302e640 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2514036900 0x7f2514038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x558c4d32c820 tx=0x7f2624006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263fb31800 1 -- start start 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263fb31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d353ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263fb31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558c4d31fee0 con 0x558c4d353ac0 2024-04-26T12:30:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d353ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d353ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41176/0 (socket says 172.21.15.170:41176) 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.032+0000 7f263b82f640 1 -- 172.21.15.170:0/2070364504 learned_addr learned my addr 172.21.15.170:0/2070364504 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f263b82f640 1 -- 172.21.15.170:0/2070364504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4d3544b0 con 0x558c4d353ac0 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f263b82f640 1 --2- 172.21.15.170:0/2070364504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d353ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f262c08b000 tx=0x7f262c05ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7442b6493e920d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f251affd640 1 -- 172.21.15.170:0/2070364504 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c076dc0 con 0x558c4d353ac0 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f251affd640 1 -- 172.21.15.170:0/2070364504 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c0a6070 con 0x558c4d353ac0 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f251affd640 1 -- 172.21.15.170:0/2070364504 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c0725b0 con 0x558c4d353ac0 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f263fb31800 1 -- 172.21.15.170:0/2070364504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 msgr2=0x558c4d353ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f263fb31800 1 --2- 172.21.15.170:0/2070364504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d353ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f262c08b000 tx=0x7f262c05ef70 comp rx=0 tx=0).stop 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f263fb31800 1 -- 172.21.15.170:0/2070364504 shutdown_connections 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f263fb31800 1 --2- 172.21.15.170:0/2070364504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d353ee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.033+0000 7f263fb31800 1 -- 172.21.15.170:0/2070364504 >> 172.21.15.170:0/2070364504 conn(0x558c4d34fdd0 msgr2=0x558c4d34de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263fb31800 1 -- 172.21.15.170:0/2070364504 shutdown_connections 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263fb31800 1 -- 172.21.15.170:0/2070364504 wait complete. 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263fb31800 1 Processor -- start 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263fb31800 1 -- start start 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263fb31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d35ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263fb31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558c4d354b40 con 0x558c4d353ac0 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d35ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263b82f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d35ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41182/0 (socket says 172.21.15.170:41182) 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 learned_addr learned my addr 172.21.15.170:0/1277472564 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.034+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4d35b3b0 con 0x558c4d353ac0 2024-04-26T12:30:31.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.035+0000 7f263b82f640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d35ae70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f262c076990 tx=0x7f262c081f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.035+0000 7f25197fa640 1 -- 172.21.15.170:0/1277472564 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c07e540 con 0x558c4d353ac0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.035+0000 7f25197fa640 1 -- 172.21.15.170:0/1277472564 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c06d160 con 0x558c4d353ac0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.035+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c4d35b3b0 con 0x558c4d353ac0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.035+0000 7f25197fa640 1 -- 172.21.15.170:0/1277472564 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c0725b0 con 0x558c4d353ac0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.035+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c4d35b850 con 0x558c4d353ac0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f25197fa640 1 -- 172.21.15.170:0/1277472564 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f262c0b9030 con 0x558c4d353ac0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f25197fa640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2504036950 0x7f2504038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f25197fa640 1 -- 172.21.15.170:0/1277472564 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f262c0b7070 con 0x558c4d353ac0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f263302e640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2504036950 0x7f2504038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f263302e640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2504036950 0x7f2504038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f262400ffd0 tx=0x7f2624023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d3664c0 0x558c4d368980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3690d0 con 0x558c4d3664c0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.036+0000 7f263c030640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d3664c0 0x558c4d368980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263c030640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d3664c0 0x558c4d368980 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 20 realm 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3694e0 con 0x558c4d3664c0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d369db0 con 0x558c4d3664c0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.037+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d36aeb0 0x558c4d36d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36d8b0 con 0x558c4d36aeb0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263b82f640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d36aeb0 0x558c4d36d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263b82f640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d36aeb0 0x558c4d36d2a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 20 searching for the correct realm 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558c4d36f860 0x558c4d371d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.038+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3723f0 con 0x558c4d36f860 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.039+0000 7f263302e640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558c4d36f860 0x558c4d371d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.039+0000 7f263302e640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558c4d36f860 0x558c4d371d20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.039+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.039+0000 7f263302e640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f262402e910 0x7f262403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.039+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3723f0 con 0x7f262402e910 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.039+0000 7f263c030640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f262402e910 0x7f262403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.040+0000 7f263c030640 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f262402e910 0x7f262403a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.040+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.040+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.040+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.040+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.040+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.040+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x7f262402e910 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.041+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.042+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.042+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.042+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.042+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.042+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.042+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x7f262402e910 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.043+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.044+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.045+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.045+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.045+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.045+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.045+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.045+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x7f262402e910 2024-04-26T12:30:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.046+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.046+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.046+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.046+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.046+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.046+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x7f262402e910 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36f860 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.047+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d36aeb0 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.048+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.048+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x558c4d3664c0 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.048+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.048+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36a150 con 0x7f262402e910 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:31.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36e170 con 0x558c4d3664c0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36e170 con 0x558c4d3664c0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36e170 con 0x7f262402e910 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 zone default found 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 4 Realm: () 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 zonegroup default 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.049+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d36ea10 con 0x558c4d36aeb0 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d374250 con 0x558c4d36f860 2024-04-26T12:30:31.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.050+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3745f0 con 0x558c4d36f860 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.051+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.051+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.051+0000 7f263fb31800 20 started sync module instance, tier type = 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.051+0000 7f263fb31800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.051+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3736f0 con 0x7f262402e910 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.052+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.052+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94061079247632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3736f0 con 0x7f262402e910 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.052+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d374e80 con 0x558c4d3664c0 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.053+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94061079247632] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.053+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.053+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94061079251344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3736f0 con 0x558c4d3664c0 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.053+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3758f0 con 0x558c4d36f860 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.054+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94061079251344] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.054+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.054+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94061079245376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d373660 con 0x558c4d36f860 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.054+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d376690 con 0x7f262402e910 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.055+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94061079245376] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.055+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.055+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94061079256288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d376ab0 con 0x7f262402e910 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.055+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3774b0 con 0x558c4d3664c0 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.056+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.056+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94061079261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3773e0 con 0x558c4d3664c0 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.056+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3783c0 con 0x558c4d36aeb0 2024-04-26T12:30:31.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.056+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94061079256288] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.057+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94061079261120] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.057+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.057+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94061079263392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d377ec0 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.057+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d378c60 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.058+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.058+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94061079269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3798d0 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.058+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d37a2f0 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.058+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94061079263392] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94061079269376] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94061079270432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d376140 con 0x558c4d36aeb0 2024-04-26T12:30:31.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 20 add_watcher() i=0 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 20 add_watcher() i=1 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 20 add_watcher() i=2 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 20 add_watcher() i=3 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 20 add_watcher() i=4 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 20 add_watcher() i=5 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.059+0000 7f263fb31800 20 add_watcher() i=6 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.060+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94061079270432] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.060+0000 7f263fb31800 20 add_watcher() i=7 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.060+0000 7f263fb31800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.060+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d37d560 con 0x558c4d3664c0 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.060+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.061+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94061079272928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d37aa20 con 0x558c4d3664c0 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.061+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94061079272928] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f24f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 5 note: GC not initialized 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f24f0fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 20 Filter name: none 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f246a7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.062+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3b0c50 con 0x558c4d36aeb0 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:30:31.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3af290 con 0x558c4d3664c0 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 20 rados_obj.operate() r=0 bl.length=7 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3af680 con 0x558c4d3664c0 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:31.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.063+0000 7f263fb31800 20 get_user_info_from_index found 0 xattrs 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.064+0000 7f24f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.064+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94061079272928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d3630a0 con 0x558c4d3664c0 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.065+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94061079272928] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.065+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94061079247632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d379de0 con 0x7f262402e910 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.066+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94061079247632] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.066+0000 7f263fb31800 20 remove_watcher() i=0 2024-04-26T12:30:31.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.066+0000 7f263fb31800 2 removed watcher, disabling cache 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.066+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94061079251344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d379de0 con 0x558c4d3664c0 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.067+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94061079251344] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.067+0000 7f263fb31800 20 remove_watcher() i=1 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.067+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94061079245376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d374990 con 0x558c4d36f860 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.068+0000 7f263302e640 1 -- 172.21.15.170:0/1277472564 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94061079245376] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2624037040 con 0x558c4d36f860 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.068+0000 7f263fb31800 20 remove_watcher() i=2 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.068+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94061079256288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d379de0 con 0x7f262402e910 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.069+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94061079256288] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x7f262402e910 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.069+0000 7f263fb31800 20 remove_watcher() i=3 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.069+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94061079261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d373240 con 0x558c4d3664c0 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.071+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94061079261120] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263400a4a0 con 0x558c4d3664c0 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.071+0000 7f263fb31800 20 remove_watcher() i=4 2024-04-26T12:30:31.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.071+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94061079263392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d379de0 con 0x558c4d36aeb0 2024-04-26T12:30:31.087 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.072+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94061079263392] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.072+0000 7f263fb31800 20 remove_watcher() i=5 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.072+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94061079269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d376fc0 con 0x558c4d36aeb0 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.072+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94061079269376] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.072+0000 7f263fb31800 20 remove_watcher() i=6 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.072+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94061079270432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558c4d373240 con 0x558c4d36aeb0 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.073+0000 7f263b82f640 1 -- 172.21.15.170:0/1277472564 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94061079270432] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c094020 con 0x558c4d36aeb0 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.073+0000 7f263fb31800 20 remove_watcher() i=7 2024-04-26T12:30:31.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.073+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d36aeb0 msgr2=0x558c4d36d2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.073+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d36aeb0 0x558c4d36d2a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.073+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d3664c0 msgr2=0x558c4d368980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.073+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d3664c0 0x558c4d368980 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f262402e910 msgr2=0x7f262403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f262402e910 0x7f262403a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558c4d36f860 msgr2=0x558c4d371d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558c4d36f860 0x558c4d371d20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2504036950 msgr2=0x7f2504038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2504036950 0x7f2504038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f262400ffd0 tx=0x7f2624023040 comp rx=0 tx=0).stop 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 msgr2=0x558c4d35ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263c030640 1 -- 172.21.15.170:0/1277472564 reap_dead start 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d35ae70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f262c076990 tx=0x7f262c081f90 comp rx=0 tx=0).stop 2024-04-26T12:30:31.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 shutdown_connections 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1277472564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d353ac0 0x558c4d35ae70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 >> 172.21.15.170:0/1277472564 conn(0x558c4d34fdd0 msgr2=0x558c4d34d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 shutdown_connections 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1277472564 wait complete. 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2514036900 msgr2=0x7f2514038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2514036900 0x7f2514038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x558c4d32c820 tx=0x7f2624006000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d346a60 msgr2=0x558c4d346e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d346a60 0x558c4d346e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f262c08c8b0 tx=0x7f262c05c9f0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 shutdown_connections 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2514036900 0x7f2514038dc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1661343352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d346a60 0x558c4d346e80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 >> 172.21.15.170:0/1661343352 conn(0x558c4d33ab00 msgr2=0x558c4d33af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 shutdown_connections 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1661343352 wait complete. 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d331b80 msgr2=0x558c4d333f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558c4d331b80 0x558c4d333f70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d22f660 msgr2=0x558c4d32f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558c4d22f660 0x558c4d32f330 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558c4d335ac0 msgr2=0x558c4d337f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.074+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558c4d335ac0 0x558c4d337f10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2524036950 msgr2=0x7f2524038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2524036950 0x7f2524038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2624000c00 tx=0x7f26240013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 msgr2=0x558c4d3282c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 --2- 172.21.15.170:0/1193070452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558c4d22e400 0x558c4d3282c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f262c061040 tx=0x7f262c002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263c030640 1 -- 172.21.15.170:0/1193070452 reap_dead start 2024-04-26T12:30:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 shutdown_connections 2024-04-26T12:30:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 >> 172.21.15.170:0/1193070452 conn(0x558c4d229a00 msgr2=0x558c4d31e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 shutdown_connections 2024-04-26T12:30:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.075+0000 7f263fb31800 1 -- 172.21.15.170:0/1193070452 wait complete. 2024-04-26T12:30:31.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:31.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:31.097 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc7411800 1 Processor -- start 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc7411800 1 -- start start 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc7411800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b1ca673960 0x55b1ca675d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc7411800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1ca51c0c0 con 0x55b1ca66f5c0 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc7411800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55b1ca5004d0 con 0x55b1ca673960 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc2346640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b1ca673960 0x55b1ca675d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc2b47640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55b1ca66f5c0 0x55b1ca66f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46006/0 (socket says 172.21.15.170:46006) 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc2346640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b1ca673960 0x55b1ca675d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41186/0 (socket says 172.21.15.170:41186) 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.139+0000 7fbcc2b47640 1 -- 172.21.15.170:0/4188111932 learned_addr learned my addr 172.21.15.170:0/4188111932 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.140+0000 7fbcc2346640 1 -- 172.21.15.170:0/4188111932 >> v1:172.21.15.132:6789/0 conn(0x55b1ca66f5c0 legacy=0x55b1ca66f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.140+0000 7fbcc2346640 1 -- 172.21.15.170:0/4188111932 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ca52dd40 con 0x55b1ca673960 2024-04-26T12:30:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.141+0000 7fbcc2346640 1 --2- 172.21.15.170:0/4188111932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca673960 0x55b1ca675d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800a470 tx=0x7fbcb801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601727859fec67e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc1b45640 1 -- 172.21.15.170:0/4188111932 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb8057070 con 0x55b1ca673960 2024-04-26T12:30:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc1b45640 1 -- 172.21.15.170:0/4188111932 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb8052570 con 0x55b1ca673960 2024-04-26T12:30:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc1b45640 1 -- 172.21.15.170:0/4188111932 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb8052870 con 0x55b1ca673960 2024-04-26T12:30:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc7411800 1 -- 172.21.15.170:0/4188111932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca673960 msgr2=0x55b1ca675d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc7411800 1 --2- 172.21.15.170:0/4188111932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca673960 0x55b1ca675d50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800a470 tx=0x7fbcb801ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc7411800 1 -- 172.21.15.170:0/4188111932 shutdown_connections 2024-04-26T12:30:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc7411800 1 --2- 172.21.15.170:0/4188111932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca673960 0x55b1ca675d50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc7411800 1 -- 172.21.15.170:0/4188111932 >> 172.21.15.170:0/4188111932 conn(0x55b1ca66ab80 msgr2=0x55b1ca66cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc7411800 1 -- 172.21.15.170:0/4188111932 shutdown_connections 2024-04-26T12:30:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.142+0000 7fbcc7411800 1 -- 172.21.15.170:0/4188111932 wait complete. 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc7411800 1 Processor -- start 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc7411800 1 -- start start 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc7411800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca5e5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc7411800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b1ca5bab40 con 0x55b1ca66f5c0 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca5e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca5e5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41202/0 (socket says 172.21.15.170:41202) 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc2b47640 1 -- 172.21.15.170:0/1832906868 learned_addr learned my addr 172.21.15.170:0/1832906868 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.154+0000 7fbcc2b47640 1 -- 172.21.15.170:0/1832906868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ca52c590 con 0x55b1ca66f5c0 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.155+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/1832906868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca5e5000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4001e10 tx=0x7fbcb400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9068214708b424 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.155+0000 7fbbb0e09640 1 -- 172.21.15.170:0/1832906868 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4012020 con 0x55b1ca66f5c0 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.155+0000 7fbbb0e09640 1 -- 172.21.15.170:0/1832906868 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb400e5a0 con 0x55b1ca66f5c0 2024-04-26T12:30:31.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.155+0000 7fbbb0e09640 1 -- 172.21.15.170:0/1832906868 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb400e8e0 con 0x55b1ca66f5c0 2024-04-26T12:30:31.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.155+0000 7fbcc7411800 1 -- 172.21.15.170:0/1832906868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 msgr2=0x55b1ca5e5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.155+0000 7fbcc7411800 1 --2- 172.21.15.170:0/1832906868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca5e5000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4001e10 tx=0x7fbcb400b780 comp rx=0 tx=0).stop 2024-04-26T12:30:31.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 -- 172.21.15.170:0/1832906868 shutdown_connections 2024-04-26T12:30:31.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 --2- 172.21.15.170:0/1832906868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca5e5000 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 -- 172.21.15.170:0/1832906868 >> 172.21.15.170:0/1832906868 conn(0x55b1ca66ab80 msgr2=0x55b1ca75c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 -- 172.21.15.170:0/1832906868 shutdown_connections 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 -- 172.21.15.170:0/1832906868 wait complete. 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 Processor -- start 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 -- start start 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca76a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc7411800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b1ca676620 con 0x55b1ca66f5c0 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca76a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca76a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41216/0 (socket says 172.21.15.170:41216) 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.156+0000 7fbcc2b47640 1 -- 172.21.15.170:0/460741347 learned_addr learned my addr 172.21.15.170:0/460741347 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.157+0000 7fbcc2b47640 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ca5238f0 con 0x55b1ca66f5c0 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.157+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca76a2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400b7c0 tx=0x7fbcb4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.157+0000 7fbbaf606640 1 -- 172.21.15.170:0/460741347 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4012030 con 0x55b1ca66f5c0 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.157+0000 7fbbaf606640 1 -- 172.21.15.170:0/460741347 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb4001470 con 0x55b1ca66f5c0 2024-04-26T12:30:31.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.157+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1ca76a800 con 0x55b1ca66f5c0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.157+0000 7fbbaf606640 1 -- 172.21.15.170:0/460741347 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb401a8d0 con 0x55b1ca66f5c0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.157+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ca76ad20 con 0x55b1ca66f5c0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbbaf606640 1 -- 172.21.15.170:0/460741347 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbcb4015020 con 0x55b1ca66f5c0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbbaf606640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbba8036950 0x7fbba8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbbaf606640 1 -- 172.21.15.170:0/460741347 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbcb4020030 con 0x55b1ca66f5c0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbcc2346640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbba8036950 0x7fbba8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca673960 0x55b1ca771330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7718b0 con 0x55b1ca673960 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbcc3348640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca673960 0x55b1ca771330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbcc2346640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbba8036950 0x7fbba8038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8054000 tx=0x7fbcb804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.158+0000 7fbcc3348640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca673960 0x55b1ca771330 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.159+0000 7fbcc3348640 1 -- 172.21.15.170:0/460741347 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca673960 2024-04-26T12:30:31.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.159+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca76e900 con 0x55b1ca673960 2024-04-26T12:30:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.159+0000 7fbcc3348640 1 -- 172.21.15.170:0/460741347 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca673960 2024-04-26T12:30:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.159+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca773bc0 0x55b1ca775fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.159+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca776650 con 0x55b1ca773bc0 2024-04-26T12:30:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.159+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca773bc0 0x55b1ca775fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.159+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca773bc0 0x55b1ca775fb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.160+0000 7fbcc2b47640 1 -- 172.21.15.170:0/460741347 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbcb4018950 con 0x55b1ca773bc0 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.160+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca772b70 con 0x55b1ca673960 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.160+0000 7fbcc3348640 1 -- 172.21.15.170:0/460741347 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca673960 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.160+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b1ca777b00 0x55b1ca779f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.160+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca77a6b0 con 0x55b1ca777b00 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.160+0000 7fbcc2346640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b1ca777b00 0x55b1ca779f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.160+0000 7fbcc2346640 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b1ca777b00 0x55b1ca779f50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc2346640 1 -- 172.21.15.170:0/460741347 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbcb8052a40 con 0x55b1ca777b00 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc7411800 1 Processor -- start 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc7411800 1 -- start start 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc7411800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca788ad0 0x55b1ca788ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc7411800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b1ca560e60 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca788ad0 0x55b1ca788ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca788ad0 0x55b1ca788ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41224/0 (socket says 172.21.15.170:41224) 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.161+0000 7fbcc2b47640 1 -- 172.21.15.170:0/3882320820 learned_addr learned my addr 172.21.15.170:0/3882320820 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.162+0000 7fbcc2b47640 1 -- 172.21.15.170:0/3882320820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ca789430 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.162+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca788ad0 0x55b1ca788ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbcb404ae10 tx=0x7fbcb4045f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.162+0000 7fbbace01640 1 -- 172.21.15.170:0/3882320820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb404cb20 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.162+0000 7fbbace01640 1 -- 172.21.15.170:0/3882320820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb403d070 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.162+0000 7fbbace01640 1 -- 172.21.15.170:0/3882320820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb404ce30 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.162+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1ca789ea0 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.162+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ca78a3a0 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbbace01640 1 -- 172.21.15.170:0/3882320820 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbcb4041040 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbbace01640 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb9c036900 0x7fbb9c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbbace01640 1 -- 172.21.15.170:0/3882320820 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbcb4019070 con 0x55b1ca788ad0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbcc2346640 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb9c036900 0x7fbb9c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbcc7411800 1 Processor -- start 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbcc7411800 1 -- start start 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbcc2346640 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb9c036900 0x7fbb9c038dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55b1ca76e820 tx=0x7fbcb8005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbcc7411800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca795f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.163+0000 7fbcc7411800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b1ca5e3680 con 0x55b1ca795af0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca795f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca795f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41232/0 (socket says 172.21.15.170:41232) 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbcc2b47640 1 -- 172.21.15.170:0/4232476484 learned_addr learned my addr 172.21.15.170:0/4232476484 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbcc2b47640 1 -- 172.21.15.170:0/4232476484 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ca7964e0 con 0x55b1ca795af0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/4232476484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca795f10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4017fd0 tx=0x7fbcb4038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14d25679a747fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbba67fc640 1 -- 172.21.15.170:0/4232476484 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4049730 con 0x55b1ca795af0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbba67fc640 1 -- 172.21.15.170:0/4232476484 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb404c040 con 0x55b1ca795af0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.164+0000 7fbba67fc640 1 -- 172.21.15.170:0/4232476484 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb404c570 con 0x55b1ca795af0 2024-04-26T12:30:31.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 -- 172.21.15.170:0/4232476484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 msgr2=0x55b1ca795f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 --2- 172.21.15.170:0/4232476484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca795f10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4017fd0 tx=0x7fbcb4038470 comp rx=0 tx=0).stop 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 -- 172.21.15.170:0/4232476484 shutdown_connections 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 --2- 172.21.15.170:0/4232476484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca795f10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 -- 172.21.15.170:0/4232476484 >> 172.21.15.170:0/4232476484 conn(0x55b1ca791dc0 msgr2=0x55b1ca78fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 -- 172.21.15.170:0/4232476484 shutdown_connections 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 -- 172.21.15.170:0/4232476484 wait complete. 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 Processor -- start 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 -- start start 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca79cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc7411800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b1ca796bb0 con 0x55b1ca795af0 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca79cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc2b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca79cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41242/0 (socket says 172.21.15.170:41242) 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.165+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 learned_addr learned my addr 172.21.15.170:0/2809891153 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.166+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1ca79d470 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.166+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca79cf30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400ffd0 tx=0x7fbcb4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.166+0000 7fbba4ff9640 1 -- 172.21.15.170:0/2809891153 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4070020 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.166+0000 7fbba4ff9640 1 -- 172.21.15.170:0/2809891153 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb402dad0 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.166+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1ca79d470 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.166+0000 7fbba4ff9640 1 -- 172.21.15.170:0/2809891153 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4067040 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.166+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1ca79d470 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbba4ff9640 1 -- 172.21.15.170:0/2809891153 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbcb4073020 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbba4ff9640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb8c036900 0x7fbb8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbba4ff9640 1 -- 172.21.15.170:0/2809891153 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbcb405e070 con 0x55b1ca795af0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbcc2346640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb8c036900 0x7fbb8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca7a8680 0x55b1ca7aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ab290 con 0x55b1ca7a8680 2024-04-26T12:30:31.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbcc3348640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca7a8680 0x55b1ca7aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbcc2346640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb8c036900 0x7fbb8c038dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8052fd0 tx=0x7fbcb804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.167+0000 7fbcc3348640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca7a8680 0x55b1ca7aab40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 realm 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ab6a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:31.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7abf40 con 0x55b1ca7a8680 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7a8680 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca7ad040 0x55b1ca7af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.168+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7af970 con 0x55b1ca7ad040 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca7ad040 0x55b1ca7af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc2b47640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca7ad040 0x55b1ca7af430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc7411800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:31.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc7411800 20 searching for the correct realm 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b1ca7b19f0 0x55b1ca7b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b4580 con 0x55b1ca7b19f0 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc2346640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b1ca7b19f0 0x55b1ca7b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.169+0000 7fbcc2346640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b1ca7b19f0 0x55b1ca7b3eb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.170+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.170+0000 7fbcc2346640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbcb8076040 0x7fbcb8083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.170+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b4580 con 0x7fbcb8076040 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.170+0000 7fbcc3348640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbcb8076040 0x7fbcb8083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.170+0000 7fbcc3348640 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbcb8076040 0x7fbcb8083410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7ad040 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7a8680 2024-04-26T12:30:31.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7a8680 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.171+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7ad040 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.172+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.172+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7ad040 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.172+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.172+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x7fbcb8076040 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.172+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.172+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7b19f0 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7a8680 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7ad040 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7a8680 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.173+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x7fbcb8076040 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7ac2e0 con 0x55b1ca7b19f0 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7b19f0 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7ad040 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.174+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7b19f0 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7b19f0 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7a8680 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7a8680 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.175+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7ad040 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7b19f0 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x7fbcb8076040 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7a8680 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.176+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7ad040 2024-04-26T12:30:31.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.177+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.177+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7b19f0 2024-04-26T12:30:31.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.177+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.177+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7ad040 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.177+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.177+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x7fbcb8076040 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.177+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.178+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7b19f0 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.178+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.178+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7ad040 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.178+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.178+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x55b1ca7a8680 2024-04-26T12:30:31.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.178+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.178+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fbcb8090040 con 0x7fbcb8076040 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b02f0 con 0x55b1ca7a8680 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b02f0 con 0x55b1ca7a8680 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b02c0 con 0x7fbcb8076040 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 zone default found 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 4 Realm: () 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 zonegroup default 2024-04-26T12:30:31.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.179+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b06e0 con 0x55b1ca7ad040 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b02f0 con 0x55b1ca7b19f0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b63e0 con 0x55b1ca7b19f0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 20 started sync module instance, tier type = 2024-04-26T12:30:31.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.180+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b5880 con 0x7fbcb8076040 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.181+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.181+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94222094654848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b5880 con 0x7fbcb8076040 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.181+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b6da0 con 0x55b1ca7a8680 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.182+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94222094654848] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.183+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.183+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94222094658256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b5880 con 0x55b1ca7a8680 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.183+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b77f0 con 0x55b1ca7b19f0 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.184+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94222094658256] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.184+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.184+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94222094652368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b57f0 con 0x55b1ca7b19f0 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.184+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b86e0 con 0x7fbcb8076040 2024-04-26T12:30:31.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.185+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94222094652368] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.185+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.185+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94222094664240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b8b00 con 0x7fbcb8076040 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.185+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b94c0 con 0x55b1ca7a8680 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.186+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94222094664240] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.186+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.186+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94222094665776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b94c0 con 0x55b1ca7a8680 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.186+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b9e80 con 0x55b1ca7ad040 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.187+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94222094665776] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.187+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.187+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94222094667792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b9430 con 0x55b1ca7ad040 2024-04-26T12:30:31.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.187+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bad40 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.188+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94222094667792] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.188+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.188+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94222094674064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bb160 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.188+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bba30 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94222094674064] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94222094675120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bbc10 con 0x55b1ca7ad040 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 20 add_watcher() i=0 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 20 add_watcher() i=1 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 20 add_watcher() i=2 2024-04-26T12:30:31.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 20 add_watcher() i=3 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 20 add_watcher() i=4 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 20 add_watcher() i=5 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.189+0000 7fbcc7411800 20 add_watcher() i=6 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.190+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94222094675120] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.190+0000 7fbcc7411800 20 add_watcher() i=7 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.190+0000 7fbcc7411800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.190+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7befe0 con 0x55b1ca7a8680 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.190+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.190+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94222094678784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bc3d0 con 0x55b1ca7a8680 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.191+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94222094678784] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.191+0000 7fbb797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.191+0000 7fbcc7411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.191+0000 7fbcc7411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:31.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.191+0000 7fbcc7411800 5 note: GC not initialized 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.191+0000 7fbaf3fff640 20 reqs_thread_entry: start 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.191+0000 7fbcc7411800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.192+0000 7fbcc7411800 20 Filter name: none 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.192+0000 7fbaf1ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.192+0000 7fbcc7411800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.192+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7f20b0 con 0x55b1ca7a8680 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.192+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.192+0000 7fbcc7411800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:31.205 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:31.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.193+0000 7fbb797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.193+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94222094678784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7f0ec0 con 0x55b1ca7a8680 2024-04-26T12:30:31.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.194+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94222094678784] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.194+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94222094654848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bbb00 con 0x7fbcb8076040 2024-04-26T12:30:31.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.195+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94222094654848] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.195+0000 7fbcc7411800 20 remove_watcher() i=0 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.195+0000 7fbcc7411800 2 removed watcher, disabling cache 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.195+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94222094658256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bbb00 con 0x55b1ca7a8680 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.196+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94222094658256] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.196+0000 7fbcc7411800 20 remove_watcher() i=1 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.196+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94222094652368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7bbb00 con 0x55b1ca7b19f0 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.197+0000 7fbcc2346640 1 -- 172.21.15.170:0/2809891153 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94222094652368] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb8081070 con 0x55b1ca7b19f0 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.197+0000 7fbcc7411800 20 remove_watcher() i=2 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.197+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94222094664240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b53d0 con 0x7fbcb8076040 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.198+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94222094664240] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x7fbcb8076040 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.198+0000 7fbcc7411800 20 remove_watcher() i=3 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.198+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94222094665776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b53d0 con 0x55b1ca7a8680 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.199+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94222094665776] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcbc00a4a0 con 0x55b1ca7a8680 2024-04-26T12:30:31.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.199+0000 7fbcc7411800 20 remove_watcher() i=4 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.199+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94222094667792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b8830 con 0x55b1ca7ad040 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.200+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94222094667792] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.200+0000 7fbcc7411800 20 remove_watcher() i=5 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.200+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94222094674064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b53d0 con 0x55b1ca7ad040 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.201+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94222094674064] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.201+0000 7fbcc7411800 20 remove_watcher() i=6 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.201+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94222094675120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b1ca7b9010 con 0x55b1ca7ad040 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc2b47640 1 -- 172.21.15.170:0/2809891153 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94222094675120] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb406a040 con 0x55b1ca7ad040 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 20 remove_watcher() i=7 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca7ad040 msgr2=0x55b1ca7af430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca7ad040 0x55b1ca7af430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca7a8680 msgr2=0x55b1ca7aab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca7a8680 0x55b1ca7aab40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbcb8076040 msgr2=0x7fbcb8083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbcb8076040 0x7fbcb8083410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b1ca7b19f0 msgr2=0x55b1ca7b3eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b1ca7b19f0 0x55b1ca7b3eb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb8c036900 msgr2=0x7fbb8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb8c036900 0x7fbb8c038dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8052fd0 tx=0x7fbcb804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 msgr2=0x55b1ca79cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/2809891153 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca795af0 0x55b1ca79cf30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400ffd0 tx=0x7fbcb4005ef0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 reap_dead start 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc3348640 1 -- 172.21.15.170:0/2809891153 reap_dead start 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 shutdown_connections 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 >> 172.21.15.170:0/2809891153 conn(0x55b1ca791dc0 msgr2=0x55b1ca78f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 shutdown_connections 2024-04-26T12:30:31.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/2809891153 wait complete. 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb9c036900 msgr2=0x7fbb9c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb9c036900 0x7fbb9c038dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55b1ca76e820 tx=0x7fbcb8005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca788ad0 msgr2=0x55b1ca788ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.202+0000 7fbcc7411800 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca788ad0 0x55b1ca788ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbcb404ae10 tx=0x7fbcb4045f80 comp rx=0 tx=0).stop 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 shutdown_connections 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbb9c036900 0x7fbb9c038dc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 --2- 172.21.15.170:0/3882320820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca788ad0 0x55b1ca788ef0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 >> 172.21.15.170:0/3882320820 conn(0x55b1ca77cb70 msgr2=0x55b1ca77cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 shutdown_connections 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/3882320820 wait complete. 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca773bc0 msgr2=0x55b1ca775fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b1ca773bc0 0x55b1ca775fb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca673960 msgr2=0x55b1ca771330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b1ca673960 0x55b1ca771330 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b1ca777b00 msgr2=0x55b1ca779f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b1ca777b00 0x55b1ca779f50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbba8036950 msgr2=0x7fbba8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbba8036950 0x7fbba8038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8054000 tx=0x7fbcb804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 msgr2=0x55b1ca76a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 --2- 172.21.15.170:0/460741347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b1ca66f5c0 0x55b1ca76a2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400b7c0 tx=0x7fbcb4000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc3348640 1 -- 172.21.15.170:0/460741347 reap_dead start 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 shutdown_connections 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 >> 172.21.15.170:0/460741347 conn(0x55b1ca66ab80 msgr2=0x55b1ca75bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 shutdown_connections 2024-04-26T12:30:31.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.203+0000 7fbcc7411800 1 -- 172.21.15.170:0/460741347 wait complete. 2024-04-26T12:30:31.217 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:31.217 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-26T12:30:31.217 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-26T12:30:31.218 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-26T12:30:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.301+0000 7ff28e129800 1 Processor -- start 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.301+0000 7ff28e129800 1 -- start start 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.301+0000 7ff28e129800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55579066e3e0 0x55579066e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.301+0000 7ff28e129800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55579051c0c0 con 0x55579066f640 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.301+0000 7ff28e129800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5557905004d0 con 0x55579066e3e0 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.301+0000 7ff289da7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55579066e3e0 0x55579066e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.302+0000 7ff289da7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55579066e3e0 0x55579066e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41254/0 (socket says 172.21.15.170:41254) 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.302+0000 7ff2895a6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55579066f640 0x55579066fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46020/0 (socket says 172.21.15.170:46020) 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.302+0000 7ff289da7640 1 -- 172.21.15.170:0/1920526907 learned_addr learned my addr 172.21.15.170:0/1920526907 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.302+0000 7ff289da7640 1 -- 172.21.15.170:0/1920526907 >> v1:172.21.15.132:6789/0 conn(0x55579066f640 legacy=0x55579066fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.302+0000 7ff289da7640 1 -- 172.21.15.170:0/1920526907 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579052dd40 con 0x55579066e3e0 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff289da7640 1 --2- 172.21.15.170:0/1920526907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579066e800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff27c005fd0 tx=0x7ff27c01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5739e883d8ba223a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff288da5640 1 -- 172.21.15.170:0/1920526907 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c052540 con 0x55579066e3e0 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff288da5640 1 -- 172.21.15.170:0/1920526907 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c04e070 con 0x55579066e3e0 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff288da5640 1 -- 172.21.15.170:0/1920526907 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c052890 con 0x55579066e3e0 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff28e129800 1 -- 172.21.15.170:0/1920526907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 msgr2=0x55579066e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff28e129800 1 --2- 172.21.15.170:0/1920526907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579066e800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff27c005fd0 tx=0x7ff27c01cd80 comp rx=0 tx=0).stop 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff28e129800 1 -- 172.21.15.170:0/1920526907 shutdown_connections 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff28e129800 1 --2- 172.21.15.170:0/1920526907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579066e800 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff28e129800 1 -- 172.21.15.170:0/1920526907 >> 172.21.15.170:0/1920526907 conn(0x5557906699e0 msgr2=0x55579066be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff28e129800 1 -- 172.21.15.170:0/1920526907 shutdown_connections 2024-04-26T12:30:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.304+0000 7ff28e129800 1 -- 172.21.15.170:0/1920526907 wait complete. 2024-04-26T12:30:31.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.316+0000 7ff28e129800 1 Processor -- start 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.316+0000 7ff28e129800 1 -- start start 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.316+0000 7ff28e129800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x5557905e2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.316+0000 7ff28e129800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5557905bab40 con 0x55579066e3e0 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.316+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x5557905e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.317+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x5557905e2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41260/0 (socket says 172.21.15.170:41260) 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.317+0000 7ff289da7640 1 -- 172.21.15.170:0/1272084051 learned_addr learned my addr 172.21.15.170:0/1272084051 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.317+0000 7ff289da7640 1 -- 172.21.15.170:0/1272084051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579052c590 con 0x55579066e3e0 2024-04-26T12:30:31.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.317+0000 7ff289da7640 1 --2- 172.21.15.170:0/1272084051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x5557905e2650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff27c007000 tx=0x7ff27c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b6679109bc8c91 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.317+0000 7ff177e07640 1 -- 172.21.15.170:0/1272084051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c052860 con 0x55579066e3e0 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.317+0000 7ff177e07640 1 -- 172.21.15.170:0/1272084051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c058040 con 0x55579066e3e0 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.317+0000 7ff177e07640 1 -- 172.21.15.170:0/1272084051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c052b50 con 0x55579066e3e0 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 -- 172.21.15.170:0/1272084051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 msgr2=0x5557905e2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 --2- 172.21.15.170:0/1272084051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x5557905e2650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff27c007000 tx=0x7ff27c04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 -- 172.21.15.170:0/1272084051 shutdown_connections 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 --2- 172.21.15.170:0/1272084051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x5557905e2650 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 -- 172.21.15.170:0/1272084051 >> 172.21.15.170:0/1272084051 conn(0x5557906699e0 msgr2=0x55579075b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 -- 172.21.15.170:0/1272084051 shutdown_connections 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 -- 172.21.15.170:0/1272084051 wait complete. 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 Processor -- start 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 -- start start 2024-04-26T12:30:31.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579076a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.318+0000 7ff28e129800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555790677ab0 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579076a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579076a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41276/0 (socket says 172.21.15.170:41276) 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff289da7640 1 -- 172.21.15.170:0/2748088880 learned_addr learned my addr 172.21.15.170:0/2748088880 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff289da7640 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557905238f0 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff289da7640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579076a550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff27c05f040 tx=0x7ff27c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff176604640 1 -- 172.21.15.170:0/2748088880 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c05d420 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff176604640 1 -- 172.21.15.170:0/2748088880 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c05d5e0 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff176604640 1 -- 172.21.15.170:0/2748088880 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c05d900 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55579076aa90 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.319+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579076afb0 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.320+0000 7ff176604640 1 -- 172.21.15.170:0/2748088880 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff27c050070 con 0x55579066e3e0 2024-04-26T12:30:31.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.320+0000 7ff176604640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff1700369a0 0x7ff170038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.320+0000 7ff176604640 1 -- 172.21.15.170:0/2748088880 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff27c062070 con 0x55579066e3e0 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.320+0000 7ff2895a6640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff1700369a0 0x7ff170038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.320+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55579066f640 0x5557907715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.320+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555790771b00 con 0x55579066f640 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.320+0000 7ff28a5a8640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55579066f640 0x5557907715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.321+0000 7ff2895a6640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff1700369a0 0x7ff170038e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff280000f60 tx=0x7ff280001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.321+0000 7ff28a5a8640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55579066f640 0x5557907715c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.321+0000 7ff28a5a8640 1 -- 172.21.15.170:0/2748088880 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2840083e0 con 0x55579066f640 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.321+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55579076eb70 con 0x55579066f640 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.321+0000 7ff28a5a8640 1 -- 172.21.15.170:0/2748088880 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2840083e0 con 0x55579066f640 2024-04-26T12:30:31.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.321+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555790773df0 0x5557907761e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.321+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907768d0 con 0x555790773df0 2024-04-26T12:30:31.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.322+0000 7ff289da7640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555790773df0 0x5557907761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.322+0000 7ff289da7640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555790773df0 0x5557907761e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.322+0000 7ff289da7640 1 -- 172.21.15.170:0/2748088880 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff27c078070 con 0x555790773df0 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.322+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555790772da0 con 0x55579066f640 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.322+0000 7ff28a5a8640 1 -- 172.21.15.170:0/2748088880 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2840083e0 con 0x55579066f640 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.322+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555790777d80 0x55579077a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.322+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55579077a940 con 0x555790777d80 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.323+0000 7ff2895a6640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555790777d80 0x55579077a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.323+0000 7ff2895a6640 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555790777d80 0x55579077a1b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.323+0000 7ff2895a6640 1 -- 172.21.15.170:0/2748088880 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff28000f690 con 0x555790777d80 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.323+0000 7ff28e129800 1 Processor -- start 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.323+0000 7ff28e129800 1 -- start start 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff28e129800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790788da0 0x5557907891c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff28e129800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555790560e60 con 0x555790788da0 2024-04-26T12:30:31.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790788da0 0x5557907891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790788da0 0x5557907891c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41278/0 (socket says 172.21.15.170:41278) 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff289da7640 1 -- 172.21.15.170:0/700449121 learned_addr learned my addr 172.21.15.170:0/700449121 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff289da7640 1 -- 172.21.15.170:0/700449121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555790789700 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff289da7640 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790788da0 0x5557907891c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff27c08ca00 tx=0x7ff27c064750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff16f7fe640 1 -- 172.21.15.170:0/700449121 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c05daa0 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff16f7fe640 1 -- 172.21.15.170:0/700449121 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c05dc40 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55579078a170 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff16f7fe640 1 -- 172.21.15.170:0/700449121 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c065aa0 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.324+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579078a670 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.325+0000 7ff16f7fe640 1 -- 172.21.15.170:0/700449121 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff27c065c40 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.325+0000 7ff16f7fe640 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff164036950 0x7ff164038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.325+0000 7ff16f7fe640 1 -- 172.21.15.170:0/700449121 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff27c088070 con 0x555790788da0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.325+0000 7ff2895a6640 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff164036950 0x7ff164038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.325+0000 7ff28e129800 1 Processor -- start 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff28e129800 1 -- start start 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff2895a6640 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff164036950 0x7ff164038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x555790771f90 tx=0x7ff28000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff28e129800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x555790796370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff28e129800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555790765c40 con 0x555790795f50 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x555790796370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x555790796370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41292/0 (socket says 172.21.15.170:41292) 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff289da7640 1 -- 172.21.15.170:0/3146483513 learned_addr learned my addr 172.21.15.170:0/3146483513 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff289da7640 1 -- 172.21.15.170:0/3146483513 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555790796940 con 0x555790795f50 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff289da7640 1 --2- 172.21.15.170:0/3146483513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x555790796370 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff27c094ff0 tx=0x7ff27c0719d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e853fb84248dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff16d7fa640 1 -- 172.21.15.170:0/3146483513 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c087410 con 0x555790795f50 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff16d7fa640 1 -- 172.21.15.170:0/3146483513 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c0a0030 con 0x555790795f50 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.326+0000 7ff16d7fa640 1 -- 172.21.15.170:0/3146483513 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c071420 con 0x555790795f50 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 -- 172.21.15.170:0/3146483513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 msgr2=0x555790796370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 --2- 172.21.15.170:0/3146483513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x555790796370 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff27c094ff0 tx=0x7ff27c0719d0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 -- 172.21.15.170:0/3146483513 shutdown_connections 2024-04-26T12:30:31.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 --2- 172.21.15.170:0/3146483513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x555790796370 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 -- 172.21.15.170:0/3146483513 >> 172.21.15.170:0/3146483513 conn(0x555790792260 msgr2=0x5557907902c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 -- 172.21.15.170:0/3146483513 shutdown_connections 2024-04-26T12:30:31.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 -- 172.21.15.170:0/3146483513 wait complete. 2024-04-26T12:30:31.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 Processor -- start 2024-04-26T12:30:31.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 -- start start 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x55579079d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff28e129800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555790796fd0 con 0x555790795f50 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x55579079d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff289da7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x55579079d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41308/0 (socket says 172.21.15.170:41308) 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.327+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 learned_addr learned my addr 172.21.15.170:0/141029126 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.328+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579079d8a0 con 0x555790795f50 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.328+0000 7ff289da7640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x55579079d360 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff27c071eb0 tx=0x7ff27c06ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.328+0000 7ff15b7fe640 1 -- 172.21.15.170:0/141029126 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c0b5070 con 0x555790795f50 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.328+0000 7ff15b7fe640 1 -- 172.21.15.170:0/141029126 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c08e260 con 0x555790795f50 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.328+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55579079d8a0 con 0x555790795f50 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.328+0000 7ff15b7fe640 1 -- 172.21.15.170:0/141029126 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff27c071b10 con 0x555790795f50 2024-04-26T12:30:31.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.328+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579079d8a0 con 0x555790795f50 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff15b7fe640 1 -- 172.21.15.170:0/141029126 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff27c0b8070 con 0x555790795f50 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff15b7fe640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff154036950 0x7ff154038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff15b7fe640 1 -- 172.21.15.170:0/141029126 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff27c0ad070 con 0x555790795f50 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff2895a6640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff154036950 0x7ff154038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff2895a6640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff154036950 0x7ff154038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55579077ad40 tx=0x7ff280010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5557907a8850 0x5557907aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.329+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907ab460 con 0x5557907a8850 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28a5a8640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5557907a8850 0x5557907aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28a5a8640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5557907a8850 0x5557907aad10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2840083e0 con 0x5557907a8850 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 20 realm 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907ab870 con 0x5557907a8850 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2840083e0 con 0x5557907a8850 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2840083e0 con 0x5557907a8850 2024-04-26T12:30:31.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.330+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac4e0 con 0x5557907a8850 2024-04-26T12:30:31.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.331+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2840083e0 con 0x5557907a8850 2024-04-26T12:30:31.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.331+0000 7ff28e129800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.331+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.331+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5557907acea0 0x5557907af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.331+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907af8e0 con 0x5557907acea0 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.331+0000 7ff289da7640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5557907acea0 0x5557907af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.331+0000 7ff289da7640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5557907acea0 0x5557907af290 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.332+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.332+0000 7ff28e129800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.332+0000 7ff28e129800 20 searching for the correct realm 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.332+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5557907b1850 0x5557907b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.332+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907b43e0 con 0x5557907b1850 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.332+0000 7ff2895a6640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5557907b1850 0x5557907b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.332+0000 7ff2895a6640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5557907b1850 0x5557907b3d10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.333+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.333+0000 7ff2895a6640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff28000f070 0x7ff28002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.333+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907b43e0 con 0x7ff28000f070 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.333+0000 7ff28a5a8640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff28000f070 0x7ff28002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.333+0000 7ff28a5a8640 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff28000f070 0x7ff28002e910 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.333+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff2840083e0 con 0x7ff28000f070 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.333+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2840083e0 con 0x5557907a8850 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.334+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x7ff28000f070 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.335+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x7ff28000f070 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.336+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.337+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.338+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x7ff28000f070 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.339+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x7ff28000f070 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907b1850 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907acea0 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.340+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x5557907a8850 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5557907ac140 con 0x7ff28000f070 2024-04-26T12:30:31.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907afc80 con 0x5557907a8850 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.341+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907afc80 con 0x5557907a8850 2024-04-26T12:30:31.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907afc80 con 0x7ff28000f070 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 zone default found 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 4 Realm: () 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 zonegroup default 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907b0520 con 0x5557907acea0 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.342+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907b6240 con 0x5557907b1850 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff28e129800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907b65e0 con 0x5557907b1850 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff28e129800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff28e129800 20 started sync module instance, tier type = 2024-04-26T12:30:31.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff28e129800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:31.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.343+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b56e0 con 0x7ff28000f070 2024-04-26T12:30:31.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.344+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.344+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93834574519344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b56e0 con 0x7ff28000f070 2024-04-26T12:30:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.344+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b6fa0 con 0x5557907a8850 2024-04-26T12:30:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.345+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93834574519344] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.346+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.346+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93834574523600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b56e0 con 0x5557907a8850 2024-04-26T12:30:31.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.346+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b79f0 con 0x5557907b1850 2024-04-26T12:30:31.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.347+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.347+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93834574523600] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.347+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93834574525696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b8290 con 0x5557907b1850 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.347+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b5230 con 0x7ff28000f070 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.347+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93834574525696] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.348+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.348+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93834574527968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b8cd0 con 0x7ff28000f070 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.348+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b9580 con 0x5557907a8850 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.349+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93834574527968] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.349+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.349+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93834574530592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b90f0 con 0x5557907a8850 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.349+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b9f90 con 0x5557907acea0 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.350+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.350+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93834574535392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907ba830 con 0x5557907acea0 2024-04-26T12:30:31.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.350+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907bb290 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.350+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93834574530592] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.351+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93834574535392] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.351+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.351+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93834574531648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907ba330 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.351+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907bbb30 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93834574531648] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93834574540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907ba330 con 0x5557907acea0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 20 add_watcher() i=0 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 20 add_watcher() i=1 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 20 add_watcher() i=2 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 20 add_watcher() i=3 2024-04-26T12:30:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 20 add_watcher() i=4 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 20 add_watcher() i=5 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.352+0000 7ff28e129800 20 add_watcher() i=6 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.353+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93834574540144] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.353+0000 7ff28e129800 20 add_watcher() i=7 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.353+0000 7ff28e129800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.353+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907beba0 con 0x5557907a8850 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.353+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.353+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93834574542240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907bc060 con 0x5557907a8850 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.354+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93834574542240] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.354+0000 7ff13b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.354+0000 7ff28e129800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.354+0000 7ff28e129800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.354+0000 7ff28e129800 5 note: GC not initialized 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff13a7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 20 Filter name: none 2024-04-26T12:30:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff0abfff640 20 reqs_thread_entry: start 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907f22a0 con 0x5557907a8850 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.355+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907f4d30 con 0x7ff28000f070 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.356+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.356+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907f84b0 con 0x5557907a8850 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28e129800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28e129800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28e129800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93834574790400 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5557907f7020 con 0x5557907a8850 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 93834574530592 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7ff284010040 con 0x5557907a8850 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff16d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 93834574530592 notifier 4320 bl.length()=567 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff16d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff16d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff16d7fa640 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff14c003ea0 con 0x5557907a8850 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(65 notify.4 [notify cookie 93834574790400 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.357+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 93834574790400 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff28400a730 con 0x5557907a8850 2024-04-26T12:30:31.379 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.358+0000 7ff13b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.358+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93834574542240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907f7020 con 0x5557907a8850 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.359+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93834574542240] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.359+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93834574519344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907f7020 con 0x7ff28000f070 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.360+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93834574519344] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.360+0000 7ff28e129800 20 remove_watcher() i=0 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.360+0000 7ff28e129800 2 removed watcher, disabling cache 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.360+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93834574523600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907f7020 con 0x5557907a8850 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.361+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93834574523600] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.361+0000 7ff28e129800 20 remove_watcher() i=1 2024-04-26T12:30:31.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.361+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93834574525696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907f7020 con 0x5557907b1850 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.362+0000 7ff2895a6640 1 -- 172.21.15.170:0/141029126 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93834574525696] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff280037040 con 0x5557907b1850 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.362+0000 7ff28e129800 20 remove_watcher() i=2 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.362+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93834574527968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b6cd0 con 0x7ff28000f070 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.363+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93834574527968] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x7ff28000f070 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.363+0000 7ff28e129800 20 remove_watcher() i=3 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.363+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93834574530592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b7500 con 0x5557907a8850 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.364+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93834574530592] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff284026040 con 0x5557907a8850 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.364+0000 7ff28e129800 20 remove_watcher() i=4 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.364+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93834574535392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b6cd0 con 0x5557907acea0 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.365+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93834574535392] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.365+0000 7ff28e129800 20 remove_watcher() i=5 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.365+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93834574531648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b8820 con 0x5557907acea0 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.366+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93834574531648] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.366+0000 7ff28e129800 20 remove_watcher() i=6 2024-04-26T12:30:31.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.366+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93834574540144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5557907b7500 con 0x5557907acea0 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff289da7640 1 -- 172.21.15.170:0/141029126 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93834574540144] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff27c0b7030 con 0x5557907acea0 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 20 remove_watcher() i=7 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5557907acea0 msgr2=0x5557907af290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5557907acea0 0x5557907af290 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5557907a8850 msgr2=0x5557907aad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5557907a8850 0x5557907aad10 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff28000f070 msgr2=0x7ff28002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff28000f070 0x7ff28002e910 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5557907b1850 msgr2=0x5557907b3d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.367+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5557907b1850 0x5557907b3d10 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff154036950 msgr2=0x7ff154038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff154036950 0x7ff154038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55579077ad40 tx=0x7ff280010000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 msgr2=0x55579079d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28a5a8640 1 -- 172.21.15.170:0/141029126 reap_dead start 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x55579079d360 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff27c071eb0 tx=0x7ff27c06ef10 comp rx=0 tx=0).stop 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 shutdown_connections 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/141029126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790795f50 0x55579079d360 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 >> 172.21.15.170:0/141029126 conn(0x555790792260 msgr2=0x55579078f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 shutdown_connections 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/141029126 wait complete. 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff164036950 msgr2=0x7ff164038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff164036950 0x7ff164038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x555790771f90 tx=0x7ff28000f000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790788da0 msgr2=0x5557907891c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790788da0 0x5557907891c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff27c08ca00 tx=0x7ff27c064750 comp rx=0 tx=0).stop 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 shutdown_connections 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff164036950 0x7ff164038e10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/700449121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555790788da0 0x5557907891c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 >> 172.21.15.170:0/700449121 conn(0x55579077ce40 msgr2=0x55579077d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 shutdown_connections 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/700449121 wait complete. 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555790773df0 msgr2=0x5557907761e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555790773df0 0x5557907761e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55579066f640 msgr2=0x5557907715c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55579066f640 0x5557907715c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555790777d80 msgr2=0x55579077a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555790777d80 0x55579077a1b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff1700369a0 msgr2=0x7ff170038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff1700369a0 0x7ff170038e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff280000f60 tx=0x7ff280001370 comp rx=0 tx=0).stop 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 msgr2=0x55579076a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28e129800 1 --2- 172.21.15.170:0/2748088880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55579066e3e0 0x55579076a550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff27c05f040 tx=0x7ff27c003330 comp rx=0 tx=0).stop 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.368+0000 7ff28a5a8640 1 -- 172.21.15.170:0/2748088880 reap_dead start 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.369+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 shutdown_connections 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.369+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 >> 172.21.15.170:0/2748088880 conn(0x5557906699e0 msgr2=0x555790759b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.369+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 shutdown_connections 2024-04-26T12:30:31.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.369+0000 7ff28e129800 1 -- 172.21.15.170:0/2748088880 wait complete. 2024-04-26T12:30:31.390 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:31.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:31.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:31.390 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:31.467 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:31.467 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.467+0000 7fd30f614800 1 Processor -- start 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.467+0000 7fd30f614800 1 -- start start 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.467+0000 7fd30f614800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55acb331d500 0x55acb331d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.467+0000 7fd30f614800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acb31ca0c0 con 0x55acb331e760 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.467+0000 7fd30f614800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55acb31ae4d0 con 0x55acb331d500 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.468+0000 7fd30ac7d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55acb331d500 0x55acb331d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.468+0000 7fd30247c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55acb331e760 0x55acb331ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46024/0 (socket says 172.21.15.170:46024) 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.468+0000 7fd30ac7d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55acb331d500 0x55acb331d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41320/0 (socket says 172.21.15.170:41320) 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.468+0000 7fd30247c640 1 -- 172.21.15.170:0/1045141277 learned_addr learned my addr 172.21.15.170:0/1045141277 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.468+0000 7fd30ac7d640 1 -- 172.21.15.170:0/1045141277 >> v1:172.21.15.132:6789/0 conn(0x55acb331e760 legacy=0x55acb331ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.468+0000 7fd30ac7d640 1 -- 172.21.15.170:0/1045141277 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb31dbd40 con 0x55acb331d500 2024-04-26T12:30:31.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/1045141277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb331d920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00a470 tx=0x7fd2fc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce5c3102d3c9609 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30a47c640 1 -- 172.21.15.170:0/1045141277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc057070 con 0x55acb331d500 2024-04-26T12:30:31.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30a47c640 1 -- 172.21.15.170:0/1045141277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc052570 con 0x55acb331d500 2024-04-26T12:30:31.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30a47c640 1 -- 172.21.15.170:0/1045141277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc052870 con 0x55acb331d500 2024-04-26T12:30:31.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30f614800 1 -- 172.21.15.170:0/1045141277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 msgr2=0x55acb331d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30f614800 1 --2- 172.21.15.170:0/1045141277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb331d920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00a470 tx=0x7fd2fc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:31.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30f614800 1 -- 172.21.15.170:0/1045141277 shutdown_connections 2024-04-26T12:30:31.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30f614800 1 --2- 172.21.15.170:0/1045141277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb331d920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30f614800 1 -- 172.21.15.170:0/1045141277 >> 172.21.15.170:0/1045141277 conn(0x55acb3318b00 msgr2=0x55acb331af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30f614800 1 -- 172.21.15.170:0/1045141277 shutdown_connections 2024-04-26T12:30:31.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.470+0000 7fd30f614800 1 -- 172.21.15.170:0/1045141277 wait complete. 2024-04-26T12:30:31.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.482+0000 7fd30f614800 1 Processor -- start 2024-04-26T12:30:31.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.482+0000 7fd30f614800 1 -- start start 2024-04-26T12:30:31.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.482+0000 7fd30f614800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb340ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.482+0000 7fd30f614800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55acb3268b40 con 0x55acb331d500 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.482+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb340ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.483+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb340ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41330/0 (socket says 172.21.15.170:41330) 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.483+0000 7fd30ac7d640 1 -- 172.21.15.170:0/75709383 learned_addr learned my addr 172.21.15.170:0/75709383 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.483+0000 7fd30ac7d640 1 -- 172.21.15.170:0/75709383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb31da590 con 0x55acb331d500 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.483+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/75709383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb340ebb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc055040 tx=0x7fd2fc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bd233091b22e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.483+0000 7fd1f8e09640 1 -- 172.21.15.170:0/75709383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc057070 con 0x55acb331d500 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.483+0000 7fd1f8e09640 1 -- 172.21.15.170:0/75709383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc063070 con 0x55acb331d500 2024-04-26T12:30:31.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.483+0000 7fd1f8e09640 1 -- 172.21.15.170:0/75709383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc052720 con 0x55acb331d500 2024-04-26T12:30:31.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 -- 172.21.15.170:0/75709383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 msgr2=0x55acb340ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 --2- 172.21.15.170:0/75709383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb340ebb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc055040 tx=0x7fd2fc04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 -- 172.21.15.170:0/75709383 shutdown_connections 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 --2- 172.21.15.170:0/75709383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb340ebb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 -- 172.21.15.170:0/75709383 >> 172.21.15.170:0/75709383 conn(0x55acb3318b00 msgr2=0x55acb340a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 -- 172.21.15.170:0/75709383 shutdown_connections 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 -- 172.21.15.170:0/75709383 wait complete. 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 Processor -- start 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 -- start start 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb3416460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.484+0000 7fd30f614800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55acb3326bd0 con 0x55acb331d500 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb3416460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb3416460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41336/0 (socket says 172.21.15.170:41336) 2024-04-26T12:30:31.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd30ac7d640 1 -- 172.21.15.170:0/432224546 learned_addr learned my addr 172.21.15.170:0/432224546 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd30ac7d640 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb31d18f0 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb3416460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc060040 tx=0x7fd2fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd1f7606640 1 -- 172.21.15.170:0/432224546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc052c70 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acb34169a0 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd1f7606640 1 -- 172.21.15.170:0/432224546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc06c070 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd1f7606640 1 -- 172.21.15.170:0/432224546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc05e480 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.485+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acb3416f20 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.486+0000 7fd1f7606640 1 -- 172.21.15.170:0/432224546 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd2fc05e620 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.486+0000 7fd1f7606640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1f0036900 0x7fd1f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.486+0000 7fd1f7606640 1 -- 172.21.15.170:0/432224546 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd2fc08e680 con 0x55acb331d500 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.486+0000 7fd30247c640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1f0036900 0x7fd1f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.486+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb331e760 0x55acb341d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.486+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb341da10 con 0x55acb331e760 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30b47e640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb331e760 0x55acb341d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30247c640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1f0036900 0x7fd1f0038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4000f60 tx=0x7fd2f40012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30b47e640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb331e760 0x55acb341d4d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30b47e640 1 -- 172.21.15.170:0/432224546 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb331e760 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb341aaa0 con 0x55acb331e760 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30b47e640 1 -- 172.21.15.170:0/432224546 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb331e760 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb341fd20 0x55acb3422110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.487+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb34227b0 con 0x55acb341fd20 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.488+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb341fd20 0x55acb3422110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.488+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb341fd20 0x55acb3422110 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.488+0000 7fd30ac7d640 1 -- 172.21.15.170:0/432224546 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb341fd20 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.488+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb341ecd0 con 0x55acb331e760 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.489+0000 7fd30b47e640 1 -- 172.21.15.170:0/432224546 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb331e760 2024-04-26T12:30:31.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.489+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55acb3423c60 0x55acb34260b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.489+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb3426810 con 0x55acb3423c60 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.489+0000 7fd30247c640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55acb3423c60 0x55acb34260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.489+0000 7fd30247c640 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55acb3423c60 0x55acb34260b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.489+0000 7fd30247c640 1 -- 172.21.15.170:0/432224546 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb3423c60 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30f614800 1 Processor -- start 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30f614800 1 -- start start 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30f614800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb32929b0 0x55acb3290e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30f614800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55acb320ee60 con 0x55acb32929b0 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb32929b0 0x55acb3290e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb32929b0 0x55acb3290e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41350/0 (socket says 172.21.15.170:41350) 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30ac7d640 1 -- 172.21.15.170:0/1256979396 learned_addr learned my addr 172.21.15.170:0/1256979396 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30ac7d640 1 -- 172.21.15.170:0/1256979396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb3291360 con 0x55acb32929b0 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.490+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb32929b0 0x55acb3290e20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc08caa0 tx=0x7fd2fc009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.491+0000 7fd1f4e01640 1 -- 172.21.15.170:0/1256979396 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc092020 con 0x55acb32929b0 2024-04-26T12:30:31.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.491+0000 7fd1f4e01640 1 -- 172.21.15.170:0/1256979396 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc058040 con 0x55acb32929b0 2024-04-26T12:30:31.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.491+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acb3291590 con 0x55acb32929b0 2024-04-26T12:30:31.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.491+0000 7fd1f4e01640 1 -- 172.21.15.170:0/1256979396 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc009a30 con 0x55acb32929b0 2024-04-26T12:30:31.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.491+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acb3291a90 con 0x55acb32929b0 2024-04-26T12:30:31.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.491+0000 7fd1f4e01640 1 -- 172.21.15.170:0/1256979396 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd2fc095020 con 0x55acb32929b0 2024-04-26T12:30:31.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.491+0000 7fd1f4e01640 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1e4036950 0x7fd1e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd1f4e01640 1 -- 172.21.15.170:0/1256979396 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd2fc098ca0 con 0x55acb32929b0 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30247c640 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1e4036950 0x7fd1e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30f614800 1 Processor -- start 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30f614800 1 -- start start 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30247c640 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1e4036950 0x7fd1e4038e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400bf50 tx=0x7fd2f400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30f614800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb3444440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30f614800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55acb340f270 con 0x55acb3444020 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb3444440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb3444440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41356/0 (socket says 172.21.15.170:41356) 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30ac7d640 1 -- 172.21.15.170:0/3616854392 learned_addr learned my addr 172.21.15.170:0/3616854392 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.492+0000 7fd30ac7d640 1 -- 172.21.15.170:0/3616854392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb3444a10 con 0x55acb3444020 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/3616854392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb3444440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009720 tx=0x7fd2fc05ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77b68f1106261a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd1ee7fc640 1 -- 172.21.15.170:0/3616854392 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc004e90 con 0x55acb3444020 2024-04-26T12:30:31.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd1ee7fc640 1 -- 172.21.15.170:0/3616854392 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc002a20 con 0x55acb3444020 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd1ee7fc640 1 -- 172.21.15.170:0/3616854392 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc074120 con 0x55acb3444020 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 -- 172.21.15.170:0/3616854392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 msgr2=0x55acb3444440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 --2- 172.21.15.170:0/3616854392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb3444440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009720 tx=0x7fd2fc05ec20 comp rx=0 tx=0).stop 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 -- 172.21.15.170:0/3616854392 shutdown_connections 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 --2- 172.21.15.170:0/3616854392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb3444440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 -- 172.21.15.170:0/3616854392 >> 172.21.15.170:0/3616854392 conn(0x55acb34402f0 msgr2=0x55acb343e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 -- 172.21.15.170:0/3616854392 shutdown_connections 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 -- 172.21.15.170:0/3616854392 wait complete. 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.493+0000 7fd30f614800 1 Processor -- start 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30f614800 1 -- start start 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30f614800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb344b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30f614800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55acb3445070 con 0x55acb3444020 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb344b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30ac7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb344b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41370/0 (socket says 172.21.15.170:41370) 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 learned_addr learned my addr 172.21.15.170:0/4186753981 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb344b7e0 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb344b2a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009bd0 tx=0x7fd2fc090460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd1ecff9640 1 -- 172.21.15.170:0/4186753981 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc074730 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.494+0000 7fd1ecff9640 1 -- 172.21.15.170:0/4186753981 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc084930 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.495+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acb344b7e0 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.495+0000 7fd1ecff9640 1 -- 172.21.15.170:0/4186753981 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc084c30 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.495+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acb344b7e0 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.495+0000 7fd1ecff9640 1 -- 172.21.15.170:0/4186753981 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd2fc0bd030 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.495+0000 7fd1ecff9640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1d4036950 0x7fd1d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.495+0000 7fd1ecff9640 1 -- 172.21.15.170:0/4186753981 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd2fc0bb070 con 0x55acb3444020 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30247c640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1d4036950 0x7fd1d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb3456960 0x55acb3458e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb3459570 con 0x55acb3456960 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30b47e640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb3456960 0x55acb3458e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30247c640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1d4036950 0x7fd1d4038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4001b60 tx=0x7fd2f4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30b47e640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb3456960 0x55acb3458e20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30f614800 20 realm 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.496+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb3459980 con 0x55acb3456960 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a250 con 0x55acb3456960 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb345b0e0 0x55acb345d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345dc30 con 0x55acb345b0e0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb345b0e0 0x55acb345d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.497+0000 7fd30ac7d640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb345b0e0 0x55acb345d4d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.498+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.498+0000 7fd30f614800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.498+0000 7fd30f614800 20 searching for the correct realm 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.498+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55acb345fce0 0x55acb34621a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.498+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb3462870 con 0x55acb345fce0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.498+0000 7fd30247c640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55acb345fce0 0x55acb34621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.498+0000 7fd30247c640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55acb345fce0 0x55acb34621a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.499+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.499+0000 7fd30247c640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd2f4038040 0x7fd2f401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.499+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb3462870 con 0x7fd2f4038040 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.499+0000 7fd30b47e640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd2f4038040 0x7fd2f401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.499+0000 7fd30b47e640 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd2f4038040 0x7fd2f401bab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.499+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.499+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.500+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x7fd2f4038040 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.501+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x7fd2f4038040 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.502+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.503+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.503+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.503+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.503+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.503+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.503+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.503+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.504+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.504+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.504+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.504+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.504+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.504+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.504+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x7fd2f4038040 2024-04-26T12:30:31.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.505+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x7fd2f4038040 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345fce0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb345b0e0 2024-04-26T12:30:31.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.506+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x55acb3456960 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55acb345a5f0 con 0x7fd2f4038040 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345e5e0 con 0x55acb3456960 2024-04-26T12:30:31.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345e5e0 con 0x55acb3456960 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.507+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345e5b0 con 0x7fd2f4038040 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 zone default found 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 4 Realm: () 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:31.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 zonegroup default 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345e9d0 con 0x55acb345b0e0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb345e5e0 con 0x55acb345fce0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.508+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb34646d0 con 0x55acb345fce0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.509+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.509+0000 7fd30f614800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.509+0000 7fd30f614800 20 started sync module instance, tier type = 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.509+0000 7fd30f614800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.509+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3463b70 con 0x7fd2f4038040 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.510+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.510+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200230461584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3463b70 con 0x7fd2f4038040 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.510+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb34650f0 con 0x55acb3456960 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.511+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200230461584] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.511+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.511+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200230464480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3463b70 con 0x55acb3456960 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.511+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3465b80 con 0x55acb345fce0 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.512+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200230464480] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.512+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.512+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200230459072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3463ae0 con 0x55acb345fce0 2024-04-26T12:30:31.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.512+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3466a40 con 0x7fd2f4038040 2024-04-26T12:30:31.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.513+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.513+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200230459072] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.513+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200230471056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3466e60 con 0x7fd2f4038040 2024-04-26T12:30:31.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.513+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3467730 con 0x55acb3456960 2024-04-26T12:30:31.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.514+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.514+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200230473312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3467280 con 0x55acb3456960 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.514+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb34686b0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.514+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200230471056] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.515+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200230473312] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.515+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.515+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200230476576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb34669b0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.515+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3468f80 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.516+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200230476576] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.516+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.516+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200230478272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb34697d0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.516+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb346a0a0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200230478272] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200230482720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb346a280 con 0x55acb345b0e0 2024-04-26T12:30:31.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 20 add_watcher() i=0 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 20 add_watcher() i=1 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 20 add_watcher() i=2 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 20 add_watcher() i=3 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 20 add_watcher() i=4 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 20 add_watcher() i=5 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.517+0000 7fd30f614800 20 add_watcher() i=6 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.518+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200230482720] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.518+0000 7fd30f614800 20 add_watcher() i=7 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.518+0000 7fd30f614800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.518+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb346d650 con 0x55acb3456960 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.518+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.518+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200230486384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb346aa40 con 0x55acb3456960 2024-04-26T12:30:31.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.519+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200230486384] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.519+0000 7fd1c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.519+0000 7fd30f614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.519+0000 7fd30f614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.519+0000 7fd30f614800 5 note: GC not initialized 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd13bfff640 20 reqs_thread_entry: start 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd30f614800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd30f614800 20 Filter name: none 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd139ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd30f614800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55acb34a0780 con 0x55acb3456960 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.520+0000 7fd30f614800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:31.536 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.521+0000 7fd1c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.521+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200230486384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb349f590 con 0x55acb3456960 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.522+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94200230486384] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.522+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200230461584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb346a170 con 0x7fd2f4038040 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.523+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94200230461584] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.523+0000 7fd30f614800 20 remove_watcher() i=0 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.523+0000 7fd30f614800 2 removed watcher, disabling cache 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.523+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200230464480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb346a170 con 0x55acb3456960 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.524+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94200230464480] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.524+0000 7fd30f614800 20 remove_watcher() i=1 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.524+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200230459072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb346a170 con 0x55acb345fce0 2024-04-26T12:30:31.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.525+0000 7fd30247c640 1 -- 172.21.15.170:0/4186753981 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94200230459072] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2f4009050 con 0x55acb345fce0 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.525+0000 7fd30f614800 20 remove_watcher() i=2 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.525+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200230471056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb34636c0 con 0x7fd2f4038040 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.526+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94200230471056] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x7fd2f4038040 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.526+0000 7fd30f614800 20 remove_watcher() i=3 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.526+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200230473312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb34636c0 con 0x55acb3456960 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.527+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94200230473312] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30400a4a0 con 0x55acb3456960 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.527+0000 7fd30f614800 20 remove_watcher() i=4 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.527+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200230476576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3466e60 con 0x55acb345b0e0 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.528+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94200230476576] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.528+0000 7fd30f614800 20 remove_watcher() i=5 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.528+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200230478272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb34636c0 con 0x55acb345b0e0 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.529+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94200230478272] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.529+0000 7fd30f614800 20 remove_watcher() i=6 2024-04-26T12:30:31.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.529+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200230482720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55acb3467b20 con 0x55acb345b0e0 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30ac7d640 1 -- 172.21.15.170:0/4186753981 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94200230482720] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2fc0717f0 con 0x55acb345b0e0 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 20 remove_watcher() i=7 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb345b0e0 msgr2=0x55acb345d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb345b0e0 0x55acb345d4d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb3456960 msgr2=0x55acb3458e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb3456960 0x55acb3458e20 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd2f4038040 msgr2=0x7fd2f401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd2f4038040 0x7fd2f401bab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55acb345fce0 msgr2=0x55acb34621a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55acb345fce0 0x55acb34621a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1d4036950 msgr2=0x7fd1d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1d4036950 0x7fd1d4038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4001b60 tx=0x7fd2f4010000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 msgr2=0x55acb344b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30b47e640 1 -- 172.21.15.170:0/4186753981 reap_dead start 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb344b2a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009bd0 tx=0x7fd2fc090460 comp rx=0 tx=0).stop 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 shutdown_connections 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/4186753981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb3444020 0x55acb344b2a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 >> 172.21.15.170:0/4186753981 conn(0x55acb34402f0 msgr2=0x55acb343d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 shutdown_connections 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/4186753981 wait complete. 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1e4036950 msgr2=0x7fd1e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.530+0000 7fd30f614800 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1e4036950 0x7fd1e4038e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400bf50 tx=0x7fd2f400f000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb32929b0 msgr2=0x55acb3290e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb32929b0 0x55acb3290e20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc08caa0 tx=0x7fd2fc009550 comp rx=0 tx=0).stop 2024-04-26T12:30:31.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 shutdown_connections 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1e4036950 0x7fd1e4038e10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/1256979396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb32929b0 0x55acb3290e20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 >> 172.21.15.170:0/1256979396 conn(0x55acb3428d10 msgr2=0x55acb3429110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 shutdown_connections 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/1256979396 wait complete. 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb341fd20 msgr2=0x55acb3422110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55acb341fd20 0x55acb3422110 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb331e760 msgr2=0x55acb341d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55acb331e760 0x55acb341d4d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55acb3423c60 msgr2=0x55acb34260b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55acb3423c60 0x55acb34260b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1f0036900 msgr2=0x7fd1f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd1f0036900 0x7fd1f0038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4000f60 tx=0x7fd2f40012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 msgr2=0x55acb3416460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 --2- 172.21.15.170:0/432224546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55acb331d500 0x55acb3416460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc060040 tx=0x7fd2fc002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30b47e640 1 -- 172.21.15.170:0/432224546 reap_dead start 2024-04-26T12:30:31.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 shutdown_connections 2024-04-26T12:30:31.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 >> 172.21.15.170:0/432224546 conn(0x55acb3318b00 msgr2=0x55acb340d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 shutdown_connections 2024-04-26T12:30:31.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.531+0000 7fd30f614800 1 -- 172.21.15.170:0/432224546 wait complete. 2024-04-26T12:30:31.547 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:31.547 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-26T12:30:31.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-26T12:30:31.548 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-26T12:30:31.624 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:31.625 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.624+0000 7fbf41e2f800 1 Processor -- start 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.624+0000 7fbf41e2f800 1 -- start start 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.624+0000 7fbf41e2f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a7226d9970 0x55a7226e2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.624+0000 7fbf41e2f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a7225860c0 con 0x55a7226d7e30 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.624+0000 7fbf41e2f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55a72256a4d0 con 0x55a7226d9970 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.625+0000 7fbf3c7c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a7226d9970 0x55a7226e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.625+0000 7fbf3c7c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a7226d9970 0x55a7226e2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41372/0 (socket says 172.21.15.170:41372) 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.625+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/2170471632 learned_addr learned my addr 172.21.15.170:0/2170471632 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.625+0000 7fbf3cfca640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55a7226d7e30 0x55a7226d8250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46040/0 (socket says 172.21.15.170:46040) 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.625+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/2170471632 >> v1:172.21.15.132:6789/0 conn(0x55a7226d7e30 legacy=0x55a7226d8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.625+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/2170471632 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a722597d40 con 0x55a7226d9970 2024-04-26T12:30:31.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/2170471632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d9970 0x55a7226e2470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000a520 tx=0x7fbf3001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307039bdedfd9fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf3bfc8640 1 -- 172.21.15.170:0/2170471632 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf30057070 con 0x55a7226d9970 2024-04-26T12:30:31.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf3bfc8640 1 -- 172.21.15.170:0/2170471632 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf30052440 con 0x55a7226d9970 2024-04-26T12:30:31.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf3bfc8640 1 -- 172.21.15.170:0/2170471632 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3004ae60 con 0x55a7226d9970 2024-04-26T12:30:31.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf41e2f800 1 -- 172.21.15.170:0/2170471632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d9970 msgr2=0x55a7226e2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/2170471632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d9970 0x55a7226e2470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000a520 tx=0x7fbf3001d010 comp rx=0 tx=0).stop 2024-04-26T12:30:31.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf41e2f800 1 -- 172.21.15.170:0/2170471632 shutdown_connections 2024-04-26T12:30:31.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/2170471632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d9970 0x55a7226e2470 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.627+0000 7fbf41e2f800 1 -- 172.21.15.170:0/2170471632 >> 172.21.15.170:0/2170471632 conn(0x55a7226d3990 msgr2=0x55a7226d5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.628+0000 7fbf41e2f800 1 -- 172.21.15.170:0/2170471632 shutdown_connections 2024-04-26T12:30:31.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.628+0000 7fbf41e2f800 1 -- 172.21.15.170:0/2170471632 wait complete. 2024-04-26T12:30:31.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.639+0000 7fbf41e2f800 1 Processor -- start 2024-04-26T12:30:31.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.639+0000 7fbf41e2f800 1 -- start start 2024-04-26T12:30:31.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.639+0000 7fbf41e2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbf41e2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a722624b40 con 0x55a7226d7e30 2024-04-26T12:30:31.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41386/0 (socket says 172.21.15.170:41386) 2024-04-26T12:30:31.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbf3cfca640 1 -- 172.21.15.170:0/3223117511 learned_addr learned my addr 172.21.15.170:0/3223117511 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbf3cfca640 1 -- 172.21.15.170:0/3223117511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a722596590 con 0x55a7226d7e30 2024-04-26T12:30:31.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/3223117511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227ccb40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c001e90 tx=0x7fbf2c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfae2e978a6863 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbe2ae0d640 1 -- 172.21.15.170:0/3223117511 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c00e5c0 con 0x55a7226d7e30 2024-04-26T12:30:31.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbe2ae0d640 1 -- 172.21.15.170:0/3223117511 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c006070 con 0x55a7226d7e30 2024-04-26T12:30:31.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.640+0000 7fbe2ae0d640 1 -- 172.21.15.170:0/3223117511 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c00e890 con 0x55a7226d7e30 2024-04-26T12:30:31.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 -- 172.21.15.170:0/3223117511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 msgr2=0x55a7227ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/3223117511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227ccb40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c001e90 tx=0x7fbf2c00b6c0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 -- 172.21.15.170:0/3223117511 shutdown_connections 2024-04-26T12:30:31.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/3223117511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227ccb40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 -- 172.21.15.170:0/3223117511 >> 172.21.15.170:0/3223117511 conn(0x55a7226d3990 msgr2=0x55a7227c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 -- 172.21.15.170:0/3223117511 shutdown_connections 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 -- 172.21.15.170:0/3223117511 wait complete. 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 Processor -- start 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.641+0000 7fbf41e2f800 1 -- start start 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf41e2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf41e2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a7226e4c90 con 0x55a7226d7e30 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227d44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41392/0 (socket says 172.21.15.170:41392) 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf3cfca640 1 -- 172.21.15.170:0/176891013 learned_addr learned my addr 172.21.15.170:0/176891013 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf3cfca640 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a72258d8f0 con 0x55a7226d7e30 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227d44f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c010 tx=0x7fbf2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbe2960a640 1 -- 172.21.15.170:0/176891013 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c00f8d0 con 0x55a7226d7e30 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbe2960a640 1 -- 172.21.15.170:0/176891013 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c00fa90 con 0x55a7226d7e30 2024-04-26T12:30:31.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbe2960a640 1 -- 172.21.15.170:0/176891013 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c00fdb0 con 0x55a7226d7e30 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7227d4a30 con 0x55a7226d7e30 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.642+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7227d4f50 con 0x55a7226d7e30 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.643+0000 7fbe2960a640 1 -- 172.21.15.170:0/176891013 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbf2c017070 con 0x55a7226d7e30 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.643+0000 7fbe2960a640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe24036950 0x7fbe24038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.643+0000 7fbe2960a640 1 -- 172.21.15.170:0/176891013 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbf2c015020 con 0x55a7226d7e30 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.643+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe24036950 0x7fbe24038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.643+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7226d9970 0x55a7227db560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.643+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7227dbae0 con 0x55a7226d9970 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf3d7cb640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7226d9970 0x55a7227db560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe24036950 0x7fbe24038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf30054000 tx=0x7fbf3004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf3d7cb640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7226d9970 0x55a7227db560 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/176891013 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7226d9970 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7227d8b30 con 0x55a7226d9970 2024-04-26T12:30:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/176891013 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7226d9970 2024-04-26T12:30:31.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7227dde30 0x55a7227e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.644+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7227e0910 con 0x55a7227dde30 2024-04-26T12:30:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.645+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7227dde30 0x55a7227e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.645+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7227dde30 0x55a7227e0220 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.645+0000 7fbf3cfca640 1 -- 172.21.15.170:0/176891013 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf2c02e070 con 0x55a7227dde30 2024-04-26T12:30:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.645+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7227dcde0 con 0x55a7226d9970 2024-04-26T12:30:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.646+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/176891013 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7226d9970 2024-04-26T12:30:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.646+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a7227e1d70 0x55a7227e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.646+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7227e4960 con 0x55a7227e1d70 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.646+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a7227e1d70 0x55a7227e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.646+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a7227e1d70 0x55a7227e4200 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.646+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/176891013 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf3005a040 con 0x55a7227e1d70 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf41e2f800 1 Processor -- start 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf41e2f800 1 -- start start 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf41e2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227f2da0 0x55a7227f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf41e2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a7225cae60 con 0x55a7227f2da0 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227f2da0 0x55a7227f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227f2da0 0x55a7227f31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41402/0 (socket says 172.21.15.170:41402) 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf3cfca640 1 -- 172.21.15.170:0/248389751 learned_addr learned my addr 172.21.15.170:0/248389751 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf3cfca640 1 -- 172.21.15.170:0/248389751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7227f3700 con 0x55a7227f2da0 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.647+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227f2da0 0x55a7227f31c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c04b5c0 tx=0x7fbf2c041e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbe227fc640 1 -- 172.21.15.170:0/248389751 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c04baa0 con 0x55a7227f2da0 2024-04-26T12:30:31.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbe227fc640 1 -- 172.21.15.170:0/248389751 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c04bc40 con 0x55a7227f2da0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7227f4170 con 0x55a7227f2da0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbe227fc640 1 -- 172.21.15.170:0/248389751 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c01a480 con 0x55a7227f2da0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7227f4670 con 0x55a7227f2da0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbe227fc640 1 -- 172.21.15.170:0/248389751 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbf2c01a620 con 0x55a7227f2da0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbe227fc640 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe140369c0 0x7fbe14038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbe227fc640 1 -- 172.21.15.170:0/248389751 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbf2c03bc90 con 0x55a7227f2da0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.648+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe140369c0 0x7fbe14038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf41e2f800 1 Processor -- start 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe140369c0 0x7fbe14038e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55a7227dcdb0 tx=0x7fbf30005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf41e2f800 1 -- start start 2024-04-26T12:30:31.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf41e2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722800370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf41e2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a7227cd2c0 con 0x55a7227fff50 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722800370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722800370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41416/0 (socket says 172.21.15.170:41416) 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1670592840 learned_addr learned my addr 172.21.15.170:0/1670592840 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1670592840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a722800940 con 0x55a7227fff50 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.649+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/1670592840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722800370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c02eff0 tx=0x7fbf2c03f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a75b1125fe576 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbe13fff640 1 -- 172.21.15.170:0/1670592840 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c031d40 con 0x55a7227fff50 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbe13fff640 1 -- 172.21.15.170:0/1670592840 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c044bf0 con 0x55a7227fff50 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbe13fff640 1 -- 172.21.15.170:0/1670592840 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c03d120 con 0x55a7227fff50 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1670592840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 msgr2=0x55a722800370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1670592840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722800370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c02eff0 tx=0x7fbf2c03f980 comp rx=0 tx=0).stop 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1670592840 shutdown_connections 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1670592840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722800370 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1670592840 >> 172.21.15.170:0/1670592840 conn(0x55a7227fc220 msgr2=0x55a7227fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1670592840 shutdown_connections 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1670592840 wait complete. 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 Processor -- start 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 -- start start 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722807320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.650+0000 7fbf41e2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a722801010 con 0x55a7227fff50 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722807320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbf3cfca640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722807320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41422/0 (socket says 172.21.15.170:41422) 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 learned_addr learned my addr 172.21.15.170:0/1269771999 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a722807860 con 0x55a7227fff50 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722807320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c000fb0 tx=0x7fbf2c02ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbe127fc640 1 -- 172.21.15.170:0/1269771999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c03f040 con 0x55a7227fff50 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbe127fc640 1 -- 172.21.15.170:0/1269771999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c044580 con 0x55a7227fff50 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a722807860 con 0x55a7227fff50 2024-04-26T12:30:31.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbe127fc640 1 -- 172.21.15.170:0/1269771999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf2c031570 con 0x55a7227fff50 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.651+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a722807860 con 0x55a7227fff50 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.652+0000 7fbe127fc640 1 -- 172.21.15.170:0/1269771999 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbf2c060030 con 0x55a7227fff50 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.652+0000 7fbe127fc640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe08036950 0x7fbe08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.652+0000 7fbe127fc640 1 -- 172.21.15.170:0/1269771999 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbf2c05e020 con 0x55a7227fff50 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.652+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe08036950 0x7fbe08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe08036950 0x7fbe08038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55a7227e4d60 tx=0x7fbf3004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7228129c0 0x55a722814e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7228155d0 con 0x55a7228129c0 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf3d7cb640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7228129c0 0x55a722814e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf3d7cb640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7228129c0 0x55a722814e80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf41e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf41e2f800 20 realm 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.653+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7228159e0 con 0x55a7228129c0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a7228162b0 con 0x55a7228129c0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7228173b0 0x55a7228197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a722819d60 con 0x55a7228173b0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.654+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7228173b0 0x55a7228197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.655+0000 7fbf3cfca640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7228173b0 0x55a7228197a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.655+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.655+0000 7fbf41e2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.655+0000 7fbf41e2f800 20 searching for the correct realm 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.655+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a72281bd10 0x55a72281e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.655+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a72281e8a0 con 0x55a72281bd10 2024-04-26T12:30:31.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.655+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a72281bd10 0x55a72281e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.656+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a72281bd10 0x55a72281e1d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.656+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.656+0000 7fbf3c7c9640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbf30085040 0x7fbf30076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.656+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a72281e8a0 con 0x7fbf30085040 2024-04-26T12:30:31.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.656+0000 7fbf3d7cb640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbf30085040 0x7fbf30076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.656+0000 7fbf3d7cb640 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbf30085040 0x7fbf30076430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.657+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x7fbf30085040 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.658+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.659+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.659+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.659+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.659+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x7fbf30085040 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.659+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.659+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.660+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.661+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x7fbf30085040 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.662+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.662+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.662+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.662+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.662+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x7fbf30085040 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a72281bd10 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.663+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228173b0 2024-04-26T12:30:31.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x55a7228129c0 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a722816650 con 0x7fbf30085040 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.664+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a72281a620 con 0x55a7228129c0 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a72281a620 con 0x55a7228129c0 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a72281a620 con 0x7fbf30085040 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 zone default found 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 4 Realm: () 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:31.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 zonegroup default 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.665+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a72281aec0 con 0x55a7228173b0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a722820700 con 0x55a72281bd10 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a722820aa0 con 0x55a72281bd10 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 20 started sync module instance, tier type = 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:31.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.666+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a72281fba0 con 0x7fbf30085040 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.667+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.667+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94176326844352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a72281fba0 con 0x7fbf30085040 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.667+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228212f0 con 0x55a7228129c0 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.668+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94176326844352] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.669+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.669+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94176326842096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228212f0 con 0x55a7228129c0 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.669+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722821d10 con 0x55a72281bd10 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.670+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94176326842096] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.670+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.670+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94176326848064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722821260 con 0x55a72281bd10 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.670+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722822c00 con 0x7fbf30085040 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.671+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94176326848064] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.671+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.671+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94176326854480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722823020 con 0x7fbf30085040 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.671+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228239e0 con 0x55a7228129c0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.672+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94176326854480] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.672+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.672+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94176326856016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228239e0 con 0x55a7228129c0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.672+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228243a0 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.673+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94176326856016] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.673+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.673+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94176326858032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722823950 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.673+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722825170 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.674+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94176326858032] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.674+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.674+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94176326863216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228259c0 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.674+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722826380 con 0x55a7228173b0 2024-04-26T12:30:31.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94176326863216] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94176326868688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228267a0 con 0x55a7228173b0 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 20 add_watcher() i=0 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 20 add_watcher() i=1 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 20 add_watcher() i=2 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 20 add_watcher() i=3 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 20 add_watcher() i=4 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 20 add_watcher() i=5 2024-04-26T12:30:31.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.675+0000 7fbf41e2f800 20 add_watcher() i=6 2024-04-26T12:30:31.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.676+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94176326868688] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.676+0000 7fbf41e2f800 20 add_watcher() i=7 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.676+0000 7fbf41e2f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.676+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a722829a80 con 0x55a7228129c0 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.676+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.677+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94176326870112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722826d30 con 0x55a7228129c0 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94176326870112] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbdf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 5 note: GC not initialized 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbdf1fe3640 20 reqs_thread_entry: start 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 20 Filter name: none 2024-04-26T12:30:31.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbd637fe640 20 reqs_thread_entry: start 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.678+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a72285d1c0 con 0x55a7228129c0 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf41e2f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf41e2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf41e2f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf41e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a72285fc50 con 0x7fbf30085040 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.679+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a7228633b0 con 0x55a7228129c0 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbf41e2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:31.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbf41e2f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbf41e2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94176327118368 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a72285ec40 con 0x55a7228129c0 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94176326856016 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fbf340266e0 con 0x55a7228129c0 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbe13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94176326856016 notifier 4334 bl.length()=567 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbe13fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbe13fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(65 notify.4 [notify cookie 94176327118368 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.680+0000 7fbe13fff640 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbe00003ea0 con 0x55a7228129c0 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.681+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.681+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94176327118368 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbf34018e10 con 0x55a7228129c0 2024-04-26T12:30:31.694 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:31.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.682+0000 7fbdf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.682+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94176326870112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722862200 con 0x55a7228129c0 2024-04-26T12:30:31.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.683+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94176326870112] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.683+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94176326844352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722826460 con 0x7fbf30085040 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.684+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94176326844352] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.684+0000 7fbf41e2f800 20 remove_watcher() i=0 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.684+0000 7fbf41e2f800 2 removed watcher, disabling cache 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.684+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94176326842096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722826460 con 0x55a7228129c0 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.685+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94176326842096] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.685+0000 7fbf41e2f800 20 remove_watcher() i=1 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.685+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94176326848064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722826460 con 0x55a72281bd10 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.686+0000 7fbf3c7c9640 1 -- 172.21.15.170:0/1269771999 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94176326848064] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf30073070 con 0x55a72281bd10 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.686+0000 7fbf41e2f800 20 remove_watcher() i=2 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.686+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94176326854480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722820e40 con 0x7fbf30085040 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.687+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94176326854480] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x7fbf30085040 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.687+0000 7fbf41e2f800 20 remove_watcher() i=3 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.687+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94176326856016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722822750 con 0x55a7228129c0 2024-04-26T12:30:31.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.688+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94176326856016] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3400a4a0 con 0x55a7228129c0 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.688+0000 7fbf41e2f800 20 remove_watcher() i=4 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.688+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94176326858032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722820e40 con 0x55a7228173b0 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.689+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94176326858032] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.689+0000 7fbf41e2f800 20 remove_watcher() i=5 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.689+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94176326863216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722822d50 con 0x55a7228173b0 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.690+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94176326863216] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.690+0000 7fbf41e2f800 20 remove_watcher() i=6 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.690+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94176326868688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a722822750 con 0x55a7228173b0 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf3cfca640 1 -- 172.21.15.170:0/1269771999 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94176326868688] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf2c057030 con 0x55a7228173b0 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 20 remove_watcher() i=7 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7228173b0 msgr2=0x55a7228197a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7228173b0 0x55a7228197a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7228129c0 msgr2=0x55a722814e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7228129c0 0x55a722814e80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbf30085040 msgr2=0x7fbf30076430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbf30085040 0x7fbf30076430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a72281bd10 msgr2=0x55a72281e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a72281bd10 0x55a72281e1d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe08036950 msgr2=0x7fbe08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe08036950 0x7fbe08038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55a7227e4d60 tx=0x7fbf3004f000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 msgr2=0x55a722807320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/1269771999 reap_dead start 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722807320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c000fb0 tx=0x7fbf2c02ff30 comp rx=0 tx=0).stop 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 shutdown_connections 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/1269771999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227fff50 0x55a722807320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 >> 172.21.15.170:0/1269771999 conn(0x55a7227fc220 msgr2=0x55a7227f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 shutdown_connections 2024-04-26T12:30:31.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/1269771999 wait complete. 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe140369c0 msgr2=0x7fbe14038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe140369c0 0x7fbe14038e80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55a7227dcdb0 tx=0x7fbf30005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227f2da0 msgr2=0x55a7227f31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227f2da0 0x55a7227f31c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c04b5c0 tx=0x7fbf2c041e50 comp rx=0 tx=0).stop 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 shutdown_connections 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe140369c0 0x7fbe14038e80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/248389751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7227f2da0 0x55a7227f31c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 >> 172.21.15.170:0/248389751 conn(0x55a7227e6e40 msgr2=0x55a7227e7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 shutdown_connections 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.691+0000 7fbf41e2f800 1 -- 172.21.15.170:0/248389751 wait complete. 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7227dde30 msgr2=0x55a7227e0220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a7227dde30 0x55a7227e0220 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7226d9970 msgr2=0x55a7227db560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a7226d9970 0x55a7227db560 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a7227e1d70 msgr2=0x55a7227e4200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a7227e1d70 0x55a7227e4200 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe24036950 msgr2=0x7fbe24038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbe24036950 0x7fbe24038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf30054000 tx=0x7fbf3004e000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 msgr2=0x55a7227d44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 --2- 172.21.15.170:0/176891013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a7226d7e30 0x55a7227d44f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c010 tx=0x7fbf2c000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf3d7cb640 1 -- 172.21.15.170:0/176891013 reap_dead start 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 shutdown_connections 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 >> 172.21.15.170:0/176891013 conn(0x55a7226d3990 msgr2=0x55a7227cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 shutdown_connections 2024-04-26T12:30:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.692+0000 7fbf41e2f800 1 -- 172.21.15.170:0/176891013 wait complete. 2024-04-26T12:30:31.705 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:31.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:31.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:31.706 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:31.789 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:31.789 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.788+0000 7fdd1e814800 1 Processor -- start 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1e814800 1 -- start start 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1e814800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ba2d06dab0 0x55ba2d06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1e814800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba2cf160c0 con 0x55ba2d06ab20 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1e814800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55ba2cefa4d0 con 0x55ba2d06dab0 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1175b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ba2d06dab0 0x55ba2d06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd19f5c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55ba2d06ab20 0x55ba2d06af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46056/0 (socket says 172.21.15.170:46056) 2024-04-26T12:30:31.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd19f5c640 1 -- 172.21.15.170:0/3530438587 learned_addr learned my addr 172.21.15.170:0/3530438587 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:31.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1175b640 1 -- 172.21.15.170:0/3530438587 >> v1:172.21.15.132:6789/0 conn(0x55ba2d06ab20 legacy=0x55ba2d06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1975b640 1 -- 172.21.15.170:0/3530438587 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150882436 0 0) 0x55ba2cf160c0 con 0x55ba2d06ab20 2024-04-26T12:30:31.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.789+0000 7fdd1175b640 1 -- 172.21.15.170:0/3530438587 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2cf27d40 con 0x55ba2d06dab0 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.791+0000 7fdd1175b640 1 --2- 172.21.15.170:0/3530438587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06dab0 0x55ba2d06fea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400a470 tx=0x7fdd0401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bae08016e81077 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.791+0000 7fdd1975b640 1 -- 172.21.15.170:0/3530438587 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd04057070 con 0x55ba2d06dab0 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.791+0000 7fdd1975b640 1 -- 172.21.15.170:0/3530438587 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd04052570 con 0x55ba2d06dab0 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.791+0000 7fdd1975b640 1 -- 172.21.15.170:0/3530438587 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd04052870 con 0x55ba2d06dab0 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.792+0000 7fdd1e814800 1 -- 172.21.15.170:0/3530438587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06dab0 msgr2=0x55ba2d06fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.792+0000 7fdd1e814800 1 --2- 172.21.15.170:0/3530438587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06dab0 0x55ba2d06fea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400a470 tx=0x7fdd0401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.792+0000 7fdd1e814800 1 -- 172.21.15.170:0/3530438587 shutdown_connections 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.792+0000 7fdd1e814800 1 --2- 172.21.15.170:0/3530438587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06dab0 0x55ba2d06fea0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.792+0000 7fdd1e814800 1 -- 172.21.15.170:0/3530438587 >> 172.21.15.170:0/3530438587 conn(0x55ba2d063160 msgr2=0x55ba2d065580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.792+0000 7fdd1e814800 1 -- 172.21.15.170:0/3530438587 shutdown_connections 2024-04-26T12:30:31.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.792+0000 7fdd1e814800 1 -- 172.21.15.170:0/3530438587 wait complete. 2024-04-26T12:30:31.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.803+0000 7fdd1e814800 1 Processor -- start 2024-04-26T12:30:31.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd1e814800 1 -- start start 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd1e814800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d15a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd1e814800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba2cfb4b40 con 0x55ba2d06ab20 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d15a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41430/0 (socket says 172.21.15.170:41430) 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd19f5c640 1 -- 172.21.15.170:0/3764746885 learned_addr learned my addr 172.21.15.170:0/3764746885 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd19f5c640 1 -- 172.21.15.170:0/3764746885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2cf26590 con 0x55ba2d06ab20 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/3764746885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d15a410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00b240 tx=0x7fdd0c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7108aac61eaf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdc07e07640 1 -- 172.21.15.170:0/3764746885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c008070 con 0x55ba2d06ab20 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.804+0000 7fdc07e07640 1 -- 172.21.15.170:0/3764746885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c00d500 con 0x55ba2d06ab20 2024-04-26T12:30:31.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdc07e07640 1 -- 172.21.15.170:0/3764746885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c00d860 con 0x55ba2d06ab20 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdd1e814800 1 -- 172.21.15.170:0/3764746885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 msgr2=0x55ba2d15a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdd1e814800 1 --2- 172.21.15.170:0/3764746885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d15a410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00b240 tx=0x7fdd0c00b700 comp rx=0 tx=0).stop 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdd1e814800 1 -- 172.21.15.170:0/3764746885 shutdown_connections 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdd1e814800 1 --2- 172.21.15.170:0/3764746885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d15a410 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdd1e814800 1 -- 172.21.15.170:0/3764746885 >> 172.21.15.170:0/3764746885 conn(0x55ba2d063160 msgr2=0x55ba2d155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdd1e814800 1 -- 172.21.15.170:0/3764746885 shutdown_connections 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.805+0000 7fdd1e814800 1 -- 172.21.15.170:0/3764746885 wait complete. 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd1e814800 1 Processor -- start 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd1e814800 1 -- start start 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd1e814800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd1e814800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d0706e0 con 0x55ba2d06ab20 2024-04-26T12:30:31.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41442/0 (socket says 172.21.15.170:41442) 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd19f5c640 1 -- 172.21.15.170:0/1576114385 learned_addr learned my addr 172.21.15.170:0/1576114385 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd19f5c640 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2cf1d8f0 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d161e50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55ba2d15b1a0 tx=0x7fdd0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdc06604640 1 -- 172.21.15.170:0/1576114385 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c019870 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdc06604640 1 -- 172.21.15.170:0/1576114385 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c019a10 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.806+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba2d162390 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.807+0000 7fdc06604640 1 -- 172.21.15.170:0/1576114385 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c019d30 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.807+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d1628b0 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.807+0000 7fdc06604640 1 -- 172.21.15.170:0/1576114385 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd0c017040 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.807+0000 7fdc06604640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc00036950 0x7fdc00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.807+0000 7fdc06604640 1 -- 172.21.15.170:0/1576114385 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fdd0c015020 con 0x55ba2d06ab20 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1175b640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc00036950 0x7fdc00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d06dab0 0x55ba2d168ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d169440 con 0x55ba2d06dab0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1a75d640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d06dab0 0x55ba2d168ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1175b640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc00036950 0x7fdc00038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd04054000 tx=0x7fdd0404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1a75d640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d06dab0 0x55ba2d168ec0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1a75d640 1 -- 172.21.15.170:0/1576114385 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d06dab0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.808+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d166470 con 0x55ba2d06dab0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.809+0000 7fdd1a75d640 1 -- 172.21.15.170:0/1576114385 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d06dab0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.809+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d16b770 0x55ba2d16db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.809+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d16e200 con 0x55ba2d16b770 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.809+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d16b770 0x55ba2d16db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.809+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d16b770 0x55ba2d16db60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.809+0000 7fdd19f5c640 1 -- 172.21.15.170:0/1576114385 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d16b770 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.809+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d16a720 con 0x55ba2d06dab0 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.810+0000 7fdd1a75d640 1 -- 172.21.15.170:0/1576114385 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d06dab0 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.810+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba2d16f6b0 0x55ba2d171b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.810+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d172260 con 0x55ba2d16f6b0 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.810+0000 7fdd1175b640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba2d16f6b0 0x55ba2d171b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.810+0000 7fdd1175b640 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba2d16f6b0 0x55ba2d171b00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.810+0000 7fdd1175b640 1 -- 172.21.15.170:0/1576114385 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd040528e0 con 0x55ba2d16f6b0 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd1e814800 1 Processor -- start 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd1e814800 1 -- start start 2024-04-26T12:30:31.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd1e814800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d1806a0 0x55ba2d180ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd1e814800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba2cf5ae60 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d1806a0 0x55ba2d180ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d1806a0 0x55ba2d180ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41446/0 (socket says 172.21.15.170:41446) 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2444047758 learned_addr learned my addr 172.21.15.170:0/2444047758 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2444047758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d181000 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.811+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d1806a0 0x55ba2d180ac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c04b480 tx=0x7fdd0c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdbff7fe640 1 -- 172.21.15.170:0/2444047758 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c044a50 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdbff7fe640 1 -- 172.21.15.170:0/2444047758 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c044bf0 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdbff7fe640 1 -- 172.21.15.170:0/2444047758 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c044ed0 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba2d181a70 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d181f70 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdbff7fe640 1 -- 172.21.15.170:0/2444047758 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd0c03f1b0 con 0x55ba2d1806a0 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdbff7fe640 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbf4036950 0x7fdbf4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.812+0000 7fdbff7fe640 1 -- 172.21.15.170:0/2444047758 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fdd0c03cc50 con 0x55ba2d1806a0 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd1175b640 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbf4036950 0x7fdbf4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd1e814800 1 Processor -- start 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd1e814800 1 -- start start 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd1175b640 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbf4036950 0x7fdbf4038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55ba2d1663b0 tx=0x7fdd04005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd1e814800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd1e814800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d15ab90 con 0x55ba2d069f80 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41460/0 (socket says 172.21.15.170:41460) 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd19f5c640 1 -- 172.21.15.170:0/236237520 learned_addr learned my addr 172.21.15.170:0/236237520 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.813+0000 7fdd19f5c640 1 -- 172.21.15.170:0/236237520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d06a430 con 0x55ba2d069f80 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/236237520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d068670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c03cfd0 tx=0x7fdd0c0266d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8576b19e5135861d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdbfd7fa640 1 -- 172.21.15.170:0/236237520 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c026a00 con 0x55ba2d069f80 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdbfd7fa640 1 -- 172.21.15.170:0/236237520 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c044830 con 0x55ba2d069f80 2024-04-26T12:30:31.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdbfd7fa640 1 -- 172.21.15.170:0/236237520 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c030d00 con 0x55ba2d069f80 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd1e814800 1 -- 172.21.15.170:0/236237520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 msgr2=0x55ba2d068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd1e814800 1 --2- 172.21.15.170:0/236237520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d068670 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c03cfd0 tx=0x7fdd0c0266d0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd1e814800 1 -- 172.21.15.170:0/236237520 shutdown_connections 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd1e814800 1 --2- 172.21.15.170:0/236237520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d068670 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd1e814800 1 -- 172.21.15.170:0/236237520 >> 172.21.15.170:0/236237520 conn(0x55ba2d189c80 msgr2=0x55ba2d187ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd1e814800 1 -- 172.21.15.170:0/236237520 shutdown_connections 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.814+0000 7fdd1e814800 1 -- 172.21.15.170:0/236237520 wait complete. 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd1e814800 1 Processor -- start 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd1e814800 1 -- start start 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd1e814800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd1e814800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ba2d06a430 con 0x55ba2d069f80 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd19f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41462/0 (socket says 172.21.15.170:41462) 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 learned_addr learned my addr 172.21.15.170:0/2521428022 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2d197320 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.815+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d196de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c026710 tx=0x7fdd0c04c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.816+0000 7fdbeb7fe640 1 -- 172.21.15.170:0/2521428022 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c01c610 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.816+0000 7fdbeb7fe640 1 -- 172.21.15.170:0/2521428022 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c06b030 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.816+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba2d197320 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.816+0000 7fdbeb7fe640 1 -- 172.21.15.170:0/2521428022 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd0c04c030 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.816+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba2d197320 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.816+0000 7fdbeb7fe640 1 -- 172.21.15.170:0/2521428022 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd0c01ca40 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdbeb7fe640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbe4036950 0x7fdbe4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdbeb7fe640 1 -- 172.21.15.170:0/2521428022 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fdd0c071c80 con 0x55ba2d069f80 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdd1175b640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbe4036950 0x7fdbe4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d1a2390 0x55ba2d1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a4fa0 con 0x55ba2d1a2390 2024-04-26T12:30:31.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdd1a75d640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d1a2390 0x55ba2d1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdd1175b640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbe4036950 0x7fdbe4038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd04052fd0 tx=0x7fdd0404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.817+0000 7fdd1a75d640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d1a2390 0x55ba2d1a4850 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 realm 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a53b0 con 0x55ba2d1a2390 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5c50 con 0x55ba2d1a2390 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a2390 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d1a6d50 0x55ba2d1a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a9680 con 0x55ba2d1a6d50 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.818+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d1a6d50 0x55ba2d1a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd19f5c640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d1a6d50 0x55ba2d1a9140 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd1e814800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd1e814800 20 searching for the correct realm 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba2d1ab700 0x55ba2d1adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1ae290 con 0x55ba2d1ab700 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd1175b640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba2d1ab700 0x55ba2d1adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.819+0000 7fdd1175b640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba2d1ab700 0x55ba2d1adbc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.820+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.820+0000 7fdd1175b640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd04076040 0x7fdd0405e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.820+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1ae290 con 0x7fdd04076040 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.820+0000 7fdd1a75d640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd04076040 0x7fdd0405e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.820+0000 7fdd1a75d640 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd04076040 0x7fdd0405e480 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.820+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.820+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.821+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.821+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a2390 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.821+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.821+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a2390 2024-04-26T12:30:31.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.821+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.821+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.821+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x7fdd04076040 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1ab700 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a2390 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.822+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1a2390 2024-04-26T12:30:31.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x7fdd04076040 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a5ff0 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.823+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a6d50 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.824+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a2390 2024-04-26T12:30:31.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a2390 2024-04-26T12:30:31.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a6d50 2024-04-26T12:30:31.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1ab700 2024-04-26T12:30:31.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.825+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x7fdd04076040 2024-04-26T12:30:31.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.826+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.826+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a2390 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.826+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.826+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a6d50 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.826+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.826+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1ab700 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a6d50 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x7fdd04076040 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1ab700 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.827+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a6d50 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x55ba2d1a2390 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd04090040 con 0x7fdd04076040 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1aa000 con 0x55ba2d1a2390 2024-04-26T12:30:31.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.828+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1aa000 con 0x55ba2d1a2390 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1a9fd0 con 0x7fdd04076040 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 20 zone default found 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 4 Realm: () 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:31.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 20 zonegroup default 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.829+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1aa3f0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1aa000 con 0x55ba2d1ab700 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b00f0 con 0x55ba2d1ab700 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 20 started sync module instance, tier type = 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.830+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1af590 con 0x7fdd04076040 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.831+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.831+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94258109020816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1af590 con 0x7fdd04076040 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.831+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b0b20 con 0x55ba2d1a2390 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.832+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94258109020816] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.833+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.833+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94258109023792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1af590 con 0x55ba2d1a2390 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.833+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b15c0 con 0x55ba2d1ab700 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.834+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94258109023792] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.834+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.834+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94258109018336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1af500 con 0x55ba2d1ab700 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.834+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b23b0 con 0x7fdd04076040 2024-04-26T12:30:31.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.835+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94258109018336] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.835+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.835+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94258109028832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b27a0 con 0x7fdd04076040 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.835+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b31a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.836+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.836+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94258109033648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b30d0 con 0x55ba2d1a2390 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.836+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b40d0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.836+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94258109028832] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.837+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94258109033648] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.837+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.837+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94258109035920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b3be0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.837+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b49a0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.838+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94258109035920] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.838+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.838+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94258109029888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b51f0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.838+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b5bb0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94258109029888] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94258109044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b5fd0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 20 add_watcher() i=0 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 20 add_watcher() i=1 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 20 add_watcher() i=2 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 20 add_watcher() i=3 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 20 add_watcher() i=4 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 20 add_watcher() i=5 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.839+0000 7fdd1e814800 20 add_watcher() i=6 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.840+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94258109044480] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.840+0000 7fdd1e814800 20 add_watcher() i=7 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.840+0000 7fdd1e814800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:31.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.840+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b9260 con 0x55ba2d1a2390 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.840+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.840+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94258109045904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b6560 con 0x55ba2d1a2390 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.841+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94258109045904] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.841+0000 7fdbcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.841+0000 7fdd1e814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.841+0000 7fdd1e814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.841+0000 7fdd1e814800 5 note: GC not initialized 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdbca7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdd1e814800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdd1e814800 20 Filter name: none 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdb3bfff640 20 reqs_thread_entry: start 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdd1e814800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1ec4e0 con 0x55ba2d1a2390 2024-04-26T12:30:31.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.842+0000 7fdd1e814800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:31.855 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.843+0000 7fdbcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.843+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94258109045904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b8990 con 0x55ba2d1a2390 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.844+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94258109045904] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.844+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94258109020816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b5c90 con 0x7fdd04076040 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.845+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94258109020816] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.845+0000 7fdd1e814800 20 remove_watcher() i=0 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.845+0000 7fdd1e814800 2 removed watcher, disabling cache 2024-04-26T12:30:31.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.845+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94258109023792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b5c90 con 0x55ba2d1a2390 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.846+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94258109023792] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.846+0000 7fdd1e814800 20 remove_watcher() i=1 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.846+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94258109018336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b0630 con 0x55ba2d1ab700 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.847+0000 7fdd1175b640 1 -- 172.21.15.170:0/2521428022 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94258109018336] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd04081070 con 0x55ba2d1ab700 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.847+0000 7fdd1e814800 20 remove_watcher() i=2 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.847+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94258109028832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b5c90 con 0x7fdd04076040 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.848+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94258109028832] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x7fdd04076040 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.848+0000 7fdd1e814800 20 remove_watcher() i=3 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.848+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94258109033648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1af0e0 con 0x55ba2d1a2390 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.849+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94258109033648] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd1400a4a0 con 0x55ba2d1a2390 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.849+0000 7fdd1e814800 20 remove_watcher() i=4 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.849+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94258109035920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b19e0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.850+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94258109035920] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.850+0000 7fdd1e814800 20 remove_watcher() i=5 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.850+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94258109029888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b5c90 con 0x55ba2d1a6d50 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.851+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94258109029888] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.851+0000 7fdd1e814800 20 remove_watcher() i=6 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.851+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94258109044480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ba2d1b2cb0 con 0x55ba2d1a6d50 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd19f5c640 1 -- 172.21.15.170:0/2521428022 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94258109044480] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0c02d070 con 0x55ba2d1a6d50 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 20 remove_watcher() i=7 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d1a6d50 msgr2=0x55ba2d1a9140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d1a6d50 0x55ba2d1a9140 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d1a2390 msgr2=0x55ba2d1a4850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d1a2390 0x55ba2d1a4850 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd04076040 msgr2=0x7fdd0405e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd04076040 0x7fdd0405e480 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba2d1ab700 msgr2=0x55ba2d1adbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.852+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ba2d1ab700 0x55ba2d1adbc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbe4036950 msgr2=0x7fdbe4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbe4036950 0x7fdbe4038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd04052fd0 tx=0x7fdd0404f000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 msgr2=0x55ba2d196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d196de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c026710 tx=0x7fdd0c04c460 comp rx=0 tx=0).stop 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1a75d640 1 -- 172.21.15.170:0/2521428022 reap_dead start 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 shutdown_connections 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2521428022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d069f80 0x55ba2d196de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 >> 172.21.15.170:0/2521428022 conn(0x55ba2d189c80 msgr2=0x55ba2d1872e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 shutdown_connections 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2521428022 wait complete. 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbf4036950 msgr2=0x7fdbf4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbf4036950 0x7fdbf4038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55ba2d1663b0 tx=0x7fdd04005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d1806a0 msgr2=0x55ba2d180ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d1806a0 0x55ba2d180ac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c04b480 tx=0x7fdd0c00ed40 comp rx=0 tx=0).stop 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 shutdown_connections 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdbf4036950 0x7fdbf4038e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/2444047758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d1806a0 0x55ba2d180ac0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 >> 172.21.15.170:0/2444047758 conn(0x55ba2d174740 msgr2=0x55ba2d174b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 shutdown_connections 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/2444047758 wait complete. 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d16b770 msgr2=0x55ba2d16db60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ba2d16b770 0x55ba2d16db60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d06dab0 msgr2=0x55ba2d168ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ba2d06dab0 0x55ba2d168ec0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba2d16f6b0 msgr2=0x55ba2d171b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ba2d16f6b0 0x55ba2d171b00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc00036950 msgr2=0x7fdc00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc00036950 0x7fdc00038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd04054000 tx=0x7fdd0404e000 comp rx=0 tx=0).stop 2024-04-26T12:30:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 msgr2=0x55ba2d161e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 --2- 172.21.15.170:0/1576114385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ba2d06ab20 0x55ba2d161e50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55ba2d15b1a0 tx=0x7fdd0c000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1a75d640 1 -- 172.21.15.170:0/1576114385 reap_dead start 2024-04-26T12:30:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 shutdown_connections 2024-04-26T12:30:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.853+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 >> 172.21.15.170:0/1576114385 conn(0x55ba2d063160 msgr2=0x55ba2d158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.854+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 shutdown_connections 2024-04-26T12:30:31.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.854+0000 7fdd1e814800 1 -- 172.21.15.170:0/1576114385 wait complete. 2024-04-26T12:30:31.866 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:31.866 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-26T12:30:31.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-26T12:30:31.866 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-26T12:30:31.953 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:31.953 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:31.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd93bf46800 1 Processor -- start 2024-04-26T12:30:31.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd93bf46800 1 -- start start 2024-04-26T12:30:31.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd93bf46800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d922d73e00 0x55d922e08480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd93bf46800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d922cac0c0 con 0x55d922d75140 2024-04-26T12:30:31.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd93bf46800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55d922c904d0 con 0x55d922d73e00 2024-04-26T12:30:31.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd939244640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d922d73e00 0x55d922e08480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd939a45640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55d922d75140 0x55d922d736f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46068/0 (socket says 172.21.15.170:46068) 2024-04-26T12:30:31.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd939244640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d922d73e00 0x55d922e08480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41464/0 (socket says 172.21.15.170:41464) 2024-04-26T12:30:31.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd939a45640 1 -- 172.21.15.170:0/3139214080 learned_addr learned my addr 172.21.15.170:0/3139214080 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:31.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd939244640 1 -- 172.21.15.170:0/3139214080 >> v1:172.21.15.132:6789/0 conn(0x55d922d75140 legacy=0x55d922d736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.953+0000 7fd939244640 1 -- 172.21.15.170:0/3139214080 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d922cbdd40 con 0x55d922d73e00 2024-04-26T12:30:31.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.955+0000 7fd939244640 1 --2- 172.21.15.170:0/3139214080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922e08480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd93000a470 tx=0x7fd93001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4289c007b916a384 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.955+0000 7fd938a43640 1 -- 172.21.15.170:0/3139214080 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd930057070 con 0x55d922d73e00 2024-04-26T12:30:31.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.955+0000 7fd938a43640 1 -- 172.21.15.170:0/3139214080 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd930052570 con 0x55d922d73e00 2024-04-26T12:30:31.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.955+0000 7fd938a43640 1 -- 172.21.15.170:0/3139214080 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd930052870 con 0x55d922d73e00 2024-04-26T12:30:31.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.956+0000 7fd93bf46800 1 -- 172.21.15.170:0/3139214080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 msgr2=0x55d922e08480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.956+0000 7fd93bf46800 1 --2- 172.21.15.170:0/3139214080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922e08480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd93000a470 tx=0x7fd93001ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:31.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.956+0000 7fd93bf46800 1 -- 172.21.15.170:0/3139214080 shutdown_connections 2024-04-26T12:30:31.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.956+0000 7fd93bf46800 1 --2- 172.21.15.170:0/3139214080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922e08480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.956+0000 7fd93bf46800 1 -- 172.21.15.170:0/3139214080 >> 172.21.15.170:0/3139214080 conn(0x55d922dfaba0 msgr2=0x55d922dfcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.956+0000 7fd93bf46800 1 -- 172.21.15.170:0/3139214080 shutdown_connections 2024-04-26T12:30:31.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.956+0000 7fd93bf46800 1 -- 172.21.15.170:0/3139214080 wait complete. 2024-04-26T12:30:31.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.968+0000 7fd93bf46800 1 Processor -- start 2024-04-26T12:30:31.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.968+0000 7fd93bf46800 1 -- start start 2024-04-26T12:30:31.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.968+0000 7fd93bf46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922ef2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.968+0000 7fd93bf46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d922d4ab60 con 0x55d922d73e00 2024-04-26T12:30:31.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.968+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922ef2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.968+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922ef2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41466/0 (socket says 172.21.15.170:41466) 2024-04-26T12:30:31.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.968+0000 7fd939a45640 1 -- 172.21.15.170:0/2294258924 learned_addr learned my addr 172.21.15.170:0/2294258924 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.969+0000 7fd939a45640 1 -- 172.21.15.170:0/2294258924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d922cbc590 con 0x55d922d73e00 2024-04-26T12:30:31.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.969+0000 7fd939a45640 1 --2- 172.21.15.170:0/2294258924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922ef2d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd92c001640 tx=0x7fd92c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb0fcbe2681fe75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.969+0000 7fd827e07640 1 -- 172.21.15.170:0/2294258924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c004520 con 0x55d922d73e00 2024-04-26T12:30:31.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.969+0000 7fd827e07640 1 -- 172.21.15.170:0/2294258924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0046c0 con 0x55d922d73e00 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.969+0000 7fd827e07640 1 -- 172.21.15.170:0/2294258924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c004a40 con 0x55d922d73e00 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 -- 172.21.15.170:0/2294258924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 msgr2=0x55d922ef2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2294258924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922ef2d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd92c001640 tx=0x7fd92c001b00 comp rx=0 tx=0).stop 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 -- 172.21.15.170:0/2294258924 shutdown_connections 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2294258924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922ef2d70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 -- 172.21.15.170:0/2294258924 >> 172.21.15.170:0/2294258924 conn(0x55d922dfaba0 msgr2=0x55d922eee690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 -- 172.21.15.170:0/2294258924 shutdown_connections 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 -- 172.21.15.170:0/2294258924 wait complete. 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 Processor -- start 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 -- start start 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922efa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd93bf46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d922e0acd0 con 0x55d922d73e00 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922efa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922efa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41476/0 (socket says 172.21.15.170:41476) 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.970+0000 7fd939a45640 1 -- 172.21.15.170:0/2434753440 learned_addr learned my addr 172.21.15.170:0/2434753440 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.971+0000 7fd939a45640 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d922cb38f0 con 0x55d922d73e00 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.971+0000 7fd939a45640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922efa710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd92c001b40 tx=0x7fd92c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.971+0000 7fd826604640 1 -- 172.21.15.170:0/2434753440 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c022020 con 0x55d922d73e00 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.971+0000 7fd826604640 1 -- 172.21.15.170:0/2434753440 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0148b0 con 0x55d922d73e00 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.971+0000 7fd826604640 1 -- 172.21.15.170:0/2434753440 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c014bf0 con 0x55d922d73e00 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.971+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d922efac50 con 0x55d922d73e00 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.971+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d922efb170 con 0x55d922d73e00 2024-04-26T12:30:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd826604640 1 -- 172.21.15.170:0/2434753440 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd92c025020 con 0x55d922d73e00 2024-04-26T12:30:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd826604640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd820036950 0x7fd820038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd826604640 1 -- 172.21.15.170:0/2434753440 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd92c018030 con 0x55d922d73e00 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd939244640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd820036950 0x7fd820038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922d75140 0x55d922f01780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f01d00 con 0x55d922d75140 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd93a246640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922d75140 0x55d922f01780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd939244640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd820036950 0x7fd820038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd930054000 tx=0x7fd93004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.972+0000 7fd93a246640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922d75140 0x55d922f01780 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.973+0000 7fd93a246640 1 -- 172.21.15.170:0/2434753440 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922d75140 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.973+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922efed30 con 0x55d922d75140 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.973+0000 7fd93a246640 1 -- 172.21.15.170:0/2434753440 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922d75140 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.973+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f04010 0x55d922f06400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.973+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f06af0 con 0x55d922f04010 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.973+0000 7fd939a45640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f04010 0x55d922f06400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.974+0000 7fd939a45640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f04010 0x55d922f06400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.974+0000 7fd939a45640 1 -- 172.21.15.170:0/2434753440 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd92c01b070 con 0x55d922f04010 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.974+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f02f90 con 0x55d922d75140 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.974+0000 7fd93a246640 1 -- 172.21.15.170:0/2434753440 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922d75140 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.974+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d922f07f50 0x55d922f0a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.974+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f0aae0 con 0x55d922f07f50 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.974+0000 7fd939244640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d922f07f50 0x55d922f0a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.975+0000 7fd939244640 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d922f07f50 0x55d922f0a380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.975+0000 7fd939244640 1 -- 172.21.15.170:0/2434753440 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd930052a40 con 0x55d922f07f50 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.975+0000 7fd93bf46800 1 Processor -- start 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.975+0000 7fd93bf46800 1 -- start start 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.975+0000 7fd93bf46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f18f40 0x55d922f19360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.975+0000 7fd93bf46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d922cf0e60 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f18f40 0x55d922f19360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f18f40 0x55d922f19360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41480/0 (socket says 172.21.15.170:41480) 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd939a45640 1 -- 172.21.15.170:0/2019949494 learned_addr learned my addr 172.21.15.170:0/2019949494 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd939a45640 1 -- 172.21.15.170:0/2019949494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d922f198a0 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd939a45640 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f18f40 0x55d922f19360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd92c004690 tx=0x7fd92c010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd81f7fe640 1 -- 172.21.15.170:0/2019949494 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c03f020 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd81f7fe640 1 -- 172.21.15.170:0/2019949494 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c01e520 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d922f1a310 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd81f7fe640 1 -- 172.21.15.170:0/2019949494 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c01e800 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.976+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d922f1a810 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.977+0000 7fd81f7fe640 1 -- 172.21.15.170:0/2019949494 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd92c010070 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.977+0000 7fd81f7fe640 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd814036950 0x7fd814038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.977+0000 7fd81f7fe640 1 -- 172.21.15.170:0/2019949494 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd92c03c330 con 0x55d922f18f40 2024-04-26T12:30:31.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.977+0000 7fd939244640 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd814036950 0x7fd814038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.977+0000 7fd93bf46800 1 Processor -- start 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.977+0000 7fd93bf46800 1 -- start start 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.977+0000 7fd939244640 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd814036950 0x7fd814038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55d922f025c0 tx=0x7fd930005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd93bf46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f26510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd93bf46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d922ef34f0 con 0x55d922f260f0 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f26510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f26510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41486/0 (socket says 172.21.15.170:41486) 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd939a45640 1 -- 172.21.15.170:0/4171115651 learned_addr learned my addr 172.21.15.170:0/4171115651 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd939a45640 1 -- 172.21.15.170:0/4171115651 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d922f26ae0 con 0x55d922f260f0 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd939a45640 1 --2- 172.21.15.170:0/4171115651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f26510 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd92c04c7d0 tx=0x7fd92c005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfda2d2b5a31c72e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd81d7fa640 1 -- 172.21.15.170:0/4171115651 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c00f670 con 0x55d922f260f0 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd81d7fa640 1 -- 172.21.15.170:0/4171115651 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c03c130 con 0x55d922f260f0 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.978+0000 7fd81d7fa640 1 -- 172.21.15.170:0/4171115651 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c012bc0 con 0x55d922f260f0 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 -- 172.21.15.170:0/4171115651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 msgr2=0x55d922f26510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 --2- 172.21.15.170:0/4171115651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f26510 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd92c04c7d0 tx=0x7fd92c005590 comp rx=0 tx=0).stop 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 -- 172.21.15.170:0/4171115651 shutdown_connections 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 --2- 172.21.15.170:0/4171115651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f26510 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 -- 172.21.15.170:0/4171115651 >> 172.21.15.170:0/4171115651 conn(0x55d922f223c0 msgr2=0x55d922f20420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 -- 172.21.15.170:0/4171115651 shutdown_connections 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 -- 172.21.15.170:0/4171115651 wait complete. 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 Processor -- start 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 -- start start 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f2d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd93bf46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d922f271b0 con 0x55d922f260f0 2024-04-26T12:30:31.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f2d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd939a45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f2d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41494/0 (socket says 172.21.15.170:41494) 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.979+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 learned_addr learned my addr 172.21.15.170:0/2356570205 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.980+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d922f2d990 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.980+0000 7fd939a45640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f2d450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd92c03eff0 tx=0x7fd92c03c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.980+0000 7fd80b7fe640 1 -- 172.21.15.170:0/2356570205 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c070070 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.980+0000 7fd80b7fe640 1 -- 172.21.15.170:0/2356570205 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c026e70 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.980+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d922f2d990 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.980+0000 7fd80b7fe640 1 -- 172.21.15.170:0/2356570205 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd92c01d550 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.980+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d922f2d990 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.981+0000 7fd80b7fe640 1 -- 172.21.15.170:0/2356570205 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd92c073070 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.981+0000 7fd80b7fe640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd804036900 0x7fd804038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.981+0000 7fd80b7fe640 1 -- 172.21.15.170:0/2356570205 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd92c067030 con 0x55d922f260f0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.981+0000 7fd939244640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd804036900 0x7fd804038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.981+0000 7fd939244640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd804036900 0x7fd804038dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd93000a470 tx=0x7fd93004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922f38bf0 0x55d922f3b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3b800 con 0x55d922f38bf0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93a246640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922f38bf0 0x55d922f3b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93a246640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922f38bf0 0x55d922f3b0b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922f38bf0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 20 realm 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3bc30 con 0x55d922f38bf0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922f38bf0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:31.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.982+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f38bf0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922f38bf0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c8a0 con 0x55d922f38bf0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922f38bf0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f3d260 0x55d922f3f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3fc60 con 0x55d922f3d260 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.983+0000 7fd939a45640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f3d260 0x55d922f3f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd939a45640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f3d260 0x55d922f3f650 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd93bf46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd93bf46800 20 searching for the correct realm 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d922f41bf0 0x55d922f440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f44780 con 0x55d922f41bf0 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd939244640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d922f41bf0 0x55d922f440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.984+0000 7fd939244640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d922f41bf0 0x55d922f440b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.985+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.985+0000 7fd939244640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd930076040 0x7fd930083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.985+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f44780 con 0x7fd930076040 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.985+0000 7fd93a246640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd930076040 0x7fd930083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.985+0000 7fd93a246640 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd930076040 0x7fd930083410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.985+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd9340083e0 con 0x7fd930076040 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.985+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f3d260 2024-04-26T12:30:31.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:31.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f38bf0 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9340083e0 con 0x55d922f38bf0 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f38bf0 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f3d260 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.986+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f3d260 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x7fd930076040 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f41bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f38bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.987+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f3d260 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f38bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x7fd930076040 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d922f3c500 con 0x55d922f41bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f41bf0 2024-04-26T12:30:32.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.988+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f3d260 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.989+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.989+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f41bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.989+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.989+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f41bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.989+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.989+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f38bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f38bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f3d260 2024-04-26T12:30:32.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f41bf0 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.990+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x7fd930076040 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.991+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.991+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f38bf0 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.991+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.991+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f3d260 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.991+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.991+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f41bf0 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f3d260 2024-04-26T12:30:32.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x7fd930076040 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f41bf0 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.992+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f3d260 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x55d922f38bf0 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd930090040 con 0x7fd930076040 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f40000 con 0x55d922f38bf0 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.993+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f40000 con 0x55d922f38bf0 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f40000 con 0x7fd930076040 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 zone default found 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 4 Realm: () 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 zonegroup default 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f408a0 con 0x55d922f3d260 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.994+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f465e0 con 0x55d922f41bf0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f46980 con 0x55d922f41bf0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd93bf46800 20 started sync module instance, tier type = 2024-04-26T12:30:32.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd93bf46800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.995+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f45a80 con 0x7fd930076040 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.996+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.996+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94391082704848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f45a80 con 0x7fd930076040 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.996+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f47340 con 0x55d922f38bf0 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.997+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94391082704848] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.997+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.997+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94391082702768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f47340 con 0x55d922f38bf0 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.997+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f47d00 con 0x55d922f41bf0 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.998+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.998+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94391082702768] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.998+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94391082711120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f485d0 con 0x55d922f41bf0 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.998+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f46e90 con 0x7fd930076040 2024-04-26T12:30:32.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.999+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94391082711120] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.999+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.999+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94391082713376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f48ff0 con 0x7fd930076040 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:31.999+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f499b0 con 0x55d922f38bf0 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.000+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94391082713376] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.000+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.000+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94391082716448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f499b0 con 0x55d922f38bf0 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.000+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4a370 con 0x55d922f3d260 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.001+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94391082716448] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.001+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.001+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94391082718944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4a370 con 0x55d922f3d260 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.001+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4ad30 con 0x55d922f3d260 2024-04-26T12:30:32.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.002+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94391082718944] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.002+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.002+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94391082721440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4ad30 con 0x55d922f3d260 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.002+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4b750 con 0x55d922f3d260 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94391082721440] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94391082725952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4b930 con 0x55d922f3d260 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 20 add_watcher() i=0 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 20 add_watcher() i=1 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 20 add_watcher() i=2 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 20 add_watcher() i=3 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 20 add_watcher() i=4 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 20 add_watcher() i=5 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.003+0000 7fd93bf46800 20 add_watcher() i=6 2024-04-26T12:30:32.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.004+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94391082725952] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.004+0000 7fd93bf46800 20 add_watcher() i=7 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.004+0000 7fd93bf46800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.004+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4ed00 con 0x55d922f38bf0 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.005+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.005+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94391082727456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f4c120 con 0x55d922f38bf0 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94391082727456] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd7eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:32.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 5 note: GC not initialized 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd7ea7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 20 Filter name: none 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd75bfff640 20 reqs_thread_entry: start 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.006+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f82380 con 0x55d922f38bf0 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f82df0 con 0x55d922f3d260 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.007+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f88720 con 0x55d922f38bf0 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.008+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93bf46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93bf46800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93bf46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94391082975632 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f83e30 con 0x55d922f38bf0 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94391082716448 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7fd934010040 con 0x55d922f38bf0 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd81d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94391082716448 notifier 4348 bl.length()=678 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd81d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd81d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(65 notify.4 [notify cookie 94391082975632 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd81d7fa640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd7fc003ea0 con 0x55d922f38bf0 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94391082975632 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd93402b440 con 0x55d922f38bf0 2024-04-26T12:30:32.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.009+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f88190 con 0x55d922f3d260 2024-04-26T12:30:32.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.010+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.010+0000 7fd93bf46800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.010+0000 7fd93bf46800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.010+0000 7fd93bf46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.010+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94391082975632 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d922f83980 con 0x55d922f41bf0 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== watch-notify(notify (1) cookie 94391082711120 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fd93008a040 con 0x55d922f41bf0 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd81d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94391082711120 notifier 4348 bl.length()=177 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd81d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd81d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd81d7fa640 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd7fc003ea0 con 0x55d922f41bf0 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(68 notify.2 [notify cookie 94391082975632 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== watch-notify(notify_complete (2) cookie 94391082975632 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d922cbdd40 con 0x55d922f41bf0 2024-04-26T12:30:32.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.011+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.028 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:30:32.008487Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:32.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.012+0000 7fd7eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.012+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94391082727456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f84260 con 0x55d922f38bf0 2024-04-26T12:30:32.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.013+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94391082727456] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.013+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94391082704848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f86d90 con 0x7fd930076040 2024-04-26T12:30:32.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.014+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94391082704848] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.014+0000 7fd93bf46800 20 remove_watcher() i=0 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.014+0000 7fd93bf46800 2 removed watcher, disabling cache 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.014+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94391082702768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f45fb0 con 0x55d922f38bf0 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.015+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94391082702768] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.015+0000 7fd93bf46800 20 remove_watcher() i=1 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.015+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94391082711120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f457b0 con 0x55d922f41bf0 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.016+0000 7fd939244640 1 -- 172.21.15.170:0/2356570205 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94391082711120] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd930081070 con 0x55d922f41bf0 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.016+0000 7fd93bf46800 20 remove_watcher() i=2 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.016+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94391082713376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f47850 con 0x7fd930076040 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.017+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94391082713376] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x7fd930076040 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.017+0000 7fd93bf46800 20 remove_watcher() i=3 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.017+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94391082716448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f47850 con 0x55d922f38bf0 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.018+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94391082716448] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd934026040 con 0x55d922f38bf0 2024-04-26T12:30:32.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.018+0000 7fd93bf46800 20 remove_watcher() i=4 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.018+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94391082718944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f48d20 con 0x55d922f3d260 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.019+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94391082718944] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.019+0000 7fd93bf46800 20 remove_watcher() i=5 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.019+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94391082721440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f47850 con 0x55d922f3d260 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.020+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94391082721440] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.020+0000 7fd93bf46800 20 remove_watcher() i=6 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.020+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94391082725952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d922f48d20 con 0x55d922f3d260 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd939a45640 1 -- 172.21.15.170:0/2356570205 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94391082725952] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd92c072030 con 0x55d922f3d260 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 20 remove_watcher() i=7 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f3d260 msgr2=0x55d922f3f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f3d260 0x55d922f3f650 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922f38bf0 msgr2=0x55d922f3b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922f38bf0 0x55d922f3b0b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd930076040 msgr2=0x7fd930083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd930076040 0x7fd930083410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d922f41bf0 msgr2=0x55d922f440b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d922f41bf0 0x55d922f440b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd804036900 msgr2=0x7fd804038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd804036900 0x7fd804038dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd93000a470 tx=0x7fd93004f000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93a246640 1 -- 172.21.15.170:0/2356570205 reap_dead start 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 msgr2=0x55d922f2d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.021+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f2d450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd92c03eff0 tx=0x7fd92c03c070 comp rx=0 tx=0).stop 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 shutdown_connections 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2356570205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f260f0 0x55d922f2d450 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 >> 172.21.15.170:0/2356570205 conn(0x55d922f223c0 msgr2=0x55d922f1fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 shutdown_connections 2024-04-26T12:30:32.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2356570205 wait complete. 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd814036950 msgr2=0x7fd814038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd814036950 0x7fd814038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55d922f025c0 tx=0x7fd930005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f18f40 msgr2=0x55d922f19360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f18f40 0x55d922f19360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd92c004690 tx=0x7fd92c010ab0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 shutdown_connections 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd814036950 0x7fd814038e10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2019949494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922f18f40 0x55d922f19360 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 >> 172.21.15.170:0/2019949494 conn(0x55d922f0cfe0 msgr2=0x55d922f0d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 shutdown_connections 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2019949494 wait complete. 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f04010 msgr2=0x55d922f06400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d922f04010 0x55d922f06400 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922d75140 msgr2=0x55d922f01780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d922d75140 0x55d922f01780 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d922f07f50 msgr2=0x55d922f0a380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d922f07f50 0x55d922f0a380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd820036950 msgr2=0x7fd820038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd820036950 0x7fd820038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd930054000 tx=0x7fd93004e000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 msgr2=0x55d922efa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 --2- 172.21.15.170:0/2434753440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d922d73e00 0x55d922efa710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd92c001b40 tx=0x7fd92c001250 comp rx=0 tx=0).stop 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93a246640 1 -- 172.21.15.170:0/2434753440 reap_dead start 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 shutdown_connections 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.022+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 >> 172.21.15.170:0/2434753440 conn(0x55d922dfaba0 msgr2=0x55d922ef1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.023+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 shutdown_connections 2024-04-26T12:30:32.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.023+0000 7fd93bf46800 1 -- 172.21.15.170:0/2434753440 wait complete. 2024-04-26T12:30:32.040 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:30:32.008487Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:32.040 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:32.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:32.040 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:32.083 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:32.083 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.083+0000 7ff18872e800 1 Processor -- start 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.083+0000 7ff18872e800 1 -- start start 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.083+0000 7ff18872e800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d79dcde140 0x55d79dcdc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.083+0000 7ff18872e800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d79dc150c0 con 0x55d79dcdcc30 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.083+0000 7ff18872e800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55d79dbf94d0 con 0x55d79dcde140 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.084+0000 7ff184467640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d79dcde140 0x55d79dcdc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.084+0000 7ff184467640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d79dcde140 0x55d79dcdc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41506/0 (socket says 172.21.15.170:41506) 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.084+0000 7ff17bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55d79dcdcc30 0x55d79dd70430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46080/0 (socket says 172.21.15.170:46080) 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.084+0000 7ff184467640 1 -- 172.21.15.170:0/569427516 learned_addr learned my addr 172.21.15.170:0/569427516 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.084+0000 7ff184467640 1 -- 172.21.15.170:0/569427516 >> v1:172.21.15.132:6789/0 conn(0x55d79dcdcc30 legacy=0x55d79dd70430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.084+0000 7ff184467640 1 -- 172.21.15.170:0/569427516 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79dc26d40 con 0x55d79dcde140 2024-04-26T12:30:32.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.084+0000 7ff183c66640 1 -- 172.21.15.170:0/569427516 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123744992 0 0) 0x55d79dc150c0 con 0x55d79dcdcc30 2024-04-26T12:30:32.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff184467640 1 --2- 172.21.15.170:0/569427516 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcde140 0x55d79dcdc6f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff17400a520 tx=0x7ff17401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f304aa87a2a06d14 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff183c66640 1 -- 172.21.15.170:0/569427516 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff174057070 con 0x55d79dcde140 2024-04-26T12:30:32.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff183c66640 1 -- 172.21.15.170:0/569427516 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174052570 con 0x55d79dcde140 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff183c66640 1 -- 172.21.15.170:0/569427516 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff17404ae60 con 0x55d79dcde140 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff18872e800 1 -- 172.21.15.170:0/569427516 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcde140 msgr2=0x55d79dcdc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff18872e800 1 --2- 172.21.15.170:0/569427516 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcde140 0x55d79dcdc6f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff17400a520 tx=0x7ff17401d010 comp rx=0 tx=0).stop 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff18872e800 1 -- 172.21.15.170:0/569427516 shutdown_connections 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff18872e800 1 --2- 172.21.15.170:0/569427516 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcde140 0x55d79dcdc6f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff18872e800 1 -- 172.21.15.170:0/569427516 >> 172.21.15.170:0/569427516 conn(0x55d79dd63b80 msgr2=0x55d79dd65fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff18872e800 1 -- 172.21.15.170:0/569427516 shutdown_connections 2024-04-26T12:30:32.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.086+0000 7ff18872e800 1 -- 172.21.15.170:0/569427516 wait complete. 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.098+0000 7ff18872e800 1 Processor -- start 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.098+0000 7ff18872e800 1 -- start start 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.098+0000 7ff18872e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de5bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.098+0000 7ff18872e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d79dcb3b40 con 0x55d79dcdcc30 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.098+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de5bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.098+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de5bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41512/0 (socket says 172.21.15.170:41512) 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.098+0000 7ff184467640 1 -- 172.21.15.170:0/4066151932 learned_addr learned my addr 172.21.15.170:0/4066151932 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.099+0000 7ff184467640 1 -- 172.21.15.170:0/4066151932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79dc25590 con 0x55d79dcdcc30 2024-04-26T12:30:32.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.099+0000 7ff184467640 1 --2- 172.21.15.170:0/4066151932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de5bc70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff174000c00 tx=0x7ff17404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7565590b4bde607d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.099+0000 7ff07260c640 1 -- 172.21.15.170:0/4066151932 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff174057040 con 0x55d79dcdcc30 2024-04-26T12:30:32.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.099+0000 7ff07260c640 1 -- 172.21.15.170:0/4066151932 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174052720 con 0x55d79dcdcc30 2024-04-26T12:30:32.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.099+0000 7ff07260c640 1 -- 172.21.15.170:0/4066151932 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff174052a40 con 0x55d79dcdcc30 2024-04-26T12:30:32.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 -- 172.21.15.170:0/4066151932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 msgr2=0x55d79de5bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 --2- 172.21.15.170:0/4066151932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de5bc70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff174000c00 tx=0x7ff17404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 -- 172.21.15.170:0/4066151932 shutdown_connections 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 --2- 172.21.15.170:0/4066151932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de5bc70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 -- 172.21.15.170:0/4066151932 >> 172.21.15.170:0/4066151932 conn(0x55d79dd63b80 msgr2=0x55d79de57590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 -- 172.21.15.170:0/4066151932 shutdown_connections 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 -- 172.21.15.170:0/4066151932 wait complete. 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 Processor -- start 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 -- start start 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de63500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff18872e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d79dd73e60 con 0x55d79dcdcc30 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de63500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de63500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41522/0 (socket says 172.21.15.170:41522) 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.100+0000 7ff184467640 1 -- 172.21.15.170:0/1300415109 learned_addr learned my addr 172.21.15.170:0/1300415109 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.101+0000 7ff184467640 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79dc1c8f0 con 0x55d79dcdcc30 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.101+0000 7ff184467640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de63500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff174052540 tx=0x7ff174003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.101+0000 7ff070e09640 1 -- 172.21.15.170:0/1300415109 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff174073070 con 0x55d79dcdcc30 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.101+0000 7ff070e09640 1 -- 172.21.15.170:0/1300415109 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174052c80 con 0x55d79dcdcc30 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.101+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d79de63a40 con 0x55d79dcdcc30 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.101+0000 7ff070e09640 1 -- 172.21.15.170:0/1300415109 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff174057070 con 0x55d79dcdcc30 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.101+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79de63f60 con 0x55d79dcdcc30 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff070e09640 1 -- 172.21.15.170:0/1300415109 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff174076070 con 0x55d79dcdcc30 2024-04-26T12:30:32.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff070e09640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff06c036950 0x7ff06c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff070e09640 1 -- 172.21.15.170:0/1300415109 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff17408da50 con 0x55d79dcdcc30 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff06c036950 0x7ff06c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dcde140 0x55d79de6a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79de6aab0 con 0x55d79dcde140 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff184c68640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dcde140 0x55d79de6a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff06c036950 0x7ff06c038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.102+0000 7ff184c68640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dcde140 0x55d79de6a570 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.103+0000 7ff184c68640 1 -- 172.21.15.170:0/1300415109 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dcde140 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.103+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79de67b20 con 0x55d79dcde140 2024-04-26T12:30:32.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.103+0000 7ff184c68640 1 -- 172.21.15.170:0/1300415109 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dcde140 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.103+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79de6cda0 0x55d79de6f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.103+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79de6f860 con 0x55d79de6cda0 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.103+0000 7ff184467640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79de6cda0 0x55d79de6f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.103+0000 7ff184467640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79de6cda0 0x55d79de6f190 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.104+0000 7ff184467640 1 -- 172.21.15.170:0/1300415109 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff174075030 con 0x55d79de6cda0 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.104+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79de6bd50 con 0x55d79dcde140 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.104+0000 7ff184c68640 1 -- 172.21.15.170:0/1300415109 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dcde140 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.104+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d79de70ca0 0x55d79de73160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.104+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79de738f0 con 0x55d79de70ca0 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.104+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d79de70ca0 0x55d79de73160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.104+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d79de70ca0 0x55d79de73160 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff17bfff640 1 -- 172.21.15.170:0/1300415109 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff16c00f670 con 0x55d79de70ca0 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff18872e800 1 Processor -- start 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff18872e800 1 -- start start 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff18872e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de81da0 0x55d79de821c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff18872e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d79dc59e60 con 0x55d79de81da0 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de81da0 0x55d79de821c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de81da0 0x55d79de821c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41534/0 (socket says 172.21.15.170:41534) 2024-04-26T12:30:32.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.105+0000 7ff184467640 1 -- 172.21.15.170:0/4111081474 learned_addr learned my addr 172.21.15.170:0/4111081474 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.106+0000 7ff184467640 1 -- 172.21.15.170:0/4111081474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79de82700 con 0x55d79de81da0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.106+0000 7ff184467640 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de81da0 0x55d79de821c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff174006910 tx=0x7ff174076810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.106+0000 7ff069ffb640 1 -- 172.21.15.170:0/4111081474 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff174006b90 con 0x55d79de81da0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.106+0000 7ff069ffb640 1 -- 172.21.15.170:0/4111081474 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff174006d30 con 0x55d79de81da0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.106+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d79de83170 con 0x55d79de81da0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.106+0000 7ff069ffb640 1 -- 172.21.15.170:0/4111081474 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff17406e780 con 0x55d79de81da0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.106+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79de83670 con 0x55d79de81da0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff069ffb640 1 -- 172.21.15.170:0/4111081474 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff17406e920 con 0x55d79de81da0 2024-04-26T12:30:32.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff069ffb640 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff05c036950 0x7ff05c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff069ffb640 1 -- 172.21.15.170:0/4111081474 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff17407a0f0 con 0x55d79de81da0 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff17bfff640 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff05c036950 0x7ff05c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff18872e800 1 Processor -- start 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff18872e800 1 -- start start 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff17bfff640 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff05c036950 0x7ff05c038e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55d79de6af40 tx=0x7ff16c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff18872e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de8f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.107+0000 7ff18872e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d79de5c330 con 0x55d79de8ef50 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de8f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de8f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41542/0 (socket says 172.21.15.170:41542) 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff184467640 1 -- 172.21.15.170:0/3670867374 learned_addr learned my addr 172.21.15.170:0/3670867374 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff184467640 1 -- 172.21.15.170:0/3670867374 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79de8f940 con 0x55d79de8ef50 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff184467640 1 --2- 172.21.15.170:0/3670867374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de8f370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff174095e90 tx=0x7ff1740957d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49e9a4d3ed0b74e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff0637fe640 1 -- 172.21.15.170:0/3670867374 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff17405d440 con 0x55d79de8ef50 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff0637fe640 1 -- 172.21.15.170:0/3670867374 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1740af070 con 0x55d79de8ef50 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff0637fe640 1 -- 172.21.15.170:0/3670867374 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff17405c580 con 0x55d79de8ef50 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff18872e800 1 -- 172.21.15.170:0/3670867374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 msgr2=0x55d79de8f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff18872e800 1 --2- 172.21.15.170:0/3670867374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de8f370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff174095e90 tx=0x7ff1740957d0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff18872e800 1 -- 172.21.15.170:0/3670867374 shutdown_connections 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff18872e800 1 --2- 172.21.15.170:0/3670867374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de8f370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.108+0000 7ff18872e800 1 -- 172.21.15.170:0/3670867374 >> 172.21.15.170:0/3670867374 conn(0x55d79de8b260 msgr2=0x55d79de892c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff18872e800 1 -- 172.21.15.170:0/3670867374 shutdown_connections 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff18872e800 1 -- 172.21.15.170:0/3670867374 wait complete. 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff18872e800 1 Processor -- start 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff18872e800 1 -- start start 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff18872e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de96310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff18872e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d79de8ffd0 con 0x55d79de8ef50 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de96310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff184467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de96310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41544/0 (socket says 172.21.15.170:41544) 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.109+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 learned_addr learned my addr 172.21.15.170:0/1287823552 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.110+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d79de96850 con 0x55d79de8ef50 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.110+0000 7ff184467640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de96310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff17407bdf0 tx=0x7ff174092e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.110+0000 7ff061ffb640 1 -- 172.21.15.170:0/1287823552 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff17408d540 con 0x55d79de8ef50 2024-04-26T12:30:32.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.110+0000 7ff061ffb640 1 -- 172.21.15.170:0/1287823552 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1740a3070 con 0x55d79de8ef50 2024-04-26T12:30:32.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.110+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d79de96850 con 0x55d79de8ef50 2024-04-26T12:30:32.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.110+0000 7ff061ffb640 1 -- 172.21.15.170:0/1287823552 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff17408a4b0 con 0x55d79de8ef50 2024-04-26T12:30:32.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.110+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d79de96850 con 0x55d79de8ef50 2024-04-26T12:30:32.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.111+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.111+0000 7ff061ffb640 1 -- 172.21.15.170:0/1287823552 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff17408a650 con 0x55d79de8ef50 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.111+0000 7ff061ffb640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff054036950 0x7ff054038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.111+0000 7ff061ffb640 1 -- 172.21.15.170:0/1287823552 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff1740c0ca0 con 0x55d79de8ef50 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.111+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff054036950 0x7ff054038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dea18d0 0x55d79dea3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea44c0 con 0x55d79dea18d0 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff184c68640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dea18d0 0x55d79dea3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff054036950 0x7ff054038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55d79de73cf0 tx=0x7ff16c023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff184c68640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dea18d0 0x55d79dea3d70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 20 realm 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea48d0 con 0x55d79dea18d0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.112+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5170 con 0x55d79dea18d0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff18872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff18872e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79dea6270 0x55d79dea8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea8be0 con 0x55d79dea6270 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff184467640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79dea6270 0x55d79dea8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.113+0000 7ff184467640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79dea6270 0x55d79dea8660 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.114+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.114+0000 7ff18872e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.114+0000 7ff18872e800 20 searching for the correct realm 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.114+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d79deaac30 0x55d79dead0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.114+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dead7c0 con 0x55d79deaac30 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.114+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d79deaac30 0x55d79dead0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.114+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d79deaac30 0x55d79dead0f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.115+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.115+0000 7ff17bfff640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff16c03a3c0 0x7ff16c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.115+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dead7c0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.115+0000 7ff184c68640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff16c03a3c0 0x7ff16c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.115+0000 7ff184c68640 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff16c03a3c0 0x7ff16c03a7e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.115+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.115+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.116+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x7ff16c03a3c0 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.117+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x7ff16c03a3c0 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.118+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.119+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x7ff16c03a3c0 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.120+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.121+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.121+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.121+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.121+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.121+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.121+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x7ff16c03a3c0 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79deaac30 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea6270 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.122+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x55d79dea18d0 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea5510 con 0x7ff16c03a3c0 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea9530 con 0x55d79dea18d0 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.123+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea9530 con 0x55d79dea18d0 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea9500 con 0x7ff16c03a3c0 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 zone default found 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 4 Realm: () 2024-04-26T12:30:32.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 zonegroup default 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79dea9920 con 0x55d79dea6270 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79deaf620 con 0x55d79deaac30 2024-04-26T12:30:32.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.124+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79deaf9c0 con 0x55d79deaac30 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.125+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.125+0000 7ff18872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.125+0000 7ff18872e800 20 started sync module instance, tier type = 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.125+0000 7ff18872e800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.125+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deaeac0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.126+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.126+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94384555749088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deaeac0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.126+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb0210 con 0x55d79dea18d0 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.127+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94384555749088] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.127+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.127+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94384555747104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb0210 con 0x55d79dea18d0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.127+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb0bd0 con 0x55d79deaac30 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.128+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94384555747104] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.128+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.128+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94384555752800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb0180 con 0x55d79deaac30 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.128+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb1a40 con 0x7ff16c03a3c0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.129+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.129+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94384555759472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb21e0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.129+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb2d00 con 0x55d79dea18d0 2024-04-26T12:30:32.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.129+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94384555752800] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.130+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94384555759472] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.130+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.130+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94384555763664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb2cc0 con 0x55d79dea18d0 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.130+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb35a0 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.131+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94384555763664] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.131+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.131+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94384555766000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb2cc0 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.131+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb3f60 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.132+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94384555766000] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.132+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.132+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94384555757424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb47b0 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.132+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb5170 con 0x55d79dea6270 2024-04-26T12:30:32.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.133+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94384555757424] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.133+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94384555773120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb5590 con 0x55d79dea6270 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=0 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=1 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=2 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=3 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=4 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=5 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=6 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94384555773120] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 20 add_watcher() i=7 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.134+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb8870 con 0x55d79dea18d0 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.135+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.135+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94384555774544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb5b20 con 0x55d79dea18d0 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94384555774544] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff03a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff18872e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff18872e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff18872e800 5 note: GC not initialized 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff0397e2640 20 reqs_thread_entry: start 2024-04-26T12:30:32.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff18872e800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:32.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff18872e800 20 Filter name: none 2024-04-26T12:30:32.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7fefaaffd640 20 reqs_thread_entry: start 2024-04-26T12:30:32.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff18872e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.136+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d79deebac0 con 0x55d79dea18d0 2024-04-26T12:30:32.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.137+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.137+0000 7ff18872e800 20 rados_obj.operate() r=0 bl.length=502 2024-04-26T12:30:32.158 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:30:32.008487Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:32.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.138+0000 7ff03a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.138+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94384555774544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deea530 con 0x55d79dea18d0 2024-04-26T12:30:32.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.138+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94384555774544] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.138+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94384555749088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deea9e0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.139+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94384555749088] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.139+0000 7ff18872e800 20 remove_watcher() i=0 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.139+0000 7ff18872e800 2 removed watcher, disabling cache 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.139+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94384555747104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deaeee0 con 0x55d79dea18d0 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.140+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94384555747104] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.140+0000 7ff18872e800 20 remove_watcher() i=1 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.140+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94384555752800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deaeee0 con 0x55d79deaac30 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.141+0000 7ff17bfff640 1 -- 172.21.15.170:0/1287823552 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94384555752800] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff16c037040 con 0x55d79deaac30 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.142+0000 7ff18872e800 20 remove_watcher() i=2 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.142+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94384555759472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deafd60 con 0x7ff16c03a3c0 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.143+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94384555759472] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x7ff16c03a3c0 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.143+0000 7ff18872e800 20 remove_watcher() i=3 2024-04-26T12:30:32.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.143+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94384555763664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deafd60 con 0x55d79dea18d0 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.143+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94384555763664] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c00a4a0 con 0x55d79dea18d0 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.143+0000 7ff18872e800 20 remove_watcher() i=4 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.144+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94384555766000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb27d0 con 0x55d79dea6270 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.145+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94384555766000] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.145+0000 7ff18872e800 20 remove_watcher() i=5 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.145+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94384555757424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deafd60 con 0x55d79dea6270 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.145+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94384555757424] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.145+0000 7ff18872e800 20 remove_watcher() i=6 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.145+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94384555773120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d79deb27d0 con 0x55d79dea6270 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff184467640 1 -- 172.21.15.170:0/1287823552 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94384555773120] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1740c5020 con 0x55d79dea6270 2024-04-26T12:30:32.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 20 remove_watcher() i=7 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79dea6270 msgr2=0x55d79dea8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79dea6270 0x55d79dea8660 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dea18d0 msgr2=0x55d79dea3d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dea18d0 0x55d79dea3d70 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff16c03a3c0 msgr2=0x7ff16c03a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ff16c03a3c0 0x7ff16c03a7e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d79deaac30 msgr2=0x55d79dead0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d79deaac30 0x55d79dead0f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff054036950 msgr2=0x7ff054038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff054036950 0x7ff054038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55d79de73cf0 tx=0x7ff16c023040 comp rx=0 tx=0).stop 2024-04-26T12:30:32.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 msgr2=0x55d79de96310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de96310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff17407bdf0 tx=0x7ff174092e70 comp rx=0 tx=0).stop 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff184c68640 1 -- 172.21.15.170:0/1287823552 reap_dead start 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 shutdown_connections 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/1287823552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de8ef50 0x55d79de96310 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 >> 172.21.15.170:0/1287823552 conn(0x55d79de8b260 msgr2=0x55d79de888c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 shutdown_connections 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/1287823552 wait complete. 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff05c036950 msgr2=0x7ff05c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff05c036950 0x7ff05c038e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55d79de6af40 tx=0x7ff16c006000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de81da0 msgr2=0x55d79de821c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de81da0 0x55d79de821c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff174006910 tx=0x7ff174076810 comp rx=0 tx=0).stop 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 shutdown_connections 2024-04-26T12:30:32.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff05c036950 0x7ff05c038e10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 --2- 172.21.15.170:0/4111081474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79de81da0 0x55d79de821c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 >> 172.21.15.170:0/4111081474 conn(0x55d79de75e40 msgr2=0x55d79de76240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 shutdown_connections 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.147+0000 7ff18872e800 1 -- 172.21.15.170:0/4111081474 wait complete. 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79de6cda0 msgr2=0x55d79de6f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d79de6cda0 0x55d79de6f190 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dcde140 msgr2=0x55d79de6a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d79dcde140 0x55d79de6a570 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d79de70ca0 msgr2=0x55d79de73160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d79de70ca0 0x55d79de73160 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff06c036950 msgr2=0x7ff06c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff06c036950 0x7ff06c038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c0013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 msgr2=0x55d79de63500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 --2- 172.21.15.170:0/1300415109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d79dcdcc30 0x55d79de63500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff174052540 tx=0x7ff174003020 comp rx=0 tx=0).stop 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff184c68640 1 -- 172.21.15.170:0/1300415109 reap_dead start 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 shutdown_connections 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 >> 172.21.15.170:0/1300415109 conn(0x55d79dd63b80 msgr2=0x55d79de5a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 shutdown_connections 2024-04-26T12:30:32.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.148+0000 7ff18872e800 1 -- 172.21.15.170:0/1300415109 wait complete. 2024-04-26T12:30:32.171 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:30:32.008487Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:32.172 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-26T12:30:32.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-26T12:30:32.172 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-26T12:30:32.251 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:32.251 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e43dc800 1 Processor -- start 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e43dc800 1 -- start start 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e43dc800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5578047bb5e0 0x5578047bba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e43dc800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578046680c0 con 0x5578047bc750 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e43dc800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55780464c4d0 con 0x5578047bb5e0 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e1ee2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5578047bb5e0 0x5578047bba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62dbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5578047bc750 0x5578047bcbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46096/0 (socket says 172.21.15.170:46096) 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e1ee2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5578047bb5e0 0x5578047bba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41554/0 (socket says 172.21.15.170:41554) 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62dbfff640 1 -- 172.21.15.170:0/4211034437 learned_addr learned my addr 172.21.15.170:0/4211034437 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4211034437 >> v1:172.21.15.132:6789/0 conn(0x5578047bc750 legacy=0x5578047bcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e16e1640 1 -- 172.21.15.170:0/4211034437 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960609224 0 0) 0x5578046680c0 con 0x5578047bc750 2024-04-26T12:30:32.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.251+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4211034437 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804679d40 con 0x5578047bb5e0 2024-04-26T12:30:32.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.253+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/4211034437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578047bba00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f62d400a470 tx=0x7f62d401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140d4a3e98d5c7c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.253+0000 7f62e16e1640 1 -- 172.21.15.170:0/4211034437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4057070 con 0x5578047bb5e0 2024-04-26T12:30:32.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.253+0000 7f62e16e1640 1 -- 172.21.15.170:0/4211034437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4052570 con 0x5578047bb5e0 2024-04-26T12:30:32.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.253+0000 7f62e16e1640 1 -- 172.21.15.170:0/4211034437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4052870 con 0x5578047bb5e0 2024-04-26T12:30:32.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.254+0000 7f62e43dc800 1 -- 172.21.15.170:0/4211034437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 msgr2=0x5578047bba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.254+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4211034437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578047bba00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f62d400a470 tx=0x7f62d401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:32.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.254+0000 7f62e43dc800 1 -- 172.21.15.170:0/4211034437 shutdown_connections 2024-04-26T12:30:32.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.254+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4211034437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578047bba00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.254+0000 7f62e43dc800 1 -- 172.21.15.170:0/4211034437 >> 172.21.15.170:0/4211034437 conn(0x5578047b6ba0 msgr2=0x5578047b8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.254+0000 7f62e43dc800 1 -- 172.21.15.170:0/4211034437 shutdown_connections 2024-04-26T12:30:32.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.254+0000 7f62e43dc800 1 -- 172.21.15.170:0/4211034437 wait complete. 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e43dc800 1 Processor -- start 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e43dc800 1 -- start start 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e43dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e43dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557804706b70 con 0x5578047bb5e0 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41562/0 (socket says 172.21.15.170:41562) 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e1ee2640 1 -- 172.21.15.170:0/2254208524 learned_addr learned my addr 172.21.15.170:0/2254208524 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.266+0000 7f62e1ee2640 1 -- 172.21.15.170:0/2254208524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804678590 con 0x5578047bb5e0 2024-04-26T12:30:32.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.267+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/2254208524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048ac9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62d4055040 tx=0x7f62d404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e179a2546b3da1b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.267+0000 7f61cfe07640 1 -- 172.21.15.170:0/2254208524 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4063070 con 0x5578047bb5e0 2024-04-26T12:30:32.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.267+0000 7f61cfe07640 1 -- 172.21.15.170:0/2254208524 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4058040 con 0x5578047bb5e0 2024-04-26T12:30:32.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.267+0000 7f61cfe07640 1 -- 172.21.15.170:0/2254208524 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4057070 con 0x5578047bb5e0 2024-04-26T12:30:32.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.267+0000 7f62e43dc800 1 -- 172.21.15.170:0/2254208524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 msgr2=0x5578048ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.267+0000 7f62e43dc800 1 --2- 172.21.15.170:0/2254208524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048ac9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f62d4055040 tx=0x7f62d404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 -- 172.21.15.170:0/2254208524 shutdown_connections 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 --2- 172.21.15.170:0/2254208524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048ac9f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 -- 172.21.15.170:0/2254208524 >> 172.21.15.170:0/2254208524 conn(0x5578047b6ba0 msgr2=0x5578048a8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 -- 172.21.15.170:0/2254208524 shutdown_connections 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 -- 172.21.15.170:0/2254208524 wait complete. 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 Processor -- start 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 -- start start 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e43dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578047c4bf0 con 0x5578047bb5e0 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41574/0 (socket says 172.21.15.170:41574) 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e1ee2640 1 -- 172.21.15.170:0/1632413460 learned_addr learned my addr 172.21.15.170:0/1632413460 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.268+0000 7f62e1ee2640 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780466f8f0 con 0x5578047bb5e0 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.269+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048b4360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62d4061040 tx=0x7f62d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.269+0000 7f61ce604640 1 -- 172.21.15.170:0/1632413460 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4063030 con 0x5578047bb5e0 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.269+0000 7f61ce604640 1 -- 172.21.15.170:0/1632413460 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d4052a60 con 0x5578047bb5e0 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.269+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578048b48a0 con 0x5578047bb5e0 2024-04-26T12:30:32.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.269+0000 7f61ce604640 1 -- 172.21.15.170:0/1632413460 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4052d40 con 0x5578047bb5e0 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.269+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578048b4dc0 con 0x5578047bb5e0 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f61ce604640 1 -- 172.21.15.170:0/1632413460 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f62d405e480 con 0x5578047bb5e0 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f61ce604640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61c8036950 0x7f61c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f61ce604640 1 -- 172.21.15.170:0/1632413460 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f62d4064070 con 0x5578047bb5e0 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f62dbfff640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61c8036950 0x7f61c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578047bc750 0x5578048bb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048bb8c0 con 0x5578047bc750 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f62e26e3640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578047bc750 0x5578048bb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f62dbfff640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61c8036950 0x7f61c8038e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62cc000c00 tx=0x7f62cc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.270+0000 7f62e26e3640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578047bc750 0x5578048bb380 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.271+0000 7f62e26e3640 1 -- 172.21.15.170:0/1632413460 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578047bc750 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.271+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048b8930 con 0x5578047bc750 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.271+0000 7f62e26e3640 1 -- 172.21.15.170:0/1632413460 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578047bc750 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.271+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048bdbb0 0x5578048bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.271+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048c0670 con 0x5578048bdbb0 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.271+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048bdbb0 0x5578048bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.272+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048bdbb0 0x5578048bffa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.272+0000 7f62e1ee2640 1 -- 172.21.15.170:0/1632413460 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f62d4070020 con 0x5578048bdbb0 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.272+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048bcb60 con 0x5578047bc750 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.272+0000 7f62e26e3640 1 -- 172.21.15.170:0/1632413460 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578047bc750 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.272+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578048c1ab0 0x5578048c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.272+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048c4700 con 0x5578048c1ab0 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.272+0000 7f62dbfff640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578048c1ab0 0x5578048c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.273+0000 7f62dbfff640 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578048c1ab0 0x5578048c3f70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.273+0000 7f62dbfff640 1 -- 172.21.15.170:0/1632413460 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f62cc00f670 con 0x5578048c1ab0 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.273+0000 7f62e43dc800 1 Processor -- start 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.273+0000 7f62e43dc800 1 -- start start 2024-04-26T12:30:32.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.273+0000 7f62e43dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578048d2bb0 0x5578048d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.273+0000 7f62e43dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578046ace60 con 0x5578048d2bb0 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578048d2bb0 0x5578048d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578048d2bb0 0x5578048d2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41584/0 (socket says 172.21.15.170:41584) 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4165901991 learned_addr learned my addr 172.21.15.170:0/4165901991 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4165901991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578048d3510 con 0x5578048d2bb0 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578048d2bb0 0x5578048d2fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f62d408c8b0 tx=0x7f62d405c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f61c77fe640 1 -- 172.21.15.170:0/4165901991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d408b120 con 0x5578048d2bb0 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f61c77fe640 1 -- 172.21.15.170:0/4165901991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d408b2c0 con 0x5578048d2bb0 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f61c77fe640 1 -- 172.21.15.170:0/4165901991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d4076a40 con 0x5578048d2bb0 2024-04-26T12:30:32.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578048d3f80 con 0x5578048d2bb0 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.274+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578048d3f80 con 0x5578048d2bb0 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.275+0000 7f61c77fe640 1 -- 172.21.15.170:0/4165901991 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f62d4087070 con 0x5578048d2bb0 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.275+0000 7f61c77fe640 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61bc036950 0x7f61bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.275+0000 7f61c77fe640 1 -- 172.21.15.170:0/4165901991 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f62d40073e0 con 0x5578048d2bb0 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.275+0000 7f62dbfff640 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61bc036950 0x7f61bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.275+0000 7f62e43dc800 1 Processor -- start 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.275+0000 7f62e43dc800 1 -- start start 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62dbfff640 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61bc036950 0x7f61bc038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x5578048bbd50 tx=0x7f62cc006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62e43dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578047310f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62e43dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578048ad0b0 con 0x557804730cd0 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578047310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578047310f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41586/0 (socket says 172.21.15.170:41586) 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62e1ee2640 1 -- 172.21.15.170:0/1784187113 learned_addr learned my addr 172.21.15.170:0/1784187113 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62e1ee2640 1 -- 172.21.15.170:0/1784187113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780472f4d0 con 0x557804730cd0 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/1784187113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578047310f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62d4082fd0 tx=0x7f62d407ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d17286a6284436 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f61c57fa640 1 -- 172.21.15.170:0/1784187113 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d404be60 con 0x557804730cd0 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f61c57fa640 1 -- 172.21.15.170:0/1784187113 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d40a6070 con 0x557804730cd0 2024-04-26T12:30:32.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.276+0000 7f61c57fa640 1 -- 172.21.15.170:0/1784187113 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d408ddd0 con 0x557804730cd0 2024-04-26T12:30:32.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 -- 172.21.15.170:0/1784187113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 msgr2=0x5578047310f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1784187113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578047310f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62d4082fd0 tx=0x7f62d407ea80 comp rx=0 tx=0).stop 2024-04-26T12:30:32.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 -- 172.21.15.170:0/1784187113 shutdown_connections 2024-04-26T12:30:32.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1784187113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578047310f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 -- 172.21.15.170:0/1784187113 >> 172.21.15.170:0/1784187113 conn(0x5578048dbec0 msgr2=0x5578048d9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 -- 172.21.15.170:0/1784187113 shutdown_connections 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 -- 172.21.15.170:0/1784187113 wait complete. 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 Processor -- start 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 -- start start 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578048e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e43dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55780472f8e0 con 0x557804730cd0 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578048e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e1ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578048e90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41592/0 (socket says 172.21.15.170:41592) 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.277+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 learned_addr learned my addr 172.21.15.170:0/4001579181 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.278+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578048e9630 con 0x557804730cd0 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.278+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578048e90f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f62d40057d0 tx=0x7f62d4058ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.278+0000 7f61b37fe640 1 -- 172.21.15.170:0/4001579181 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d405e9a0 con 0x557804730cd0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.278+0000 7f61b37fe640 1 -- 172.21.15.170:0/4001579181 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d40b7070 con 0x557804730cd0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.278+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578048e9630 con 0x557804730cd0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.278+0000 7f61b37fe640 1 -- 172.21.15.170:0/4001579181 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62d405eb40 con 0x557804730cd0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.278+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578048e9ad0 con 0x557804730cd0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.279+0000 7f61b37fe640 1 -- 172.21.15.170:0/4001579181 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f62d40a0070 con 0x557804730cd0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.279+0000 7f61b37fe640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61ac036900 0x7f61ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.279+0000 7f61b37fe640 1 -- 172.21.15.170:0/4001579181 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f62d409d030 con 0x557804730cd0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.279+0000 7f62dbfff640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61ac036900 0x7f61ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.279+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.279+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578048f4730 0x5578048f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.279+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048f7340 con 0x5578048f4730 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62dbfff640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61ac036900 0x7f61ac038dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5578048c4b00 tx=0x7f62cc023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e26e3640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578048f4730 0x5578048f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e26e3640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578048f4730 0x5578048f6bf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 20 realm 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048f7750 con 0x5578048f4730 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048f8020 con 0x5578048f4730 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.280+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.281+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.281+0000 7f62e43dc800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.281+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.281+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048f9120 0x5578048fb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.281+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048fbad0 con 0x5578048f9120 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.281+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048f9120 0x5578048fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.281+0000 7f62e1ee2640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048f9120 0x5578048fb510 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.282+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.282+0000 7f62e43dc800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.282+0000 7f62e43dc800 20 searching for the correct realm 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.282+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578048fda80 0x5578048fff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.282+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557804900610 con 0x5578048fda80 2024-04-26T12:30:32.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.282+0000 7f62dbfff640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578048fda80 0x5578048fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.282+0000 7f62dbfff640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578048fda80 0x5578048fff40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.283+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.283+0000 7f62dbfff640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f62cc03a3c0 0x7f62cc03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.283+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557804900610 con 0x7f62cc03a3c0 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.283+0000 7f62e26e3640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f62cc03a3c0 0x7f62cc03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.283+0000 7f62e26e3640 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f62cc03a3c0 0x7f62cc03a810 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.283+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.283+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.284+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.285+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.286+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.287+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.288+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.289+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.290+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.290+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048fda80 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.290+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.290+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f9120 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.290+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.290+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x5578048f4730 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578048f83c0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:32.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:32.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048fc390 con 0x5578048f4730 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048fc390 con 0x5578048f4730 2024-04-26T12:30:32.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.291+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048fc390 con 0x7f62cc03a3c0 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 zone default found 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 4 Realm: () 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 zonegroup default 2024-04-26T12:30:32.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578048fcc30 con 0x5578048f9120 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557804902470 con 0x5578048fda80 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557804902810 con 0x5578048fda80 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.292+0000 7f62e43dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.293+0000 7f62e43dc800 20 started sync module instance, tier type = 2024-04-26T12:30:32.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.293+0000 7f62e43dc800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.293+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804901910 con 0x7f62cc03a3c0 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.294+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.294+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93973960990224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804901910 con 0x7f62cc03a3c0 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.294+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578049031d0 con 0x5578048f4730 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.295+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93973960990224] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.295+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.295+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93973960988224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578049031d0 con 0x5578048f4730 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.295+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804903c10 con 0x5578048fda80 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.296+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93973960988224] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.296+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.296+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93973960994080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804903140 con 0x5578048fda80 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.296+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804904ad0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.297+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93973960994080] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.297+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.297+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93973961000480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804904a40 con 0x7f62cc03a3c0 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.297+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804905890 con 0x5578048f4730 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.298+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.298+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93973961003888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804905890 con 0x5578048f4730 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.298+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578049067d0 con 0x5578048f9120 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.299+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93973961000480] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.299+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.299+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93973961003888] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.299+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93973961007776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804904e90 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.300+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804907070 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.300+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93973961007776] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.300+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.300+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93973961006208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578049078c0 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.300+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804908190 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.301+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93973961006208] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.301+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93973961012752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804908150 con 0x5578048f9120 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=0 2024-04-26T12:30:32.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=1 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=2 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=3 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=4 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=5 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=6 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93973961012752] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 20 add_watcher() i=7 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.302+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55780490b5e0 con 0x5578048f4730 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.303+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.303+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93973961013936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804908b30 con 0x5578048f4730 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93973961013936] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f61937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f62e43dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f62e43dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f62e43dc800 5 note: GC not initialized 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f61927fc640 20 reqs_thread_entry: start 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f62e43dc800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.304+0000 7f62e43dc800 20 Filter name: none 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f6103fff640 20 reqs_thread_entry: start 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55780493ed30 con 0x5578048f4730 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 20 rados_obj.operate() r=0 bl.length=502 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.305+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578049453c0 con 0x5578048f4730 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f62e43dc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f62e43dc800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f62e43dc800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:32.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93973961264688 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557804940ad0 con 0x5578048f4730 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 93973961003888 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f62dc0266e0 con 0x5578048f4730 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f61c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 93973961003888 notifier 4362 bl.length()=567 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f61c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.306+0000 7f61c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.307+0000 7f61c57fa640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f61a4003ea0 con 0x5578048f4730 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.307+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(64 notify.4 [notify cookie 93973961264688 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.307+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.307+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 93973961264688 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f62dc018d60 con 0x5578048f4730 2024-04-26T12:30:32.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.307+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804944e30 con 0x5578048f9120 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.308+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.308+0000 7f62e43dc800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.308+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93973961264688 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557804940620 con 0x5578048fda80 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.308+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== watch-notify(notify (1) cookie 93973960994080 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f62cc018040 con 0x5578048fda80 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.308+0000 7f61c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 93973960994080 notifier 4362 bl.length()=170 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.309+0000 7f61c4ff9640 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f610c0032c0 con 0x5578048fda80 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.309+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 notify.2 [notify cookie 93973961264688 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.309+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.309+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== watch-notify(notify_complete (2) cookie 93973961264688 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f62cc03ad50 con 0x5578048fda80 2024-04-26T12:30:32.334 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:32.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.310+0000 7f61937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.310+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93973961013936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55780493d2b0 con 0x5578048f4730 2024-04-26T12:30:32.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.311+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93973961013936] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.311+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93973960990224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804907a70 con 0x7f62cc03a3c0 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.312+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93973960990224] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.312+0000 7f62e43dc800 20 remove_watcher() i=0 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.312+0000 7f62e43dc800 2 removed watcher, disabling cache 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.312+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93973960988224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804901df0 con 0x5578048f4730 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.313+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93973960988224] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.313+0000 7f62e43dc800 20 remove_watcher() i=1 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.313+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93973960994080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804901640 con 0x5578048fda80 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.314+0000 7f62dbfff640 1 -- 172.21.15.170:0/4001579181 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93973960994080] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62cc037040 con 0x5578048fda80 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.314+0000 7f62e43dc800 20 remove_watcher() i=2 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.314+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93973961000480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804901640 con 0x7f62cc03a3c0 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.315+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93973961000480] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x7f62cc03a3c0 2024-04-26T12:30:32.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.315+0000 7f62e43dc800 20 remove_watcher() i=3 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.315+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93973961003888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804904620 con 0x5578048f4730 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.316+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93973961003888] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62dc00a4a0 con 0x5578048f4730 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.316+0000 7f62e43dc800 20 remove_watcher() i=4 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.316+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93973961007776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804901640 con 0x5578048f9120 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.317+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93973961007776] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.317+0000 7f62e43dc800 20 remove_watcher() i=5 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.317+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93973961006208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804905370 con 0x5578048f9120 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.318+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93973961006208] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.318+0000 7f62e43dc800 20 remove_watcher() i=6 2024-04-26T12:30:32.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.318+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93973961012752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557804904620 con 0x5578048f9120 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e1ee2640 1 -- 172.21.15.170:0/4001579181 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93973961012752] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f62d4094020 con 0x5578048f9120 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 20 remove_watcher() i=7 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048f9120 msgr2=0x5578048fb510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048f9120 0x5578048fb510 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578048f4730 msgr2=0x5578048f6bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578048f4730 0x5578048f6bf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f62cc03a3c0 msgr2=0x7f62cc03a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f62cc03a3c0 0x7f62cc03a810 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578048fda80 msgr2=0x5578048fff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578048fda80 0x5578048fff40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61ac036900 msgr2=0x7f61ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61ac036900 0x7f61ac038dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5578048c4b00 tx=0x7f62cc023040 comp rx=0 tx=0).stop 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 msgr2=0x5578048e90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4001579181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557804730cd0 0x5578048e90f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f62d40057d0 tx=0x7f62d4058ea0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e26e3640 1 -- 172.21.15.170:0/4001579181 reap_dead start 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 shutdown_connections 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.319+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 >> 172.21.15.170:0/4001579181 conn(0x5578048dbec0 msgr2=0x5578048d9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 shutdown_connections 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4001579181 wait complete. 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61bc036950 msgr2=0x7f61bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61bc036950 0x7f61bc038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x5578048bbd50 tx=0x7f62cc006000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578048d2bb0 msgr2=0x5578048d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578048d2bb0 0x5578048d2fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f62d408c8b0 tx=0x7f62d405c9f0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 shutdown_connections 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61bc036950 0x7f61bc038e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/4165901991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578048d2bb0 0x5578048d2fd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 >> 172.21.15.170:0/4165901991 conn(0x5578048c6c50 msgr2=0x5578048c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 shutdown_connections 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/4165901991 wait complete. 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048bdbb0 msgr2=0x5578048bffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578048bdbb0 0x5578048bffa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578047bc750 msgr2=0x5578048bb380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578047bc750 0x5578048bb380 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578048c1ab0 msgr2=0x5578048c3f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578048c1ab0 0x5578048c3f70 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61c8036950 msgr2=0x7f61c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61c8036950 0x7f61c8038e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62cc000c00 tx=0x7f62cc0013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 msgr2=0x5578048b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 --2- 172.21.15.170:0/1632413460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578047bb5e0 0x5578048b4360 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f62d4061040 tx=0x7f62d4002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e26e3640 1 -- 172.21.15.170:0/1632413460 reap_dead start 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 shutdown_connections 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 >> 172.21.15.170:0/1632413460 conn(0x5578047b6ba0 msgr2=0x5578048ab3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.320+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 shutdown_connections 2024-04-26T12:30:32.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.321+0000 7f62e43dc800 1 -- 172.21.15.170:0/1632413460 wait complete. 2024-04-26T12:30:32.347 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:32.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-26T12:30:32.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-26T12:30:32.348 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-26T12:30:32.392 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:32.392 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f4732da2800 1 Processor -- start 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f4732da2800 1 -- start start 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f4732da2800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55e656065b30 0x55e656067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f4732da2800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e655f0e0c0 con 0x55e656062020 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f4732da2800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55e655ef24d0 con 0x55e656065b30 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f472bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55e656065b30 0x55e656067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f472bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55e656065b30 0x55e656067f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41606/0 (socket says 172.21.15.170:41606) 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f472bfff640 1 -- 172.21.15.170:0/4127404789 learned_addr learned my addr 172.21.15.170:0/4127404789 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.392+0000 7f47308a8640 1 --1- 172.21.15.170:0/4127404789 >> v1:172.21.15.132:6789/0 conn(0x55e656062020 0x55e656064410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46106/0 (socket says 172.21.15.170:46106) 2024-04-26T12:30:32.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.393+0000 7f472bfff640 1 -- 172.21.15.170:0/4127404789 >> v1:172.21.15.132:6789/0 conn(0x55e656062020 legacy=0x55e656064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.393+0000 7f472b7fe640 1 -- 172.21.15.170:0/4127404789 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137136859 0 0) 0x55e655f0e0c0 con 0x55e656062020 2024-04-26T12:30:32.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.393+0000 7f472bfff640 1 -- 172.21.15.170:0/4127404789 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e655f1fd40 con 0x55e656065b30 2024-04-26T12:30:32.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.394+0000 7f472bfff640 1 --2- 172.21.15.170:0/4127404789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656065b30 0x55e656067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f471c00a520 tx=0x7f471c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3e426e85ff24a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f472b7fe640 1 -- 172.21.15.170:0/4127404789 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f471c057070 con 0x55e656065b30 2024-04-26T12:30:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f472b7fe640 1 -- 172.21.15.170:0/4127404789 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471c052570 con 0x55e656065b30 2024-04-26T12:30:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f472b7fe640 1 -- 172.21.15.170:0/4127404789 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f471c04ae60 con 0x55e656065b30 2024-04-26T12:30:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f4732da2800 1 -- 172.21.15.170:0/4127404789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656065b30 msgr2=0x55e656067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f4732da2800 1 --2- 172.21.15.170:0/4127404789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656065b30 0x55e656067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f471c00a520 tx=0x7f471c01d010 comp rx=0 tx=0).stop 2024-04-26T12:30:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f4732da2800 1 -- 172.21.15.170:0/4127404789 shutdown_connections 2024-04-26T12:30:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f4732da2800 1 --2- 172.21.15.170:0/4127404789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656065b30 0x55e656067f20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f4732da2800 1 -- 172.21.15.170:0/4127404789 >> 172.21.15.170:0/4127404789 conn(0x55e65605b9b0 msgr2=0x55e65605ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f4732da2800 1 -- 172.21.15.170:0/4127404789 shutdown_connections 2024-04-26T12:30:32.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.395+0000 7f4732da2800 1 -- 172.21.15.170:0/4127404789 wait complete. 2024-04-26T12:30:32.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f4732da2800 1 Processor -- start 2024-04-26T12:30:32.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f4732da2800 1 -- start start 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f4732da2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e656061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f4732da2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e655facb70 con 0x55e656062020 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e656061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e656061960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41620/0 (socket says 172.21.15.170:41620) 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f47308a8640 1 -- 172.21.15.170:0/2431876799 learned_addr learned my addr 172.21.15.170:0/2431876799 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f47308a8640 1 -- 172.21.15.170:0/2431876799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e655f1e590 con 0x55e656062020 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.407+0000 7f47308a8640 1 --2- 172.21.15.170:0/2431876799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e656061960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f472400b210 tx=0x7f472400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a15b9232807185c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f461ee05640 1 -- 172.21.15.170:0/2431876799 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4724008070 con 0x55e656062020 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f461ee05640 1 -- 172.21.15.170:0/2431876799 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472400d500 con 0x55e656062020 2024-04-26T12:30:32.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f461ee05640 1 -- 172.21.15.170:0/2431876799 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f472400d840 con 0x55e656062020 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f4732da2800 1 -- 172.21.15.170:0/2431876799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 msgr2=0x55e656061960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f4732da2800 1 --2- 172.21.15.170:0/2431876799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e656061960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f472400b210 tx=0x7f472400b6d0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f4732da2800 1 -- 172.21.15.170:0/2431876799 shutdown_connections 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f4732da2800 1 --2- 172.21.15.170:0/2431876799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e656061960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f4732da2800 1 -- 172.21.15.170:0/2431876799 >> 172.21.15.170:0/2431876799 conn(0x55e65605b9b0 msgr2=0x55e65614de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f4732da2800 1 -- 172.21.15.170:0/2431876799 shutdown_connections 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.408+0000 7f4732da2800 1 -- 172.21.15.170:0/2431876799 wait complete. 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.409+0000 7f4732da2800 1 Processor -- start 2024-04-26T12:30:32.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.409+0000 7f4732da2800 1 -- start start 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.409+0000 7f4732da2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e65615c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.409+0000 7f4732da2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e65606a770 con 0x55e656062020 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.409+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e65615c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.409+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e65615c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41622/0 (socket says 172.21.15.170:41622) 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.409+0000 7f47308a8640 1 -- 172.21.15.170:0/3679475143 learned_addr learned my addr 172.21.15.170:0/3679475143 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.410+0000 7f47308a8640 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e655f158f0 con 0x55e656062020 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.410+0000 7f47308a8640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e65615c100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f472400b210 tx=0x7f4724000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.410+0000 7f461d602640 1 -- 172.21.15.170:0/3679475143 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f472400f950 con 0x55e656062020 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.410+0000 7f461d602640 1 -- 172.21.15.170:0/3679475143 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472400faf0 con 0x55e656062020 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.410+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e65615c640 con 0x55e656062020 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.410+0000 7f461d602640 1 -- 172.21.15.170:0/3679475143 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f472400fdd0 con 0x55e656062020 2024-04-26T12:30:32.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.410+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65615cb60 con 0x55e656062020 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f461d602640 1 -- 172.21.15.170:0/3679475143 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4724017040 con 0x55e656062020 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f461d602640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4618036900 0x7f4618038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f461d602640 1 -- 172.21.15.170:0/3679475143 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4724015020 con 0x55e656062020 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f472bfff640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4618036900 0x7f4618038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e656065b30 0x55e656163170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561636b0 con 0x55e656065b30 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f47310a9640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e656065b30 0x55e656163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f472bfff640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4618036900 0x7f4618038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f471c054000 tx=0x7f471c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.411+0000 7f47310a9640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e656065b30 0x55e656163170 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.412+0000 7f47310a9640 1 -- 172.21.15.170:0/3679475143 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e656065b30 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.412+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e656160740 con 0x55e656065b30 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.412+0000 7f47310a9640 1 -- 172.21.15.170:0/3679475143 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e656065b30 2024-04-26T12:30:32.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.412+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e6561659c0 0x55e656167db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.412+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e656168450 con 0x55e6561659c0 2024-04-26T12:30:32.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.412+0000 7f47308a8640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e6561659c0 0x55e656167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.413+0000 7f47308a8640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e6561659c0 0x55e656167db0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.413+0000 7f47308a8640 1 -- 172.21.15.170:0/3679475143 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f472402d070 con 0x55e6561659c0 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.413+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e656164970 con 0x55e656065b30 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.413+0000 7f47310a9640 1 -- 172.21.15.170:0/3679475143 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e656065b30 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.413+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55e656169900 0x55e65616bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.413+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e65616c4b0 con 0x55e656169900 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.413+0000 7f472bfff640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55e656169900 0x55e65616bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.414+0000 7f472bfff640 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55e656169900 0x55e65616bd50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.414+0000 7f472bfff640 1 -- 172.21.15.170:0/3679475143 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f471c05a040 con 0x55e656169900 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.414+0000 7f4732da2800 1 Processor -- start 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.414+0000 7f4732da2800 1 -- start start 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.414+0000 7f4732da2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e65617a910 0x55e65617ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.414+0000 7f4732da2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e655f52e60 con 0x55e65617a910 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e65617a910 0x55e65617ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e65617a910 0x55e65617ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41626/0 (socket says 172.21.15.170:41626) 2024-04-26T12:30:32.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f47308a8640 1 -- 172.21.15.170:0/3963064693 learned_addr learned my addr 172.21.15.170:0/3963064693 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f47308a8640 1 -- 172.21.15.170:0/3963064693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65617b270 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f47308a8640 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e65617a910 0x55e65617ad30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f472404b4b0 tx=0x7f472401aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f46167fc640 1 -- 172.21.15.170:0/3963064693 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4724019470 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f46167fc640 1 -- 172.21.15.170:0/3963064693 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4724019610 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e65617bce0 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f46167fc640 1 -- 172.21.15.170:0/3963064693 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47240198f0 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.415+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65617c1e0 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f46167fc640 1 -- 172.21.15.170:0/3963064693 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f472403f1b0 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f46167fc640 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4608036900 0x7f4608038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f46167fc640 1 -- 172.21.15.170:0/3963064693 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f472403cc50 con 0x55e65617a910 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f472bfff640 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4608036900 0x7f4608038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f4732da2800 1 Processor -- start 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f4732da2800 1 -- start start 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f472bfff640 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4608036900 0x7f4608038dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55e656160660 tx=0x7f471c005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f4732da2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e6561880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.416+0000 7f4732da2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e65605ffe0 con 0x55e656187cb0 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e6561880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e6561880d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41630/0 (socket says 172.21.15.170:41630) 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f47308a8640 1 -- 172.21.15.170:0/4128251485 learned_addr learned my addr 172.21.15.170:0/4128251485 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f47308a8640 1 -- 172.21.15.170:0/4128251485 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6561886a0 con 0x55e656187cb0 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f47308a8640 1 --2- 172.21.15.170:0/4128251485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e6561880d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f472400e6b0 tx=0x7f4724026640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a72309e14208e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f4607fff640 1 -- 172.21.15.170:0/4128251485 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f472404b530 con 0x55e656187cb0 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f4607fff640 1 -- 172.21.15.170:0/4128251485 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4724026430 con 0x55e656187cb0 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.417+0000 7f4607fff640 1 -- 172.21.15.170:0/4128251485 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4724040e20 con 0x55e656187cb0 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 -- 172.21.15.170:0/4128251485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 msgr2=0x55e6561880d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 --2- 172.21.15.170:0/4128251485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e6561880d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f472400e6b0 tx=0x7f4724026640 comp rx=0 tx=0).stop 2024-04-26T12:30:32.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 -- 172.21.15.170:0/4128251485 shutdown_connections 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 --2- 172.21.15.170:0/4128251485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e6561880d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 -- 172.21.15.170:0/4128251485 >> 172.21.15.170:0/4128251485 conn(0x55e656183f30 msgr2=0x55e656181f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 -- 172.21.15.170:0/4128251485 shutdown_connections 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 -- 172.21.15.170:0/4128251485 wait complete. 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 Processor -- start 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 -- start start 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e65618f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f4732da2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e656188d10 con 0x55e656187cb0 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e65618f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f47308a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e65618f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41640/0 (socket says 172.21.15.170:41640) 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.418+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 learned_addr learned my addr 172.21.15.170:0/594347196 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.419+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65618f590 con 0x55e656187cb0 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.419+0000 7f47308a8640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e65618f050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f472403cec0 tx=0x7f4724027400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.419+0000 7f46067fc640 1 -- 172.21.15.170:0/594347196 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f472400c280 con 0x55e656187cb0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.419+0000 7f46067fc640 1 -- 172.21.15.170:0/594347196 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472406b030 con 0x55e656187cb0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.419+0000 7f46067fc640 1 -- 172.21.15.170:0/594347196 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f472404bc60 con 0x55e656187cb0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.419+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e65618f590 con 0x55e656187cb0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.419+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65618f590 con 0x55e656187cb0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f46067fc640 1 -- 172.21.15.170:0/594347196 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4724030450 con 0x55e656187cb0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f46067fc640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f45fc036900 0x7f45fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f46067fc640 1 -- 172.21.15.170:0/594347196 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4724071c80 con 0x55e656187cb0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f472bfff640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f45fc036900 0x7f45fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e65619a5e0 0x55e65619caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e65619d1f0 con 0x55e65619a5e0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f472bfff640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f45fc036900 0x7f45fc038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f471c055040 tx=0x7f471c04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.420+0000 7f47310a9640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e65619a5e0 0x55e65619caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f47310a9640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e65619a5e0 0x55e65619caa0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 20 realm 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e65619d600 con 0x55e65619a5e0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e65619ded0 con 0x55e65619a5e0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.421+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e65619efd0 0x55e6561a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a19d0 con 0x55e65619efd0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f47308a8640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e65619efd0 0x55e6561a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f47308a8640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e65619efd0 0x55e6561a13c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 20 searching for the correct realm 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55e6561a39a0 0x55e6561a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a6530 con 0x55e6561a39a0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.422+0000 7f472bfff640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55e6561a39a0 0x55e6561a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.423+0000 7f472bfff640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55e6561a39a0 0x55e6561a5e60 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.423+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.423+0000 7f472bfff640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f471c082040 0x7f471c083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.423+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a6530 con 0x7f471c082040 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.423+0000 7f47310a9640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f471c082040 0x7f471c083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.423+0000 7f47310a9640 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f471c082040 0x7f471c083430 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.424+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x7f471c082040 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.425+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.426+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.426+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.426+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.426+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x7f471c082040 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.426+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.426+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.427+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.428+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x7f471c082040 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.429+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x7f471c082040 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e6561a39a0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.430+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619efd0 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x55e65619a5e0 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e65619e270 con 0x7f471c082040 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:32.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.431+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a2290 con 0x55e65619a5e0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a2290 con 0x55e65619a5e0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a2290 con 0x7f471c082040 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:32.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 zone default found 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 4 Realm: () 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 zonegroup default 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.432+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a2b30 con 0x55e65619efd0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a8390 con 0x55e6561a39a0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.433+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a8730 con 0x55e6561a39a0 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.434+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.434+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.434+0000 7f4732da2800 20 started sync module instance, tier type = 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.434+0000 7f4732da2800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.434+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a7830 con 0x7f471c082040 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.435+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.435+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94447775415600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a7830 con 0x7f471c082040 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.435+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a90f0 con 0x55e65619a5e0 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.436+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.436+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94447775419456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a90c0 con 0x55e65619a5e0 2024-04-26T12:30:32.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.436+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94447775415600] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.436+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a9ef0 con 0x55e6561a39a0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.437+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94447775419456] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.437+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.437+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94447775423040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a9080 con 0x55e6561a39a0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.437+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561aa970 con 0x7f471c082040 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.438+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.438+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94447775425632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561ab210 con 0x7f471c082040 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.438+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561abcb0 con 0x55e65619a5e0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.438+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94447775423040] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.439+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.439+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94447775430528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561abc70 con 0x55e65619a5e0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.439+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561ac6c0 con 0x55e65619efd0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.439+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94447775425632] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.440+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94447775430528] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.440+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.440+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94447775421664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561aad60 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.440+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561acf60 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.441+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94447775421664] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.441+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.441+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94447775433232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561ad7b0 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.441+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561ae040 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94447775433232] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94447775437568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561ae2e0 con 0x55e65619efd0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 20 add_watcher() i=0 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 20 add_watcher() i=1 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 20 add_watcher() i=2 2024-04-26T12:30:32.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 20 add_watcher() i=3 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 20 add_watcher() i=4 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 20 add_watcher() i=5 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.442+0000 7f4732da2800 20 add_watcher() i=6 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.443+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94447775437568] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.443+0000 7f4732da2800 20 add_watcher() i=7 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.443+0000 7f4732da2800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.443+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561b1850 con 0x55e65619a5e0 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.443+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.443+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94447775439760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561aed70 con 0x55e65619a5e0 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.444+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94447775439760] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.444+0000 7f45e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.444+0000 7f4732da2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.444+0000 7f4732da2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:32.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 5 note: GC not initialized 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f45e5fe3640 20 reqs_thread_entry: start 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 20 Filter name: none 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f45577fe640 20 reqs_thread_entry: start 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561e4f30 con 0x55e65619a5e0 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:32.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.445+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561e59a0 con 0x55e65619a5e0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.446+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.446+0000 7f4732da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.446+0000 7f4732da2800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.446+0000 7f4732da2800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.446+0000 7f4732da2800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.446+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561eb390 con 0x55e65619a5e0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4732da2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4732da2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4732da2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94447775690240 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561e69b0 con 0x55e65619a5e0 2024-04-26T12:30:32.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify (1) cookie 94447775430528 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f472c026780 con 0x55e65619a5e0 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4607fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94447775430528 notifier 4369 bl.length()=732 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4607fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify cookie 94447775690240 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4607fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f4607fff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f45f4003ea0 con 0x55e65619a5e0 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.447+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.448+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== watch-notify(notify_complete (2) cookie 94447775690240 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f472c018d60 con 0x55e65619a5e0 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.448+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561eae00 con 0x55e65619a5e0 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4732da2800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4732da2800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4732da2800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94447775690240 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e6561e6500 con 0x7f471c082040 2024-04-26T12:30:32.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== watch-notify(notify (1) cookie 94447775415600 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f472c018d60 con 0x7f471c082040 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4607fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94447775415600 notifier 4369 bl.length()=166 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4607fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4607fff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f4607fff640 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f45f4003ea0 con 0x7f471c082040 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(68 notify.0 [notify cookie 94447775690240 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.449+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== watch-notify(notify_complete (2) cookie 94447775690240 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f472c005110 con 0x7f471c082040 2024-04-26T12:30:32.465 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"nby0AuKIglqLJNOqSPCYNbNahjSLE13wv0fQXeYC","active":true,"create_date":"2024-04-26T12:30:32.447016Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:32.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.450+0000 7f45e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.450+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94447775439760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561e9de0 con 0x55e65619a5e0 2024-04-26T12:30:32.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.451+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94447775439760] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.451+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94447775415600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e656193b70 con 0x7f471c082040 2024-04-26T12:30:32.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.452+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94447775415600] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.452+0000 7f4732da2800 20 remove_watcher() i=0 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.452+0000 7f4732da2800 2 removed watcher, disabling cache 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.452+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94447775419456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a7d30 con 0x55e65619a5e0 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.453+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94447775419456] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.453+0000 7f4732da2800 20 remove_watcher() i=1 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.453+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94447775423040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a7d30 con 0x55e6561a39a0 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.454+0000 7f472bfff640 1 -- 172.21.15.170:0/594347196 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94447775423040] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f471c07f070 con 0x55e6561a39a0 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.454+0000 7f4732da2800 20 remove_watcher() i=2 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.454+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94447775425632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a9a40 con 0x7f471c082040 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.455+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94447775425632] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x7f471c082040 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.455+0000 7f4732da2800 20 remove_watcher() i=3 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.455+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94447775430528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a9a40 con 0x55e65619a5e0 2024-04-26T12:30:32.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.457+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94447775430528] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f472c00a4a0 con 0x55e65619a5e0 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.457+0000 7f4732da2800 20 remove_watcher() i=4 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.457+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94447775421664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a8c40 con 0x55e65619efd0 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.458+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94447775421664] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.458+0000 7f4732da2800 20 remove_watcher() i=5 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.458+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94447775433232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561a8c40 con 0x55e65619efd0 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.459+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94447775433232] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.459+0000 7f4732da2800 20 remove_watcher() i=6 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.459+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94447775437568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e6561ac210 con 0x55e65619efd0 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f47308a8640 1 -- 172.21.15.170:0/594347196 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94447775437568] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4724077070 con 0x55e65619efd0 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 20 remove_watcher() i=7 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e65619efd0 msgr2=0x55e6561a13c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e65619efd0 0x55e6561a13c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e65619a5e0 msgr2=0x55e65619caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e65619a5e0 0x55e65619caa0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f471c082040 msgr2=0x7f471c083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f471c082040 0x7f471c083430 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55e6561a39a0 msgr2=0x55e6561a5e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55e6561a39a0 0x55e6561a5e60 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f45fc036900 msgr2=0x7f45fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f45fc036900 0x7f45fc038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f471c055040 tx=0x7f471c04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 msgr2=0x55e65618f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f47310a9640 1 -- 172.21.15.170:0/594347196 reap_dead start 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e65618f050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f472403cec0 tx=0x7f4724027400 comp rx=0 tx=0).stop 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 shutdown_connections 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/594347196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656187cb0 0x55e65618f050 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 >> 172.21.15.170:0/594347196 conn(0x55e656183f30 msgr2=0x55e656181590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 shutdown_connections 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/594347196 wait complete. 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4608036900 msgr2=0x7f4608038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4608036900 0x7f4608038dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55e656160660 tx=0x7f471c005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e65617a910 msgr2=0x55e65617ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e65617a910 0x55e65617ad30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f472404b4b0 tx=0x7f472401aaf0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 shutdown_connections 2024-04-26T12:30:32.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4608036900 0x7f4608038dc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 --2- 172.21.15.170:0/3963064693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e65617a910 0x55e65617ad30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 >> 172.21.15.170:0/3963064693 conn(0x55e65616e9b0 msgr2=0x55e65616edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 shutdown_connections 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.460+0000 7f4732da2800 1 -- 172.21.15.170:0/3963064693 wait complete. 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e6561659c0 msgr2=0x55e656167db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e6561659c0 0x55e656167db0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e656065b30 msgr2=0x55e656163170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e656065b30 0x55e656163170 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55e656169900 msgr2=0x55e65616bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55e656169900 0x55e65616bd50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4618036900 msgr2=0x7f4618038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4618036900 0x7f4618038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f471c054000 tx=0x7f471c04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 msgr2=0x55e65615c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 --2- 172.21.15.170:0/3679475143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e656062020 0x55e65615c100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f472400b210 tx=0x7f4724000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f47310a9640 1 -- 172.21.15.170:0/3679475143 reap_dead start 2024-04-26T12:30:32.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 shutdown_connections 2024-04-26T12:30:32.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 >> 172.21.15.170:0/3679475143 conn(0x55e65605b9b0 msgr2=0x55e65614d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 shutdown_connections 2024-04-26T12:30:32.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.461+0000 7f4732da2800 1 -- 172.21.15.170:0/3679475143 wait complete. 2024-04-26T12:30:32.477 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'nby0AuKIglqLJNOqSPCYNbNahjSLE13wv0fQXeYC', 'active': True, 'create_date': '2024-04-26T12:30:32.447016Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:32.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-26T12:30:32.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-26T12:30:32.478 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-26T12:30:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:32.526 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.525+0000 7f980e3af800 1 Processor -- start 2024-04-26T12:30:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.525+0000 7f980e3af800 1 -- start start 2024-04-26T12:30:32.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980e3af800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b17cd4e140 0x55b17cd4c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980e3af800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b17cc850c0 con 0x55b17cd4cc30 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980e3af800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55b17cc694d0 con 0x55b17cd4e140 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980beb5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b17cd4e140 0x55b17cd4c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980b6b4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55b17cd4cc30 0x55b17cde0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46114/0 (socket says 172.21.15.170:46114) 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980b6b4640 1 -- 172.21.15.170:0/2301884214 learned_addr learned my addr 172.21.15.170:0/2301884214 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980beb5640 1 -- 172.21.15.170:0/2301884214 >> v1:172.21.15.132:6789/0 conn(0x55b17cd4cc30 legacy=0x55b17cde0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.526+0000 7f980beb5640 1 -- 172.21.15.170:0/2301884214 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17cc96d40 con 0x55b17cd4e140 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.528+0000 7f980beb5640 1 --2- 172.21.15.170:0/2301884214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4e140 0x55b17cd4c6f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9804005fd0 tx=0x7f980401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18c15c121a363cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.528+0000 7f980aeb3640 1 -- 172.21.15.170:0/2301884214 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9804052560 con 0x55b17cd4e140 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.528+0000 7f980aeb3640 1 -- 172.21.15.170:0/2301884214 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9804052700 con 0x55b17cd4e140 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.528+0000 7f980aeb3640 1 -- 172.21.15.170:0/2301884214 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9804052a60 con 0x55b17cd4e140 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.529+0000 7f980e3af800 1 -- 172.21.15.170:0/2301884214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4e140 msgr2=0x55b17cd4c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.529+0000 7f980e3af800 1 --2- 172.21.15.170:0/2301884214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4e140 0x55b17cd4c6f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9804005fd0 tx=0x7f980401ccc0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.529+0000 7f980e3af800 1 -- 172.21.15.170:0/2301884214 shutdown_connections 2024-04-26T12:30:32.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.529+0000 7f980e3af800 1 --2- 172.21.15.170:0/2301884214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4e140 0x55b17cd4c6f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.529+0000 7f980e3af800 1 -- 172.21.15.170:0/2301884214 >> 172.21.15.170:0/2301884214 conn(0x55b17cdd3ba0 msgr2=0x55b17cdd5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.529+0000 7f980e3af800 1 -- 172.21.15.170:0/2301884214 shutdown_connections 2024-04-26T12:30:32.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.529+0000 7f980e3af800 1 -- 172.21.15.170:0/2301884214 wait complete. 2024-04-26T12:30:32.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.540+0000 7f980e3af800 1 Processor -- start 2024-04-26T12:30:32.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.540+0000 7f980e3af800 1 -- start start 2024-04-26T12:30:32.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.540+0000 7f980e3af800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17cecbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.540+0000 7f980e3af800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b17cd23b60 con 0x55b17cd4cc30 2024-04-26T12:30:32.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17cecbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17cecbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41664/0 (socket says 172.21.15.170:41664) 2024-04-26T12:30:32.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f980beb5640 1 -- 172.21.15.170:0/3525092008 learned_addr learned my addr 172.21.15.170:0/3525092008 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f980beb5640 1 -- 172.21.15.170:0/3525092008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17cc95590 con 0x55b17cd4cc30 2024-04-26T12:30:32.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f980beb5640 1 --2- 172.21.15.170:0/3525092008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17cecbe60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9804007000 tx=0x7f980404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5500a0d2e47bd3c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f96f9e0b640 1 -- 172.21.15.170:0/3525092008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9804052aa0 con 0x55b17cd4cc30 2024-04-26T12:30:32.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f96f9e0b640 1 -- 172.21.15.170:0/3525092008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9804052c40 con 0x55b17cd4cc30 2024-04-26T12:30:32.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.541+0000 7f96f9e0b640 1 -- 172.21.15.170:0/3525092008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980405c430 con 0x55b17cd4cc30 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 -- 172.21.15.170:0/3525092008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 msgr2=0x55b17cecbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 --2- 172.21.15.170:0/3525092008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17cecbe60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9804007000 tx=0x7f980404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 -- 172.21.15.170:0/3525092008 shutdown_connections 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 --2- 172.21.15.170:0/3525092008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17cecbe60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 -- 172.21.15.170:0/3525092008 >> 172.21.15.170:0/3525092008 conn(0x55b17cdd3ba0 msgr2=0x55b17cec7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 -- 172.21.15.170:0/3525092008 shutdown_connections 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 -- 172.21.15.170:0/3525092008 wait complete. 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 Processor -- start 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.542+0000 7f980e3af800 1 -- start start 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980e3af800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17ced3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980e3af800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b17cde3e40 con 0x55b17cd4cc30 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17ced3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17ced3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41674/0 (socket says 172.21.15.170:41674) 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980beb5640 1 -- 172.21.15.170:0/440579207 learned_addr learned my addr 172.21.15.170:0/440579207 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980beb5640 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17cc8c8f0 con 0x55b17cd4cc30 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980beb5640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17ced3730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f980401b9b0 tx=0x7f9804003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f96f3fff640 1 -- 172.21.15.170:0/440579207 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9804052aa0 con 0x55b17cd4cc30 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f96f3fff640 1 -- 172.21.15.170:0/440579207 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980405cbd0 con 0x55b17cd4cc30 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b17ced3c70 con 0x55b17cd4cc30 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f96f3fff640 1 -- 172.21.15.170:0/440579207 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980406f410 con 0x55b17cd4cc30 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.543+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17ced4130 con 0x55b17cd4cc30 2024-04-26T12:30:32.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.544+0000 7f96f3fff640 1 -- 172.21.15.170:0/440579207 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f980406f5b0 con 0x55b17cd4cc30 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.544+0000 7f96f3fff640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96f4036950 0x7f96f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.544+0000 7f96f3fff640 1 -- 172.21.15.170:0/440579207 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f980406c070 con 0x55b17cd4cc30 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.544+0000 7f980b6b4640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96f4036950 0x7f96f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.544+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cd4e140 0x55b17ceda7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.544+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cedace0 con 0x55b17cd4e140 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980c6b6640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cd4e140 0x55b17ceda7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980b6b4640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96f4036950 0x7f96f4038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97f4000f60 tx=0x7f97f40012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980c6b6640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cd4e140 0x55b17ceda7a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980c6b6640 1 -- 172.21.15.170:0/440579207 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cd4e140 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17ced7d50 con 0x55b17cd4e140 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980c6b6640 1 -- 172.21.15.170:0/440579207 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cd4e140 2024-04-26T12:30:32.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cedcff0 0x55b17cedf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.545+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cedfad0 con 0x55b17cedcff0 2024-04-26T12:30:32.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.546+0000 7f980beb5640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cedcff0 0x55b17cedf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.546+0000 7f980beb5640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cedcff0 0x55b17cedf3e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.546+0000 7f980beb5640 1 -- 172.21.15.170:0/440579207 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9804066790 con 0x55b17cedcff0 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.546+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cedbfa0 con 0x55b17cd4e140 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.547+0000 7f980c6b6640 1 -- 172.21.15.170:0/440579207 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cd4e140 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.547+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b17cee0f80 0x55b17cee33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.547+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cee3b40 con 0x55b17cee0f80 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.547+0000 7f980b6b4640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b17cee0f80 0x55b17cee33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.547+0000 7f980b6b4640 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b17cee0f80 0x55b17cee33b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.547+0000 7f980b6b4640 1 -- 172.21.15.170:0/440579207 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cee0f80 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980e3af800 1 Processor -- start 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980e3af800 1 -- start start 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980e3af800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cef1fa0 0x55b17cef23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980e3af800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b17ccc9e60 con 0x55b17cef1fa0 2024-04-26T12:30:32.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cef1fa0 0x55b17cef23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cef1fa0 0x55b17cef23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41676/0 (socket says 172.21.15.170:41676) 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980beb5640 1 -- 172.21.15.170:0/314513142 learned_addr learned my addr 172.21.15.170:0/314513142 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980beb5640 1 -- 172.21.15.170:0/314513142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17cef2900 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.548+0000 7f980beb5640 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cef1fa0 0x55b17cef23c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f980405a4e0 tx=0x7f9804077e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.549+0000 7f96f17fa640 1 -- 172.21.15.170:0/314513142 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980408e1f0 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.549+0000 7f96f17fa640 1 -- 172.21.15.170:0/314513142 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980408e390 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.549+0000 7f96f17fa640 1 -- 172.21.15.170:0/314513142 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9804051be0 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.549+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b17cef3370 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.549+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17cef3870 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.549+0000 7f96f17fa640 1 -- 172.21.15.170:0/314513142 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f980408b3f0 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f96f17fa640 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96e4036900 0x7f96e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f96f17fa640 1 -- 172.21.15.170:0/314513142 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f98040070a0 con 0x55b17cef1fa0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980b6b4640 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96e4036900 0x7f96e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980e3af800 1 Processor -- start 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980e3af800 1 -- start start 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980b6b4640 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96e4036900 0x7f96e4038dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97f400bf50 tx=0x7f97f400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980e3af800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17ceff540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980e3af800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b17cecc520 con 0x55b17ceff120 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17ceff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17ceff540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41690/0 (socket says 172.21.15.170:41690) 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.550+0000 7f980beb5640 1 -- 172.21.15.170:0/2706675624 learned_addr learned my addr 172.21.15.170:0/2706675624 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980beb5640 1 -- 172.21.15.170:0/2706675624 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17ceffb10 con 0x55b17ceff120 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980beb5640 1 --2- 172.21.15.170:0/2706675624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17ceff540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f980405afd0 tx=0x7f980406eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c51f9f8c29d1c17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f96eaffd640 1 -- 172.21.15.170:0/2706675624 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9804005020 con 0x55b17ceff120 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f96eaffd640 1 -- 172.21.15.170:0/2706675624 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9804004ca0 con 0x55b17ceff120 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f96eaffd640 1 -- 172.21.15.170:0/2706675624 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98040051c0 con 0x55b17ceff120 2024-04-26T12:30:32.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980e3af800 1 -- 172.21.15.170:0/2706675624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 msgr2=0x55b17ceff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980e3af800 1 --2- 172.21.15.170:0/2706675624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17ceff540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f980405afd0 tx=0x7f980406eb20 comp rx=0 tx=0).stop 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980e3af800 1 -- 172.21.15.170:0/2706675624 shutdown_connections 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980e3af800 1 --2- 172.21.15.170:0/2706675624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17ceff540 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980e3af800 1 -- 172.21.15.170:0/2706675624 >> 172.21.15.170:0/2706675624 conn(0x55b17cefb480 msgr2=0x55b17cef94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980e3af800 1 -- 172.21.15.170:0/2706675624 shutdown_connections 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.551+0000 7f980e3af800 1 -- 172.21.15.170:0/2706675624 wait complete. 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980e3af800 1 Processor -- start 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980e3af800 1 -- start start 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980e3af800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17cf06520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980e3af800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b17cf001c0 con 0x55b17ceff120 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17cf06520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980beb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17cf06520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41704/0 (socket says 172.21.15.170:41704) 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 learned_addr learned my addr 172.21.15.170:0/894063329 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b17cf06a60 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980beb5640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17cf06520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f980405afd0 tx=0x7f9804078ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f96e97fa640 1 -- 172.21.15.170:0/894063329 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9804004e50 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f96e97fa640 1 -- 172.21.15.170:0/894063329 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980408d040 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b17cf06a60 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.552+0000 7f96e97fa640 1 -- 172.21.15.170:0/894063329 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980408d380 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.553+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b17cf06a60 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.553+0000 7f96e97fa640 1 -- 172.21.15.170:0/894063329 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f98040b3030 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.553+0000 7f96e97fa640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96d4036af0 0x7f96d4038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.553+0000 7f96e97fa640 1 -- 172.21.15.170:0/894063329 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f98040b1070 con 0x55b17ceff120 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.553+0000 7f980b6b4640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96d4036af0 0x7f96d4038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.554+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.554+0000 7f980b6b4640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96d4036af0 0x7f96d4038fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f97f4001b60 tx=0x7f97f4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.554+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cf11aa0 0x55b17cf13f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.554+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf146b0 con 0x55b17cf11aa0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.554+0000 7f980c6b6640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cf11aa0 0x55b17cf13f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.554+0000 7f980c6b6640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cf11aa0 0x55b17cf13f60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.554+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cf11aa0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 realm 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf14ac0 con 0x55b17cf11aa0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cf11aa0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:32.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cf11aa0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15730 con 0x55b17cf11aa0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cf11aa0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cf160f0 0x55b17cf184e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf18b30 con 0x55b17cf160f0 2024-04-26T12:30:32.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.555+0000 7f980beb5640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cf160f0 0x55b17cf184e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980beb5640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cf160f0 0x55b17cf184e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980e3af800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980e3af800 20 searching for the correct realm 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b17cf1aac0 0x55b17cf1cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1d650 con 0x55b17cf1aac0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980b6b4640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b17cf1aac0 0x55b17cf1cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.556+0000 7f980b6b4640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b17cf1aac0 0x55b17cf1cf80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.557+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.557+0000 7f980b6b4640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f97f4038040 0x7f97f401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.557+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1d650 con 0x7f97f4038040 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.557+0000 7f980c6b6640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f97f4038040 0x7f97f401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.557+0000 7f980c6b6640 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f97f4038040 0x7f97f401bab0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f97fc0083e0 con 0x7f97f4038040 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc0083e0 con 0x55b17cf11aa0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.558+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x7f97f4038040 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.559+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x7f97f4038040 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.560+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.561+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.562+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x7f97f4038040 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.563+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.564+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.564+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.564+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.564+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x7f97f4038040 2024-04-26T12:30:32.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.564+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.564+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf1aac0 2024-04-26T12:30:32.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.565+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.565+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf160f0 2024-04-26T12:30:32.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.565+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.565+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x55b17cf11aa0 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.565+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.565+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf15390 con 0x7f97f4038040 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:32.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf18ed0 con 0x55b17cf11aa0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf18ed0 con 0x55b17cf11aa0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf18ed0 con 0x7f97f4038040 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 zone default found 2024-04-26T12:30:32.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 4 Realm: () 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 zonegroup default 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.566+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf19770 con 0x55b17cf160f0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1f4b0 con 0x55b17cf1aac0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1f850 con 0x55b17cf1aac0 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 20 started sync module instance, tier type = 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.567+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1e950 con 0x7f97f4038040 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.568+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.568+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94220793802048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1e950 con 0x7f97f4038040 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.568+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf200e0 con 0x55b17cf11aa0 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.569+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94220793802048] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.570+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.570+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94220793805808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1e950 con 0x55b17cf11aa0 2024-04-26T12:30:32.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.570+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf20b30 con 0x55b17cf1aac0 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.570+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94220793805808] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.571+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.571+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94220793799840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1e8c0 con 0x55b17cf1aac0 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.571+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf219f0 con 0x7f97f4038040 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.572+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94220793799840] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.572+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.572+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94220793812288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf21e10 con 0x7f97f4038040 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.572+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf227d0 con 0x55b17cf11aa0 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.573+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.573+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94220793812288] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.573+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94220793815840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf22bf0 con 0x55b17cf11aa0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.573+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf23160 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.574+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.574+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94220793813344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf23a00 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.574+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf24420 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.574+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94220793815840] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.575+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.575+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94220793816896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf24cc0 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.575+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf25570 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.575+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94220793813344] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94220793816896] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94220793820496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf24cc0 con 0x55b17cf160f0 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 20 add_watcher() i=0 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 20 add_watcher() i=1 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 20 add_watcher() i=2 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 20 add_watcher() i=3 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 20 add_watcher() i=4 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 20 add_watcher() i=5 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.576+0000 7f980e3af800 20 add_watcher() i=6 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.577+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94220793820496] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.577+0000 7f980e3af800 20 add_watcher() i=7 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.577+0000 7f980e3af800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.577+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf28780 con 0x55b17cf11aa0 2024-04-26T12:30:32.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.577+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.577+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94220793825296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf25c00 con 0x55b17cf11aa0 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.578+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94220793825296] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.578+0000 7f96c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.578+0000 7f980e3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.578+0000 7f980e3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.578+0000 7f980e3af800 5 note: GC not initialized 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.578+0000 7f96c0fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 20 Filter name: none 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f963a7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf5bb90 con 0x55b17cf11aa0 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.579+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf62300 con 0x55b17cf11aa0 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.580+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.580+0000 7f980e3af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.580+0000 7f980e3af800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.580+0000 7f980e3af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94220794076528 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf5da10 con 0x55b17cf11aa0 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94220793815840 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f97fc010040 con 0x55b17cf11aa0 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f96eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94220793815840 notifier 4376 bl.length()=732 2024-04-26T12:30:32.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f96eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:32.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f96eaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:32.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f96eaffd640 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f96d0003ea0 con 0x55b17cf11aa0 2024-04-26T12:30:32.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(64 notify.4 [notify cookie 94220794076528 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.581+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94220794076528 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f97fc00a730 con 0x55b17cf11aa0 2024-04-26T12:30:32.596 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:32.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.582+0000 7f96c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.582+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94220793825296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf5de40 con 0x55b17cf11aa0 2024-04-26T12:30:32.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.583+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94220793825296] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.583+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94220793802048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf24810 con 0x7f97f4038040 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.584+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94220793802048] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.584+0000 7f980e3af800 20 remove_watcher() i=0 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.584+0000 7f980e3af800 2 removed watcher, disabling cache 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.584+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94220793805808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1ed40 con 0x55b17cf11aa0 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.585+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94220793805808] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.585+0000 7f980e3af800 20 remove_watcher() i=1 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.585+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94220793799840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1ed40 con 0x55b17cf1aac0 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.586+0000 7f980b6b4640 1 -- 172.21.15.170:0/894063329 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94220793799840] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f4009050 con 0x55b17cf1aac0 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.586+0000 7f980e3af800 20 remove_watcher() i=2 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.586+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94220793812288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1e4a0 con 0x7f97f4038040 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.587+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94220793812288] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x7f97f4038040 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.587+0000 7f980e3af800 20 remove_watcher() i=3 2024-04-26T12:30:32.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.587+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94220793815840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf21540 con 0x55b17cf11aa0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.588+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94220793815840] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97fc026040 con 0x55b17cf11aa0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.588+0000 7f980e3af800 20 remove_watcher() i=4 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.588+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94220793813344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1e4a0 con 0x55b17cf160f0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.589+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94220793813344] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.589+0000 7f980e3af800 20 remove_watcher() i=5 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.589+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94220793816896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf22320 con 0x55b17cf160f0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.590+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94220793816896] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.590+0000 7f980e3af800 20 remove_watcher() i=6 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.590+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94220793820496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b17cf1e4a0 con 0x55b17cf160f0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980beb5640 1 -- 172.21.15.170:0/894063329 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94220793820496] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9804066790 con 0x55b17cf160f0 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 20 remove_watcher() i=7 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cf160f0 msgr2=0x55b17cf184e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cf160f0 0x55b17cf184e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cf11aa0 msgr2=0x55b17cf13f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cf11aa0 0x55b17cf13f60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f97f4038040 msgr2=0x7f97f401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f97f4038040 0x7f97f401bab0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b17cf1aac0 msgr2=0x55b17cf1cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b17cf1aac0 0x55b17cf1cf80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96d4036af0 msgr2=0x7f96d4038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96d4036af0 0x7f96d4038fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f97f4001b60 tx=0x7f97f4010000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 msgr2=0x55b17cf06520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980c6b6640 1 -- 172.21.15.170:0/894063329 reap_dead start 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17cf06520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f980405afd0 tx=0x7f9804078ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 shutdown_connections 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/894063329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17ceff120 0x55b17cf06520 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 >> 172.21.15.170:0/894063329 conn(0x55b17cefb480 msgr2=0x55b17cef8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 shutdown_connections 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/894063329 wait complete. 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96e4036900 msgr2=0x7f96e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96e4036900 0x7f96e4038dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97f400bf50 tx=0x7f97f400f000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cef1fa0 msgr2=0x55b17cef23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.591+0000 7f980e3af800 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cef1fa0 0x55b17cef23c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f980405a4e0 tx=0x7f9804077e90 comp rx=0 tx=0).stop 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 shutdown_connections 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96e4036900 0x7f96e4038dc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 --2- 172.21.15.170:0/314513142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cef1fa0 0x55b17cef23c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 >> 172.21.15.170:0/314513142 conn(0x55b17cee6040 msgr2=0x55b17cee6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 shutdown_connections 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/314513142 wait complete. 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cedcff0 msgr2=0x55b17cedf3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b17cedcff0 0x55b17cedf3e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cd4e140 msgr2=0x55b17ceda7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b17cd4e140 0x55b17ceda7a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b17cee0f80 msgr2=0x55b17cee33b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b17cee0f80 0x55b17cee33b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96f4036950 msgr2=0x7f96f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f96f4036950 0x7f96f4038e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f97f4000f60 tx=0x7f97f40012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 msgr2=0x55b17ced3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 --2- 172.21.15.170:0/440579207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b17cd4cc30 0x55b17ced3730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f980401b9b0 tx=0x7f9804003330 comp rx=0 tx=0).stop 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980c6b6640 1 -- 172.21.15.170:0/440579207 reap_dead start 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 shutdown_connections 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 >> 172.21.15.170:0/440579207 conn(0x55b17cdd3ba0 msgr2=0x55b17ceca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 shutdown_connections 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.592+0000 7f980e3af800 1 -- 172.21.15.170:0/440579207 wait complete. 2024-04-26T12:30:32.608 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:32.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:32.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:32.608 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:32.650 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:32.651 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:32.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.650+0000 7fe4bb3dc800 1 Processor -- start 2024-04-26T12:30:32.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.650+0000 7fe4bb3dc800 1 -- start start 2024-04-26T12:30:32.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.650+0000 7fe4bb3dc800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5617b3095950 0x5617b309e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.650+0000 7fe4bb3dc800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617b2f420c0 con 0x5617b3093e10 2024-04-26T12:30:32.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.650+0000 7fe4bb3dc800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5617b2f264d0 con 0x5617b3095950 2024-04-26T12:30:32.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.651+0000 7fe4b06e1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5617b3095950 0x5617b309e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.651+0000 7fe4b8ee2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5617b3093e10 0x5617b3094230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46118/0 (socket says 172.21.15.170:46118) 2024-04-26T12:30:32.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.651+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3963861906 learned_addr learned my addr 172.21.15.170:0/3963861906 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:32.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.651+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3963861906 >> v1:172.21.15.132:6789/0 conn(0x5617b3093e10 legacy=0x5617b3094230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.651+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3963861906 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b2f53d40 con 0x5617b3095950 2024-04-26T12:30:32.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.653+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3963861906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3095950 0x5617b309e450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000a470 tx=0x7fe4a001cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c942a11645b4314a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.653+0000 7fe4b3fff640 1 -- 172.21.15.170:0/3963861906 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0057070 con 0x5617b3095950 2024-04-26T12:30:32.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.653+0000 7fe4b3fff640 1 -- 172.21.15.170:0/3963861906 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a004ab60 con 0x5617b3095950 2024-04-26T12:30:32.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.653+0000 7fe4b3fff640 1 -- 172.21.15.170:0/3963861906 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a004ae60 con 0x5617b3095950 2024-04-26T12:30:32.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.654+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3963861906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3095950 msgr2=0x5617b309e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.654+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3963861906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3095950 0x5617b309e450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000a470 tx=0x7fe4a001cce0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.654+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3963861906 shutdown_connections 2024-04-26T12:30:32.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.654+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3963861906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3095950 0x5617b309e450 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.654+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3963861906 >> 172.21.15.170:0/3963861906 conn(0x5617b308f990 msgr2=0x5617b3091db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.654+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3963861906 shutdown_connections 2024-04-26T12:30:32.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.654+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3963861906 wait complete. 2024-04-26T12:30:32.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.665+0000 7fe4bb3dc800 1 Processor -- start 2024-04-26T12:30:32.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.665+0000 7fe4bb3dc800 1 -- start start 2024-04-26T12:30:32.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.665+0000 7fe4bb3dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3188c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.665+0000 7fe4bb3dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5617b2fe0b40 con 0x5617b3093e10 2024-04-26T12:30:32.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3188c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3188c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41722/0 (socket says 172.21.15.170:41722) 2024-04-26T12:30:32.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/2760952477 learned_addr learned my addr 172.21.15.170:0/2760952477 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/2760952477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b2f52590 con 0x5617b3093e10 2024-04-26T12:30:32.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/2760952477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3188c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800b560 tx=0x7fe4a800ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f555037feb6150c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe3a6e0d640 1 -- 172.21.15.170:0/2760952477 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8008070 con 0x5617b3093e10 2024-04-26T12:30:32.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe3a6e0d640 1 -- 172.21.15.170:0/2760952477 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a800d610 con 0x5617b3093e10 2024-04-26T12:30:32.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.666+0000 7fe3a6e0d640 1 -- 172.21.15.170:0/2760952477 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a800d910 con 0x5617b3093e10 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2760952477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 msgr2=0x5617b3188c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2760952477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3188c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800b560 tx=0x7fe4a800ba20 comp rx=0 tx=0).stop 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2760952477 shutdown_connections 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2760952477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3188c80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2760952477 >> 172.21.15.170:0/2760952477 conn(0x5617b308f990 msgr2=0x5617b31845a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2760952477 shutdown_connections 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2760952477 wait complete. 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 Processor -- start 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 -- start start 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3190680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.667+0000 7fe4bb3dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5617b30a0c70 con 0x5617b3093e10 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3190680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3190680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41730/0 (socket says 172.21.15.170:41730) 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/2942665831 learned_addr learned my addr 172.21.15.170:0/2942665831 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b2f498f0 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3190680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800b500 tx=0x7fe4a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe3a560a640 1 -- 172.21.15.170:0/2942665831 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a800fab0 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe3a560a640 1 -- 172.21.15.170:0/2942665831 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a800fc50 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617b3190bc0 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe3a560a640 1 -- 172.21.15.170:0/2942665831 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8019470 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.668+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b31910e0 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.669+0000 7fe3a560a640 1 -- 172.21.15.170:0/2942665831 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4a8017040 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.669+0000 7fe3a560a640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3a0036950 0x7fe3a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.669+0000 7fe3a560a640 1 -- 172.21.15.170:0/2942665831 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe4a8015020 con 0x5617b3093e10 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.669+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3a0036950 0x7fe3a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.669+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b3095950 0x5617b31976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.670+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b3197cc0 con 0x5617b3095950 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.670+0000 7fe4b96e3640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b3095950 0x5617b31976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.670+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3a0036950 0x7fe3a0038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0054000 tx=0x7fe4a004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.670+0000 7fe4b96e3640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b3095950 0x5617b31976f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.670+0000 7fe4b96e3640 1 -- 172.21.15.170:0/2942665831 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b3095950 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.670+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b3194cc0 con 0x5617b3095950 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.670+0000 7fe4b96e3640 1 -- 172.21.15.170:0/2942665831 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b3095950 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.671+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b3199fc0 0x5617b319c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.671+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b319ca80 con 0x5617b3199fc0 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.671+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b3199fc0 0x5617b319c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.671+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b3199fc0 0x5617b319c3b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.671+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/2942665831 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b3199fc0 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.671+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b3198f70 con 0x5617b3095950 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.672+0000 7fe4b96e3640 1 -- 172.21.15.170:0/2942665831 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b3095950 2024-04-26T12:30:32.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.672+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5617b319dec0 0x5617b31a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.672+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31a0b10 con 0x5617b319dec0 2024-04-26T12:30:32.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.672+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5617b319dec0 0x5617b31a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.672+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5617b319dec0 0x5617b31a0380 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.672+0000 7fe4b06e1640 1 -- 172.21.15.170:0/2942665831 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4a005a040 con 0x5617b319dec0 2024-04-26T12:30:32.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4bb3dc800 1 Processor -- start 2024-04-26T12:30:32.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4bb3dc800 1 -- start start 2024-04-26T12:30:32.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4bb3dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31aef70 0x5617b31af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4bb3dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5617b2f86e60 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31aef70 0x5617b31af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31aef70 0x5617b31af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41744/0 (socket says 172.21.15.170:41744) 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3841884706 learned_addr learned my addr 172.21.15.170:0/3841884706 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3841884706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b31af8d0 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31aef70 0x5617b31af390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800eb00 tx=0x7fe4a800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe39e7fc640 1 -- 172.21.15.170:0/3841884706 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a80183d0 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.673+0000 7fe39e7fc640 1 -- 172.21.15.170:0/3841884706 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8018570 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.674+0000 7fe39e7fc640 1 -- 172.21.15.170:0/3841884706 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8018850 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.674+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617b31b0340 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.674+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b31b0840 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.674+0000 7fe39e7fc640 1 -- 172.21.15.170:0/3841884706 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4a8019610 con 0x5617b31aef70 2024-04-26T12:30:32.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.674+0000 7fe39e7fc640 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3900369c0 0x7fe390038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.674+0000 7fe39e7fc640 1 -- 172.21.15.170:0/3841884706 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe4a803bc90 con 0x5617b31aef70 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.674+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3900369c0 0x7fe390038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4bb3dc800 1 Processor -- start 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3900369c0 0x7fe390038e80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5617b3198140 tx=0x7fe4a0005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4bb3dc800 1 -- start start 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4bb3dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31bc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4bb3dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5617b3189400 con 0x5617b31bc270 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31bc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31bc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41748/0 (socket says 172.21.15.170:41748) 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/1721513010 learned_addr learned my addr 172.21.15.170:0/1721513010 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/1721513010 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b31bcc60 con 0x5617b31bc270 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.675+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/1721513010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31bc690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4a801b750 tx=0x7fe4a801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b0fc76f85b3ad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe38ffff640 1 -- 172.21.15.170:0/1721513010 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a803f040 con 0x5617b31bc270 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe38ffff640 1 -- 172.21.15.170:0/1721513010 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a805c070 con 0x5617b31bc270 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe38ffff640 1 -- 172.21.15.170:0/1721513010 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a8010d10 con 0x5617b31bc270 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/1721513010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 msgr2=0x5617b31bc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/1721513010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31bc690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4a801b750 tx=0x7fe4a801c8b0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/1721513010 shutdown_connections 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/1721513010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31bc690 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/1721513010 >> 172.21.15.170:0/1721513010 conn(0x5617b31b85d0 msgr2=0x5617b31b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/1721513010 shutdown_connections 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/1721513010 wait complete. 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 Processor -- start 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.676+0000 7fe4bb3dc800 1 -- start start 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4bb3dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4bb3dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5617b31bd310 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4b8ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31c3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41762/0 (socket says 172.21.15.170:41762) 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 learned_addr learned my addr 172.21.15.170:0/3676283512 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b31c3b90 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31c3650 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8045cb0 tx=0x7fe4a802ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe38e7fc640 1 -- 172.21.15.170:0/3676283512 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a803f050 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe38e7fc640 1 -- 172.21.15.170:0/3676283512 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8044220 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617b31c3b90 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe38e7fc640 1 -- 172.21.15.170:0/3676283512 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a801a9d0 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.677+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b31c3b90 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.678+0000 7fe38e7fc640 1 -- 172.21.15.170:0/3676283512 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe4a8044440 con 0x5617b31bc270 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.678+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.678+0000 7fe38e7fc640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe384036950 0x7fe384038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.678+0000 7fe38e7fc640 1 -- 172.21.15.170:0/3676283512 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe4a806dca0 con 0x5617b31bc270 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.678+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe384036950 0x7fe384038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b31ceba0 0x5617b31d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d17b0 con 0x5617b31ceba0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4b96e3640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b31ceba0 0x5617b31d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe384036950 0x7fe384038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5617b31a0f10 tx=0x7fe4a004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4b96e3640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b31ceba0 0x5617b31d1060 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 20 realm 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d1c10 con 0x5617b31ceba0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.679+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d24b0 con 0x5617b31ceba0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4bb3dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4bb3dc800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b31d35b0 0x5617b31d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d5f20 con 0x5617b31d35b0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b31d35b0 0x5617b31d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.680+0000 7fe4b8ee2640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b31d35b0 0x5617b31d59a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4bb3dc800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4bb3dc800 20 searching for the correct realm 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5617b31d7f50 0x5617b31da410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31daae0 con 0x5617b31d7f50 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5617b31d7f50 0x5617b31da410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5617b31d7f50 0x5617b31da410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4b06e1640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe4a0081420 0x7fe4a0081860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.681+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31daae0 con 0x7fe4a0081420 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.682+0000 7fe4b96e3640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe4a0081420 0x7fe4a0081860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.682+0000 7fe4b96e3640 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe4a0081420 0x7fe4a0081860 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.682+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.682+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.682+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.682+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x7fe4a0081420 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.683+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.684+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.684+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.684+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.684+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.684+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.684+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.684+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x7fe4a0081420 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.685+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.686+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.686+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.686+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.686+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.686+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.686+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.687+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x7fe4a0081420 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.688+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.688+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.688+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.688+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.688+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x7fe4a0081420 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d7f50 2024-04-26T12:30:32.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.689+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31d35b0 2024-04-26T12:30:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x5617b31ceba0 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d2850 con 0x7fe4a0081420 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.690+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d6870 con 0x5617b31ceba0 2024-04-26T12:30:32.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d6870 con 0x5617b31ceba0 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d6840 con 0x7fe4a0081420 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 zone default found 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 4 Realm: () 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:32.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 zonegroup default 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.691+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31d6c60 con 0x5617b31d35b0 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dc940 con 0x5617b31d7f50 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dcce0 con 0x5617b31d7f50 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 20 started sync module instance, tier type = 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:32.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.692+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dbde0 con 0x7fe4a0081420 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.693+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.693+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94659789308416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dbde0 con 0x7fe4a0081420 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.693+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dd530 con 0x5617b31ceba0 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.694+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94659789308416] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.694+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.695+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94659789306432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dd530 con 0x5617b31ceba0 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.695+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31ddef0 con 0x5617b31d7f50 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.695+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94659789306432] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.696+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.696+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94659789312128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dd4a0 con 0x5617b31d7f50 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.696+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31ded60 con 0x7fe4a0081420 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.697+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.697+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94659789318800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31df4c0 con 0x7fe4a0081420 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.697+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94659789312128] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.697+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31de2d0 con 0x5617b31ceba0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94659789318800] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94659789319952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31de2d0 con 0x5617b31ceba0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e0450 con 0x5617b31d35b0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94659789324128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e0cf0 con 0x5617b31d35b0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94659789319952] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.698+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dfad0 con 0x5617b31d35b0 2024-04-26T12:30:32.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.699+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94659789324128] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.701+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.701+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94659789328992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e1b30 con 0x5617b31d35b0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.701+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e23c0 con 0x5617b31d35b0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94659789328992] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94659789330048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e2660 con 0x5617b31d35b0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 20 add_watcher() i=0 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 20 add_watcher() i=1 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 20 add_watcher() i=2 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 20 add_watcher() i=3 2024-04-26T12:30:32.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 20 add_watcher() i=4 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 20 add_watcher() i=5 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.702+0000 7fe4bb3dc800 20 add_watcher() i=6 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.703+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94659789330048] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.703+0000 7fe4bb3dc800 20 add_watcher() i=7 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.703+0000 7fe4bb3dc800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.703+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e5b70 con 0x5617b31ceba0 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.703+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.703+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94659789332720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e3030 con 0x5617b31ceba0 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.704+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94659789332720] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.704+0000 7fe36f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.704+0000 7fe4bb3dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.704+0000 7fe4bb3dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:32.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.704+0000 7fe4bb3dc800 5 note: GC not initialized 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe36e7e4640 20 reqs_thread_entry: start 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe4bb3dc800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe4bb3dc800 20 Filter name: none 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe4bb3dc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe367fff640 20 reqs_thread_entry: start 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617b3218d20 con 0x5617b31ceba0 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.705+0000 7fe4bb3dc800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:30:32.718 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:32.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.706+0000 7fe36f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.706+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94659789332720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b32177b0 con 0x5617b31ceba0 2024-04-26T12:30:32.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.707+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94659789332720] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.707+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94659789308416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e20b0 con 0x7fe4a0081420 2024-04-26T12:30:32.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.708+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94659789308416] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.708+0000 7fe4bb3dc800 20 remove_watcher() i=0 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.708+0000 7fe4bb3dc800 2 removed watcher, disabling cache 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.708+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94659789306432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dc200 con 0x5617b31ceba0 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.709+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94659789306432] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.709+0000 7fe4bb3dc800 20 remove_watcher() i=1 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.709+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94659789312128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dc200 con 0x5617b31d7f50 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.710+0000 7fe4b06e1640 1 -- 172.21.15.170:0/3676283512 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94659789312128] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a0071070 con 0x5617b31d7f50 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.710+0000 7fe4bb3dc800 20 remove_watcher() i=2 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.710+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94659789318800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dd080 con 0x7fe4a0081420 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.711+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94659789318800] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x7fe4a0081420 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.711+0000 7fe4bb3dc800 20 remove_watcher() i=3 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.711+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94659789319952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dd080 con 0x5617b31ceba0 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.712+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94659789319952] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b400a4a0 con 0x5617b31ceba0 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.712+0000 7fe4bb3dc800 20 remove_watcher() i=4 2024-04-26T12:30:32.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.712+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94659789324128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dd080 con 0x5617b31d35b0 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.713+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94659789324128] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.713+0000 7fe4bb3dc800 20 remove_watcher() i=5 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.713+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94659789328992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31dd080 con 0x5617b31d35b0 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.714+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94659789328992] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.714+0000 7fe4bb3dc800 20 remove_watcher() i=6 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.714+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94659789330048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617b31e1260 con 0x5617b31d35b0 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4b8ee2640 1 -- 172.21.15.170:0/3676283512 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94659789330048] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a802d070 con 0x5617b31d35b0 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 20 remove_watcher() i=7 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b31d35b0 msgr2=0x5617b31d59a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b31d35b0 0x5617b31d59a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b31ceba0 msgr2=0x5617b31d1060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b31ceba0 0x5617b31d1060 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe4a0081420 msgr2=0x7fe4a0081860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fe4a0081420 0x7fe4a0081860 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5617b31d7f50 msgr2=0x5617b31da410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5617b31d7f50 0x5617b31da410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe384036950 msgr2=0x7fe384038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe384036950 0x7fe384038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5617b31a0f10 tx=0x7fe4a004f000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 msgr2=0x5617b31c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3676283512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31bc270 0x5617b31c3650 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8045cb0 tx=0x7fe4a802ae70 comp rx=0 tx=0).stop 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 reap_dead start 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4b96e3640 1 -- 172.21.15.170:0/3676283512 reap_dead start 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 shutdown_connections 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 >> 172.21.15.170:0/3676283512 conn(0x5617b31b85d0 msgr2=0x5617b31b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 shutdown_connections 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3676283512 wait complete. 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3900369c0 msgr2=0x7fe390038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3900369c0 0x7fe390038e80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5617b3198140 tx=0x7fe4a0005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31aef70 msgr2=0x5617b31af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31aef70 0x5617b31af390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800eb00 tx=0x7fe4a800ef40 comp rx=0 tx=0).stop 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 shutdown_connections 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3900369c0 0x7fe390038e80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/3841884706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b31aef70 0x5617b31af390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.715+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 >> 172.21.15.170:0/3841884706 conn(0x5617b31a3010 msgr2=0x5617b31a3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 shutdown_connections 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/3841884706 wait complete. 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b3199fc0 msgr2=0x5617b319c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5617b3199fc0 0x5617b319c3b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b3095950 msgr2=0x5617b31976f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5617b3095950 0x5617b31976f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5617b319dec0 msgr2=0x5617b31a0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5617b319dec0 0x5617b31a0380 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3a0036950 msgr2=0x7fe3a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe3a0036950 0x7fe3a0038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0054000 tx=0x7fe4a004e000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 msgr2=0x5617b3190680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 --2- 172.21.15.170:0/2942665831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5617b3093e10 0x5617b3190680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800b500 tx=0x7fe4a8000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4b96e3640 1 -- 172.21.15.170:0/2942665831 reap_dead start 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 shutdown_connections 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 >> 172.21.15.170:0/2942665831 conn(0x5617b308f990 msgr2=0x5617b3187670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 shutdown_connections 2024-04-26T12:30:32.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.716+0000 7fe4bb3dc800 1 -- 172.21.15.170:0/2942665831 wait complete. 2024-04-26T12:30:32.734 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:32.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:32.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:32.735 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:32.813 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52f212800 1 Processor -- start 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52f212800 1 -- start start 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52f212800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55f7a5224100 0x55f7a52226b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52f212800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7a515b0c0 con 0x55f7a5222bf0 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52f212800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55f7a513f4d0 con 0x55f7a5224100 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52a95c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55f7a5224100 0x55f7a52226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52a95c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55f7a5224100 0x55f7a52226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41772/0 (socket says 172.21.15.170:41772) 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52a95c640 1 -- 172.21.15.170:0/1582032472 learned_addr learned my addr 172.21.15.170:0/1582032472 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.813+0000 7fb52215b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55f7a5222bf0 0x55f7a52b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46122/0 (socket says 172.21.15.170:46122) 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.814+0000 7fb52a95c640 1 -- 172.21.15.170:0/1582032472 >> v1:172.21.15.132:6789/0 conn(0x55f7a5222bf0 legacy=0x55f7a52b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.814+0000 7fb52a95c640 1 -- 172.21.15.170:0/1582032472 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a516cd40 con 0x55f7a5224100 2024-04-26T12:30:32.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.815+0000 7fb52a95c640 1 --2- 172.21.15.170:0/1582032472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5224100 0x55f7a52226b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00a520 tx=0x7fb51c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bea32cbc9b225ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52a15b640 1 -- 172.21.15.170:0/1582032472 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c057070 con 0x55f7a5224100 2024-04-26T12:30:32.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52a15b640 1 -- 172.21.15.170:0/1582032472 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c052570 con 0x55f7a5224100 2024-04-26T12:30:32.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52a15b640 1 -- 172.21.15.170:0/1582032472 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c04ae60 con 0x55f7a5224100 2024-04-26T12:30:32.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52f212800 1 -- 172.21.15.170:0/1582032472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5224100 msgr2=0x55f7a52226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52f212800 1 --2- 172.21.15.170:0/1582032472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5224100 0x55f7a52226b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00a520 tx=0x7fb51c01d010 comp rx=0 tx=0).stop 2024-04-26T12:30:32.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52f212800 1 -- 172.21.15.170:0/1582032472 shutdown_connections 2024-04-26T12:30:32.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52f212800 1 --2- 172.21.15.170:0/1582032472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5224100 0x55f7a52226b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52f212800 1 -- 172.21.15.170:0/1582032472 >> 172.21.15.170:0/1582032472 conn(0x55f7a52a9b80 msgr2=0x55f7a52abfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52f212800 1 -- 172.21.15.170:0/1582032472 shutdown_connections 2024-04-26T12:30:32.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.816+0000 7fb52f212800 1 -- 172.21.15.170:0/1582032472 wait complete. 2024-04-26T12:30:32.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52f212800 1 Processor -- start 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52f212800 1 -- start start 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52f212800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52f212800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f7a51f9b40 con 0x55f7a5222bf0 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41786/0 (socket says 172.21.15.170:41786) 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52a95c640 1 -- 172.21.15.170:0/2614248331 learned_addr learned my addr 172.21.15.170:0/2614248331 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.828+0000 7fb52a95c640 1 -- 172.21.15.170:0/2614248331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a516b590 con 0x55f7a5222bf0 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52a95c640 1 --2- 172.21.15.170:0/2614248331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a1e60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb51c000c00 tx=0x7fb51c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9aafb5d2a1153c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb418e09640 1 -- 172.21.15.170:0/2614248331 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c057040 con 0x55f7a5222bf0 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb418e09640 1 -- 172.21.15.170:0/2614248331 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c052720 con 0x55f7a5222bf0 2024-04-26T12:30:32.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb418e09640 1 -- 172.21.15.170:0/2614248331 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c052a40 con 0x55f7a5222bf0 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52f212800 1 -- 172.21.15.170:0/2614248331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 msgr2=0x55f7a53a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52f212800 1 --2- 172.21.15.170:0/2614248331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a1e60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb51c000c00 tx=0x7fb51c04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52f212800 1 -- 172.21.15.170:0/2614248331 shutdown_connections 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52f212800 1 --2- 172.21.15.170:0/2614248331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a1e60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52f212800 1 -- 172.21.15.170:0/2614248331 >> 172.21.15.170:0/2614248331 conn(0x55f7a52a9b80 msgr2=0x55f7a539d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52f212800 1 -- 172.21.15.170:0/2614248331 shutdown_connections 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.829+0000 7fb52f212800 1 -- 172.21.15.170:0/2614248331 wait complete. 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52f212800 1 Processor -- start 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52f212800 1 -- start start 2024-04-26T12:30:32.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52f212800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52f212800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f7a52b9e40 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41792/0 (socket says 172.21.15.170:41792) 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52a95c640 1 -- 172.21.15.170:0/2954548817 learned_addr learned my addr 172.21.15.170:0/2954548817 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52a95c640 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a51628f0 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52a95c640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a9740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb51c052540 tx=0x7fb51c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb417606640 1 -- 172.21.15.170:0/2954548817 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c073070 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb417606640 1 -- 172.21.15.170:0/2954548817 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c052c80 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb417606640 1 -- 172.21.15.170:0/2954548817 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c057070 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.830+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7a53a9c80 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.831+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7a53aa1a0 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.831+0000 7fb417606640 1 -- 172.21.15.170:0/2954548817 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb51c076070 con 0x55f7a5222bf0 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.831+0000 7fb417606640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb410036950 0x7fb410038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.831+0000 7fb417606640 1 -- 172.21.15.170:0/2954548817 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb51c08da50 con 0x55f7a5222bf0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.831+0000 7fb52215b640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb410036950 0x7fb410038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a5224100 0x55f7a53b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53b0d80 con 0x55f7a5224100 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52b15d640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a5224100 0x55f7a53b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52215b640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb410036950 0x7fb410038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb514000f60 tx=0x7fb514001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52b15d640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a5224100 0x55f7a53b07b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52b15d640 1 -- 172.21.15.170:0/2954548817 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a5224100 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53add80 con 0x55f7a5224100 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.832+0000 7fb52b15d640 1 -- 172.21.15.170:0/2954548817 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a5224100 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.833+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53b30e0 0x55f7a53b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.833+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53b5bc0 con 0x55f7a53b30e0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.833+0000 7fb52a95c640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53b30e0 0x55f7a53b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.833+0000 7fb52a95c640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53b30e0 0x55f7a53b54d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.833+0000 7fb52a95c640 1 -- 172.21.15.170:0/2954548817 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb51c075030 con 0x55f7a53b30e0 2024-04-26T12:30:32.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.833+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53b2090 con 0x55f7a5224100 2024-04-26T12:30:32.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.834+0000 7fb52b15d640 1 -- 172.21.15.170:0/2954548817 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a5224100 2024-04-26T12:30:32.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.834+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f7a53b7070 0x55f7a53b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.834+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53b9c20 con 0x55f7a53b7070 2024-04-26T12:30:32.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.834+0000 7fb52215b640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f7a53b7070 0x55f7a53b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.834+0000 7fb52215b640 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f7a53b7070 0x55f7a53b94c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.834+0000 7fb52215b640 1 -- 172.21.15.170:0/2954548817 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb51400f690 con 0x55f7a53b7070 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.834+0000 7fb52f212800 1 Processor -- start 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52f212800 1 -- start start 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52f212800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53c8080 0x55f7a53c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52f212800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f7a519fe60 con 0x55f7a53c8080 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53c8080 0x55f7a53c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53c8080 0x55f7a53c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41800/0 (socket says 172.21.15.170:41800) 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52a95c640 1 -- 172.21.15.170:0/1691826231 learned_addr learned my addr 172.21.15.170:0/1691826231 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52a95c640 1 -- 172.21.15.170:0/1691826231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a53c89e0 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.835+0000 7fb52a95c640 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53c8080 0x55f7a53c84a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006910 tx=0x7fb51c076810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb414e01640 1 -- 172.21.15.170:0/1691826231 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c006b90 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb414e01640 1 -- 172.21.15.170:0/1691826231 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c006d30 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7a53c9450 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb414e01640 1 -- 172.21.15.170:0/1691826231 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c06e780 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7a53c9950 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb414e01640 1 -- 172.21.15.170:0/1691826231 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb51c06e920 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb414e01640 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036950 0x7fb404038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb414e01640 1 -- 172.21.15.170:0/1691826231 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb51c0850a0 con 0x55f7a53c8080 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.836+0000 7fb52215b640 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036950 0x7fb404038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52f212800 1 Processor -- start 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52f212800 1 -- start start 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52215b640 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036950 0x7fb404038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55f7a53b1690 tx=0x7fb51400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52f212800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53d5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52f212800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f7a53a2520 con 0x55f7a53d5230 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53d5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53d5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41806/0 (socket says 172.21.15.170:41806) 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52a95c640 1 -- 172.21.15.170:0/131222349 learned_addr learned my addr 172.21.15.170:0/131222349 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52a95c640 1 -- 172.21.15.170:0/131222349 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a53d5c20 con 0x55f7a53d5230 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.837+0000 7fb52a95c640 1 --2- 172.21.15.170:0/131222349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53d5650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb51c05dc20 tx=0x7fb51c09e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f4c4acd9692f6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb40e7fc640 1 -- 172.21.15.170:0/131222349 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c095400 con 0x55f7a53d5230 2024-04-26T12:30:32.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb40e7fc640 1 -- 172.21.15.170:0/131222349 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c0ad070 con 0x55f7a53d5230 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb40e7fc640 1 -- 172.21.15.170:0/131222349 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c0680b0 con 0x55f7a53d5230 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 -- 172.21.15.170:0/131222349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 msgr2=0x55f7a53d5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 --2- 172.21.15.170:0/131222349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53d5650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb51c05dc20 tx=0x7fb51c09e4b0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 -- 172.21.15.170:0/131222349 shutdown_connections 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 --2- 172.21.15.170:0/131222349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53d5650 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 -- 172.21.15.170:0/131222349 >> 172.21.15.170:0/131222349 conn(0x55f7a53d1540 msgr2=0x55f7a53cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 -- 172.21.15.170:0/131222349 shutdown_connections 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 -- 172.21.15.170:0/131222349 wait complete. 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 Processor -- start 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.838+0000 7fb52f212800 1 -- start start 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52f212800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53dc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52f212800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f7a53d62b0 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53dc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52a95c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53dc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41812/0 (socket says 172.21.15.170:41812) 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 learned_addr learned my addr 172.21.15.170:0/3306542369 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7a53dcad0 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52a95c640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53dc590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb51c068500 tx=0x7fb51c064fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb40cff9640 1 -- 172.21.15.170:0/3306542369 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c05cc90 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb40cff9640 1 -- 172.21.15.170:0/3306542369 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c05ce30 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7a53dcad0 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.839+0000 7fb40cff9640 1 -- 172.21.15.170:0/3306542369 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c098b40 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.840+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7a53dcad0 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.840+0000 7fb40cff9640 1 -- 172.21.15.170:0/3306542369 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb51c0a7070 con 0x55f7a53d5230 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.840+0000 7fb40cff9640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f4036950 0x7fb3f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb40cff9640 1 -- 172.21.15.170:0/3306542369 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb51c0bdc90 con 0x55f7a53d5230 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52215b640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f4036950 0x7fb3f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a53e7d30 0x55f7a53ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53ea940 con 0x55f7a53e7d30 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52b15d640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a53e7d30 0x55f7a53ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52215b640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f4036950 0x7fb3f4038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55f7a53ba020 tx=0x7fb514010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52b15d640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a53e7d30 0x55f7a53ea1f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52f212800 20 realm 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.841+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53ead50 con 0x55f7a53e7d30 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb5f0 con 0x55f7a53e7d30 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53ec6f0 0x55f7a53eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53ef060 con 0x55f7a53ec6f0 2024-04-26T12:30:32.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.842+0000 7fb52a95c640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53ec6f0 0x55f7a53eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52a95c640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53ec6f0 0x55f7a53eeae0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52f212800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52f212800 20 searching for the correct realm 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f7a53f10b0 0x55f7a53f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f3c40 con 0x55f7a53f10b0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52215b640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f7a53f10b0 0x55f7a53f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.843+0000 7fb52215b640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f7a53f10b0 0x55f7a53f3570 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.844+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.844+0000 7fb52215b640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb51400f070 0x7fb51402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.844+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f3c40 con 0x7fb51400f070 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.844+0000 7fb52b15d640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb51400f070 0x7fb51402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.844+0000 7fb52b15d640 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb51400f070 0x7fb51402e910 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.844+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.844+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.845+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.845+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.845+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.845+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.845+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.845+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x7fb51400f070 2024-04-26T12:30:32.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.846+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x7fb51400f070 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.847+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.848+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.849+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x7fb51400f070 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.850+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.850+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.850+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.850+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x7fb51400f070 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53f10b0 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.851+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53ec6f0 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x55f7a53e7d30 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53eb990 con 0x7fb51400f070 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:32.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.852+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53ef9b0 con 0x55f7a53e7d30 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53ef9b0 con 0x55f7a53e7d30 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53ef980 con 0x7fb51400f070 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 zone default found 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 4 Realm: () 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 zonegroup default 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53efda0 con 0x55f7a53ec6f0 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.853+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f5aa0 con 0x55f7a53f10b0 2024-04-26T12:30:32.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f5e40 con 0x55f7a53f10b0 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52f212800 20 started sync module instance, tier type = 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52f212800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.854+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f4f40 con 0x7fb51400f070 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.855+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.855+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522117673776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f4f40 con 0x7fb51400f070 2024-04-26T12:30:32.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.855+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f6690 con 0x55f7a53e7d30 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.856+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522117673776] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.856+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.857+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522117672048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f6690 con 0x55f7a53e7d30 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.857+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f7050 con 0x55f7a53f10b0 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.857+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522117672048] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.859+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.859+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522117677536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f6600 con 0x55f7a53f10b0 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.859+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f7f10 con 0x7fb51400f070 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.860+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522117677536] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.860+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.860+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522117683808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f8330 con 0x7fb51400f070 2024-04-26T12:30:32.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.860+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f8cf0 con 0x55f7a53e7d30 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.861+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.861+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522117683808] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.861+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522117687360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f9110 con 0x55f7a53e7d30 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.861+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f7ea0 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.862+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.862+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522117691008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f9f50 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.862+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53fa910 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.862+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522117687360] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.863+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522117691008] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.863+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.863+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522117694560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53fad30 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.863+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53fb580 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522117694560] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522117697744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53fb9a0 con 0x55f7a53ec6f0 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 20 add_watcher() i=0 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 20 add_watcher() i=1 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 20 add_watcher() i=2 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 20 add_watcher() i=3 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 20 add_watcher() i=4 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 20 add_watcher() i=5 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.864+0000 7fb52f212800 20 add_watcher() i=6 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.865+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522117697744] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.865+0000 7fb52f212800 20 add_watcher() i=7 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.865+0000 7fb52f212800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.865+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53fecd0 con 0x55f7a53e7d30 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.865+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.865+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522117699168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53fbf30 con 0x55f7a53e7d30 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522117699168] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb3e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52f212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52f212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52f212800 5 note: GC not initialized 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb35bfff640 20 reqs_thread_entry: start 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52f212800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52f212800 20 Filter name: none 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb359ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52f212800 20 rados->read ofs=0 len=0 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.867+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f7a5431fa0 con 0x55f7a53e7d30 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.868+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.868+0000 7fb52f212800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:30:32.880 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:32.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.868+0000 7fb3e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:32.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.868+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522117699168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a54309f0 con 0x55f7a53e7d30 2024-04-26T12:30:32.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.869+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94522117699168] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.869+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522117673776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a5430ea0 con 0x7fb51400f070 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.870+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94522117673776] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.870+0000 7fb52f212800 20 remove_watcher() i=0 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.870+0000 7fb52f212800 2 removed watcher, disabling cache 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.870+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522117672048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f5330 con 0x55f7a53e7d30 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.871+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94522117672048] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.871+0000 7fb52f212800 20 remove_watcher() i=1 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.871+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522117677536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f5330 con 0x55f7a53f10b0 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.872+0000 7fb52215b640 1 -- 172.21.15.170:0/3306542369 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94522117677536] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb514037040 con 0x55f7a53f10b0 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.872+0000 7fb52f212800 20 remove_watcher() i=2 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.872+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522117683808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f61e0 con 0x7fb51400f070 2024-04-26T12:30:32.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.873+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94522117683808] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x7fb51400f070 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.873+0000 7fb52f212800 20 remove_watcher() i=3 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.873+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522117687360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f7a60 con 0x55f7a53e7d30 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.875+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94522117687360] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb52400a4a0 con 0x55f7a53e7d30 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.875+0000 7fb52f212800 20 remove_watcher() i=4 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.875+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522117691008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f61e0 con 0x55f7a53ec6f0 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.875+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94522117691008] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.875+0000 7fb52f212800 20 remove_watcher() i=5 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.875+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522117694560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f8840 con 0x55f7a53ec6f0 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.876+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94522117694560] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.876+0000 7fb52f212800 20 remove_watcher() i=6 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.876+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522117697744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f7a53f7a60 con 0x55f7a53ec6f0 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.877+0000 7fb52a95c640 1 -- 172.21.15.170:0/3306542369 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94522117697744] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51c0c2020 con 0x55f7a53ec6f0 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.877+0000 7fb52f212800 20 remove_watcher() i=7 2024-04-26T12:30:32.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53ec6f0 msgr2=0x55f7a53eeae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53ec6f0 0x55f7a53eeae0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a53e7d30 msgr2=0x55f7a53ea1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a53e7d30 0x55f7a53ea1f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb51400f070 msgr2=0x7fb51402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb51400f070 0x7fb51402e910 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f7a53f10b0 msgr2=0x55f7a53f3570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f7a53f10b0 0x55f7a53f3570 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f4036950 msgr2=0x7fb3f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f4036950 0x7fb3f4038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55f7a53ba020 tx=0x7fb514010000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 msgr2=0x55f7a53dc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/3306542369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53d5230 0x55f7a53dc590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb51c068500 tx=0x7fb51c064fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 reap_dead start 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52b15d640 1 -- 172.21.15.170:0/3306542369 reap_dead start 2024-04-26T12:30:32.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 shutdown_connections 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 >> 172.21.15.170:0/3306542369 conn(0x55f7a53d1540 msgr2=0x55f7a53ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 shutdown_connections 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/3306542369 wait complete. 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036950 msgr2=0x7fb404038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036950 0x7fb404038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55f7a53b1690 tx=0x7fb51400f000 comp rx=0 tx=0).stop 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53c8080 msgr2=0x55f7a53c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53c8080 0x55f7a53c84a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006910 tx=0x7fb51c076810 comp rx=0 tx=0).stop 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 shutdown_connections 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036950 0x7fb404038e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/1691826231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a53c8080 0x55f7a53c84a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 >> 172.21.15.170:0/1691826231 conn(0x55f7a53bc120 msgr2=0x55f7a53bc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 shutdown_connections 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/1691826231 wait complete. 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53b30e0 msgr2=0x55f7a53b54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f7a53b30e0 0x55f7a53b54d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a5224100 msgr2=0x55f7a53b07b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f7a5224100 0x55f7a53b07b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f7a53b7070 msgr2=0x55f7a53b94c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.878+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f7a53b7070 0x55f7a53b94c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb410036950 msgr2=0x7fb410038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb410036950 0x7fb410038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb514000f60 tx=0x7fb514001370 comp rx=0 tx=0).stop 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 msgr2=0x55f7a53a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 --2- 172.21.15.170:0/2954548817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f7a5222bf0 0x55f7a53a9740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb51c052540 tx=0x7fb51c003020 comp rx=0 tx=0).stop 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52b15d640 1 -- 172.21.15.170:0/2954548817 reap_dead start 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 shutdown_connections 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 >> 172.21.15.170:0/2954548817 conn(0x55f7a52a9b80 msgr2=0x55f7a53a0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 shutdown_connections 2024-04-26T12:30:32.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.879+0000 7fb52f212800 1 -- 172.21.15.170:0/2954548817 wait complete. 2024-04-26T12:30:32.891 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:32.892 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-26T12:30:32.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-26T12:30:32.892 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-26T12:30:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:32.979 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.978+0000 7fdd53bdc800 1 Processor -- start 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.978+0000 7fdd53bdc800 1 -- start start 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd53bdc800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55f189156890 0x55f189158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd53bdc800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1890000c0 con 0x55f189152400 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd53bdc800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55f188fe44d0 con 0x55f189156890 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd50ee1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55f189156890 0x55f189158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd516e2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55f189152400 0x55f189152820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46126/0 (socket says 172.21.15.170:46126) 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd516e2640 1 -- 172.21.15.170:0/656569347 learned_addr learned my addr 172.21.15.170:0/656569347 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd50ee1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55f189156890 0x55f189158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41816/0 (socket says 172.21.15.170:41816) 2024-04-26T12:30:32.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd50ee1640 1 -- 172.21.15.170:0/656569347 >> v1:172.21.15.132:6789/0 conn(0x55f189152400 legacy=0x55f189152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd50ee1640 1 -- 172.21.15.170:0/656569347 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f189011d40 con 0x55f189156890 2024-04-26T12:30:32.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.979+0000 7fdd43fff640 1 -- 172.21.15.170:0/656569347 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127235711 0 0) 0x55f1890000c0 con 0x55f189152400 2024-04-26T12:30:32.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.981+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/656569347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189156890 0x55f189158c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800a470 tx=0x7fdd4801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da07bdbe7c58c4b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.981+0000 7fdd43fff640 1 -- 172.21.15.170:0/656569347 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd48057070 con 0x55f189156890 2024-04-26T12:30:32.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.981+0000 7fdd43fff640 1 -- 172.21.15.170:0/656569347 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48052570 con 0x55f189156890 2024-04-26T12:30:32.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.981+0000 7fdd43fff640 1 -- 172.21.15.170:0/656569347 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd48052870 con 0x55f189156890 2024-04-26T12:30:32.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.982+0000 7fdd53bdc800 1 -- 172.21.15.170:0/656569347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189156890 msgr2=0x55f189158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:32.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.982+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/656569347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189156890 0x55f189158c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800a470 tx=0x7fdd4801ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:32.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.982+0000 7fdd53bdc800 1 -- 172.21.15.170:0/656569347 shutdown_connections 2024-04-26T12:30:32.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.982+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/656569347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189156890 0x55f189158c80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:32.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.982+0000 7fdd53bdc800 1 -- 172.21.15.170:0/656569347 >> 172.21.15.170:0/656569347 conn(0x55f18914da00 msgr2=0x55f18914fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:32.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.982+0000 7fdd53bdc800 1 -- 172.21.15.170:0/656569347 shutdown_connections 2024-04-26T12:30:32.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.982+0000 7fdd53bdc800 1 -- 172.21.15.170:0/656569347 wait complete. 2024-04-26T12:30:32.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd53bdc800 1 Processor -- start 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd53bdc800 1 -- start start 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd53bdc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f1890c6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd53bdc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f18909eb60 con 0x55f189152400 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f1890c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f1890c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41822/0 (socket says 172.21.15.170:41822) 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd516e2640 1 -- 172.21.15.170:0/2540193290 learned_addr learned my addr 172.21.15.170:0/2540193290 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd516e2640 1 -- 172.21.15.170:0/2540193290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f189010590 con 0x55f189152400 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.994+0000 7fdd516e2640 1 --2- 172.21.15.170:0/2540193290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f1890c6670 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400b240 tx=0x7fdd4400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7057974d4bf15cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:32.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdc3f606640 1 -- 172.21.15.170:0/2540193290 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd44008070 con 0x55f189152400 2024-04-26T12:30:32.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdc3f606640 1 -- 172.21.15.170:0/2540193290 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4400d500 con 0x55f189152400 2024-04-26T12:30:32.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdc3f606640 1 -- 172.21.15.170:0/2540193290 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd4400d860 con 0x55f189152400 2024-04-26T12:30:33.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2540193290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 msgr2=0x55f1890c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2540193290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f1890c6670 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400b240 tx=0x7fdd4400b700 comp rx=0 tx=0).stop 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2540193290 shutdown_connections 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2540193290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f1890c6670 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2540193290 >> 172.21.15.170:0/2540193290 conn(0x55f18914da00 msgr2=0x55f18923ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2540193290 shutdown_connections 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.995+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2540193290 wait complete. 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd53bdc800 1 Processor -- start 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd53bdc800 1 -- start start 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd53bdc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f18924e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd53bdc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f189159550 con 0x55f189152400 2024-04-26T12:30:33.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f18924e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f18924e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41832/0 (socket says 172.21.15.170:41832) 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd516e2640 1 -- 172.21.15.170:0/2182816049 learned_addr learned my addr 172.21.15.170:0/2182816049 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd516e2640 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1890078f0 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdd516e2640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f18924e190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000fb0 tx=0x7fdd44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.996+0000 7fdc3de03640 1 -- 172.21.15.170:0/2182816049 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd4400f9d0 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.997+0000 7fdc3de03640 1 -- 172.21.15.170:0/2182816049 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4400fb70 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.997+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f18924e6d0 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.997+0000 7fdc3de03640 1 -- 172.21.15.170:0/2182816049 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd4400fe50 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.997+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18924ebf0 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.997+0000 7fdc3de03640 1 -- 172.21.15.170:0/2182816049 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd44017040 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.997+0000 7fdc3de03640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc38036af0 0x7fdc38038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.997+0000 7fdc3de03640 1 -- 172.21.15.170:0/2182816049 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fdd44015020 con 0x55f189152400 2024-04-26T12:30:33.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc38036af0 0x7fdc38038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f189156890 0x55f189255200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189255740 con 0x55f189156890 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd51ee3640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f189156890 0x55f189255200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc38036af0 0x7fdc38038fb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd48054000 tx=0x7fdd4804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd51ee3640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f189156890 0x55f189255200 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd51ee3640 1 -- 172.21.15.170:0/2182816049 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f189156890 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.998+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1892527d0 con 0x55f189156890 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.999+0000 7fdd51ee3640 1 -- 172.21.15.170:0/2182816049 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f189156890 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.999+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f189257a50 0x55f189259e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.999+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f18925a530 con 0x55f189257a50 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.999+0000 7fdd516e2640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f189257a50 0x55f189259e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.999+0000 7fdd516e2640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f189257a50 0x55f189259e40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.999+0000 7fdd516e2640 1 -- 172.21.15.170:0/2182816049 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd4402d070 con 0x55f189257a50 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:32.999+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189256a00 con 0x55f189156890 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.000+0000 7fdd51ee3640 1 -- 172.21.15.170:0/2182816049 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f189156890 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.000+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f18925b9e0 0x55f18925de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.000+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f18925e590 con 0x55f18925b9e0 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.000+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f18925b9e0 0x55f18925de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.000+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f18925b9e0 0x55f18925de30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.000+0000 7fdd50ee1640 1 -- 172.21.15.170:0/2182816049 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd48052940 con 0x55f18925b9e0 2024-04-26T12:30:33.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd53bdc800 1 Processor -- start 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd53bdc800 1 -- start start 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd53bdc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f18926c9f0 0x55f18926ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd53bdc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f189044e60 con 0x55f18926c9f0 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f18926c9f0 0x55f18926ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f18926c9f0 0x55f18926ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41844/0 (socket says 172.21.15.170:41844) 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd516e2640 1 -- 172.21.15.170:0/1043513400 learned_addr learned my addr 172.21.15.170:0/1043513400 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd516e2640 1 -- 172.21.15.170:0/1043513400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18926d350 con 0x55f18926c9f0 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.001+0000 7fdd516e2640 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f18926c9f0 0x55f18926ce10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdd4404b440 tx=0x7fdd4400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdc36ffd640 1 -- 172.21.15.170:0/1043513400 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd44043070 con 0x55f18926c9f0 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdc36ffd640 1 -- 172.21.15.170:0/1043513400 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44018ca0 con 0x55f18926c9f0 2024-04-26T12:30:33.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f18926ddc0 con 0x55f18926c9f0 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdc36ffd640 1 -- 172.21.15.170:0/1043513400 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd44019470 con 0x55f18926c9f0 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18926e2c0 con 0x55f18926c9f0 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdc36ffd640 1 -- 172.21.15.170:0/1043513400 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd44038020 con 0x55f18926c9f0 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdc36ffd640 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc280368b0 0x7fdc28038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdc36ffd640 1 -- 172.21.15.170:0/1043513400 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fdd44036020 con 0x55f18926c9f0 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.002+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc280368b0 0x7fdc28038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd53bdc800 1 Processor -- start 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd53bdc800 1 -- start start 2024-04-26T12:30:33.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc280368b0 0x7fdc28038d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f189256000 tx=0x7fdd48005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd53bdc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f18927a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd53bdc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f189249720 con 0x55f189279d30 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f18927a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f18927a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41852/0 (socket says 172.21.15.170:41852) 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd516e2640 1 -- 172.21.15.170:0/1551080614 learned_addr learned my addr 172.21.15.170:0/1551080614 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.003+0000 7fdd516e2640 1 -- 172.21.15.170:0/1551080614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18927a720 con 0x55f189279d30 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd516e2640 1 --2- 172.21.15.170:0/1551080614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f18927a150 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400efd0 tx=0x7fdd440199e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee83cd0fe40c3d6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdc34ff9640 1 -- 172.21.15.170:0/1551080614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd44057030 con 0x55f189279d30 2024-04-26T12:30:33.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdc34ff9640 1 -- 172.21.15.170:0/1551080614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44044280 con 0x55f189279d30 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdc34ff9640 1 -- 172.21.15.170:0/1551080614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd440444e0 con 0x55f189279d30 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1551080614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 msgr2=0x55f18927a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/1551080614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f18927a150 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400efd0 tx=0x7fdd440199e0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1551080614 shutdown_connections 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/1551080614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f18927a150 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1551080614 >> 172.21.15.170:0/1551080614 conn(0x55f189276050 msgr2=0x55f1892740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1551080614 shutdown_connections 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1551080614 wait complete. 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.004+0000 7fdd53bdc800 1 Processor -- start 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd53bdc800 1 -- start start 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd53bdc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f189281160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd53bdc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55f18927ae40 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f189281160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd516e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f189281160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41856/0 (socket says 172.21.15.170:41856) 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 learned_addr learned my addr 172.21.15.170:0/4024485693 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1892816a0 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd516e2640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f189281160 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400bc50 tx=0x7fdd44012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdc26ffd640 1 -- 172.21.15.170:0/4024485693 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd4401cd20 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdc26ffd640 1 -- 172.21.15.170:0/4024485693 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4403f8e0 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1892816a0 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.005+0000 7fdc26ffd640 1 -- 172.21.15.170:0/4024485693 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd44030450 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.006+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1892816a0 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.006+0000 7fdc26ffd640 1 -- 172.21.15.170:0/4024485693 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdd4406a070 con 0x55f189279d30 2024-04-26T12:30:33.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.006+0000 7fdc26ffd640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc1c036950 0x7fdc1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.006+0000 7fdc26ffd640 1 -- 172.21.15.170:0/4024485693 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fdd4405b070 con 0x55f189279d30 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.006+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc1c036950 0x7fdc1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.007+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc1c036950 0x7fdc1c038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd48052fd0 tx=0x7fdd4804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.007+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.007+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f18928c6c0 0x55f18928eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.007+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f18928f2d0 con 0x55f18928c6c0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.007+0000 7fdd51ee3640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f18928c6c0 0x55f18928eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.007+0000 7fdd51ee3640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f18928c6c0 0x55f18928eb80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 realm 2024-04-26T12:30:33.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f18928f6e0 con 0x55f18928c6c0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f18928ffb0 con 0x55f18928c6c0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f18928c6c0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f1892910b0 0x55f1892934a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.008+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189293ab0 con 0x55f1892910b0 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd516e2640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f1892910b0 0x55f1892934a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd516e2640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f1892910b0 0x55f1892934a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd53bdc800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd53bdc800 20 searching for the correct realm 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f189295a60 0x55f189297f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1892985f0 con 0x55f189295a60 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.009+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f189295a60 0x55f189297f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.010+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f189295a60 0x55f189297f20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.010+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.010+0000 7fdd50ee1640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd48076040 0x7fdd48083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.010+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f1892985f0 con 0x7fdd48076040 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.010+0000 7fdd51ee3640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd48076040 0x7fdd48083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.010+0000 7fdd51ee3640 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd48076040 0x7fdd48083410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f1892910b0 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f18928c6c0 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f18928c6c0 2024-04-26T12:30:33.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.011+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f1892910b0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f1892910b0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x7fdd48076040 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f189295a60 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.012+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f18928c6c0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f1892910b0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f18928c6c0 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x7fdd48076040 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.013+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f189290350 con 0x55f189295a60 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f189295a60 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f1892910b0 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f189295a60 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f189295a60 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.014+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.015+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f18928c6c0 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.015+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.015+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f18928c6c0 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.015+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.015+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f1892910b0 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.015+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.015+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f189295a60 2024-04-26T12:30:33.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x7fdd48076040 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f18928c6c0 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f1892910b0 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.016+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f189295a60 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f1892910b0 2024-04-26T12:30:33.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x7fdd48076040 2024-04-26T12:30:33.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f189295a60 2024-04-26T12:30:33.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.017+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f1892910b0 2024-04-26T12:30:33.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x55f18928c6c0 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fdd48090040 con 0x7fdd48076040 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189294370 con 0x55f18928c6c0 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.018+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189294370 con 0x55f18928c6c0 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189294370 con 0x7fdd48076040 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 zone default found 2024-04-26T12:30:33.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 4 Realm: () 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 zonegroup default 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f189294c10 con 0x55f1892910b0 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.019+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f18929a450 con 0x55f189295a60 2024-04-26T12:30:33.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f18929a7f0 con 0x55f189295a60 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd53bdc800 20 started sync module instance, tier type = 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd53bdc800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.020+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1892998f0 con 0x7fdd48076040 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.021+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.021+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94495876685072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1892998f0 con 0x7fdd48076040 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.021+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929b040 con 0x55f18928c6c0 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.022+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94495876685072] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.022+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.022+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94495876683296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929b040 con 0x55f18928c6c0 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.022+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929ba40 con 0x55f189295a60 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.023+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94495876683296] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.023+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.023+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94495876688784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929afb0 con 0x55f189295a60 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.024+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929c900 con 0x7fdd48076040 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.025+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.025+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94495876695600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929d0a0 con 0x7fdd48076040 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.025+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929dbc0 con 0x55f18928c6c0 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.025+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94495876688784] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.026+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.026+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94495876699792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929db80 con 0x55f18928c6c0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.026+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929e5d0 con 0x55f1892910b0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.026+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94495876695600] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.027+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.027+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94495876702496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929e9f0 con 0x55f1892910b0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.027+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929f3b0 con 0x55f1892910b0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.027+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94495876699792] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.027+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94495876702496] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.028+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.028+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94495876693552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929f3b0 con 0x55f1892910b0 2024-04-26T12:30:33.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.028+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929fc50 con 0x55f1892910b0 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94495876693552] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94495876706048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929fe30 con 0x55f1892910b0 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=0 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=1 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=2 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=3 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=4 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=5 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=6 2024-04-26T12:30:33.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94495876706048] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 20 add_watcher() i=7 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.029+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1892a3020 con 0x55f18928c6c0 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.030+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.030+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94495876708832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1892a02b0 con 0x55f18928c6c0 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94495876708832] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdc077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 5 note: GC not initialized 2024-04-26T12:30:33.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdc067e4640 20 reqs_thread_entry: start 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 20 Filter name: none 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdb77fff640 20 reqs_thread_entry: start 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.031+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1892d66e0 con 0x55f18928c6c0 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-26T12:30:33.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1892d7470 con 0x7fdd48076040 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.032+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1892dd1d0 con 0x55f18928c6c0 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.033+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.033+0000 7fdd53bdc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.033+0000 7fdd53bdc800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.033+0000 7fdd53bdc800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.033+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94495876959328 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1892d9d60 con 0x55f18928c6c0 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.033+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94495876699792 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7fdd4c0267f0 con 0x55f18928c6c0 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdc34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94495876699792 notifier 4397 bl.length()=849 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdc34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(65 notify.4 [notify cookie 94495876959328 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdc34ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdc34ff9640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fdc14003ea0 con 0x55f18928c6c0 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94495876959328 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdd4c018d70 con 0x55f18928c6c0 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.034+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1892dcc60 con 0x7fdd48076040 2024-04-26T12:30:33.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.035+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.035+0000 7fdd53bdc800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.035+0000 7fdd53bdc800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.035+0000 7fdd53bdc800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.035+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94495876959328 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f1892d9d10 con 0x7fdd48076040 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== watch-notify(notify (1) cookie 94495876685072 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fdd4c018d70 con 0x7fdd48076040 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdc34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94495876685072 notifier 4397 bl.length()=166 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdc34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdc34ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdc34ff9640 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fdc14003ea0 con 0x7fdd48076040 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(68 notify.0 [notify cookie 94495876959328 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== watch-notify(notify_complete (2) cookie 94495876959328 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdd4c026b60 con 0x7fdd48076040 2024-04-26T12:30:33.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.036+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.060 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:30:33.033367Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:33.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.037+0000 7fdc077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.037+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94495876708832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f1892d77b0 con 0x55f18928c6c0 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.038+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94495876708832] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.038+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94495876685072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929f9e0 con 0x7fdd48076040 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.039+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94495876685072] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.039+0000 7fdd53bdc800 20 remove_watcher() i=0 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.039+0000 7fdd53bdc800 2 removed watcher, disabling cache 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.039+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94495876683296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929f9e0 con 0x55f18928c6c0 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.040+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94495876683296] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.040+0000 7fdd53bdc800 20 remove_watcher() i=1 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.040+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94495876688784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f189299620 con 0x55f189295a60 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.041+0000 7fdd50ee1640 1 -- 172.21.15.170:0/4024485693 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94495876688784] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd48081070 con 0x55f189295a60 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.041+0000 7fdd53bdc800 20 remove_watcher() i=2 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.041+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94495876695600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929f9e0 con 0x7fdd48076040 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.042+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94495876695600] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x7fdd48076040 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.042+0000 7fdd53bdc800 20 remove_watcher() i=3 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.042+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94495876699792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929ab90 con 0x55f18928c6c0 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.043+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94495876699792] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4c00a4a0 con 0x55f18928c6c0 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.043+0000 7fdd53bdc800 20 remove_watcher() i=4 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.043+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94495876702496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929c630 con 0x55f1892910b0 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.044+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94495876702496] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.044+0000 7fdd53bdc800 20 remove_watcher() i=5 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.044+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94495876693552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929f9e0 con 0x55f1892910b0 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.045+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94495876693552] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.045+0000 7fdd53bdc800 20 remove_watcher() i=6 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.045+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94495876706048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f18929ab90 con 0x55f1892910b0 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd516e2640 1 -- 172.21.15.170:0/4024485693 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94495876706048] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd4407f040 con 0x55f1892910b0 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 20 remove_watcher() i=7 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f1892910b0 msgr2=0x55f1892934a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f1892910b0 0x55f1892934a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f18928c6c0 msgr2=0x55f18928eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f18928c6c0 0x55f18928eb80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd48076040 msgr2=0x7fdd48083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdd48076040 0x7fdd48083410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f189295a60 msgr2=0x55f189297f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55f189295a60 0x55f189297f20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc1c036950 msgr2=0x7fdc1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc1c036950 0x7fdc1c038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd48052fd0 tx=0x7fdd4804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd51ee3640 1 -- 172.21.15.170:0/4024485693 reap_dead start 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 msgr2=0x55f189281160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f189281160 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400bc50 tx=0x7fdd44012ea0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 shutdown_connections 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/4024485693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189279d30 0x55f189281160 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 >> 172.21.15.170:0/4024485693 conn(0x55f189276050 msgr2=0x55f1892736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 shutdown_connections 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/4024485693 wait complete. 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc280368b0 msgr2=0x7fdc28038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc280368b0 0x7fdc28038d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f189256000 tx=0x7fdd48005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f18926c9f0 msgr2=0x55f18926ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.046+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f18926c9f0 0x55f18926ce10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdd4404b440 tx=0x7fdd4400ef40 comp rx=0 tx=0).stop 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 shutdown_connections 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc280368b0 0x7fdc28038d70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/1043513400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f18926c9f0 0x55f18926ce10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 >> 172.21.15.170:0/1043513400 conn(0x55f189260a90 msgr2=0x55f189260e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 shutdown_connections 2024-04-26T12:30:33.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/1043513400 wait complete. 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f189257a50 msgr2=0x55f189259e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55f189257a50 0x55f189259e40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f189156890 msgr2=0x55f189255200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55f189156890 0x55f189255200 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f18925b9e0 msgr2=0x55f18925de30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55f18925b9e0 0x55f18925de30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc38036af0 msgr2=0x7fdc38038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdc38036af0 0x7fdc38038fb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd48054000 tx=0x7fdd4804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 msgr2=0x55f18924e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 --2- 172.21.15.170:0/2182816049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f189152400 0x55f18924e190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000fb0 tx=0x7fdd44000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd51ee3640 1 -- 172.21.15.170:0/2182816049 reap_dead start 2024-04-26T12:30:33.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 shutdown_connections 2024-04-26T12:30:33.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 >> 172.21.15.170:0/2182816049 conn(0x55f18914da00 msgr2=0x55f18923d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 shutdown_connections 2024-04-26T12:30:33.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.047+0000 7fdd53bdc800 1 -- 172.21.15.170:0/2182816049 wait complete. 2024-04-26T12:30:33.073 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:30:33.033367Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:33.073 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:30:33.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:30:33.073 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:30:33.116 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:33.116 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:33.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.116+0000 7f99ff525800 1 Processor -- start 2024-04-26T12:30:33.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.116+0000 7f99ff525800 1 -- start start 2024-04-26T12:30:33.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.116+0000 7f99ff525800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5644320385c0 0x5644320389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.116+0000 7f99ff525800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564431ee50c0 con 0x564432039730 2024-04-26T12:30:33.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.116+0000 7f99ff525800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x564431ec94d0 con 0x5644320385c0 2024-04-26T12:30:33.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.117+0000 7f99fb2b7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5644320385c0 0x5644320389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.117+0000 7f99fb2b7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5644320385c0 0x5644320389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41874/0 (socket says 172.21.15.170:41874) 2024-04-26T12:30:33.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.117+0000 7f99faab6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x564432039730 0x564432039bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46140/0 (socket says 172.21.15.170:46140) 2024-04-26T12:30:33.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.117+0000 7f99fb2b7640 1 -- 172.21.15.170:0/3781727722 learned_addr learned my addr 172.21.15.170:0/3781727722 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.117+0000 7f99fb2b7640 1 -- 172.21.15.170:0/3781727722 >> v1:172.21.15.132:6789/0 conn(0x564432039730 legacy=0x564432039bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.117+0000 7f99fb2b7640 1 -- 172.21.15.170:0/3781727722 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564431ef6d40 con 0x5644320385c0 2024-04-26T12:30:33.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/3781727722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x5644320389e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00a520 tx=0x7f99ec01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ebfc6b3665cb0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99fa2b5640 1 -- 172.21.15.170:0/3781727722 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec057070 con 0x5644320385c0 2024-04-26T12:30:33.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99fa2b5640 1 -- 172.21.15.170:0/3781727722 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec052570 con 0x5644320385c0 2024-04-26T12:30:33.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99fa2b5640 1 -- 172.21.15.170:0/3781727722 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec04ae60 con 0x5644320385c0 2024-04-26T12:30:33.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99ff525800 1 -- 172.21.15.170:0/3781727722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 msgr2=0x5644320389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99ff525800 1 --2- 172.21.15.170:0/3781727722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x5644320389e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00a520 tx=0x7f99ec01d010 comp rx=0 tx=0).stop 2024-04-26T12:30:33.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99ff525800 1 -- 172.21.15.170:0/3781727722 shutdown_connections 2024-04-26T12:30:33.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99ff525800 1 --2- 172.21.15.170:0/3781727722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x5644320389e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99ff525800 1 -- 172.21.15.170:0/3781727722 >> 172.21.15.170:0/3781727722 conn(0x564432033b80 msgr2=0x564432035fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.119+0000 7f99ff525800 1 -- 172.21.15.170:0/3781727722 shutdown_connections 2024-04-26T12:30:33.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.120+0000 7f99ff525800 1 -- 172.21.15.170:0/3781727722 wait complete. 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.131+0000 7f99ff525800 1 Processor -- start 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.131+0000 7f99ff525800 1 -- start start 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.131+0000 7f99ff525800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564432129bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.131+0000 7f99ff525800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564431f83b40 con 0x5644320385c0 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564432129bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564432129bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41880/0 (socket says 172.21.15.170:41880) 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f99fb2b7640 1 -- 172.21.15.170:0/1125368418 learned_addr learned my addr 172.21.15.170:0/1125368418 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f99fb2b7640 1 -- 172.21.15.170:0/1125368418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564431ef5590 con 0x5644320385c0 2024-04-26T12:30:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/1125368418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564432129bc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99ec055040 tx=0x7f99ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761568581696f2ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f98e960a640 1 -- 172.21.15.170:0/1125368418 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec057040 con 0x5644320385c0 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f98e960a640 1 -- 172.21.15.170:0/1125368418 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec052720 con 0x5644320385c0 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.132+0000 7f98e960a640 1 -- 172.21.15.170:0/1125368418 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec052a40 con 0x5644320385c0 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 -- 172.21.15.170:0/1125368418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 msgr2=0x564432129bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 --2- 172.21.15.170:0/1125368418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564432129bc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99ec055040 tx=0x7f99ec04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 -- 172.21.15.170:0/1125368418 shutdown_connections 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 --2- 172.21.15.170:0/1125368418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564432129bc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 -- 172.21.15.170:0/1125368418 >> 172.21.15.170:0/1125368418 conn(0x564432033b80 msgr2=0x5644321254e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 -- 172.21.15.170:0/1125368418 shutdown_connections 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 -- 172.21.15.170:0/1125368418 wait complete. 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 Processor -- start 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 -- start start 2024-04-26T12:30:33.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564431fae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.133+0000 7f99ff525800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564432041ba0 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564431fae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564431fae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41892/0 (socket says 172.21.15.170:41892) 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f99fb2b7640 1 -- 172.21.15.170:0/1105850172 learned_addr learned my addr 172.21.15.170:0/1105850172 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f99fb2b7640 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564431eec8f0 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564431fae000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99ec052540 tx=0x7f99ec003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f98e7e07640 1 -- 172.21.15.170:0/1105850172 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec073070 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f98e7e07640 1 -- 172.21.15.170:0/1105850172 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec052c90 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564431fac6f0 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f98e7e07640 1 -- 172.21.15.170:0/1105850172 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec057070 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.134+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564431facc10 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.135+0000 7f98e7e07640 1 -- 172.21.15.170:0/1105850172 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f99ec076070 con 0x5644320385c0 2024-04-26T12:30:33.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.135+0000 7f98e7e07640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98e0036950 0x7f98e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.135+0000 7f98e7e07640 1 -- 172.21.15.170:0/1105850172 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f99ec08d9f0 con 0x5644320385c0 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.135+0000 7f99faab6640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98e0036950 0x7f98e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.135+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432039730 0x56443213a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.135+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56443213add0 con 0x564432039730 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.135+0000 7f99fbab8640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432039730 0x56443213a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.136+0000 7f99faab6640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98e0036950 0x7f98e0038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000f60 tx=0x7f99f0001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.136+0000 7f99fbab8640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432039730 0x56443213a890 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.136+0000 7f99fbab8640 1 -- 172.21.15.170:0/1105850172 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432039730 2024-04-26T12:30:33.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.136+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56443213b620 con 0x564432039730 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.136+0000 7f99fbab8640 1 -- 172.21.15.170:0/1105850172 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432039730 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.136+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56443213cf70 0x56443213f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.136+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56443213fba0 con 0x56443213cf70 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.137+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56443213cf70 0x56443213f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.137+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56443213cf70 0x56443213f410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.137+0000 7f99fb2b7640 1 -- 172.21.15.170:0/1105850172 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99ec075030 con 0x56443213cf70 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.137+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56443213bea0 con 0x564432039730 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.137+0000 7f99fbab8640 1 -- 172.21.15.170:0/1105850172 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432039730 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.137+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564432141050 0x5644321434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.137+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564432143c20 con 0x564432141050 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.138+0000 7f99faab6640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564432141050 0x5644321434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.138+0000 7f99faab6640 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564432141050 0x5644321434c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.138+0000 7f99faab6640 1 -- 172.21.15.170:0/1105850172 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99f000f690 con 0x564432141050 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.138+0000 7f99ff525800 1 Processor -- start 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.138+0000 7f99ff525800 1 -- start start 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99ff525800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564432152080 0x5644321524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99ff525800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564431fae540 con 0x564432152080 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564432152080 0x5644321524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564432152080 0x5644321524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41896/0 (socket says 172.21.15.170:41896) 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4155420388 learned_addr learned my addr 172.21.15.170:0/4155420388 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4155420388 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644321529e0 con 0x564432152080 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564432152080 0x5644321524a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f99ec055040 tx=0x7f99ec077df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f98e5602640 1 -- 172.21.15.170:0/4155420388 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec083040 con 0x564432152080 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f98e5602640 1 -- 172.21.15.170:0/4155420388 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec091070 con 0x564432152080 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564432153450 con 0x564432152080 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f98e5602640 1 -- 172.21.15.170:0/4155420388 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec05d440 con 0x564432152080 2024-04-26T12:30:33.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.139+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564432153950 con 0x564432152080 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.140+0000 7f98e5602640 1 -- 172.21.15.170:0/4155420388 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f99ec086030 con 0x564432152080 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.140+0000 7f98e5602640 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98d4036900 0x7f98d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.140+0000 7f98e5602640 1 -- 172.21.15.170:0/4155420388 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f99ec097cc0 con 0x564432152080 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.140+0000 7f99faab6640 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98d4036900 0x7f98d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.140+0000 7f99ff525800 1 Processor -- start 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99ff525800 1 -- start start 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99faab6640 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98d4036900 0x7f98d4038dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x564431fad030 tx=0x7f99f000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99ff525800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x56443215f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99ff525800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564431f29e60 con 0x56443215f280 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x56443215f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x56443215f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41908/0 (socket says 172.21.15.170:41908) 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99fb2b7640 1 -- 172.21.15.170:0/1710406636 learned_addr learned my addr 172.21.15.170:0/1710406636 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99fb2b7640 1 -- 172.21.15.170:0/1710406636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443215fc70 con 0x56443215f280 2024-04-26T12:30:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.141+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/1710406636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x56443215f6a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99ec080180 tx=0x7f99ec076950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e0687e3c5850ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f98deffd640 1 -- 172.21.15.170:0/1710406636 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec07fcc0 con 0x56443215f280 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f98deffd640 1 -- 172.21.15.170:0/1710406636 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec078c40 con 0x56443215f280 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f98deffd640 1 -- 172.21.15.170:0/1710406636 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec07fe60 con 0x56443215f280 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 -- 172.21.15.170:0/1710406636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 msgr2=0x56443215f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 --2- 172.21.15.170:0/1710406636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x56443215f6a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f99ec080180 tx=0x7f99ec076950 comp rx=0 tx=0).stop 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 -- 172.21.15.170:0/1710406636 shutdown_connections 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 --2- 172.21.15.170:0/1710406636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x56443215f6a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 -- 172.21.15.170:0/1710406636 >> 172.21.15.170:0/1710406636 conn(0x56443215b550 msgr2=0x5644321595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 -- 172.21.15.170:0/1710406636 shutdown_connections 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 -- 172.21.15.170:0/1710406636 wait complete. 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 Processor -- start 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 -- start start 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.142+0000 7f99ff525800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x5644321663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99ff525800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564432160150 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x5644321663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99fb2b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x5644321663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41926/0 (socket says 172.21.15.170:41926) 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 learned_addr learned my addr 172.21.15.170:0/4263805866 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564432166930 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x5644321663f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99ec076c60 tx=0x7f99ec090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f98dd7fa640 1 -- 172.21.15.170:0/4263805866 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec0bb070 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f98dd7fa640 1 -- 172.21.15.170:0/4263805866 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec080890 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564432166930 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f98dd7fa640 1 -- 172.21.15.170:0/4263805866 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec09b030 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.143+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564432166930 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.144+0000 7f98dd7fa640 1 -- 172.21.15.170:0/4263805866 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f99ec0be070 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.144+0000 7f98dd7fa640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98c4036950 0x7f98c4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.144+0000 7f98dd7fa640 1 -- 172.21.15.170:0/4263805866 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f99ec0a7070 con 0x56443215f280 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.144+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.144+0000 7f99faab6640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98c4036950 0x7f98c4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.144+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432171b40 0x564432174000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.144+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564432174750 con 0x564432171b40 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99fbab8640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432171b40 0x564432174000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99faab6640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98c4036950 0x7f98c4038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x564432144020 tx=0x7f99f0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99fbab8640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432171b40 0x564432174000 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 20 realm 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564432174b60 con 0x564432171b40 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:33.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564432175400 con 0x564432171b40 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.145+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.146+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.146+0000 7f99ff525800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.146+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.146+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564432176500 0x5644321788f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.146+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564432178e70 con 0x564432176500 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.146+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564432176500 0x5644321788f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.146+0000 7f99fb2b7640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564432176500 0x5644321788f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99ff525800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99ff525800 20 searching for the correct realm 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56443217aec0 0x56443217d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56443217da50 con 0x56443217aec0 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99faab6640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56443217aec0 0x56443217d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99faab6640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56443217aec0 0x56443217d380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99faab6640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f99f000f070 0x7f99f002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.147+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56443217da50 con 0x7f99f000f070 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.148+0000 7f99fbab8640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f99f000f070 0x7f99f002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.148+0000 7f99fbab8640 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f99f000f070 0x7f99f002e910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.148+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.148+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.148+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.148+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.149+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x7f99f000f070 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.150+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x7f99f000f070 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.151+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.152+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x7f99f000f070 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.153+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.154+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.154+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.154+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.154+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.154+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.154+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x7f99f000f070 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x56443217aec0 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432176500 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x564432171b40 2024-04-26T12:30:33.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.155+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644321757a0 con 0x7f99f000f070 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644321797c0 con 0x564432171b40 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644321797c0 con 0x564432171b40 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644321797c0 con 0x7f99f000f070 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 zone default found 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 4 Realm: () 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 zonegroup default 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.156+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564432179bb0 con 0x564432176500 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56443217f8b0 con 0x56443217aec0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56443217fc50 con 0x56443217aec0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 20 started sync module instance, tier type = 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.157+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56443217a3f0 con 0x7f99f000f070 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.158+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.158+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94850898192544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56443217f170 con 0x7f99f000f070 2024-04-26T12:30:33.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.158+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644321804a0 con 0x564432171b40 2024-04-26T12:30:33.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.159+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94850898192544] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.159+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.159+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94850898193872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644321804a0 con 0x564432171b40 2024-04-26T12:30:33.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.159+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432180e60 con 0x56443217aec0 2024-04-26T12:30:33.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.160+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94850898193872] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.161+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.161+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94850898198512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432180410 con 0x56443217aec0 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.161+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432181cd0 con 0x7f99f000f070 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.162+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94850898198512] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.162+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.162+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94850898204704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644321820f0 con 0x7f99f000f070 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.162+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432182ab0 con 0x564432171b40 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.163+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94850898204704] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.163+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.163+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94850898206240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432182ab0 con 0x564432171b40 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.163+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432183470 con 0x564432176500 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.164+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.164+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94850898210752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432183cc0 con 0x564432176500 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.164+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644321846c0 con 0x564432176500 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.164+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94850898206240] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.165+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94850898210752] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.165+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.165+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94850898208256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432184a60 con 0x564432176500 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.165+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644321852b0 con 0x564432176500 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94850898208256] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94850898217568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432185330 con 0x564432176500 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 20 add_watcher() i=0 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 20 add_watcher() i=1 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 20 add_watcher() i=2 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 20 add_watcher() i=3 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 20 add_watcher() i=4 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 20 add_watcher() i=5 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.166+0000 7f99ff525800 20 add_watcher() i=6 2024-04-26T12:30:33.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.167+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94850898217568] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.167+0000 7f99ff525800 20 add_watcher() i=7 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.167+0000 7f99ff525800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.167+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564432188690 con 0x564432171b40 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.167+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.167+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94850898231440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644321854a0 con 0x564432171b40 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.168+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94850898231440] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.168+0000 7f98b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 5 note: GC not initialized 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f98b0fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 20 Filter name: none 2024-04-26T12:30:33.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f982a7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644321bb940 con 0x564432171b40 2024-04-26T12:30:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.169+0000 7f99ff525800 20 rados_obj.operate() r=0 bl.length=673 2024-04-26T12:30:33.183 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:30:33.033367Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:33.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.170+0000 7f98b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.170+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94850898231440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644321bbe80 con 0x564432171b40 2024-04-26T12:30:33.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.171+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94850898231440] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.171+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94850898192544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432188090 con 0x7f99f000f070 2024-04-26T12:30:33.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.172+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94850898192544] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.172+0000 7f99ff525800 20 remove_watcher() i=0 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.172+0000 7f99ff525800 2 removed watcher, disabling cache 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.172+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94850898193872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56443217e8a0 con 0x564432171b40 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.173+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94850898193872] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.173+0000 7f99ff525800 20 remove_watcher() i=1 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.173+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94850898198512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56443217e8a0 con 0x56443217aec0 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.174+0000 7f99faab6640 1 -- 172.21.15.170:0/4263805866 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94850898198512] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f0037040 con 0x56443217aec0 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.174+0000 7f99ff525800 20 remove_watcher() i=2 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.174+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94850898204704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56443217fff0 con 0x7f99f000f070 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.175+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94850898204704] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x7f99f000f070 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.175+0000 7f99ff525800 20 remove_watcher() i=3 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.175+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94850898206240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56443217fff0 con 0x564432171b40 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.176+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94850898206240] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99f400a4a0 con 0x564432171b40 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.176+0000 7f99ff525800 20 remove_watcher() i=4 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.176+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94850898210752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432181e20 con 0x564432176500 2024-04-26T12:30:33.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.177+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94850898210752] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.177+0000 7f99ff525800 20 remove_watcher() i=5 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.177+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94850898208256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56443217fff0 con 0x564432176500 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.178+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94850898208256] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.178+0000 7f99ff525800 20 remove_watcher() i=6 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.178+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94850898217568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564432182fc0 con 0x564432176500 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99fb2b7640 1 -- 172.21.15.170:0/4263805866 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94850898217568] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99ec0bd030 con 0x564432176500 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 20 remove_watcher() i=7 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564432176500 msgr2=0x5644321788f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564432176500 0x5644321788f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432171b40 msgr2=0x564432174000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432171b40 0x564432174000 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f99f000f070 msgr2=0x7f99f002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f99f000f070 0x7f99f002e910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56443217aec0 msgr2=0x56443217d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56443217aec0 0x56443217d380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98c4036950 msgr2=0x7f98c4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98c4036950 0x7f98c4038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x564432144020 tx=0x7f99f0010000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 msgr2=0x5644321663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99fbab8640 1 -- 172.21.15.170:0/4263805866 reap_dead start 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x5644321663f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99ec076c60 tx=0x7f99ec090f00 comp rx=0 tx=0).stop 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 shutdown_connections 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 --2- 172.21.15.170:0/4263805866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56443215f280 0x5644321663f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 >> 172.21.15.170:0/4263805866 conn(0x56443215b550 msgr2=0x564432158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 shutdown_connections 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.179+0000 7f99ff525800 1 -- 172.21.15.170:0/4263805866 wait complete. 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98d4036900 msgr2=0x7f98d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98d4036900 0x7f98d4038dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x564431fad030 tx=0x7f99f000f000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564432152080 msgr2=0x5644321524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564432152080 0x5644321524a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f99ec055040 tx=0x7f99ec077df0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 shutdown_connections 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98d4036900 0x7f98d4038dc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/4155420388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564432152080 0x5644321524a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 >> 172.21.15.170:0/4155420388 conn(0x564432146120 msgr2=0x564432146520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 shutdown_connections 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/4155420388 wait complete. 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56443213cf70 msgr2=0x56443213f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56443213cf70 0x56443213f410 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432039730 msgr2=0x56443213a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564432039730 0x56443213a890 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564432141050 msgr2=0x5644321434c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564432141050 0x5644321434c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98e0036950 msgr2=0x7f98e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f98e0036950 0x7f98e0038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000f60 tx=0x7f99f0001370 comp rx=0 tx=0).stop 2024-04-26T12:30:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 msgr2=0x564431fae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 --2- 172.21.15.170:0/1105850172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5644320385c0 0x564431fae000 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99ec052540 tx=0x7f99ec003020 comp rx=0 tx=0).stop 2024-04-26T12:30:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99fbab8640 1 -- 172.21.15.170:0/1105850172 reap_dead start 2024-04-26T12:30:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 shutdown_connections 2024-04-26T12:30:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 >> 172.21.15.170:0/1105850172 conn(0x564432033b80 msgr2=0x5644321285b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 shutdown_connections 2024-04-26T12:30:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.180+0000 7f99ff525800 1 -- 172.21.15.170:0/1105850172 wait complete. 2024-04-26T12:30:33.194 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:30:33.033367Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:33.194 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-26T12:30:33.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-26T12:30:33.194 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-26T12:30:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:33.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc68a133800 1 Processor -- start 2024-04-26T12:30:33.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc68a133800 1 -- start start 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc68a133800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a1290fd410 0x55a1290fd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc68a133800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a128fab0c0 con 0x55a1290fe670 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc68a133800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55a128f8f4d0 con 0x55a1290fd410 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc685dd1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a1290fd410 0x55a1290fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc685dd1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a1290fd410 0x55a1290fd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41932/0 (socket says 172.21.15.170:41932) 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc6855d0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55a1290fe670 0x55a1290feaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46154/0 (socket says 172.21.15.170:46154) 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.278+0000 7fc685dd1640 1 -- 172.21.15.170:0/1093208223 learned_addr learned my addr 172.21.15.170:0/1093208223 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.279+0000 7fc685dd1640 1 -- 172.21.15.170:0/1093208223 >> v1:172.21.15.132:6789/0 conn(0x55a1290fe670 legacy=0x55a1290feaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.279+0000 7fc685dd1640 1 -- 172.21.15.170:0/1093208223 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128fbcd40 con 0x55a1290fd410 2024-04-26T12:30:33.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.280+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1093208223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1290fd830 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc67800a520 tx=0x7fc67801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfaa54bcd09fbf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc684dcf640 1 -- 172.21.15.170:0/1093208223 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678057070 con 0x55a1290fd410 2024-04-26T12:30:33.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc684dcf640 1 -- 172.21.15.170:0/1093208223 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc678052570 con 0x55a1290fd410 2024-04-26T12:30:33.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc684dcf640 1 -- 172.21.15.170:0/1093208223 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67804ae60 con 0x55a1290fd410 2024-04-26T12:30:33.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc68a133800 1 -- 172.21.15.170:0/1093208223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 msgr2=0x55a1290fd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc68a133800 1 --2- 172.21.15.170:0/1093208223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1290fd830 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc67800a520 tx=0x7fc67801d010 comp rx=0 tx=0).stop 2024-04-26T12:30:33.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc68a133800 1 -- 172.21.15.170:0/1093208223 shutdown_connections 2024-04-26T12:30:33.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc68a133800 1 --2- 172.21.15.170:0/1093208223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1290fd830 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc68a133800 1 -- 172.21.15.170:0/1093208223 >> 172.21.15.170:0/1093208223 conn(0x55a1290f89b0 msgr2=0x55a1290fadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc68a133800 1 -- 172.21.15.170:0/1093208223 shutdown_connections 2024-04-26T12:30:33.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.281+0000 7fc68a133800 1 -- 172.21.15.170:0/1093208223 wait complete. 2024-04-26T12:30:33.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc68a133800 1 Processor -- start 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc68a133800 1 -- start start 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc68a133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc68a133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a129049b70 con 0x55a1290fd410 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291ed9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41938/0 (socket says 172.21.15.170:41938) 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc685dd1640 1 -- 172.21.15.170:0/498420014 learned_addr learned my addr 172.21.15.170:0/498420014 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.293+0000 7fc685dd1640 1 -- 172.21.15.170:0/498420014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128fbb590 con 0x55a1290fd410 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc685dd1640 1 --2- 172.21.15.170:0/498420014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291ed9e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc678055040 tx=0x7fc67804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6edc903cea131d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc573e07640 1 -- 172.21.15.170:0/498420014 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678057040 con 0x55a1290fd410 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc573e07640 1 -- 172.21.15.170:0/498420014 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc678052720 con 0x55a1290fd410 2024-04-26T12:30:33.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc573e07640 1 -- 172.21.15.170:0/498420014 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678052a40 con 0x55a1290fd410 2024-04-26T12:30:33.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc68a133800 1 -- 172.21.15.170:0/498420014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 msgr2=0x55a1291ed9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc68a133800 1 --2- 172.21.15.170:0/498420014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291ed9e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc678055040 tx=0x7fc67804c000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc68a133800 1 -- 172.21.15.170:0/498420014 shutdown_connections 2024-04-26T12:30:33.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc68a133800 1 --2- 172.21.15.170:0/498420014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291ed9e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.294+0000 7fc68a133800 1 -- 172.21.15.170:0/498420014 >> 172.21.15.170:0/498420014 conn(0x55a1290f89b0 msgr2=0x55a1291e9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc68a133800 1 -- 172.21.15.170:0/498420014 shutdown_connections 2024-04-26T12:30:33.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc68a133800 1 -- 172.21.15.170:0/498420014 wait complete. 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc68a133800 1 Processor -- start 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc68a133800 1 -- start start 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc68a133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc68a133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a129071600 con 0x55a1290fd410 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41954/0 (socket says 172.21.15.170:41954) 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc685dd1640 1 -- 172.21.15.170:0/1526581174 learned_addr learned my addr 172.21.15.170:0/1526581174 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.295+0000 7fc685dd1640 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a128fb28f0 con 0x55a1290fd410 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.296+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291f5260 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc6780524f0 tx=0x7fc678003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.296+0000 7fc572604640 1 -- 172.21.15.170:0/1526581174 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678073070 con 0x55a1290fd410 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.296+0000 7fc572604640 1 -- 172.21.15.170:0/1526581174 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc678052c90 con 0x55a1290fd410 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.296+0000 7fc572604640 1 -- 172.21.15.170:0/1526581174 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678057070 con 0x55a1290fd410 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.296+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1291f57a0 con 0x55a1290fd410 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.296+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1291f5cc0 con 0x55a1290fd410 2024-04-26T12:30:33.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.296+0000 7fc572604640 1 -- 172.21.15.170:0/1526581174 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc678076070 con 0x55a1290fd410 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc572604640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc56c036950 0x7fc56c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc572604640 1 -- 172.21.15.170:0/1526581174 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc67808da70 con 0x55a1290fd410 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc56c036950 0x7fc56c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a1290fe670 0x55a1291fc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a1291fc7c0 con 0x55a1290fe670 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc6865d2640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a1290fe670 0x55a1291fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc56c036950 0x7fc56c038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc67c000f60 tx=0x7fc67c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.297+0000 7fc6865d2640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a1290fe670 0x55a1291fc280 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.298+0000 7fc6865d2640 1 -- 172.21.15.170:0/1526581174 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a1290fe670 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.298+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a1291f9850 con 0x55a1290fe670 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.298+0000 7fc6865d2640 1 -- 172.21.15.170:0/1526581174 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a1290fe670 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.298+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a1291feb10 0x55a129200f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.298+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a1292015f0 con 0x55a1291feb10 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.298+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a1291feb10 0x55a129200f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.298+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a1291feb10 0x55a129200f00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.299+0000 7fc685dd1640 1 -- 172.21.15.170:0/1526581174 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc678075030 con 0x55a1291feb10 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.299+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a1291fdac0 con 0x55a1290fe670 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.299+0000 7fc6865d2640 1 -- 172.21.15.170:0/1526581174 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a1290fe670 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.299+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a129202aa0 0x55a129204ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.299+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a129205650 con 0x55a129202aa0 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.299+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a129202aa0 0x55a129204ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.299+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a129202aa0 0x55a129204ef0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc6855d0640 1 -- 172.21.15.170:0/1526581174 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc67c00f690 con 0x55a129202aa0 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc68a133800 1 Processor -- start 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc68a133800 1 -- start start 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc68a133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129213ab0 0x55a129213ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc68a133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a128fefe60 con 0x55a129213ab0 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129213ab0 0x55a129213ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129213ab0 0x55a129213ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41958/0 (socket says 172.21.15.170:41958) 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc685dd1640 1 -- 172.21.15.170:0/1926220677 learned_addr learned my addr 172.21.15.170:0/1926220677 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.300+0000 7fc685dd1640 1 -- 172.21.15.170:0/1926220677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a129214410 con 0x55a129213ab0 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.301+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129213ab0 0x55a129213ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc678052a30 tx=0x7fc678008140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.301+0000 7fc56b7fe640 1 -- 172.21.15.170:0/1926220677 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678092070 con 0x55a129213ab0 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.301+0000 7fc56b7fe640 1 -- 172.21.15.170:0/1926220677 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc678089030 con 0x55a129213ab0 2024-04-26T12:30:33.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.301+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a129214e80 con 0x55a129213ab0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.301+0000 7fc56b7fe640 1 -- 172.21.15.170:0/1926220677 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678077650 con 0x55a129213ab0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.301+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a129215380 con 0x55a129213ab0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.301+0000 7fc56b7fe640 1 -- 172.21.15.170:0/1926220677 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc678095070 con 0x55a129213ab0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc56b7fe640 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc560036950 0x7fc560038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc56b7fe640 1 -- 172.21.15.170:0/1926220677 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc678098ca0 con 0x55a129213ab0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc560036950 0x7fc560038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc68a133800 1 Processor -- start 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc68a133800 1 -- start start 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc560036950 0x7fc560038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55a1291fd0c0 tx=0x7fc67c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc68a133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a129225380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc68a133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a1291ee0a0 con 0x55a129224f60 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a129225380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a129225380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41968/0 (socket says 172.21.15.170:41968) 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.302+0000 7fc685dd1640 1 -- 172.21.15.170:0/2139976192 learned_addr learned my addr 172.21.15.170:0/2139976192 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc685dd1640 1 -- 172.21.15.170:0/2139976192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a129225950 con 0x55a129224f60 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc685dd1640 1 --2- 172.21.15.170:0/2139976192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a129225380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc6780529e0 tx=0x7fc678079b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bf41f8fe0f39c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc5697fa640 1 -- 172.21.15.170:0/2139976192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678076d70 con 0x55a129224f60 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc5697fa640 1 -- 172.21.15.170:0/2139976192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67805d620 con 0x55a129224f60 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc5697fa640 1 -- 172.21.15.170:0/2139976192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678071120 con 0x55a129224f60 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc68a133800 1 -- 172.21.15.170:0/2139976192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 msgr2=0x55a129225380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc68a133800 1 --2- 172.21.15.170:0/2139976192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a129225380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc6780529e0 tx=0x7fc678079b40 comp rx=0 tx=0).stop 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc68a133800 1 -- 172.21.15.170:0/2139976192 shutdown_connections 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc68a133800 1 --2- 172.21.15.170:0/2139976192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a129225380 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc68a133800 1 -- 172.21.15.170:0/2139976192 >> 172.21.15.170:0/2139976192 conn(0x55a12921ce60 msgr2=0x55a12921aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc68a133800 1 -- 172.21.15.170:0/2139976192 shutdown_connections 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.303+0000 7fc68a133800 1 -- 172.21.15.170:0/2139976192 wait complete. 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.304+0000 7fc68a133800 1 Processor -- start 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.304+0000 7fc68a133800 1 -- start start 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.304+0000 7fc68a133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a12922c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.304+0000 7fc68a133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a129225fe0 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.304+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a12922c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.304+0000 7fc685dd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a12922c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41972/0 (socket says 172.21.15.170:41972) 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.304+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 learned_addr learned my addr 172.21.15.170:0/1032751733 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.305+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12922c830 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.305+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a12922c2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc678007d00 tx=0x7fc6780681b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.305+0000 7fc5577fe640 1 -- 172.21.15.170:0/1032751733 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc678076e40 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.305+0000 7fc5577fe640 1 -- 172.21.15.170:0/1032751733 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67808a280 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.305+0000 7fc5577fe640 1 -- 172.21.15.170:0/1032751733 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67808a580 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.305+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a12922c830 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.305+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12922c830 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc5577fe640 1 -- 172.21.15.170:0/1032751733 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc67808a720 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc5577fe640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc550036950 0x7fc550038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc5577fe640 1 -- 172.21.15.170:0/1032751733 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc6780a2070 con 0x55a129224f60 2024-04-26T12:30:33.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc550036950 0x7fc550038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc550036950 0x7fc550038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55a129205a50 tx=0x7fc67c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a129237a90 0x55a129239f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923a6a0 con 0x55a129237a90 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.306+0000 7fc6865d2640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a129237a90 0x55a129239f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc6865d2640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a129237a90 0x55a129239f50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 20 realm 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923aab0 con 0x55a129237a90 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:33.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b380 con 0x55a129237a90 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.307+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a12923c480 0x55a12923e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923ee80 con 0x55a12923c480 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a12923c480 0x55a12923e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc685dd1640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a12923c480 0x55a12923e870 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 20 searching for the correct realm 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a129240e10 0x55a1292432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.308+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a1292439a0 con 0x55a129240e10 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.309+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a129240e10 0x55a1292432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.309+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a129240e10 0x55a1292432d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.309+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.309+0000 7fc6855d0640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc67c00f070 0x7fc67c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.309+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a1292439a0 con 0x7fc67c00f070 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.309+0000 7fc6865d2640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc67c00f070 0x7fc67c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.310+0000 7fc6865d2640 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc67c00f070 0x7fc67c02e910 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.310+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.310+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.310+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.310+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.311+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x7fc67c00f070 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.312+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x7fc67c00f070 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.313+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.314+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x7fc67c00f070 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.315+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.316+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.316+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.316+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.316+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.316+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.316+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.316+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x7fc67c00f070 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129240e10 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a12923c480 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x55a129237a90 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.317+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a12923b720 con 0x7fc67c00f070 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:33.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923f740 con 0x55a129237a90 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923f740 con 0x55a129237a90 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923f740 con 0x7fc67c00f070 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.318+0000 7fc68a133800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 20 zone default found 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 4 Realm: () 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 20 zonegroup default 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12923ffe0 con 0x55a12923c480 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a129245800 con 0x55a129240e10 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.319+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a129245ba0 con 0x55a129240e10 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.320+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.320+0000 7fc68a133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.320+0000 7fc68a133800 20 started sync module instance, tier type = 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.320+0000 7fc68a133800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.320+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129244ca0 con 0x7fc67c00f070 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.321+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.321+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94150668341440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129244ca0 con 0x7fc67c00f070 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.321+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129246560 con 0x55a129237a90 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.322+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94150668341440] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.322+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.322+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94150668339664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129246560 con 0x55a129237a90 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.322+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129246f20 con 0x55a129240e10 2024-04-26T12:30:33.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.323+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94150668339664] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.323+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.323+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94150668345520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a1292464d0 con 0x55a129240e10 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.323+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129247de0 con 0x7fc67c00f070 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.324+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94150668345520] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.325+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.325+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94150668351792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129248200 con 0x7fc67c00f070 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.325+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129248bc0 con 0x55a129237a90 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.326+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94150668351792] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.326+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.326+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94150668353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129248bc0 con 0x55a129237a90 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.326+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129249580 con 0x55a12923c480 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.327+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.327+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94150668357840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129249e20 con 0x55a12923c480 2024-04-26T12:30:33.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.327+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94150668353328] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.327+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a12924a880 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.328+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94150668357840] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.329+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.330+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94150668355344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a12924ac20 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.330+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a12924b470 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.330+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94150668355344] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94150668365760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a12924b890 con 0x55a12923c480 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=0 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=1 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=2 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=3 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=4 2024-04-26T12:30:33.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=5 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=6 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94150668365760] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 20 add_watcher() i=7 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.331+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a12924ed10 con 0x55a129237a90 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.332+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.332+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94150668379776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a12924ba90 con 0x55a129237a90 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94150668379776] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc5377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 5 note: GC not initialized 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc5367fc640 20 reqs_thread_entry: start 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:33.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 20 Filter name: none 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc4a7fff640 20 reqs_thread_entry: start 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.333+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a129282280 con 0x55a129237a90 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.334+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.334+0000 7fc68a133800 20 rados_obj.operate() r=0 bl.length=673 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.334+0000 7fc68a133800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.334+0000 7fc68a133800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.334+0000 7fc68a133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.334+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129288e70 con 0x55a129237a90 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc68a133800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc68a133800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc68a133800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:33.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94150668617952 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a1292845c0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94150668353328 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7fc680018cc0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc5697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94150668353328 notifier 4411 bl.length()=758 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc5697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc5697fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(64 notify.4 [notify cookie 94150668617952 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc5697fa640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc548003ea0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.335+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.336+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94150668617952 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc68003d4a0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.336+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a1292888e0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.336+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.336+0000 7fc68a133800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.336+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94150668617952 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a129284110 con 0x7fc67c00f070 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.337+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== watch-notify(notify (1) cookie 94150668341440 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fc68003d4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.337+0000 7fc5697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94150668341440 notifier 4411 bl.length()=159 2024-04-26T12:30:33.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.337+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [notify cookie 94150668617952 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.337+0000 7fc5697fa640 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc548003ea0 con 0x7fc67c00f070 2024-04-26T12:30:33.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.337+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.337+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== watch-notify(notify_complete (2) cookie 94150668617952 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc68003d740 con 0x7fc67c00f070 2024-04-26T12:30:33.347 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:30:33.033367Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.338+0000 7fc5377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.338+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94150668379776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129280800 con 0x55a129237a90 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.339+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94150668379776] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.339+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94150668341440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a12924e680 con 0x7fc67c00f070 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.340+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94150668341440] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.340+0000 7fc68a133800 20 remove_watcher() i=0 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.340+0000 7fc68a133800 2 removed watcher, disabling cache 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.340+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94150668339664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a12924e680 con 0x55a129237a90 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.341+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94150668339664] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.341+0000 7fc68a133800 20 remove_watcher() i=1 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.341+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94150668345520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129284d80 con 0x55a129240e10 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.342+0000 7fc6855d0640 1 -- 172.21.15.170:0/1032751733 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94150668345520] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c037040 con 0x55a129240e10 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.342+0000 7fc68a133800 20 remove_watcher() i=2 2024-04-26T12:30:33.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.342+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94150668351792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a1292460b0 con 0x7fc67c00f070 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.343+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94150668351792] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x7fc67c00f070 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.343+0000 7fc68a133800 20 remove_watcher() i=3 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.343+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94150668353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129247930 con 0x55a129237a90 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.344+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94150668353328] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc68000a4a0 con 0x55a129237a90 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.344+0000 7fc68a133800 20 remove_watcher() i=4 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.344+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94150668357840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a1292460b0 con 0x55a12923c480 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.345+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94150668357840] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.345+0000 7fc68a133800 20 remove_watcher() i=5 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.345+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94150668355344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129247f30 con 0x55a12923c480 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.346+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94150668355344] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.346+0000 7fc68a133800 20 remove_watcher() i=6 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.346+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94150668365760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a129247930 con 0x55a12923c480 2024-04-26T12:30:33.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc685dd1640 1 -- 172.21.15.170:0/1032751733 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94150668365760] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6780bf020 con 0x55a12923c480 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 20 remove_watcher() i=7 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a12923c480 msgr2=0x55a12923e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a12923c480 0x55a12923e870 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a129237a90 msgr2=0x55a129239f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a129237a90 0x55a129239f50 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc67c00f070 msgr2=0x7fc67c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc67c00f070 0x7fc67c02e910 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a129240e10 msgr2=0x55a1292432d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a129240e10 0x55a1292432d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc550036950 msgr2=0x7fc550038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc550036950 0x7fc550038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55a129205a50 tx=0x7fc67c010000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 msgr2=0x55a12922c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 --2- 172.21.15.170:0/1032751733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129224f60 0x55a12922c2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc678007d00 tx=0x7fc6780681b0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 reap_dead start 2024-04-26T12:30:33.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc6865d2640 1 -- 172.21.15.170:0/1032751733 reap_dead start 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 shutdown_connections 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 >> 172.21.15.170:0/1032751733 conn(0x55a12921ce60 msgr2=0x55a12921a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 shutdown_connections 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1032751733 wait complete. 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc560036950 msgr2=0x7fc560038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc560036950 0x7fc560038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55a1291fd0c0 tx=0x7fc67c00f000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.347+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129213ab0 msgr2=0x55a129213ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129213ab0 0x55a129213ed0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc678052a30 tx=0x7fc678008140 comp rx=0 tx=0).stop 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 shutdown_connections 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc560036950 0x7fc560038e10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1926220677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a129213ab0 0x55a129213ed0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 >> 172.21.15.170:0/1926220677 conn(0x55a129207b50 msgr2=0x55a129207f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 shutdown_connections 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1926220677 wait complete. 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a1291feb10 msgr2=0x55a129200f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a1291feb10 0x55a129200f00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a1290fe670 msgr2=0x55a1291fc280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a1290fe670 0x55a1291fc280 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a129202aa0 msgr2=0x55a129204ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a129202aa0 0x55a129204ef0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc56c036950 msgr2=0x7fc56c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc56c036950 0x7fc56c038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc67c000f60 tx=0x7fc67c001370 comp rx=0 tx=0).stop 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 msgr2=0x55a1291f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 --2- 172.21.15.170:0/1526581174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a1290fd410 0x55a1291f5260 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc6780524f0 tx=0x7fc678003020 comp rx=0 tx=0).stop 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc6865d2640 1 -- 172.21.15.170:0/1526581174 reap_dead start 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 shutdown_connections 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 >> 172.21.15.170:0/1526581174 conn(0x55a1290f89b0 msgr2=0x55a1291ec3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 shutdown_connections 2024-04-26T12:30:33.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.348+0000 7fc68a133800 1 -- 172.21.15.170:0/1526581174 wait complete. 2024-04-26T12:30:33.358 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:30:33.033367Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:33.358 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-26T12:30:33.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-26T12:30:33.359 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-26T12:30:33.401 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:33.401 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c42edf800 1 Processor -- start 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c42edf800 1 -- start start 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c42edf800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d842f49970 0x55d842f52470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c42edf800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d842df60c0 con 0x55d842f47e30 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c42edf800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55d842dda4d0 con 0x55d842f49970 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c401e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d842f49970 0x55d842f52470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c401e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d842f49970 0x55d842f52470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41988/0 (socket says 172.21.15.170:41988) 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c409e5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55d842f47e30 0x55d842f48250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46162/0 (socket says 172.21.15.170:46162) 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.401+0000 7f5c401e4640 1 -- 172.21.15.170:0/2094274735 learned_addr learned my addr 172.21.15.170:0/2094274735 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.402+0000 7f5c401e4640 1 -- 172.21.15.170:0/2094274735 >> v1:172.21.15.132:6789/0 conn(0x55d842f47e30 legacy=0x55d842f48250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.402+0000 7f5c3f9e3640 1 -- 172.21.15.170:0/2094274735 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229318277 0 0) 0x55d842df60c0 con 0x55d842f47e30 2024-04-26T12:30:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.402+0000 7f5c401e4640 1 -- 172.21.15.170:0/2094274735 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d842e07d40 con 0x55d842f49970 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c401e4640 1 --2- 172.21.15.170:0/2094274735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f49970 0x55d842f52470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800a520 tx=0x7f5c2801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304e1f3e7092b86a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c3f9e3640 1 -- 172.21.15.170:0/2094274735 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c28057070 con 0x55d842f49970 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c3f9e3640 1 -- 172.21.15.170:0/2094274735 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c28052440 con 0x55d842f49970 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c3f9e3640 1 -- 172.21.15.170:0/2094274735 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c2804ae60 con 0x55d842f49970 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c42edf800 1 -- 172.21.15.170:0/2094274735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f49970 msgr2=0x55d842f52470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c42edf800 1 --2- 172.21.15.170:0/2094274735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f49970 0x55d842f52470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800a520 tx=0x7f5c2801d010 comp rx=0 tx=0).stop 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c42edf800 1 -- 172.21.15.170:0/2094274735 shutdown_connections 2024-04-26T12:30:33.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c42edf800 1 --2- 172.21.15.170:0/2094274735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f49970 0x55d842f52470 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c42edf800 1 -- 172.21.15.170:0/2094274735 >> 172.21.15.170:0/2094274735 conn(0x55d842f43990 msgr2=0x55d842f45db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c42edf800 1 -- 172.21.15.170:0/2094274735 shutdown_connections 2024-04-26T12:30:33.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.404+0000 7f5c42edf800 1 -- 172.21.15.170:0/2094274735 wait complete. 2024-04-26T12:30:33.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.416+0000 7f5c42edf800 1 Processor -- start 2024-04-26T12:30:33.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.416+0000 7f5c42edf800 1 -- start start 2024-04-26T12:30:33.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.416+0000 7f5c42edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d84303c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.416+0000 7f5c42edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d842e94b40 con 0x55d842f47e30 2024-04-26T12:30:33.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.416+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d84303c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.416+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d84303c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:41992/0 (socket says 172.21.15.170:41992) 2024-04-26T12:30:33.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.416+0000 7f5c409e5640 1 -- 172.21.15.170:0/1332256778 learned_addr learned my addr 172.21.15.170:0/1332256778 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.417+0000 7f5c409e5640 1 -- 172.21.15.170:0/1332256778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d842e06590 con 0x55d842f47e30 2024-04-26T12:30:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.417+0000 7f5c409e5640 1 --2- 172.21.15.170:0/1332256778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d84303c8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800b210 tx=0x7f5c3800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d773659e546137b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.417+0000 7f5b2ee0d640 1 -- 172.21.15.170:0/1332256778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38008070 con 0x55d842f47e30 2024-04-26T12:30:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.417+0000 7f5b2ee0d640 1 -- 172.21.15.170:0/1332256778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3800d500 con 0x55d842f47e30 2024-04-26T12:30:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.417+0000 7f5b2ee0d640 1 -- 172.21.15.170:0/1332256778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c3800d840 con 0x55d842f47e30 2024-04-26T12:30:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 -- 172.21.15.170:0/1332256778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 msgr2=0x55d84303c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1332256778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d84303c8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800b210 tx=0x7f5c3800b6d0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 -- 172.21.15.170:0/1332256778 shutdown_connections 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1332256778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d84303c8c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 -- 172.21.15.170:0/1332256778 >> 172.21.15.170:0/1332256778 conn(0x55d842f43990 msgr2=0x55d8430381e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 -- 172.21.15.170:0/1332256778 shutdown_connections 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 -- 172.21.15.170:0/1332256778 wait complete. 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 Processor -- start 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 -- start start 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d8430442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c42edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d842f54c90 con 0x55d842f47e30 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.418+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d8430442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d8430442d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42002/0 (socket says 172.21.15.170:42002) 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5c409e5640 1 -- 172.21.15.170:0/497360509 learned_addr learned my addr 172.21.15.170:0/497360509 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5c409e5640 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d842dfd8f0 con 0x55d842f47e30 2024-04-26T12:30:33.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5c409e5640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d8430442d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5c38001e60 tx=0x7f5c38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5b2d60a640 1 -- 172.21.15.170:0/497360509 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38019870 con 0x55d842f47e30 2024-04-26T12:30:33.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5b2d60a640 1 -- 172.21.15.170:0/497360509 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c38019a10 con 0x55d842f47e30 2024-04-26T12:30:33.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d843044810 con 0x55d842f47e30 2024-04-26T12:30:33.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5b2d60a640 1 -- 172.21.15.170:0/497360509 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38019cf0 con 0x55d842f47e30 2024-04-26T12:30:33.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.419+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d843044d30 con 0x55d842f47e30 2024-04-26T12:30:33.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.420+0000 7f5b2d60a640 1 -- 172.21.15.170:0/497360509 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5c38017040 con 0x55d842f47e30 2024-04-26T12:30:33.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.420+0000 7f5b2d60a640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b28036950 0x7f5b28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.420+0000 7f5b2d60a640 1 -- 172.21.15.170:0/497360509 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5c38015020 con 0x55d842f47e30 2024-04-26T12:30:33.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.420+0000 7f5c401e4640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b28036950 0x7f5b28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.420+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d842f49970 0x55d84304b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.420+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d84304b8c0 con 0x55d842f49970 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.420+0000 7f5c411e6640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d842f49970 0x55d84304b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c401e4640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b28036950 0x7f5b28038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5c28054000 tx=0x7f5c2804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c411e6640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d842f49970 0x55d84304b340 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c411e6640 1 -- 172.21.15.170:0/497360509 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d842f49970 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843048910 con 0x55d842f49970 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c411e6640 1 -- 172.21.15.170:0/497360509 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d842f49970 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d84304dbf0 0x55d84304ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8430506d0 con 0x55d84304dbf0 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.421+0000 7f5c409e5640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d84304dbf0 0x55d84304ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.422+0000 7f5c409e5640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d84304dbf0 0x55d84304ffe0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.422+0000 7f5c409e5640 1 -- 172.21.15.170:0/497360509 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5c3802d070 con 0x55d84304dbf0 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.422+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d84304cba0 con 0x55d842f49970 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.422+0000 7f5c411e6640 1 -- 172.21.15.170:0/497360509 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d842f49970 2024-04-26T12:30:33.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.422+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d843051b80 0x55d843053fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.422+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843054730 con 0x55d843051b80 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.422+0000 7f5c401e4640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d843051b80 0x55d843053fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.423+0000 7f5c401e4640 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d843051b80 0x55d843053fd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.423+0000 7f5c401e4640 1 -- 172.21.15.170:0/497360509 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5c2805a040 con 0x55d843051b80 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.423+0000 7f5c42edf800 1 Processor -- start 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.423+0000 7f5c42edf800 1 -- start start 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.423+0000 7f5c42edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d843062b90 0x55d843062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.423+0000 7f5c42edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d842e3ae60 con 0x55d843062b90 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d843062b90 0x55d843062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d843062b90 0x55d843062fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42006/0 (socket says 172.21.15.170:42006) 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5c409e5640 1 -- 172.21.15.170:0/1872614586 learned_addr learned my addr 172.21.15.170:0/1872614586 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5c409e5640 1 -- 172.21.15.170:0/1872614586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8430634f0 con 0x55d843062b90 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5c409e5640 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d843062b90 0x55d843062fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5c3804b370 tx=0x7f5c3801aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5b267fc640 1 -- 172.21.15.170:0/1872614586 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c3801c900 con 0x55d843062b90 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5b267fc640 1 -- 172.21.15.170:0/1872614586 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c380449d0 con 0x55d843062b90 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d843063f60 con 0x55d843062b90 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5b267fc640 1 -- 172.21.15.170:0/1872614586 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38044cb0 con 0x55d843062b90 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.424+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d843064460 con 0x55d843062b90 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.425+0000 7f5b267fc640 1 -- 172.21.15.170:0/1872614586 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5c3803f1b0 con 0x55d843062b90 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.425+0000 7f5b267fc640 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b18036900 0x7f5b18038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.425+0000 7f5b267fc640 1 -- 172.21.15.170:0/1872614586 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5c3803cc50 con 0x55d843062b90 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.425+0000 7f5c401e4640 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b18036900 0x7f5b18038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.425+0000 7f5c42edf800 1 Processor -- start 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.425+0000 7f5c42edf800 1 -- start start 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.425+0000 7f5c401e4640 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b18036900 0x7f5b18038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d84304c1a0 tx=0x7f5c28005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5c42edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5c42edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d84303d040 con 0x55d84306ff40 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42014/0 (socket says 172.21.15.170:42014) 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5c409e5640 1 -- 172.21.15.170:0/574599901 learned_addr learned my addr 172.21.15.170:0/574599901 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5c409e5640 1 -- 172.21.15.170:0/574599901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d843070930 con 0x55d84306ff40 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5c409e5640 1 --2- 172.21.15.170:0/574599901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843070360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5c3803cfd0 tx=0x7f5c38020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1926cbe79f8f0484 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.426+0000 7f5b17fff640 1 -- 172.21.15.170:0/574599901 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38026430 con 0x55d84306ff40 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5b17fff640 1 -- 172.21.15.170:0/574599901 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3800fcd0 con 0x55d84306ff40 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5b17fff640 1 -- 172.21.15.170:0/574599901 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38040d70 con 0x55d84306ff40 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 -- 172.21.15.170:0/574599901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 msgr2=0x55d843070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 --2- 172.21.15.170:0/574599901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843070360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5c3803cfd0 tx=0x7f5c38020000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 -- 172.21.15.170:0/574599901 shutdown_connections 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 --2- 172.21.15.170:0/574599901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843070360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 -- 172.21.15.170:0/574599901 >> 172.21.15.170:0/574599901 conn(0x55d84306c210 msgr2=0x55d84306a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 -- 172.21.15.170:0/574599901 shutdown_connections 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 -- 172.21.15.170:0/574599901 wait complete. 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 Processor -- start 2024-04-26T12:30:33.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 -- start start 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843077290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.427+0000 7f5c42edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d843070f90 con 0x55d84306ff40 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843077290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5c409e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843077290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42016/0 (socket says 172.21.15.170:42016) 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 learned_addr learned my addr 172.21.15.170:0/1171245231 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8430777d0 con 0x55d84306ff40 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5c409e5640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843077290 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800c440 tx=0x7f5c3800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5b167fc640 1 -- 172.21.15.170:0/1171245231 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38044e50 con 0x55d84306ff40 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5b167fc640 1 -- 172.21.15.170:0/1171245231 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3803f4a0 con 0x55d84306ff40 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5b167fc640 1 -- 172.21.15.170:0/1171245231 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38040850 con 0x55d84306ff40 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8430777d0 con 0x55d84306ff40 2024-04-26T12:30:33.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.428+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8430777d0 con 0x55d84306ff40 2024-04-26T12:30:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.429+0000 7f5b167fc640 1 -- 172.21.15.170:0/1171245231 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5c38052030 con 0x55d84306ff40 2024-04-26T12:30:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.429+0000 7f5b167fc640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b0c036950 0x7f5b0c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.429+0000 7f5b167fc640 1 -- 172.21.15.170:0/1171245231 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5c38037210 con 0x55d84306ff40 2024-04-26T12:30:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.429+0000 7f5c401e4640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b0c036950 0x7f5b0c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c401e4640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b0c036950 0x7f5b0c038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55d843054b30 tx=0x7f5c2804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d843082880 0x55d843084d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843085490 con 0x55d843082880 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c411e6640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d843082880 0x55d843084d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c411e6640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d843082880 0x55d843084d40 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 20 realm 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8430858a0 con 0x55d843082880 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.430+0000 7f5c42edf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843086170 con 0x55d843082880 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d843087270 0x55d843089660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843089c70 con 0x55d843087270 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.431+0000 7f5c409e5640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d843087270 0x55d843089660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c409e5640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d843087270 0x55d843089660 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c42edf800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c42edf800 20 searching for the correct realm 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d84308bc20 0x55d84308e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d84308e7b0 con 0x55d84308bc20 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c401e4640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d84308bc20 0x55d84308e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.432+0000 7f5c401e4640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d84308bc20 0x55d84308e0e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.433+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.433+0000 7f5c401e4640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5c28082040 0x7f5c28083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.433+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d84308e7b0 con 0x7f5c28082040 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.433+0000 7f5c411e6640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5c28082040 0x7f5c28083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.433+0000 7f5c411e6640 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5c28082040 0x7f5c28083430 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.433+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.433+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.434+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x7f5c28082040 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.435+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.436+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.436+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.436+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.436+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x7f5c28082040 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.436+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.436+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.437+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.438+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.439+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.439+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x7f5c28082040 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.439+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.439+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.439+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.439+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x7f5c28082040 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.440+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d84308bc20 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843087270 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x55d843082880 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d843086510 con 0x7f5c28082040 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d84308a530 con 0x55d843082880 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.441+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d84308a530 con 0x55d843082880 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d84308a530 con 0x7f5c28082040 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 zone default found 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 4 Realm: () 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 zonegroup default 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d84308add0 con 0x55d843087270 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.442+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843090610 con 0x55d84308bc20 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c42edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8430909b0 con 0x55d84308bc20 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c42edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c42edf800 20 started sync module instance, tier type = 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c42edf800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.443+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d84308fab0 con 0x7f5c28082040 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.444+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.444+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94387325959888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d84308fab0 con 0x7f5c28082040 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.444+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843091240 con 0x55d843082880 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.445+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94387325959888] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.445+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.445+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94387325963600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d84308fab0 con 0x55d843082880 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.445+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843091d10 con 0x55d84308bc20 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.446+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.446+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94387325966336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430925b0 con 0x55d84308bc20 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.446+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843093050 con 0x7f5c28082040 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.446+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94387325963600] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.447+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94387325966336] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.447+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.447+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94387325968640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d84308f600 con 0x7f5c28082040 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.447+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430938f0 con 0x55d843082880 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.448+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.448+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94387325973440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843093d20 con 0x55d843082880 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.448+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843094820 con 0x55d843087270 2024-04-26T12:30:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.448+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94387325968640] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.449+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.449+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94387325977360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843094c10 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.449+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430955d0 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.449+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94387325973440] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.450+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94387325977360] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.450+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.450+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94387325980960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430959c0 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.450+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843096210 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94387325980960] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94387325984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843096630 con 0x55d843087270 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 20 add_watcher() i=0 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 20 add_watcher() i=1 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 20 add_watcher() i=2 2024-04-26T12:30:33.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 20 add_watcher() i=3 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 20 add_watcher() i=4 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 20 add_watcher() i=5 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.451+0000 7f5c42edf800 20 add_watcher() i=6 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.452+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94387325984096] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.452+0000 7f5c42edf800 20 add_watcher() i=7 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.452+0000 7f5c42edf800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.452+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d843099930 con 0x55d843082880 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.452+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.453+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94387325985520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843096bc0 con 0x55d843082880 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.453+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94387325985520] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5af6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:33.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 5 note: GC not initialized 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5af5fe3640 20 reqs_thread_entry: start 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 20 Filter name: none 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5a677fe640 20 reqs_thread_entry: start 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.454+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8430cd090 con 0x55d843082880 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.455+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.455+0000 7f5c42edf800 20 rados_obj.operate() r=0 bl.length=582 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.455+0000 7f5c42edf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.455+0000 7f5c42edf800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.455+0000 7f5c42edf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.455+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430d36f0 con 0x55d843082880 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c42edf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c42edf800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c42edf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94387326234976 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d8430cf090 con 0x55d843082880 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94387325973440 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f5c30026780 con 0x55d843082880 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(64 notify.4 [notify cookie 94387326234976 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5b17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94387325973440 notifier 4418 bl.length()=732 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5b17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5b17fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5b17fff640 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5b04003ea0 con 0x55d843082880 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.456+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94387326234976 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5c30018ce0 con 0x55d843082880 2024-04-26T12:30:33.469 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-26T12:30:33.033367Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.457+0000 7f5af6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.457+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94387325985520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430cb610 con 0x55d843082880 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.458+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94387325985520] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.458+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94387325959888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430962f0 con 0x7f5c28082040 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.459+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94387325959888] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.459+0000 7f5c42edf800 20 remove_watcher() i=0 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.459+0000 7f5c42edf800 2 removed watcher, disabling cache 2024-04-26T12:30:33.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.459+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94387325963600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430962f0 con 0x55d843082880 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.460+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94387325963600] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.460+0000 7f5c42edf800 20 remove_watcher() i=1 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.460+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94387325966336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430962f0 con 0x55d84308bc20 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.461+0000 7f5c401e4640 1 -- 172.21.15.170:0/1171245231 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94387325966336] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c2807f070 con 0x55d84308bc20 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.462+0000 7f5c42edf800 20 remove_watcher() i=2 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.462+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94387325968640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843091800 con 0x7f5c28082040 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.462+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94387325968640] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x7f5c28082040 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.462+0000 7f5c42edf800 20 remove_watcher() i=3 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.462+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94387325973440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843092100 con 0x55d843082880 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.463+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94387325973440] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3000a4a0 con 0x55d843082880 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.463+0000 7f5c42edf800 20 remove_watcher() i=4 2024-04-26T12:30:33.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.463+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94387325977360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843091800 con 0x55d843087270 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.464+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94387325977360] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.464+0000 7f5c42edf800 20 remove_watcher() i=5 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.464+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94387325980960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d8430933c0 con 0x55d843087270 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.465+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94387325980960] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.465+0000 7f5c42edf800 20 remove_watcher() i=6 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.465+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94387325984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d843092100 con 0x55d843087270 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c409e5640 1 -- 172.21.15.170:0/1171245231 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94387325984096] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3806b070 con 0x55d843087270 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 20 remove_watcher() i=7 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d843087270 msgr2=0x55d843089660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d843087270 0x55d843089660 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d843082880 msgr2=0x55d843084d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d843082880 0x55d843084d40 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5c28082040 msgr2=0x7f5c28083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5c28082040 0x7f5c28083430 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d84308bc20 msgr2=0x55d84308e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d84308bc20 0x55d84308e0e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b0c036950 msgr2=0x7f5b0c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b0c036950 0x7f5b0c038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55d843054b30 tx=0x7f5c2804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 msgr2=0x55d843077290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c411e6640 1 -- 172.21.15.170:0/1171245231 reap_dead start 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.466+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843077290 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800c440 tx=0x7f5c3800fec0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 shutdown_connections 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1171245231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d84306ff40 0x55d843077290 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 >> 172.21.15.170:0/1171245231 conn(0x55d84306c210 msgr2=0x55d843069870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 shutdown_connections 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1171245231 wait complete. 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b18036900 msgr2=0x7f5b18038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b18036900 0x7f5b18038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d84304c1a0 tx=0x7f5c28005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d843062b90 msgr2=0x55d843062fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d843062b90 0x55d843062fb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5c3804b370 tx=0x7f5c3801aa10 comp rx=0 tx=0).stop 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 shutdown_connections 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b18036900 0x7f5b18038dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/1872614586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d843062b90 0x55d843062fb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 >> 172.21.15.170:0/1872614586 conn(0x55d843056c30 msgr2=0x55d843057030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 shutdown_connections 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/1872614586 wait complete. 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d84304dbf0 msgr2=0x55d84304ffe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d84304dbf0 0x55d84304ffe0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d842f49970 msgr2=0x55d84304b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d842f49970 0x55d84304b340 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d843051b80 msgr2=0x55d843053fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d843051b80 0x55d843053fd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b28036950 msgr2=0x7f5b28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5b28036950 0x7f5b28038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5c28054000 tx=0x7f5c2804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 msgr2=0x55d8430442d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 --2- 172.21.15.170:0/497360509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d842f47e30 0x55d8430442d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5c38001e60 tx=0x7f5c38000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c411e6640 1 -- 172.21.15.170:0/497360509 reap_dead start 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 shutdown_connections 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.467+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 >> 172.21.15.170:0/497360509 conn(0x55d842f43990 msgr2=0x55d84303b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.468+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 shutdown_connections 2024-04-26T12:30:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.468+0000 7f5c42edf800 1 -- 172.21.15.170:0/497360509 wait complete. 2024-04-26T12:30:33.481 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-26T12:30:33.033367Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:33.481 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-26T12:30:33.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-26T12:30:33.482 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-26T12:30:33.567 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:33.568 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.567+0000 7fb520c1f800 1 Processor -- start 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.567+0000 7fb520c1f800 1 -- start start 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.567+0000 7fb520c1f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d4e28c8890 0x55d4e28cac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.568+0000 7fb520c1f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d4e27720c0 con 0x55d4e28c4400 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.568+0000 7fb520c1f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55d4e27564d0 con 0x55d4e28c8890 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.568+0000 7fb51df24640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d4e28c8890 0x55d4e28cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.568+0000 7fb51e725640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55d4e28c4400 0x55d4e28c4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46170/0 (socket says 172.21.15.170:46170) 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.568+0000 7fb51e725640 1 -- 172.21.15.170:0/2406524780 learned_addr learned my addr 172.21.15.170:0/2406524780 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.568+0000 7fb51df24640 1 -- 172.21.15.170:0/2406524780 >> v1:172.21.15.132:6789/0 conn(0x55d4e28c4400 legacy=0x55d4e28c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.568+0000 7fb51df24640 1 -- 172.21.15.170:0/2406524780 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e2783d40 con 0x55d4e28c8890 2024-04-26T12:30:33.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.570+0000 7fb51df24640 1 --2- 172.21.15.170:0/2406524780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c8890 0x55d4e28cac80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb51400a470 tx=0x7fb51401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d03760e8890520 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.570+0000 7fb51d723640 1 -- 172.21.15.170:0/2406524780 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb514057070 con 0x55d4e28c8890 2024-04-26T12:30:33.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.570+0000 7fb51d723640 1 -- 172.21.15.170:0/2406524780 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb514052570 con 0x55d4e28c8890 2024-04-26T12:30:33.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.570+0000 7fb51d723640 1 -- 172.21.15.170:0/2406524780 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb514052870 con 0x55d4e28c8890 2024-04-26T12:30:33.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.570+0000 7fb520c1f800 1 -- 172.21.15.170:0/2406524780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c8890 msgr2=0x55d4e28cac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.571+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2406524780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c8890 0x55d4e28cac80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb51400a470 tx=0x7fb51401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:33.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.571+0000 7fb520c1f800 1 -- 172.21.15.170:0/2406524780 shutdown_connections 2024-04-26T12:30:33.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.571+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2406524780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c8890 0x55d4e28cac80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.571+0000 7fb520c1f800 1 -- 172.21.15.170:0/2406524780 >> 172.21.15.170:0/2406524780 conn(0x55d4e28bfa00 msgr2=0x55d4e28c1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.571+0000 7fb520c1f800 1 -- 172.21.15.170:0/2406524780 shutdown_connections 2024-04-26T12:30:33.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.571+0000 7fb520c1f800 1 -- 172.21.15.170:0/2406524780 wait complete. 2024-04-26T12:30:33.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.582+0000 7fb520c1f800 1 Processor -- start 2024-04-26T12:30:33.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.582+0000 7fb520c1f800 1 -- start start 2024-04-26T12:30:33.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.582+0000 7fb520c1f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e2838670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.582+0000 7fb520c1f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4e2810b60 con 0x55d4e28c4400 2024-04-26T12:30:33.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.583+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e2838670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.583+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e2838670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42022/0 (socket says 172.21.15.170:42022) 2024-04-26T12:30:33.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.583+0000 7fb51e725640 1 -- 172.21.15.170:0/2590248039 learned_addr learned my addr 172.21.15.170:0/2590248039 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.583+0000 7fb51e725640 1 -- 172.21.15.170:0/2590248039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e2782590 con 0x55d4e28c4400 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.583+0000 7fb51e725640 1 --2- 172.21.15.170:0/2590248039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e2838670 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb510001e10 tx=0x7fb51000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8365a198fd3e204 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb40c608640 1 -- 172.21.15.170:0/2590248039 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510012020 con 0x55d4e28c4400 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb40c608640 1 -- 172.21.15.170:0/2590248039 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51000e5a0 con 0x55d4e28c4400 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb40c608640 1 -- 172.21.15.170:0/2590248039 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51000e8e0 con 0x55d4e28c4400 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb520c1f800 1 -- 172.21.15.170:0/2590248039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 msgr2=0x55d4e2838670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2590248039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e2838670 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb510001e10 tx=0x7fb51000b780 comp rx=0 tx=0).stop 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb520c1f800 1 -- 172.21.15.170:0/2590248039 shutdown_connections 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2590248039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e2838670 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb520c1f800 1 -- 172.21.15.170:0/2590248039 >> 172.21.15.170:0/2590248039 conn(0x55d4e28bfa00 msgr2=0x55d4e29b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb520c1f800 1 -- 172.21.15.170:0/2590248039 shutdown_connections 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.584+0000 7fb520c1f800 1 -- 172.21.15.170:0/2590248039 wait complete. 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb520c1f800 1 Processor -- start 2024-04-26T12:30:33.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb520c1f800 1 -- start start 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb520c1f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e29be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb520c1f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4e28cb550 con 0x55d4e28c4400 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e29be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e29be0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42028/0 (socket says 172.21.15.170:42028) 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb51e725640 1 -- 172.21.15.170:0/3259009968 learned_addr learned my addr 172.21.15.170:0/3259009968 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb51e725640 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e27798f0 con 0x55d4e28c4400 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.585+0000 7fb51e725640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e29be0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb51000b7c0 tx=0x7fb510000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.586+0000 7fb40ae05640 1 -- 172.21.15.170:0/3259009968 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510012030 con 0x55d4e28c4400 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.586+0000 7fb40ae05640 1 -- 172.21.15.170:0/3259009968 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510001470 con 0x55d4e28c4400 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.586+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4e29be630 con 0x55d4e28c4400 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.586+0000 7fb40ae05640 1 -- 172.21.15.170:0/3259009968 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51001a8d0 con 0x55d4e28c4400 2024-04-26T12:30:33.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.586+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4e29beb50 con 0x55d4e28c4400 2024-04-26T12:30:33.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.586+0000 7fb40ae05640 1 -- 172.21.15.170:0/3259009968 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb510015020 con 0x55d4e28c4400 2024-04-26T12:30:33.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.586+0000 7fb40ae05640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036900 0x7fb404038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb40ae05640 1 -- 172.21.15.170:0/3259009968 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb510020030 con 0x55d4e28c4400 2024-04-26T12:30:33.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb51df24640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036900 0x7fb404038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e28c8890 0x55d4e29c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29c56f0 con 0x55d4e28c8890 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb51ef26640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e28c8890 0x55d4e29c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb51df24640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036900 0x7fb404038dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb514054000 tx=0x7fb51404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb51ef26640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e28c8890 0x55d4e29c5160 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb51ef26640 1 -- 172.21.15.170:0/3259009968 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e28c8890 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.587+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29c2730 con 0x55d4e28c8890 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.588+0000 7fb51ef26640 1 -- 172.21.15.170:0/3259009968 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e28c8890 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.588+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e29c7a40 0x55d4e29c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.588+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29ca520 con 0x55d4e29c7a40 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.588+0000 7fb51e725640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e29c7a40 0x55d4e29c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.588+0000 7fb51e725640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e29c7a40 0x55d4e29c9e30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.589+0000 7fb51e725640 1 -- 172.21.15.170:0/3259009968 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb510018950 con 0x55d4e29c7a40 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.589+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29c69f0 con 0x55d4e28c8890 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.589+0000 7fb51ef26640 1 -- 172.21.15.170:0/3259009968 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e28c8890 2024-04-26T12:30:33.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.589+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d4e29cb9d0 0x55d4e29cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.589+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29ce580 con 0x55d4e29cb9d0 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.589+0000 7fb51df24640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d4e29cb9d0 0x55d4e29cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.589+0000 7fb51df24640 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d4e29cb9d0 0x55d4e29cde20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb51df24640 1 -- 172.21.15.170:0/3259009968 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb514052a40 con 0x55d4e29cb9d0 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb520c1f800 1 Processor -- start 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb520c1f800 1 -- start start 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb520c1f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29dc9a0 0x55d4e29dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb520c1f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4e27b6e60 con 0x55d4e29dc9a0 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29dc9a0 0x55d4e29dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29dc9a0 0x55d4e29dcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42032/0 (socket says 172.21.15.170:42032) 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.590+0000 7fb51e725640 1 -- 172.21.15.170:0/1756168699 learned_addr learned my addr 172.21.15.170:0/1756168699 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.591+0000 7fb51e725640 1 -- 172.21.15.170:0/1756168699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e29dd300 con 0x55d4e29dc9a0 2024-04-26T12:30:33.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.591+0000 7fb51e725640 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29dc9a0 0x55d4e29dcdc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb510000fd0 tx=0x7fb51000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.591+0000 7fb403fff640 1 -- 172.21.15.170:0/1756168699 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510017d80 con 0x55d4e29dc9a0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.591+0000 7fb403fff640 1 -- 172.21.15.170:0/1756168699 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51001ac50 con 0x55d4e29dc9a0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.591+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4e29ddd70 con 0x55d4e29dc9a0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.591+0000 7fb403fff640 1 -- 172.21.15.170:0/1756168699 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510044230 con 0x55d4e29dc9a0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.591+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4e29de270 con 0x55d4e29dc9a0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb403fff640 1 -- 172.21.15.170:0/1756168699 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5100443d0 con 0x55d4e29dc9a0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb403fff640 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f8036900 0x7fb3f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb403fff640 1 -- 172.21.15.170:0/1756168699 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb510043070 con 0x55d4e29dc9a0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb51df24640 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f8036900 0x7fb3f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb520c1f800 1 Processor -- start 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb520c1f800 1 -- start start 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb51df24640 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f8036900 0x7fb3f8038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d4e29c5ff0 tx=0x7fb514005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb520c1f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb520c1f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4e29b95f0 con 0x55d4e29e9b90 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29e9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42048/0 (socket says 172.21.15.170:42048) 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.592+0000 7fb51e725640 1 -- 172.21.15.170:0/2845563549 learned_addr learned my addr 172.21.15.170:0/2845563549 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb51e725640 1 -- 172.21.15.170:0/2845563549 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e29ea580 con 0x55d4e29e9b90 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb51e725640 1 --2- 172.21.15.170:0/2845563549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29e9fb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb510046010 tx=0x7fb5100447b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4823a7bc192500f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb401ffb640 1 -- 172.21.15.170:0/2845563549 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb510027e60 con 0x55d4e29e9b90 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb401ffb640 1 -- 172.21.15.170:0/2845563549 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510060070 con 0x55d4e29e9b90 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb401ffb640 1 -- 172.21.15.170:0/2845563549 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51004c990 con 0x55d4e29e9b90 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb520c1f800 1 -- 172.21.15.170:0/2845563549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 msgr2=0x55d4e29e9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2845563549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29e9fb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb510046010 tx=0x7fb5100447b0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb520c1f800 1 -- 172.21.15.170:0/2845563549 shutdown_connections 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2845563549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29e9fb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb520c1f800 1 -- 172.21.15.170:0/2845563549 >> 172.21.15.170:0/2845563549 conn(0x55d4e29e5e60 msgr2=0x55d4e29e3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb520c1f800 1 -- 172.21.15.170:0/2845563549 shutdown_connections 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.593+0000 7fb520c1f800 1 -- 172.21.15.170:0/2845563549 wait complete. 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.594+0000 7fb520c1f800 1 Processor -- start 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.594+0000 7fb520c1f800 1 -- start start 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.594+0000 7fb520c1f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.594+0000 7fb520c1f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4e29eac50 con 0x55d4e29e9b90 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.594+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.594+0000 7fb51e725640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29f0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42060/0 (socket says 172.21.15.170:42060) 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.594+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 learned_addr learned my addr 172.21.15.170:0/2103138049 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.595+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e29f1400 con 0x55d4e29e9b90 2024-04-26T12:30:33.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.595+0000 7fb51e725640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29f0ec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb510042d30 tx=0x7fb510013fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.595+0000 7fb3effff640 1 -- 172.21.15.170:0/2103138049 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51006a070 con 0x55d4e29e9b90 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.595+0000 7fb3effff640 1 -- 172.21.15.170:0/2103138049 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb510068070 con 0x55d4e29e9b90 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.595+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4e29f1400 con 0x55d4e29e9b90 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.595+0000 7fb3effff640 1 -- 172.21.15.170:0/2103138049 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51004c180 con 0x55d4e29e9b90 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.595+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4e29f1400 con 0x55d4e29e9b90 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb3effff640 1 -- 172.21.15.170:0/2103138049 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb51004cc70 con 0x55d4e29e9b90 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb3effff640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3e8036900 0x7fb3e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb3effff640 1 -- 172.21.15.170:0/2103138049 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb510070cc0 con 0x55d4e29e9b90 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb51df24640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3e8036900 0x7fb3e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb51df24640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3e8036900 0x7fb3e8038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb514052fd0 tx=0x7fb51404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e29fc6b0 0x55d4e29feb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29ff2c0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.596+0000 7fb51ef26640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e29fc6b0 0x55d4e29feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb51ef26640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e29fc6b0 0x55d4e29feb70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 20 realm 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29ff6d0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e29fffa0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.597+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e29fc6b0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e2a010a0 0x55d4e2a03490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a03aa0 con 0x55d4e2a010a0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb51e725640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e2a010a0 0x55d4e2a03490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb51e725640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e2a010a0 0x55d4e2a03490 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 20 searching for the correct realm 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d4e2a05a30 0x55d4e2a07ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a085c0 con 0x55d4e2a05a30 2024-04-26T12:30:33.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.598+0000 7fb51df24640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d4e2a05a30 0x55d4e2a07ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.599+0000 7fb51df24640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d4e2a05a30 0x55d4e2a07ef0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.599+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.599+0000 7fb51df24640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb514076040 0x7fb514083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.599+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a085c0 con 0x7fb514076040 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.599+0000 7fb51ef26640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb514076040 0x7fb514083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51ef26640 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb514076040 0x7fb514083410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e2a010a0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e29fc6b0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e29fc6b0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.600+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e2a010a0 2024-04-26T12:30:33.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e2a010a0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x7fb514076040 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e2a05a30 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.601+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e29fc6b0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e2a010a0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e29fc6b0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x7fb514076040 2024-04-26T12:30:33.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.602+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a00340 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.603+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.603+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.603+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.603+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a010a0 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.603+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.603+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.603+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.604+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.604+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.604+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e29fc6b0 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.604+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.604+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e29fc6b0 2024-04-26T12:30:33.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.604+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.604+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a010a0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a05a30 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x7fb514076040 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e29fc6b0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.605+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a010a0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.606+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.606+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a05a30 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.606+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.606+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a010a0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.606+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.606+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x7fb514076040 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a05a30 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e2a010a0 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x55d4e29fc6b0 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.607+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb514090040 con 0x7fb514076040 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:33.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a04360 con 0x55d4e29fc6b0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a04360 con 0x55d4e29fc6b0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a04360 con 0x7fb514076040 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 zone default found 2024-04-26T12:30:33.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 4 Realm: () 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 zonegroup default 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.608+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a04c00 con 0x55d4e2a010a0 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0a420 con 0x55d4e2a05a30 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0a7c0 con 0x55d4e2a05a30 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 20 started sync module instance, tier type = 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.609+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a098c0 con 0x7fb514076040 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.610+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.610+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94372823604448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a098c0 con 0x7fb514076040 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.610+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0b050 con 0x55d4e29fc6b0 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.611+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94372823604448] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.612+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.612+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94372823608160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a098c0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.612+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0bae0 con 0x55d4e2a05a30 2024-04-26T12:30:33.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.613+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.613+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94372823610800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0c380 con 0x55d4e2a05a30 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.613+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0ce70 con 0x7fb514076040 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.613+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94372823608160] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.614+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.614+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94372823615808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0d260 con 0x7fb514076040 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.614+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0dc60 con 0x55d4e29fc6b0 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.614+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94372823610800] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.615+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.615+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94372823613136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0dc20 con 0x55d4e29fc6b0 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.615+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0e670 con 0x55d4e2a010a0 2024-04-26T12:30:33.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.615+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94372823615808] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.616+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.616+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94372823622080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0ea60 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.616+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0f420 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.616+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94372823613136] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.617+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94372823622080] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.617+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.617+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94372823625584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0f7c0 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.617+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a10010 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94372823625584] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94372823628640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a10430 con 0x55d4e2a010a0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 20 add_watcher() i=0 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 20 add_watcher() i=1 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 20 add_watcher() i=2 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 20 add_watcher() i=3 2024-04-26T12:30:33.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 20 add_watcher() i=4 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 20 add_watcher() i=5 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.618+0000 7fb520c1f800 20 add_watcher() i=6 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.619+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94372823628640] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.619+0000 7fb520c1f800 20 add_watcher() i=7 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.619+0000 7fb520c1f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.619+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a13780 con 0x55d4e29fc6b0 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.619+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.619+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94372823630064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a109c0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.620+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94372823630064] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.620+0000 7fb3d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.620+0000 7fb520c1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.620+0000 7fb520c1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.620+0000 7fb520c1f800 5 note: GC not initialized 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.620+0000 7fb34f7fe640 20 reqs_thread_entry: start 2024-04-26T12:30:33.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.620+0000 7fb520c1f800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 20 Filter name: none 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb34d7fa640 20 reqs_thread_entry: start 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a46ef0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.621+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a4d650 con 0x55d4e29fc6b0 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.622+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.622+0000 7fb520c1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.622+0000 7fb520c1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.622+0000 7fb520c1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.622+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94372823879872 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a48dc0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.622+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94372823613136 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fb518045430 con 0x55d4e29fc6b0 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb401ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94372823613136 notifier 4425 bl.length()=567 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb401ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb401ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(64 notify.4 [notify cookie 94372823879872 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb401ffb640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb3e4003ea0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94372823879872 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb518005040 con 0x55d4e29fc6b0 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.623+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a4d0c0 con 0x7fb514076040 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.624+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.624+0000 7fb520c1f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.624+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94372823879872 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a48910 con 0x7fb514076040 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.624+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== watch-notify(notify (1) cookie 94372823604448 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fb518005040 con 0x7fb514076040 2024-04-26T12:30:33.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.624+0000 7fb4017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94372823604448 notifier 4425 bl.length()=159 2024-04-26T12:30:33.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.624+0000 7fb4017fa640 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb3540032c0 con 0x7fb514076040 2024-04-26T12:30:33.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.625+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(67 notify.0 [notify cookie 94372823879872 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.625+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== watch-notify(notify_complete (2) cookie 94372823879872 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb5180053b0 con 0x7fb514076040 2024-04-26T12:30:33.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.625+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.637 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:33.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.626+0000 7fb3d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.626+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94372823630064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a48dc0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.627+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94372823630064] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.627+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94372823604448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a100f0 con 0x7fb514076040 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.628+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94372823604448] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.628+0000 7fb520c1f800 20 remove_watcher() i=0 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.628+0000 7fb520c1f800 2 removed watcher, disabling cache 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.628+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94372823608160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a100f0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.629+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94372823608160] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.629+0000 7fb520c1f800 20 remove_watcher() i=1 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.629+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94372823610800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0ab60 con 0x55d4e2a05a30 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.630+0000 7fb51df24640 1 -- 172.21.15.170:0/2103138049 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94372823610800] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb514081070 con 0x55d4e2a05a30 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.630+0000 7fb520c1f800 20 remove_watcher() i=2 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.630+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94372823615808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a100f0 con 0x7fb514076040 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.631+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94372823615808] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x7fb514076040 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.631+0000 7fb520c1f800 20 remove_watcher() i=3 2024-04-26T12:30:33.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.631+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94372823613136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a100f0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.632+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94372823613136] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb51800a4a0 con 0x55d4e29fc6b0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.632+0000 7fb520c1f800 20 remove_watcher() i=4 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.632+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94372823622080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a100f0 con 0x55d4e2a010a0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.632+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94372823622080] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.633+0000 7fb520c1f800 20 remove_watcher() i=5 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.633+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94372823625584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a0e1c0 con 0x55d4e2a010a0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.633+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94372823625584] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.633+0000 7fb520c1f800 20 remove_watcher() i=6 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.633+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94372823628640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4e2a100f0 con 0x55d4e2a010a0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.634+0000 7fb51e725640 1 -- 172.21.15.170:0/2103138049 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94372823628640] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb510018950 con 0x55d4e2a010a0 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.634+0000 7fb520c1f800 20 remove_watcher() i=7 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e2a010a0 msgr2=0x55d4e2a03490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e2a010a0 0x55d4e2a03490 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e29fc6b0 msgr2=0x55d4e29feb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e29fc6b0 0x55d4e29feb70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb514076040 msgr2=0x7fb514083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb514076040 0x7fb514083410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d4e2a05a30 msgr2=0x55d4e2a07ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d4e2a05a30 0x55d4e2a07ef0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3e8036900 msgr2=0x7fb3e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3e8036900 0x7fb3e8038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb514052fd0 tx=0x7fb51404f000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 msgr2=0x55d4e29f0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb51ef26640 1 -- 172.21.15.170:0/2103138049 reap_dead start 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29f0ec0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb510042d30 tx=0x7fb510013fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 shutdown_connections 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/2103138049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29e9b90 0x55d4e29f0ec0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 >> 172.21.15.170:0/2103138049 conn(0x55d4e29e5e60 msgr2=0x55d4e29e34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 shutdown_connections 2024-04-26T12:30:33.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/2103138049 wait complete. 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f8036900 msgr2=0x7fb3f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f8036900 0x7fb3f8038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d4e29c5ff0 tx=0x7fb514005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29dc9a0 msgr2=0x55d4e29dcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29dc9a0 0x55d4e29dcdc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb510000fd0 tx=0x7fb51000db20 comp rx=0 tx=0).stop 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 shutdown_connections 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3f8036900 0x7fb3f8038dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/1756168699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e29dc9a0 0x55d4e29dcdc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 >> 172.21.15.170:0/1756168699 conn(0x55d4e29d0a40 msgr2=0x55d4e29d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 shutdown_connections 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/1756168699 wait complete. 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e29c7a40 msgr2=0x55d4e29c9e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d4e29c7a40 0x55d4e29c9e30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e28c8890 msgr2=0x55d4e29c5160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.635+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d4e28c8890 0x55d4e29c5160 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d4e29cb9d0 msgr2=0x55d4e29cde20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d4e29cb9d0 0x55d4e29cde20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036900 msgr2=0x7fb404038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb404036900 0x7fb404038dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb514054000 tx=0x7fb51404e000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 msgr2=0x55d4e29be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 --2- 172.21.15.170:0/3259009968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d4e28c4400 0x55d4e29be0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb51000b7c0 tx=0x7fb510000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb51ef26640 1 -- 172.21.15.170:0/3259009968 reap_dead start 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 shutdown_connections 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 >> 172.21.15.170:0/3259009968 conn(0x55d4e28bfa00 msgr2=0x55d4e29af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 shutdown_connections 2024-04-26T12:30:33.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.636+0000 7fb520c1f800 1 -- 172.21.15.170:0/3259009968 wait complete. 2024-04-26T12:30:33.648 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:33.648 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:30:33.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:30:33.649 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-26T12:30:33.691 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:33.691 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb869a94800 1 Processor -- start 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb869a94800 1 -- start start 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb869a94800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559730bee000 0x559730bf03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb869a94800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559730a9a0c0 con 0x559730bf0930 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb869a94800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x559730a7e4d0 con 0x559730bee000 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb867593640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559730bee000 0x559730bf03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb866d92640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559730bf0930 0x559730bf2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46176/0 (socket says 172.21.15.170:46176) 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.691+0000 7fb866d92640 1 -- 172.21.15.170:0/1187576014 learned_addr learned my addr 172.21.15.170:0/1187576014 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.692+0000 7fb867593640 1 -- 172.21.15.170:0/1187576014 >> v1:172.21.15.132:6789/0 conn(0x559730bf0930 legacy=0x559730bf2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.692+0000 7fb866591640 1 -- 172.21.15.170:0/1187576014 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616050347 0 0) 0x559730a9a0c0 con 0x559730bf0930 2024-04-26T12:30:33.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.692+0000 7fb867593640 1 -- 172.21.15.170:0/1187576014 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559730aabd40 con 0x559730bee000 2024-04-26T12:30:33.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb867593640 1 --2- 172.21.15.170:0/1187576014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bf03f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb85800a470 tx=0x7fb85801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6f5e043f4f43b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb866591640 1 -- 172.21.15.170:0/1187576014 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858057070 con 0x559730bee000 2024-04-26T12:30:33.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb866591640 1 -- 172.21.15.170:0/1187576014 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb858052570 con 0x559730bee000 2024-04-26T12:30:33.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb866591640 1 -- 172.21.15.170:0/1187576014 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858052870 con 0x559730bee000 2024-04-26T12:30:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb869a94800 1 -- 172.21.15.170:0/1187576014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 msgr2=0x559730bf03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb869a94800 1 --2- 172.21.15.170:0/1187576014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bf03f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb85800a470 tx=0x7fb85801ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb869a94800 1 -- 172.21.15.170:0/1187576014 shutdown_connections 2024-04-26T12:30:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb869a94800 1 --2- 172.21.15.170:0/1187576014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bf03f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb869a94800 1 -- 172.21.15.170:0/1187576014 >> 172.21.15.170:0/1187576014 conn(0x559730be7990 msgr2=0x559730be9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb869a94800 1 -- 172.21.15.170:0/1187576014 shutdown_connections 2024-04-26T12:30:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.694+0000 7fb869a94800 1 -- 172.21.15.170:0/1187576014 wait complete. 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.706+0000 7fb869a94800 1 Processor -- start 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.706+0000 7fb869a94800 1 -- start start 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.706+0000 7fb869a94800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730cde550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.706+0000 7fb869a94800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559730b38b40 con 0x559730bee000 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.706+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730cde550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.706+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730cde550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42084/0 (socket says 172.21.15.170:42084) 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.706+0000 7fb867593640 1 -- 172.21.15.170:0/4293103658 learned_addr learned my addr 172.21.15.170:0/4293103658 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.707+0000 7fb867593640 1 -- 172.21.15.170:0/4293103658 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559730aaa590 con 0x559730bee000 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.707+0000 7fb867593640 1 --2- 172.21.15.170:0/4293103658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730cde550 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb858055040 tx=0x7fb85804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b47fa0a17fc6ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.707+0000 7fb75560a640 1 -- 172.21.15.170:0/4293103658 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858057070 con 0x559730bee000 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.707+0000 7fb75560a640 1 -- 172.21.15.170:0/4293103658 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb858063070 con 0x559730bee000 2024-04-26T12:30:33.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.707+0000 7fb75560a640 1 -- 172.21.15.170:0/4293103658 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858052720 con 0x559730bee000 2024-04-26T12:30:33.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 -- 172.21.15.170:0/4293103658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 msgr2=0x559730cde550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 --2- 172.21.15.170:0/4293103658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730cde550 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb858055040 tx=0x7fb85804c000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 -- 172.21.15.170:0/4293103658 shutdown_connections 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 --2- 172.21.15.170:0/4293103658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730cde550 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 -- 172.21.15.170:0/4293103658 >> 172.21.15.170:0/4293103658 conn(0x559730be7990 msgr2=0x559730cd9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 -- 172.21.15.170:0/4293103658 shutdown_connections 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 -- 172.21.15.170:0/4293103658 wait complete. 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 Processor -- start 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 -- start start 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb869a94800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559730bf6750 con 0x559730bee000 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bed940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42088/0 (socket says 172.21.15.170:42088) 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb867593640 1 -- 172.21.15.170:0/144670549 learned_addr learned my addr 172.21.15.170:0/144670549 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.708+0000 7fb867593640 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559730aa18f0 con 0x559730bee000 2024-04-26T12:30:33.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.709+0000 7fb867593640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bed940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb858060040 tx=0x7fb858002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.709+0000 7fb753e07640 1 -- 172.21.15.170:0/144670549 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858052e30 con 0x559730bee000 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.709+0000 7fb753e07640 1 -- 172.21.15.170:0/144670549 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85806c070 con 0x559730bee000 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.709+0000 7fb753e07640 1 -- 172.21.15.170:0/144670549 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85805e5f0 con 0x559730bee000 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.709+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559730bec030 con 0x559730bee000 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.709+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559730bec5b0 con 0x559730bee000 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb753e07640 1 -- 172.21.15.170:0/144670549 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb85805e790 con 0x559730bee000 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb753e07640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb74c036950 0x7fb74c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb753e07640 1 -- 172.21.15.170:0/144670549 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb85808e8a0 con 0x559730bee000 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb866d92640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb74c036950 0x7fb74c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730bf0930 0x559730cef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730cef700 con 0x559730bf0930 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb867d94640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730bf0930 0x559730cef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb866d92640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb74c036950 0x7fb74c038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb85c000c00 tx=0x7fb85c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.710+0000 7fb867d94640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730bf0930 0x559730cef1c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.711+0000 7fb867d94640 1 -- 172.21.15.170:0/144670549 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730bf0930 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.711+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730ceff50 con 0x559730bf0930 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.711+0000 7fb867d94640 1 -- 172.21.15.170:0/144670549 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730bf0930 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.711+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730cf1860 0x559730cf3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.711+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730cf4490 con 0x559730cf1860 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.711+0000 7fb867593640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730cf1860 0x559730cf3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.711+0000 7fb867593640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730cf1860 0x559730cf3d00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.712+0000 7fb867593640 1 -- 172.21.15.170:0/144670549 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb858071990 con 0x559730cf1860 2024-04-26T12:30:33.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.712+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730cf07d0 con 0x559730bf0930 2024-04-26T12:30:33.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.712+0000 7fb867d94640 1 -- 172.21.15.170:0/144670549 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730bf0930 2024-04-26T12:30:33.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.712+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559730cf5940 0x559730cf7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.712+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730cf8510 con 0x559730cf5940 2024-04-26T12:30:33.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.712+0000 7fb866d92640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559730cf5940 0x559730cf7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.712+0000 7fb866d92640 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559730cf5940 0x559730cf7db0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb866d92640 1 -- 172.21.15.170:0/144670549 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb85c00f670 con 0x559730cf5940 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb869a94800 1 Processor -- start 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb869a94800 1 -- start start 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb869a94800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d06970 0x559730d06d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb869a94800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559730bede80 con 0x559730d06970 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d06970 0x559730d06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d06970 0x559730d06d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42102/0 (socket says 172.21.15.170:42102) 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.713+0000 7fb867593640 1 -- 172.21.15.170:0/1121977266 learned_addr learned my addr 172.21.15.170:0/1121977266 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.714+0000 7fb867593640 1 -- 172.21.15.170:0/1121977266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559730d072d0 con 0x559730d06970 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.714+0000 7fb867593640 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d06970 0x559730d06d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb858052520 tx=0x7fb858068e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.714+0000 7fb751602640 1 -- 172.21.15.170:0/1121977266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858092020 con 0x559730d06970 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.714+0000 7fb751602640 1 -- 172.21.15.170:0/1121977266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb858058040 con 0x559730d06970 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.714+0000 7fb751602640 1 -- 172.21.15.170:0/1121977266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858002a70 con 0x559730d06970 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.714+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559730d07d40 con 0x559730d06970 2024-04-26T12:30:33.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.714+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559730d07d40 con 0x559730d06970 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb751602640 1 -- 172.21.15.170:0/1121977266 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb858095020 con 0x559730d06970 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb751602640 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb740036950 0x7fb740038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb751602640 1 -- 172.21.15.170:0/1121977266 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb85808b050 con 0x559730d06970 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb866d92640 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb740036950 0x7fb740038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb869a94800 1 Processor -- start 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb869a94800 1 -- start start 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb866d92640 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb740036950 0x7fb740038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x559730bec9a0 tx=0x7fb85c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb869a94800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d13cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.715+0000 7fb869a94800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559730adee60 con 0x559730d138e0 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d13cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d13cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42118/0 (socket says 172.21.15.170:42118) 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb867593640 1 -- 172.21.15.170:0/2228659755 learned_addr learned my addr 172.21.15.170:0/2228659755 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb867593640 1 -- 172.21.15.170:0/2228659755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559730d14290 con 0x559730d138e0 2024-04-26T12:30:33.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb867593640 1 --2- 172.21.15.170:0/2228659755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d13cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb858002920 tx=0x7fb858002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529f3e91df0e278d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb74affd640 1 -- 172.21.15.170:0/2228659755 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85808b930 con 0x559730d138e0 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb74affd640 1 -- 172.21.15.170:0/2228659755 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8580047a0 con 0x559730d138e0 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb74affd640 1 -- 172.21.15.170:0/2228659755 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85808b670 con 0x559730d138e0 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb869a94800 1 -- 172.21.15.170:0/2228659755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 msgr2=0x559730d13cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb869a94800 1 --2- 172.21.15.170:0/2228659755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d13cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb858002920 tx=0x7fb858002000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.716+0000 7fb869a94800 1 -- 172.21.15.170:0/2228659755 shutdown_connections 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 --2- 172.21.15.170:0/2228659755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d13cc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 -- 172.21.15.170:0/2228659755 >> 172.21.15.170:0/2228659755 conn(0x559730d0fbb0 msgr2=0x559730d0dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 -- 172.21.15.170:0/2228659755 shutdown_connections 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 -- 172.21.15.170:0/2228659755 wait complete. 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 Processor -- start 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 -- start start 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d1a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb869a94800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559730d14820 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d1a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb867593640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d1a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42132/0 (socket says 172.21.15.170:42132) 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 learned_addr learned my addr 172.21.15.170:0/1993337858 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.717+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559730d1af20 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.718+0000 7fb867593640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d1a9e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb85807abe0 tx=0x7fb85807ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.718+0000 7fb7497fa640 1 -- 172.21.15.170:0/1993337858 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb858002770 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.718+0000 7fb7497fa640 1 -- 172.21.15.170:0/1993337858 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8580ba070 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.718+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559730d1af20 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.718+0000 7fb7497fa640 1 -- 172.21.15.170:0/1993337858 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8580043b0 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.718+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559730d1af20 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb7497fa640 1 -- 172.21.15.170:0/1993337858 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb858002c10 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb7497fa640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb730036950 0x7fb730038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb7497fa640 1 -- 172.21.15.170:0/1993337858 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb8580815e0 con 0x559730d138e0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb866d92640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb730036950 0x7fb730038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730d26110 0x559730d285d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d28d20 con 0x559730d26110 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb867d94640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730d26110 0x559730d285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.719+0000 7fb866d92640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb730036950 0x7fb730038e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x559730cf8910 tx=0x7fb85c023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb867d94640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730d26110 0x559730d285d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 realm 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d29130 con 0x559730d26110 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:33.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d29a00 con 0x559730d26110 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.720+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730d2a890 0x559730d2cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.721+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d2d3e0 con 0x559730d2a890 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.721+0000 7fb867593640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730d2a890 0x559730d2cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.721+0000 7fb867593640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730d2a890 0x559730d2cc80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.721+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.721+0000 7fb869a94800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.721+0000 7fb869a94800 20 searching for the correct realm 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559730d2f480 0x559730d31940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d32010 con 0x559730d2f480 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb866d92640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559730d2f480 0x559730d31940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb866d92640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559730d2f480 0x559730d31940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb866d92640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb85c03a3c0 0x7fb85c03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d32010 con 0x7fb85c03a3c0 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.722+0000 7fb867d94640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb85c03a3c0 0x7fb85c03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.723+0000 7fb867d94640 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb85c03a3c0 0x7fb85c03a810 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.723+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.723+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.723+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.723+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.724+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.725+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.726+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.727+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.728+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.729+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.729+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.729+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.729+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.730+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.730+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.730+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.730+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2f480 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.730+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.730+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d2a890 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x559730d26110 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559730d29da0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:33.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d2dd80 con 0x559730d26110 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.731+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d2dd80 con 0x559730d26110 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d2dd80 con 0x7fb85c03a3c0 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:33.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 zone default found 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 4 Realm: () 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 zonegroup default 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d2e170 con 0x559730d2a890 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.732+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d33e70 con 0x559730d2f480 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb869a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d34210 con 0x559730d2f480 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb869a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb869a94800 20 started sync module instance, tier type = 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb869a94800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.733+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d2e9e0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.734+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.734+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94107847569264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d33a70 con 0x7fb85c03a3c0 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.734+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d34d00 con 0x559730d26110 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.735+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94107847569264] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.735+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.735+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94107847575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d34cc0 con 0x559730d26110 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.735+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d35790 con 0x559730d2f480 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.736+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94107847575504] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.736+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.736+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94107847578208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d35b80 con 0x559730d2f480 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.736+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d36580 con 0x7fb85c03a3c0 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.737+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94107847578208] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.737+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.737+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94107847570624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d36970 con 0x7fb85c03a3c0 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.737+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d37370 con 0x559730d26110 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.738+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.738+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94107847585408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d372a0 con 0x559730d26110 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.738+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d382c0 con 0x559730d2a890 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.739+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94107847570624] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.739+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94107847585408] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.739+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.739+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94107847587680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d36090 con 0x559730d2a890 2024-04-26T12:30:33.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.739+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d38b60 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.740+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94107847587680] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.741+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.741+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94107847589296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d393b0 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.741+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d39d70 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94107847589296] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94107847594240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d39d70 con 0x559730d2a890 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 20 add_watcher() i=0 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 20 add_watcher() i=1 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 20 add_watcher() i=2 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 20 add_watcher() i=3 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 20 add_watcher() i=4 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 20 add_watcher() i=5 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.742+0000 7fb869a94800 20 add_watcher() i=6 2024-04-26T12:30:33.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.743+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94107847594240] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.743+0000 7fb869a94800 20 add_watcher() i=7 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.743+0000 7fb869a94800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.743+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d3d0c0 con 0x559730d26110 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.744+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.744+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94107847596592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d3a300 con 0x559730d26110 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94107847596592] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb71dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb869a94800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb869a94800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb869a94800 5 note: GC not initialized 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb71cfe1640 20 reqs_thread_entry: start 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb869a94800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb869a94800 20 Filter name: none 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb6967fc640 20 reqs_thread_entry: start 2024-04-26T12:30:33.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.745+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d70250 con 0x559730d26110 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb869a94800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb869a94800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d70c40 con 0x559730d26110 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb869a94800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559730d71c50 con 0x7fb85c03a3c0 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.746+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.747+0000 7fb71dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.747+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94107847596592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d3c710 con 0x559730d26110 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.748+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94107847596592] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.748+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94107847569264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d39a30 con 0x7fb85c03a3c0 2024-04-26T12:30:33.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.749+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94107847569264] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.749+0000 7fb869a94800 20 remove_watcher() i=0 2024-04-26T12:30:33.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.749+0000 7fb869a94800 2 removed watcher, disabling cache 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.749+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94107847575504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d32f70 con 0x559730d26110 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.750+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94107847575504] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.750+0000 7fb869a94800 20 remove_watcher() i=1 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.750+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94107847578208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d32f70 con 0x559730d2f480 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.751+0000 7fb866d92640 1 -- 172.21.15.170:0/1993337858 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94107847578208] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85c037040 con 0x559730d2f480 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.751+0000 7fb869a94800 20 remove_watcher() i=2 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.751+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94107847570624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d35260 con 0x7fb85c03a3c0 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.752+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94107847570624] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x7fb85c03a3c0 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.752+0000 7fb869a94800 20 remove_watcher() i=3 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.752+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94107847585408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d33480 con 0x559730d26110 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.753+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94107847585408] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86000a4a0 con 0x559730d26110 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.753+0000 7fb869a94800 20 remove_watcher() i=4 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.753+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94107847587680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d36e80 con 0x559730d2a890 2024-04-26T12:30:33.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.754+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94107847587680] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.754+0000 7fb869a94800 20 remove_watcher() i=5 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.754+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94107847589296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d36e80 con 0x559730d2a890 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.755+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94107847589296] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.755+0000 7fb869a94800 20 remove_watcher() i=6 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.755+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94107847594240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559730d37db0 con 0x559730d2a890 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb867593640 1 -- 172.21.15.170:0/1993337858 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94107847594240] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb858071990 con 0x559730d2a890 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 20 remove_watcher() i=7 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730d2a890 msgr2=0x559730d2cc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730d2a890 0x559730d2cc80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730d26110 msgr2=0x559730d285d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730d26110 0x559730d285d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb85c03a3c0 msgr2=0x7fb85c03a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb85c03a3c0 0x7fb85c03a810 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559730d2f480 msgr2=0x559730d31940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559730d2f480 0x559730d31940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb730036950 msgr2=0x7fb730038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb730036950 0x7fb730038e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x559730cf8910 tx=0x7fb85c023040 comp rx=0 tx=0).stop 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 msgr2=0x559730d1a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb867d94640 1 -- 172.21.15.170:0/1993337858 reap_dead start 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d1a9e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb85807abe0 tx=0x7fb85807ab30 comp rx=0 tx=0).stop 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 shutdown_connections 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 --2- 172.21.15.170:0/1993337858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d138e0 0x559730d1a9e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 >> 172.21.15.170:0/1993337858 conn(0x559730d0fbb0 msgr2=0x559730d0d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 shutdown_connections 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.756+0000 7fb869a94800 1 -- 172.21.15.170:0/1993337858 wait complete. 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb740036950 msgr2=0x7fb740038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb740036950 0x7fb740038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x559730bec9a0 tx=0x7fb85c006000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d06970 msgr2=0x559730d06d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d06970 0x559730d06d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb858052520 tx=0x7fb858068e30 comp rx=0 tx=0).stop 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 shutdown_connections 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb740036950 0x7fb740038e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/1121977266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730d06970 0x559730d06d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 >> 172.21.15.170:0/1121977266 conn(0x559730cfaa10 msgr2=0x559730cfae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 shutdown_connections 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/1121977266 wait complete. 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730cf1860 msgr2=0x559730cf3d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559730cf1860 0x559730cf3d00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730bf0930 msgr2=0x559730cef1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559730bf0930 0x559730cef1c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559730cf5940 msgr2=0x559730cf7db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559730cf5940 0x559730cf7db0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb74c036950 msgr2=0x7fb74c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb74c036950 0x7fb74c038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb85c000c00 tx=0x7fb85c0013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 msgr2=0x559730bed940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 --2- 172.21.15.170:0/144670549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559730bee000 0x559730bed940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb858060040 tx=0x7fb858002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb867d94640 1 -- 172.21.15.170:0/144670549 reap_dead start 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 shutdown_connections 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 >> 172.21.15.170:0/144670549 conn(0x559730be7990 msgr2=0x559730cdcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 shutdown_connections 2024-04-26T12:30:33.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.757+0000 7fb869a94800 1 -- 172.21.15.170:0/144670549 wait complete. 2024-04-26T12:30:33.768 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-04-26T12:30:33.768 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:30:33.768 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-26T12:30:33.768 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-26T12:30:33.769 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-26T12:30:33.851 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:33.852 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.851+0000 7fc196c13800 1 Processor -- start 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.851+0000 7fc196c13800 1 -- start start 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.851+0000 7fc196c13800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564b95d2e5c0 0x564b95d2e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.851+0000 7fc196c13800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b95bdb0c0 con 0x564b95d2f730 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.851+0000 7fc196c13800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x564b95bbf4d0 con 0x564b95d2e5c0 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.852+0000 7fc192221640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564b95d2e5c0 0x564b95d2e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.852+0000 7fc192221640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564b95d2e5c0 0x564b95d2e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42140/0 (socket says 172.21.15.170:42140) 2024-04-26T12:30:33.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.852+0000 7fc192221640 1 -- 172.21.15.170:0/687722312 learned_addr learned my addr 172.21.15.170:0/687722312 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.852+0000 7fc189a20640 1 --1- 172.21.15.170:0/687722312 >> v1:172.21.15.132:6789/0 conn(0x564b95d2f730 0x564b95d2fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46188/0 (socket says 172.21.15.170:46188) 2024-04-26T12:30:33.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.852+0000 7fc192221640 1 -- 172.21.15.170:0/687722312 >> v1:172.21.15.132:6789/0 conn(0x564b95d2f730 legacy=0x564b95d2fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.852+0000 7fc192221640 1 -- 172.21.15.170:0/687722312 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95becd40 con 0x564b95d2e5c0 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc192221640 1 --2- 172.21.15.170:0/687722312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95d2e9e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc18400a520 tx=0x7fc18401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab8300679d4a638 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc191a20640 1 -- 172.21.15.170:0/687722312 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184057070 con 0x564b95d2e5c0 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc191a20640 1 -- 172.21.15.170:0/687722312 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc184052570 con 0x564b95d2e5c0 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc191a20640 1 -- 172.21.15.170:0/687722312 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18404ae60 con 0x564b95d2e5c0 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc196c13800 1 -- 172.21.15.170:0/687722312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 msgr2=0x564b95d2e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc196c13800 1 --2- 172.21.15.170:0/687722312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95d2e9e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc18400a520 tx=0x7fc18401d010 comp rx=0 tx=0).stop 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc196c13800 1 -- 172.21.15.170:0/687722312 shutdown_connections 2024-04-26T12:30:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc196c13800 1 --2- 172.21.15.170:0/687722312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95d2e9e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc196c13800 1 -- 172.21.15.170:0/687722312 >> 172.21.15.170:0/687722312 conn(0x564b95d29b80 msgr2=0x564b95d2bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc196c13800 1 -- 172.21.15.170:0/687722312 shutdown_connections 2024-04-26T12:30:33.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.854+0000 7fc196c13800 1 -- 172.21.15.170:0/687722312 wait complete. 2024-04-26T12:30:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.866+0000 7fc196c13800 1 Processor -- start 2024-04-26T12:30:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.866+0000 7fc196c13800 1 -- start start 2024-04-26T12:30:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.866+0000 7fc196c13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95ca4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.866+0000 7fc196c13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b95c79b40 con 0x564b95d2e5c0 2024-04-26T12:30:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95ca4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95ca4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42142/0 (socket says 172.21.15.170:42142) 2024-04-26T12:30:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc192221640 1 -- 172.21.15.170:0/3400368447 learned_addr learned my addr 172.21.15.170:0/3400368447 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc192221640 1 -- 172.21.15.170:0/3400368447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95beb590 con 0x564b95d2e5c0 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc192221640 1 --2- 172.21.15.170:0/3400368447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95ca4000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc184055040 tx=0x7fc18404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf854f23f43c4a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc080608640 1 -- 172.21.15.170:0/3400368447 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184057040 con 0x564b95d2e5c0 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc080608640 1 -- 172.21.15.170:0/3400368447 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc184052720 con 0x564b95d2e5c0 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.867+0000 7fc080608640 1 -- 172.21.15.170:0/3400368447 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184052a40 con 0x564b95d2e5c0 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 -- 172.21.15.170:0/3400368447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 msgr2=0x564b95ca4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 --2- 172.21.15.170:0/3400368447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95ca4000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc184055040 tx=0x7fc18404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 -- 172.21.15.170:0/3400368447 shutdown_connections 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 --2- 172.21.15.170:0/3400368447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2e5c0 0x564b95ca4000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 -- 172.21.15.170:0/3400368447 >> 172.21.15.170:0/3400368447 conn(0x564b95d29b80 msgr2=0x564b95e1b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 -- 172.21.15.170:0/3400368447 shutdown_connections 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 -- 172.21.15.170:0/3400368447 wait complete. 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 Processor -- start 2024-04-26T12:30:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 -- start start 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2f730 0x564b95e298e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.868+0000 7fc196c13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b95d37ba0 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2f730 0x564b95e298e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2f730 0x564b95e298e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42144/0 (socket says 172.21.15.170:42144) 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc192221640 1 -- 172.21.15.170:0/2275199717 learned_addr learned my addr 172.21.15.170:0/2275199717 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc192221640 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95be28f0 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc192221640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2f730 0x564b95e298e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc184052540 tx=0x7fc184003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc07ee05640 1 -- 172.21.15.170:0/2275199717 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184073070 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc07ee05640 1 -- 172.21.15.170:0/2275199717 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc184052bf0 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b95e29e20 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc07ee05640 1 -- 172.21.15.170:0/2275199717 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184057070 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.869+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b95e2a340 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.870+0000 7fc07ee05640 1 -- 172.21.15.170:0/2275199717 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc184076070 con 0x564b95d2f730 2024-04-26T12:30:33.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.870+0000 7fc07ee05640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc078036950 0x7fc078038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.870+0000 7fc07ee05640 1 -- 172.21.15.170:0/2275199717 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc18408d790 con 0x564b95d2f730 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.870+0000 7fc189a20640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc078036950 0x7fc078038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.870+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e2e940 0x564b95e30d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.870+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e31270 con 0x564b95e2e940 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.870+0000 7fc192a22640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e2e940 0x564b95e30d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc189a20640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc078036950 0x7fc078038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000f60 tx=0x7fc17c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc192a22640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e2e940 0x564b95e30d30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc192a22640 1 -- 172.21.15.170:0/2275199717 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e2e940 2024-04-26T12:30:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e2df00 con 0x564b95e2e940 2024-04-26T12:30:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc192a22640 1 -- 172.21.15.170:0/2275199717 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e2e940 2024-04-26T12:30:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e33510 0x564b95e35900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e35fa0 con 0x564b95e33510 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.871+0000 7fc192221640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e33510 0x564b95e35900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.872+0000 7fc192221640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e33510 0x564b95e35900 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.872+0000 7fc192221640 1 -- 172.21.15.170:0/2275199717 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc184075030 con 0x564b95e33510 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.872+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e324c0 con 0x564b95e2e940 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.872+0000 7fc192a22640 1 -- 172.21.15.170:0/2275199717 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e2e940 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.872+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b95e37450 0x564b95e398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.872+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e3a000 con 0x564b95e37450 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.872+0000 7fc189a20640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b95e37450 0x564b95e398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.873+0000 7fc189a20640 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b95e37450 0x564b95e398a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.873+0000 7fc189a20640 1 -- 172.21.15.170:0/2275199717 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc17c00f690 con 0x564b95e37450 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.873+0000 7fc196c13800 1 Processor -- start 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.873+0000 7fc196c13800 1 -- start start 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.873+0000 7fc196c13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e48460 0x564b95e48880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc196c13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b95c1fe60 con 0x564b95e48460 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e48460 0x564b95e48880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e48460 0x564b95e48880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42160/0 (socket says 172.21.15.170:42160) 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc192221640 1 -- 172.21.15.170:0/1526050794 learned_addr learned my addr 172.21.15.170:0/1526050794 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc192221640 1 -- 172.21.15.170:0/1526050794 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95e48dc0 con 0x564b95e48460 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc192221640 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e48460 0x564b95e48880 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc18408bbf0 tx=0x7fc184076810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc077fff640 1 -- 172.21.15.170:0/1526050794 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18408dd00 con 0x564b95e48460 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc077fff640 1 -- 172.21.15.170:0/1526050794 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18405d440 con 0x564b95e48460 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b95e49830 con 0x564b95e48460 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc077fff640 1 -- 172.21.15.170:0/1526050794 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18405d740 con 0x564b95e48460 2024-04-26T12:30:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.874+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b95e49d30 con 0x564b95e48460 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.875+0000 7fc077fff640 1 -- 172.21.15.170:0/1526050794 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc184006980 con 0x564b95e48460 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.875+0000 7fc077fff640 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc06c036900 0x7fc06c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.875+0000 7fc077fff640 1 -- 172.21.15.170:0/1526050794 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc184083030 con 0x564b95e48460 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.875+0000 7fc189a20640 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc06c036900 0x7fc06c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.875+0000 7fc196c13800 1 Processor -- start 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc196c13800 1 -- start start 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc189a20640 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc06c036900 0x7fc06c038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564b95e2de40 tx=0x7fc17c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc196c13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e55a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc196c13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b95ca25c0 con 0x564b95e55630 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e55a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e55a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42164/0 (socket says 172.21.15.170:42164) 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc192221640 1 -- 172.21.15.170:0/709320425 learned_addr learned my addr 172.21.15.170:0/709320425 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc192221640 1 -- 172.21.15.170:0/709320425 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95e56020 con 0x564b95e55630 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc192221640 1 --2- 172.21.15.170:0/709320425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e55a50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc184076a20 tx=0x7fc18408d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576f260da69b8a55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc075ffb640 1 -- 172.21.15.170:0/709320425 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1840965e0 con 0x564b95e55630 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc075ffb640 1 -- 172.21.15.170:0/709320425 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc184006e50 con 0x564b95e55630 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.876+0000 7fc075ffb640 1 -- 172.21.15.170:0/709320425 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18407e4b0 con 0x564b95e55630 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 -- 172.21.15.170:0/709320425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 msgr2=0x564b95e55a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 --2- 172.21.15.170:0/709320425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e55a50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc184076a20 tx=0x7fc18408d690 comp rx=0 tx=0).stop 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 -- 172.21.15.170:0/709320425 shutdown_connections 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 --2- 172.21.15.170:0/709320425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e55a50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 -- 172.21.15.170:0/709320425 >> 172.21.15.170:0/709320425 conn(0x564b95e51900 msgr2=0x564b95e4f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 -- 172.21.15.170:0/709320425 shutdown_connections 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 -- 172.21.15.170:0/709320425 wait complete. 2024-04-26T12:30:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 Processor -- start 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 -- start start 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e5c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc196c13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b95e56680 con 0x564b95e55630 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e5c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc192221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e5c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42180/0 (socket says 172.21.15.170:42180) 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.877+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 learned_addr learned my addr 172.21.15.170:0/4209034367 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.878+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b95e5ce70 con 0x564b95e55630 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.878+0000 7fc192221640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e5c930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc184044990 tx=0x7fc18408df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.878+0000 7fc063fff640 1 -- 172.21.15.170:0/4209034367 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184079450 con 0x564b95e55630 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.878+0000 7fc063fff640 1 -- 172.21.15.170:0/4209034367 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1840b5070 con 0x564b95e55630 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.878+0000 7fc063fff640 1 -- 172.21.15.170:0/4209034367 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc184096400 con 0x564b95e55630 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.878+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b95e5ce70 con 0x564b95e55630 2024-04-26T12:30:33.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.878+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b95e5ce70 con 0x564b95e55630 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc063fff640 1 -- 172.21.15.170:0/4209034367 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc1840ac040 con 0x564b95e55630 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc063fff640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc05c0368b0 0x7fc05c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc063fff640 1 -- 172.21.15.170:0/4209034367 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc1840aa020 con 0x564b95e55630 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc189a20640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc05c0368b0 0x7fc05c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e68150 0x564b95e6a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6ad40 con 0x564b95e68150 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.879+0000 7fc192a22640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e68150 0x564b95e6a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc189a20640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc05c0368b0 0x7fc05c038d70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564b95e3a400 tx=0x7fc17c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc192a22640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e68150 0x564b95e6a5f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 20 realm 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6b150 con 0x564b95e68150 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6b9f0 con 0x564b95e68150 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.880+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc196c13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e6caf0 0x564b95e6eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6f420 con 0x564b95e6caf0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc192221640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e6caf0 0x564b95e6eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc192221640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e6caf0 0x564b95e6eee0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc196c13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc196c13800 20 searching for the correct realm 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.881+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b95e714a0 0x564b95e73960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.882+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e74030 con 0x564b95e714a0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.882+0000 7fc189a20640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b95e714a0 0x564b95e73960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.882+0000 7fc189a20640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b95e714a0 0x564b95e73960 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.882+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.882+0000 7fc189a20640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc17c00f070 0x7fc17c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.882+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e74030 con 0x7fc17c00f070 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.882+0000 7fc192a22640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc17c00f070 0x7fc17c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.883+0000 7fc192a22640 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc17c00f070 0x7fc17c02e910 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.883+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.883+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.883+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.883+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.883+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.883+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x7fc17c00f070 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.884+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.885+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x7fc17c00f070 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.886+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.886+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.886+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.886+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.886+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.886+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.887+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.888+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.888+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.888+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.888+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.888+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.888+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x7fc17c00f070 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.889+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.890+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.890+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x7fc17c00f070 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.890+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.890+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e714a0 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.890+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.890+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e6caf0 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x564b95e68150 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6bd90 con 0x7fc17c00f070 2024-04-26T12:30:33.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6fda0 con 0x564b95e68150 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.891+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6fda0 con 0x564b95e68150 2024-04-26T12:30:33.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6fd70 con 0x7fc17c00f070 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 20 zone default found 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 4 Realm: () 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:33.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 20 zonegroup default 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.892+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e70190 con 0x564b95e6caf0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e75e90 con 0x564b95e714a0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e76230 con 0x564b95e714a0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 20 started sync module instance, tier type = 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.893+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e6fda0 con 0x7fc17c00f070 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.894+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.894+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882637500032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e75750 con 0x7fc17c00f070 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.894+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e76a80 con 0x564b95e68150 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.895+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882637500032] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.896+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.896+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882637501568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e76a80 con 0x564b95e68150 2024-04-26T12:30:33.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.896+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e77440 con 0x564b95e714a0 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.897+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882637501568] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.897+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.897+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882637506000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e769f0 con 0x564b95e714a0 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.897+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e782b0 con 0x7fc17c00f070 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.898+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882637506000] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.898+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.898+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882637512192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e786d0 con 0x7fc17c00f070 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.898+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e79090 con 0x564b95e68150 2024-04-26T12:30:33.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.899+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.899+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882637515744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e794b0 con 0x564b95e68150 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.899+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e79f90 con 0x564b95e6caf0 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.899+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882637512192] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.900+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.900+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882637519520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7a380 con 0x564b95e6caf0 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.900+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7ad40 con 0x564b95e6caf0 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.902+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882637515744] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.902+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.902+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882637519520] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.902+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882637516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7b130 con 0x564b95e6caf0 2024-04-26T12:30:33.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.902+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7b980 con 0x564b95e6caf0 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.903+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882637516800] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882637525216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7bd70 con 0x564b95e6caf0 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 20 add_watcher() i=0 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 20 add_watcher() i=1 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 20 add_watcher() i=2 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 20 add_watcher() i=3 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 20 add_watcher() i=4 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 20 add_watcher() i=5 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.905+0000 7fc196c13800 20 add_watcher() i=6 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.906+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882637525216] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.906+0000 7fc196c13800 20 add_watcher() i=7 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.906+0000 7fc196c13800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:33.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.906+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7eda0 con 0x564b95e68150 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.907+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.907+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882637526736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7c260 con 0x564b95e68150 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882637526736] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc196c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc196c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc196c13800 5 note: GC not initialized 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fbfc37fe640 20 reqs_thread_entry: start 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc196c13800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc196c13800 20 Filter name: none 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fbfc17fa640 20 reqs_thread_entry: start 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.908+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95eb1f70 con 0x564b95e68150 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc196c13800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc196c13800 20 rados->read ofs=0 len=0 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95eb2960 con 0x564b95e68150 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc196c13800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564b95eb3970 con 0x7fc17c00f070 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.909+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.910+0000 7fc048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.910+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882637526736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7e8f0 con 0x564b95e68150 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.911+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94882637526736] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.911+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882637500032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e7b6a0 con 0x7fc17c00f070 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.912+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94882637500032] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.912+0000 7fc196c13800 20 remove_watcher() i=0 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.912+0000 7fc196c13800 2 removed watcher, disabling cache 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.912+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882637501568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e74e80 con 0x564b95e68150 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.913+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94882637501568] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.913+0000 7fc196c13800 20 remove_watcher() i=1 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.913+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882637506000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e74e80 con 0x564b95e714a0 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.914+0000 7fc189a20640 1 -- 172.21.15.170:0/4209034367 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94882637506000] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c037040 con 0x564b95e714a0 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.914+0000 7fc196c13800 20 remove_watcher() i=2 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.914+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882637512192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e765d0 con 0x7fc17c00f070 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.915+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94882637512192] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x7fc17c00f070 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.915+0000 7fc196c13800 20 remove_watcher() i=3 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.915+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882637515744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e765d0 con 0x564b95e68150 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.916+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94882637515744] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18c00a4a0 con 0x564b95e68150 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.916+0000 7fc196c13800 20 remove_watcher() i=4 2024-04-26T12:30:33.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.916+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882637519520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e78be0 con 0x564b95e6caf0 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.917+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94882637519520] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.917+0000 7fc196c13800 20 remove_watcher() i=5 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.917+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882637516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e765d0 con 0x564b95e6caf0 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.918+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94882637516800] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.918+0000 7fc196c13800 20 remove_watcher() i=6 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.918+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882637525216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564b95e79aa0 con 0x564b95e6caf0 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc192221640 1 -- 172.21.15.170:0/4209034367 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94882637525216] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184093020 con 0x564b95e6caf0 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 20 remove_watcher() i=7 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e6caf0 msgr2=0x564b95e6eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e6caf0 0x564b95e6eee0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e68150 msgr2=0x564b95e6a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e68150 0x564b95e6a5f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc17c00f070 msgr2=0x7fc17c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc17c00f070 0x7fc17c02e910 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b95e714a0 msgr2=0x564b95e73960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b95e714a0 0x564b95e73960 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc05c0368b0 msgr2=0x7fc05c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc05c0368b0 0x7fc05c038d70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564b95e3a400 tx=0x7fc17c010000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 msgr2=0x564b95e5c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 --2- 172.21.15.170:0/4209034367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e55630 0x564b95e5c930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc184044990 tx=0x7fc18408df50 comp rx=0 tx=0).stop 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 reap_dead start 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc192a22640 1 -- 172.21.15.170:0/4209034367 reap_dead start 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 shutdown_connections 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 >> 172.21.15.170:0/4209034367 conn(0x564b95e51900 msgr2=0x564b95e4ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 shutdown_connections 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/4209034367 wait complete. 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.919+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc06c036900 msgr2=0x7fc06c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc06c036900 0x7fc06c038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x564b95e2de40 tx=0x7fc17c00f000 comp rx=0 tx=0).stop 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e48460 msgr2=0x564b95e48880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e48460 0x564b95e48880 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc18408bbf0 tx=0x7fc184076810 comp rx=0 tx=0).stop 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 shutdown_connections 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc06c036900 0x7fc06c038dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/1526050794 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95e48460 0x564b95e48880 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 >> 172.21.15.170:0/1526050794 conn(0x564b95e3c500 msgr2=0x564b95e3c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 shutdown_connections 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/1526050794 wait complete. 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e33510 msgr2=0x564b95e35900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b95e33510 0x564b95e35900 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e2e940 msgr2=0x564b95e30d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b95e2e940 0x564b95e30d30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b95e37450 msgr2=0x564b95e398a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b95e37450 0x564b95e398a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc078036950 msgr2=0x7fc078038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc078036950 0x7fc078038e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000f60 tx=0x7fc17c001370 comp rx=0 tx=0).stop 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2f730 msgr2=0x564b95e298e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 --2- 172.21.15.170:0/2275199717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b95d2f730 0x564b95e298e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc184052540 tx=0x7fc184003020 comp rx=0 tx=0).stop 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc192a22640 1 -- 172.21.15.170:0/2275199717 reap_dead start 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 shutdown_connections 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 >> 172.21.15.170:0/2275199717 conn(0x564b95d29b80 msgr2=0x564b95e1b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 shutdown_connections 2024-04-26T12:30:33.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:33.920+0000 7fc196c13800 1 -- 172.21.15.170:0/2275199717 wait complete. 2024-04-26T12:30:33.937 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-04-26T12:30:33.937 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:30:34.030 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.030 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-26T12:30:34.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-26T12:30:34.033 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-26T12:30:34.076 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.076+0000 7f33fd52a800 1 Processor -- start 2024-04-26T12:30:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.076+0000 7f33fd52a800 1 -- start start 2024-04-26T12:30:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.076+0000 7f33fd52a800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dc3d0e95c0 0x55dc3d0e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33fd52a800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc3cf960c0 con 0x55dc3d0ea730 2024-04-26T12:30:34.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33fd52a800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55dc3cf7a4d0 con 0x55dc3d0e95c0 2024-04-26T12:30:34.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33f9264640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dc3d0e95c0 0x55dc3d0e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33f9264640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dc3d0e95c0 0x55dc3d0e99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42194/0 (socket says 172.21.15.170:42194) 2024-04-26T12:30:34.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33f9264640 1 -- 172.21.15.170:0/2595905946 learned_addr learned my addr 172.21.15.170:0/2595905946 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33f0a63640 1 --1- 172.21.15.170:0/2595905946 >> v1:172.21.15.132:6789/0 conn(0x55dc3d0ea730 0x55dc3d0eabb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46190/0 (socket says 172.21.15.170:46190) 2024-04-26T12:30:34.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33f9264640 1 -- 172.21.15.170:0/2595905946 >> v1:172.21.15.132:6789/0 conn(0x55dc3d0ea730 legacy=0x55dc3d0eabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.077+0000 7f33f9264640 1 -- 172.21.15.170:0/2595905946 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3cfa7d40 con 0x55dc3d0e95c0 2024-04-26T12:30:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.079+0000 7f33f9264640 1 --2- 172.21.15.170:0/2595905946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d0e99e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a520 tx=0x7f33ec01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414ee4cfbfe59c11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.079+0000 7f33f8a63640 1 -- 172.21.15.170:0/2595905946 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec057070 con 0x55dc3d0e95c0 2024-04-26T12:30:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.079+0000 7f33f8a63640 1 -- 172.21.15.170:0/2595905946 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec052570 con 0x55dc3d0e95c0 2024-04-26T12:30:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.079+0000 7f33f8a63640 1 -- 172.21.15.170:0/2595905946 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec04ae60 con 0x55dc3d0e95c0 2024-04-26T12:30:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.079+0000 7f33fd52a800 1 -- 172.21.15.170:0/2595905946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 msgr2=0x55dc3d0e99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.079+0000 7f33fd52a800 1 --2- 172.21.15.170:0/2595905946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d0e99e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a520 tx=0x7f33ec01d010 comp rx=0 tx=0).stop 2024-04-26T12:30:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.079+0000 7f33fd52a800 1 -- 172.21.15.170:0/2595905946 shutdown_connections 2024-04-26T12:30:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.080+0000 7f33fd52a800 1 --2- 172.21.15.170:0/2595905946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d0e99e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.080+0000 7f33fd52a800 1 -- 172.21.15.170:0/2595905946 >> 172.21.15.170:0/2595905946 conn(0x55dc3d0e4b80 msgr2=0x55dc3d0e6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.080+0000 7f33fd52a800 1 -- 172.21.15.170:0/2595905946 shutdown_connections 2024-04-26T12:30:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.080+0000 7f33fd52a800 1 -- 172.21.15.170:0/2595905946 wait complete. 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.091+0000 7f33fd52a800 1 Processor -- start 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.091+0000 7f33fd52a800 1 -- start start 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.091+0000 7f33fd52a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d1dabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.091+0000 7f33fd52a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d034b40 con 0x55dc3d0e95c0 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d1dabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d1dabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42206/0 (socket says 172.21.15.170:42206) 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f33f9264640 1 -- 172.21.15.170:0/2441384008 learned_addr learned my addr 172.21.15.170:0/2441384008 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f33f9264640 1 -- 172.21.15.170:0/2441384008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3cfa6590 con 0x55dc3d0e95c0 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f33f9264640 1 --2- 172.21.15.170:0/2441384008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d1dabc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f33ec055040 tx=0x7f33ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b2ec085c82ecbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f32e7606640 1 -- 172.21.15.170:0/2441384008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec057040 con 0x55dc3d0e95c0 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f32e7606640 1 -- 172.21.15.170:0/2441384008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec052720 con 0x55dc3d0e95c0 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.092+0000 7f32e7606640 1 -- 172.21.15.170:0/2441384008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec052a40 con 0x55dc3d0e95c0 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 -- 172.21.15.170:0/2441384008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 msgr2=0x55dc3d1dabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 --2- 172.21.15.170:0/2441384008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d1dabc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f33ec055040 tx=0x7f33ec04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 -- 172.21.15.170:0/2441384008 shutdown_connections 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 --2- 172.21.15.170:0/2441384008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d1dabc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 -- 172.21.15.170:0/2441384008 >> 172.21.15.170:0/2441384008 conn(0x55dc3d0e4b80 msgr2=0x55dc3d1d64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 -- 172.21.15.170:0/2441384008 shutdown_connections 2024-04-26T12:30:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 -- 172.21.15.170:0/2441384008 wait complete. 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.093+0000 7f33fd52a800 1 Processor -- start 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33fd52a800 1 -- start start 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33fd52a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d05f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33fd52a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d0f2ba0 con 0x55dc3d0e95c0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d05f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d05f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42212/0 (socket says 172.21.15.170:42212) 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33f9264640 1 -- 172.21.15.170:0/3554049016 learned_addr learned my addr 172.21.15.170:0/3554049016 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33f9264640 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3cf9d8f0 con 0x55dc3d0e95c0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.094+0000 7f33f9264640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d05f040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f33ec052540 tx=0x7f33ec003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.095+0000 7f32e5e03640 1 -- 172.21.15.170:0/3554049016 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec073070 con 0x55dc3d0e95c0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.095+0000 7f32e5e03640 1 -- 172.21.15.170:0/3554049016 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec052c90 con 0x55dc3d0e95c0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.095+0000 7f32e5e03640 1 -- 172.21.15.170:0/3554049016 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec057070 con 0x55dc3d0e95c0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.095+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc3d05d730 con 0x55dc3d0e95c0 2024-04-26T12:30:34.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.095+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3d05dc50 con 0x55dc3d0e95c0 2024-04-26T12:30:34.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.095+0000 7f32e5e03640 1 -- 172.21.15.170:0/3554049016 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f33ec076070 con 0x55dc3d0e95c0 2024-04-26T12:30:34.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.095+0000 7f32e5e03640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32e0036900 0x7f32e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f32e5e03640 1 -- 172.21.15.170:0/3554049016 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f33ec08da60 con 0x55dc3d0e95c0 2024-04-26T12:30:34.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32e0036900 0x7f32e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d0ea730 0x55dc3d1eb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d1ebd90 con 0x55dc3d0ea730 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33f9a65640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d0ea730 0x55dc3d1eb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32e0036900 0x7f32e0038dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000f60 tx=0x7f33e4001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33f9a65640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d0ea730 0x55dc3d1eb850 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33f9a65640 1 -- 172.21.15.170:0/3554049016 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d0ea730 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.096+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d1ec190 con 0x55dc3d0ea730 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.097+0000 7f33f9a65640 1 -- 172.21.15.170:0/3554049016 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d0ea730 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.097+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d1edfa0 0x55dc3d1f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.097+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d1f0a30 con 0x55dc3d1edfa0 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.097+0000 7f33f9264640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d1edfa0 0x55dc3d1f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.097+0000 7f33f9264640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d1edfa0 0x55dc3d1f0390 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.098+0000 7f33f9264640 1 -- 172.21.15.170:0/3554049016 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f33ec075030 con 0x55dc3d1edfa0 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.098+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d1ecf50 con 0x55dc3d0ea730 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.098+0000 7f33f9a65640 1 -- 172.21.15.170:0/3554049016 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d0ea730 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.098+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dc3d1f1ee0 0x55dc3d1f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.098+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d1f4a90 con 0x55dc3d1f1ee0 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.098+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dc3d1f1ee0 0x55dc3d1f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.098+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dc3d1f1ee0 0x55dc3d1f4330 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33f0a63640 1 -- 172.21.15.170:0/3554049016 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33e400f690 con 0x55dc3d1f1ee0 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33fd52a800 1 Processor -- start 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33fd52a800 1 -- start start 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33fd52a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d202ef0 0x55dc3d203310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33fd52a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dc3cfdae60 con 0x55dc3d202ef0 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d202ef0 0x55dc3d203310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d202ef0 0x55dc3d203310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42224/0 (socket says 172.21.15.170:42224) 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.099+0000 7f33f9264640 1 -- 172.21.15.170:0/4059280631 learned_addr learned my addr 172.21.15.170:0/4059280631 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.100+0000 7f33f9264640 1 -- 172.21.15.170:0/4059280631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3d203850 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.100+0000 7f33f9264640 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d202ef0 0x55dc3d203310 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33ec052a30 tx=0x7f33ec077860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.100+0000 7f32deffd640 1 -- 172.21.15.170:0/4059280631 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec083040 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.100+0000 7f32deffd640 1 -- 172.21.15.170:0/4059280631 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec05d780 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.100+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc3d2042c0 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.100+0000 7f32deffd640 1 -- 172.21.15.170:0/4059280631 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec076950 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.100+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3d2042c0 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f32deffd640 1 -- 172.21.15.170:0/4059280631 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f33ec076b10 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f32deffd640 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32d4036950 0x7f32d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f32deffd640 1 -- 172.21.15.170:0/4059280631 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f33ec060110 con 0x55dc3d202ef0 2024-04-26T12:30:34.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f33f0a63640 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32d4036950 0x7f32d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f33fd52a800 1 Processor -- start 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f33fd52a800 1 -- start start 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f33f0a63640 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32d4036950 0x7f32d4038e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55dc3d05e720 tx=0x7f33e400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f33fd52a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d2102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.101+0000 7f33fd52a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d1db280 con 0x55dc3d20feb0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d2102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d2102d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42226/0 (socket says 172.21.15.170:42226) 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f33f9264640 1 -- 172.21.15.170:0/3865463745 learned_addr learned my addr 172.21.15.170:0/3865463745 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f33f9264640 1 -- 172.21.15.170:0/3865463745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3d2108a0 con 0x55dc3d20feb0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f33f9264640 1 --2- 172.21.15.170:0/3865463745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d2102d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0529e0 tx=0x7f33ec066870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b559775b35b7b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f32dcff9640 1 -- 172.21.15.170:0/3865463745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec078600 con 0x55dc3d20feb0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f32dcff9640 1 -- 172.21.15.170:0/3865463745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec078860 con 0x55dc3d20feb0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.102+0000 7f32dcff9640 1 -- 172.21.15.170:0/3865463745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec05c840 con 0x55dc3d20feb0 2024-04-26T12:30:34.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 -- 172.21.15.170:0/3865463745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 msgr2=0x55dc3d2102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3865463745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d2102d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0529e0 tx=0x7f33ec066870 comp rx=0 tx=0).stop 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 -- 172.21.15.170:0/3865463745 shutdown_connections 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3865463745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d2102d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 -- 172.21.15.170:0/3865463745 >> 172.21.15.170:0/3865463745 conn(0x55dc3d20c1c0 msgr2=0x55dc3d20a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 -- 172.21.15.170:0/3865463745 shutdown_connections 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 -- 172.21.15.170:0/3865463745 wait complete. 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 Processor -- start 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 -- start start 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d217290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.103+0000 7f33fd52a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dc3d210f30 con 0x55dc3d20feb0 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d217290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f33f9264640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d217290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42238/0 (socket says 172.21.15.170:42238) 2024-04-26T12:30:34.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 learned_addr learned my addr 172.21.15.170:0/3482834951 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3d2177d0 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f33f9264640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d217290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33ec052a00 tx=0x7f33ec069f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f32caffd640 1 -- 172.21.15.170:0/3482834951 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec097760 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f32caffd640 1 -- 172.21.15.170:0/3482834951 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec0b7070 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc3d2177d0 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f32caffd640 1 -- 172.21.15.170:0/3482834951 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec097a70 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.104+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3d2177d0 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.105+0000 7f32caffd640 1 -- 172.21.15.170:0/3482834951 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f33ec04da00 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.105+0000 7f32caffd640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32c40368b0 0x7f32c4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.105+0000 7f32caffd640 1 -- 172.21.15.170:0/3482834951 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f33ec0a8030 con 0x55dc3d20feb0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.105+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.105+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32c40368b0 0x7f32c4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.105+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d222a00 0x55dc3d224ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.105+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d225610 con 0x55dc3d222a00 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33f9a65640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d222a00 0x55dc3d224ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32c40368b0 0x7f32c4038d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55dc3d1f4e90 tx=0x7f33e4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33f9a65640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d222a00 0x55dc3d224ec0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 20 realm 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d225a20 con 0x55dc3d222a00 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:34.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.106+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d2262c0 con 0x55dc3d222a00 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33fd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33fd52a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d2273c0 0x55dc3d2297b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d229cf0 con 0x55dc3d2273c0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33f9264640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d2273c0 0x55dc3d2297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.107+0000 7f33f9264640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d2273c0 0x55dc3d2297b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33fd52a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33fd52a800 20 searching for the correct realm 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dc3d22bd70 0x55dc3d22e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22e900 con 0x55dc3d22bd70 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dc3d22bd70 0x55dc3d22e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dc3d22bd70 0x55dc3d22e230 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33f0a63640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33e400f070 0x7f33e402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.108+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22e900 con 0x7f33e400f070 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.109+0000 7f33f9a65640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33e400f070 0x7f33e402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.109+0000 7f33f9a65640 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33e400f070 0x7f33e402e910 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.109+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.109+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.109+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.109+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x7f33e400f070 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.110+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.111+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x7f33e400f070 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.112+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.113+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.114+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.114+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.114+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.114+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x7f33e400f070 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.115+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.116+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.116+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x7f33e400f070 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.116+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.116+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d22bd70 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.116+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.116+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d2273c0 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x55dc3d222a00 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d226660 con 0x7f33e400f070 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22a670 con 0x55dc3d222a00 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.117+0000 7f33fd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22a670 con 0x55dc3d222a00 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22a640 con 0x7f33e400f070 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 zone default found 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 4 Realm: () 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 zonegroup default 2024-04-26T12:30:34.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22aa60 con 0x55dc3d2273c0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.118+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d230760 con 0x55dc3d22bd70 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33fd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d230b00 con 0x55dc3d22bd70 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33fd52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33fd52a800 20 started sync module instance, tier type = 2024-04-26T12:30:34.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33fd52a800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.119+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22fc00 con 0x7f33e400f070 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.120+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.120+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94404406870048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d22fc00 con 0x7f33e400f070 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.120+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d231350 con 0x55dc3d222a00 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.121+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94404406870048] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.121+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.121+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94404406868272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d231350 con 0x55dc3d222a00 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.121+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d231d10 con 0x55dc3d22bd70 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.122+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94404406868272] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.122+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.122+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94404406873760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d2312c0 con 0x55dc3d22bd70 2024-04-26T12:30:34.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.122+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d232bd0 con 0x7f33e400f070 2024-04-26T12:30:34.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.124+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.124+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94404406873760] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.124+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94404406880240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d2330c0 con 0x7f33e400f070 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.124+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d233950 con 0x55dc3d222a00 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.124+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.124+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94404406882496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d2334e0 con 0x55dc3d222a00 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.124+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d234880 con 0x55dc3d2273c0 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.125+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94404406880240] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.125+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.125+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94404406881296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d234c70 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.125+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d235630 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.125+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94404406882496] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.126+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94404406881296] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.126+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.127+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94404406885696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d235630 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.127+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d235ec0 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94404406885696] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94404406890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d2360a0 con 0x55dc3d2273c0 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=0 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=1 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=2 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=3 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=4 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=5 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=6 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94404406890880] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 20 add_watcher() i=7 2024-04-26T12:30:34.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.128+0000 7f33fd52a800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.129+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d239470 con 0x55dc3d222a00 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.129+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.129+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94404406894480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d236860 con 0x55dc3d222a00 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.130+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94404406894480] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.130+0000 7f32af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.130+0000 7f33fd52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.130+0000 7f33fd52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.130+0000 7f33fd52a800 5 note: GC not initialized 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f32ae7e4640 20 reqs_thread_entry: start 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 20 Filter name: none 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f321ffff640 20 reqs_thread_entry: start 2024-04-26T12:30:34.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d26c4f0 con 0x55dc3d222a00 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d26cee0 con 0x55dc3d222a00 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.131+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d26def0 con 0x7f33e400f070 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.132+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.132+0000 7f32af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.132+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94404406894480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d236860 con 0x55dc3d222a00 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.133+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94404406894480] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.133+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94404406870048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d236440 con 0x7f33e400f070 2024-04-26T12:30:34.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.134+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94404406870048] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.134+0000 7f33fd52a800 20 remove_watcher() i=0 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.134+0000 7f33fd52a800 2 removed watcher, disabling cache 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.134+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94404406868272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d230020 con 0x55dc3d222a00 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.135+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94404406868272] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.135+0000 7f33fd52a800 20 remove_watcher() i=1 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.135+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94404406873760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d230020 con 0x55dc3d22bd70 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.137+0000 7f33f0a63640 1 -- 172.21.15.170:0/3482834951 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94404406873760] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33e4037040 con 0x55dc3d22bd70 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.137+0000 7f33fd52a800 20 remove_watcher() i=2 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.137+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94404406880240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d230ea0 con 0x7f33e400f070 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.138+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94404406880240] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x7f33e400f070 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.138+0000 7f33fd52a800 20 remove_watcher() i=3 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.138+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94404406882496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d230ea0 con 0x55dc3d222a00 2024-04-26T12:30:34.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.139+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94404406882496] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f400a4a0 con 0x55dc3d222a00 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.139+0000 7f33fd52a800 20 remove_watcher() i=4 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.139+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94404406881296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d2330c0 con 0x55dc3d2273c0 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.140+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94404406881296] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.140+0000 7f33fd52a800 20 remove_watcher() i=5 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.140+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94404406885696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d2330c0 con 0x55dc3d2273c0 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.140+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94404406885696] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.140+0000 7f33fd52a800 20 remove_watcher() i=6 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.140+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94404406890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dc3d232ca0 con 0x55dc3d2273c0 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33f9264640 1 -- 172.21.15.170:0/3482834951 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94404406890880] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ec09e070 con 0x55dc3d2273c0 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 20 remove_watcher() i=7 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d2273c0 msgr2=0x55dc3d2297b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d2273c0 0x55dc3d2297b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d222a00 msgr2=0x55dc3d224ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d222a00 0x55dc3d224ec0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33e400f070 msgr2=0x7f33e402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33e400f070 0x7f33e402e910 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dc3d22bd70 msgr2=0x55dc3d22e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dc3d22bd70 0x55dc3d22e230 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32c40368b0 msgr2=0x7f32c4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32c40368b0 0x7f32c4038d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55dc3d1f4e90 tx=0x7f33e4010000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 msgr2=0x55dc3d217290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3482834951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d20feb0 0x55dc3d217290 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33ec052a00 tx=0x7f33ec069f20 comp rx=0 tx=0).stop 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33f9a65640 1 -- 172.21.15.170:0/3482834951 reap_dead start 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 shutdown_connections 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 >> 172.21.15.170:0/3482834951 conn(0x55dc3d20c1c0 msgr2=0x55dc3d209820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 shutdown_connections 2024-04-26T12:30:34.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/3482834951 wait complete. 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32d4036950 msgr2=0x7f32d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32d4036950 0x7f32d4038e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55dc3d05e720 tx=0x7f33e400f000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d202ef0 msgr2=0x55dc3d203310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d202ef0 0x55dc3d203310 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33ec052a30 tx=0x7f33ec077860 comp rx=0 tx=0).stop 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 shutdown_connections 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32d4036950 0x7f32d4038e10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 --2- 172.21.15.170:0/4059280631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d202ef0 0x55dc3d203310 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 >> 172.21.15.170:0/4059280631 conn(0x55dc3d1f6f90 msgr2=0x55dc3d1f7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 shutdown_connections 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.142+0000 7f33fd52a800 1 -- 172.21.15.170:0/4059280631 wait complete. 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d1edfa0 msgr2=0x55dc3d1f0390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dc3d1edfa0 0x55dc3d1f0390 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d0ea730 msgr2=0x55dc3d1eb850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dc3d0ea730 0x55dc3d1eb850 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dc3d1f1ee0 msgr2=0x55dc3d1f4330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dc3d1f1ee0 0x55dc3d1f4330 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32e0036900 msgr2=0x7f32e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f32e0036900 0x7f32e0038dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000f60 tx=0x7f33e4001370 comp rx=0 tx=0).stop 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 msgr2=0x55dc3d05f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 --2- 172.21.15.170:0/3554049016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dc3d0e95c0 0x55dc3d05f040 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f33ec052540 tx=0x7f33ec003020 comp rx=0 tx=0).stop 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33f9a65640 1 -- 172.21.15.170:0/3554049016 reap_dead start 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 shutdown_connections 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 >> 172.21.15.170:0/3554049016 conn(0x55dc3d0e4b80 msgr2=0x55dc3d1d95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 shutdown_connections 2024-04-26T12:30:34.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.143+0000 7f33fd52a800 1 -- 172.21.15.170:0/3554049016 wait complete. 2024-04-26T12:30:34.162 INFO:teuthology.orchestra.run.smithi170.stdout:["myfoo"] 2024-04-26T12:30:34.162 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-26T12:30:34.201 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-26T12:30:34.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-26T12:30:34.202 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-26T12:30:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:34.243 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.242+0000 7f0ce1010800 1 Processor -- start 2024-04-26T12:30:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0ce1010800 1 -- start start 2024-04-26T12:30:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0ce1010800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dd2efa2130 0x55dd2efa06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0ce1010800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd2eed90c0 con 0x55dd2efa0c20 2024-04-26T12:30:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0ce1010800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55dd2eebd4d0 con 0x55dd2efa2130 2024-04-26T12:30:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0cdc75c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dd2efa2130 0x55dd2efa06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0cdbf5b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55dd2efa0c20 0x55dd2f034420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46206/0 (socket says 172.21.15.170:46206) 2024-04-26T12:30:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/3989822092 learned_addr learned my addr 172.21.15.170:0/3989822092 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0cdc75c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dd2efa2130 0x55dd2efa06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42248/0 (socket says 172.21.15.170:42248) 2024-04-26T12:30:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0cdc75c640 1 -- 172.21.15.170:0/3989822092 >> v1:172.21.15.132:6789/0 conn(0x55dd2efa0c20 legacy=0x55dd2f034420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.243+0000 7f0cdc75c640 1 -- 172.21.15.170:0/3989822092 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2eeead40 con 0x55dd2efa2130 2024-04-26T12:30:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.245+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/3989822092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa2130 0x55dd2efa06e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00a470 tx=0x7f0ccc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd849cf024bfdce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.245+0000 7f0cdb75a640 1 -- 172.21.15.170:0/3989822092 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc057070 con 0x55dd2efa2130 2024-04-26T12:30:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.245+0000 7f0cdb75a640 1 -- 172.21.15.170:0/3989822092 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc052570 con 0x55dd2efa2130 2024-04-26T12:30:34.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.245+0000 7f0cdb75a640 1 -- 172.21.15.170:0/3989822092 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc052870 con 0x55dd2efa2130 2024-04-26T12:30:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.246+0000 7f0ce1010800 1 -- 172.21.15.170:0/3989822092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa2130 msgr2=0x55dd2efa06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.246+0000 7f0ce1010800 1 --2- 172.21.15.170:0/3989822092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa2130 0x55dd2efa06e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00a470 tx=0x7f0ccc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.246+0000 7f0ce1010800 1 -- 172.21.15.170:0/3989822092 shutdown_connections 2024-04-26T12:30:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.246+0000 7f0ce1010800 1 --2- 172.21.15.170:0/3989822092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa2130 0x55dd2efa06e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.246+0000 7f0ce1010800 1 -- 172.21.15.170:0/3989822092 >> 172.21.15.170:0/3989822092 conn(0x55dd2f027b70 msgr2=0x55dd2f029f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.246+0000 7f0ce1010800 1 -- 172.21.15.170:0/3989822092 shutdown_connections 2024-04-26T12:30:34.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.246+0000 7f0ce1010800 1 -- 172.21.15.170:0/3989822092 wait complete. 2024-04-26T12:30:34.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.257+0000 7f0ce1010800 1 Processor -- start 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.257+0000 7f0ce1010800 1 -- start start 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.258+0000 7f0ce1010800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f11fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.258+0000 7f0ce1010800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dd2ef77b30 con 0x55dd2efa0c20 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.258+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f11fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.258+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f11fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42252/0 (socket says 172.21.15.170:42252) 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.258+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1212742813 learned_addr learned my addr 172.21.15.170:0/1212742813 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.258+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1212742813 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2eee9590 con 0x55dd2efa0c20 2024-04-26T12:30:34.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.258+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/1212742813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f11fe30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3c601a38a47886 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0bca60c640 1 -- 172.21.15.170:0/1212742813 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc057070 con 0x55dd2efa0c20 2024-04-26T12:30:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0bca60c640 1 -- 172.21.15.170:0/1212742813 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc063070 con 0x55dd2efa0c20 2024-04-26T12:30:34.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0bca60c640 1 -- 172.21.15.170:0/1212742813 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc052720 con 0x55dd2efa0c20 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0ce1010800 1 -- 172.21.15.170:0/1212742813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 msgr2=0x55dd2f11fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1212742813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f11fe30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0ce1010800 1 -- 172.21.15.170:0/1212742813 shutdown_connections 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1212742813 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f11fe30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0ce1010800 1 -- 172.21.15.170:0/1212742813 >> 172.21.15.170:0/1212742813 conn(0x55dd2f027b70 msgr2=0x55dd2f11b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0ce1010800 1 -- 172.21.15.170:0/1212742813 shutdown_connections 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.259+0000 7f0ce1010800 1 -- 172.21.15.170:0/1212742813 wait complete. 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0ce1010800 1 Processor -- start 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0ce1010800 1 -- start start 2024-04-26T12:30:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0ce1010800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f127710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0ce1010800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dd2f037df0 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f127710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f127710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42266/0 (socket says 172.21.15.170:42266) 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0cdc75c640 1 -- 172.21.15.170:0/4228906910 learned_addr learned my addr 172.21.15.170:0/4228906910 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0cdc75c640 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2eee08f0 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.260+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f127710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0bc8e09640 1 -- 172.21.15.170:0/4228906910 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc052c70 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0bc8e09640 1 -- 172.21.15.170:0/4228906910 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc06c070 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd2f127c50 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0bc8e09640 1 -- 172.21.15.170:0/4228906910 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc05e480 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2f128110 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0bc8e09640 1 -- 172.21.15.170:0/4228906910 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ccc06e030 con 0x55dd2efa0c20 2024-04-26T12:30:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0bc8e09640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bc4036950 0x7f0bc4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.261+0000 7f0bc8e09640 1 -- 172.21.15.170:0/4228906910 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0ccc08e2b0 con 0x55dd2efa0c20 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bc4036950 0x7f0bc4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2efa2130 0x55dd2f12e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f12ed00 con 0x55dd2efa2130 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0cdcf5d640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2efa2130 0x55dd2f12e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bc4036950 0x7f0bc4038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0000f60 tx=0x7f0cd00012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0cdcf5d640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2efa2130 0x55dd2f12e780 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/4228906910 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2efa2130 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.262+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f12bd50 con 0x55dd2efa2130 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.263+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/4228906910 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2efa2130 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.263+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f131010 0x55dd2f133400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.263+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f133aa0 con 0x55dd2f131010 2024-04-26T12:30:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.263+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f131010 0x55dd2f133400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.263+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f131010 0x55dd2f133400 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0cdc75c640 1 -- 172.21.15.170:0/4228906910 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ccc070410 con 0x55dd2f131010 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f12ffc0 con 0x55dd2efa2130 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/4228906910 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2efa2130 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dd2f134f50 0x55dd2f1373c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f137b20 con 0x55dd2f134f50 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dd2f134f50 0x55dd2f1373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dd2f134f50 0x55dd2f1373c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.264+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/4228906910 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f134f50 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0ce1010800 1 Processor -- start 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0ce1010800 1 -- start start 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0ce1010800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f145f50 0x55dd2f146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0ce1010800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dd2ef1de60 con 0x55dd2f145f50 2024-04-26T12:30:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f145f50 0x55dd2f146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f145f50 0x55dd2f146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42274/0 (socket says 172.21.15.170:42274) 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0cdc75c640 1 -- 172.21.15.170:0/517395588 learned_addr learned my addr 172.21.15.170:0/517395588 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.265+0000 7f0cdc75c640 1 -- 172.21.15.170:0/517395588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2f1468b0 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.266+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f145f50 0x55dd2f146370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc08c680 tx=0x7f0ccc067f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.266+0000 7f0bc1ffb640 1 -- 172.21.15.170:0/517395588 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc084040 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.266+0000 7f0bc1ffb640 1 -- 172.21.15.170:0/517395588 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc058040 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.266+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd2f147320 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.266+0000 7f0bc1ffb640 1 -- 172.21.15.170:0/517395588 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc067950 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.266+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2f147820 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.266+0000 7f0bc1ffb640 1 -- 172.21.15.170:0/517395588 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ccc009af0 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0bc1ffb640 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bb4036950 0x7f0bb4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0bc1ffb640 1 -- 172.21.15.170:0/517395588 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0ccc09ca00 con 0x55dd2f145f50 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bb4036950 0x7f0bb4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0ce1010800 1 Processor -- start 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0ce1010800 1 -- start start 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bb4036950 0x7f0bb4038e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000bf50 tx=0x7f0cd000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0ce1010800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0ce1010800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dd2f1204f0 con 0x55dd2f153190 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42278/0 (socket says 172.21.15.170:42278) 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.267+0000 7f0cdc75c640 1 -- 172.21.15.170:0/418763741 learned_addr learned my addr 172.21.15.170:0/418763741 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0cdc75c640 1 -- 172.21.15.170:0/418763741 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2f153b80 con 0x55dd2f153190 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/418763741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f1535b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc002f40 tx=0x7f0ccc0793f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b3ced8e8d651d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0bbb7fe640 1 -- 172.21.15.170:0/418763741 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc097e30 con 0x55dd2f153190 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0bbb7fe640 1 -- 172.21.15.170:0/418763741 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0ac070 con 0x55dd2f153190 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0bbb7fe640 1 -- 172.21.15.170:0/418763741 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc05e750 con 0x55dd2f153190 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0ce1010800 1 -- 172.21.15.170:0/418763741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 msgr2=0x55dd2f1535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0ce1010800 1 --2- 172.21.15.170:0/418763741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f1535b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc002f40 tx=0x7f0ccc0793f0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0ce1010800 1 -- 172.21.15.170:0/418763741 shutdown_connections 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0ce1010800 1 --2- 172.21.15.170:0/418763741 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f1535b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.268+0000 7f0ce1010800 1 -- 172.21.15.170:0/418763741 >> 172.21.15.170:0/418763741 conn(0x55dd2f14f460 msgr2=0x55dd2f14d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0ce1010800 1 -- 172.21.15.170:0/418763741 shutdown_connections 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0ce1010800 1 -- 172.21.15.170:0/418763741 wait complete. 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0ce1010800 1 Processor -- start 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0ce1010800 1 -- start start 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0ce1010800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0ce1010800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dd2f1541e0 con 0x55dd2f153190 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0cdc75c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42294/0 (socket says 172.21.15.170:42294) 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.269+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 learned_addr learned my addr 172.21.15.170:0/1854197378 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.270+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd2f15aa40 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.270+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f15a500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097e0 tx=0x7f0ccc05df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.270+0000 7f0bb9ffb640 1 -- 172.21.15.170:0/1854197378 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc04fb20 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.270+0000 7f0bb9ffb640 1 -- 172.21.15.170:0/1854197378 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0b7070 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.270+0000 7f0bb9ffb640 1 -- 172.21.15.170:0/1854197378 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ccc04f2a0 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.270+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd2f15aa40 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.270+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd2f15aa40 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0bb9ffb640 1 -- 172.21.15.170:0/1854197378 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ccc0a5040 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0bb9ffb640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bac036950 0x7f0bac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0bb9ffb640 1 -- 172.21.15.170:0/1854197378 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0ccc0a2040 con 0x55dd2f153190 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bac036950 0x7f0bac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2f165cf0 0x55dd2f168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f1688e0 con 0x55dd2f165cf0 2024-04-26T12:30:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.271+0000 7f0cdcf5d640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2f165cf0 0x55dd2f168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bac036950 0x7f0bac038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0001b60 tx=0x7f0cd0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0cdcf5d640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2f165cf0 0x55dd2f168190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 20 realm 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f168cf0 con 0x55dd2f165cf0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169590 con 0x55dd2f165cf0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.272+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0ce1010800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f16a460 0x55dd2f16c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f16cf90 con 0x55dd2f16a460 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f16a460 0x55dd2f16c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0cdc75c640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f16a460 0x55dd2f16c850 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0ce1010800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.273+0000 7f0ce1010800 20 searching for the correct realm 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dd2f16f030 0x55dd2f1714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f171bc0 con 0x55dd2f16f030 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dd2f16f030 0x55dd2f1714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dd2f16f030 0x55dd2f1714f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0cdbf5b640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0cd0038040 0x7f0cd001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f171bc0 con 0x7f0cd0038040 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.274+0000 7f0cdcf5d640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0cd0038040 0x7f0cd001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.275+0000 7f0cdcf5d640 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0cd0038040 0x7f0cd001bab0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.275+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.275+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.275+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.275+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.275+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.275+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.276+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.277+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.278+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.278+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.278+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.278+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.278+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.278+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.279+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.280+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.281+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.282+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.282+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.282+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.282+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.282+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.282+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f16d930 con 0x55dd2f165cf0 2024-04-26T12:30:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f16d930 con 0x55dd2f165cf0 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.283+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f16d930 con 0x7f0cd0038040 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 zone default found 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 4 Realm: () 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 zonegroup default 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f16dd20 con 0x55dd2f16a460 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f173a20 con 0x55dd2f16f030 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.284+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f173dc0 con 0x55dd2f16f030 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.285+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.285+0000 7f0ce1010800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.285+0000 7f0ce1010800 20 started sync module instance, tier type = 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.285+0000 7f0ce1010800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.285+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f16e560 con 0x7f0cd0038040 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.286+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.286+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94408466180624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f1733c0 con 0x7f0cd0038040 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.286+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f174610 con 0x55dd2f165cf0 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.287+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94408466180624] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.287+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.287+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94408466182384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f174610 con 0x55dd2f165cf0 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.287+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f174fd0 con 0x55dd2f16f030 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.288+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94408466182384] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.288+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.288+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94408466186592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f174580 con 0x55dd2f16f030 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.288+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f175e40 con 0x7f0cd0038040 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.289+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94408466186592] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.289+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.289+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94408466192784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f176260 con 0x7f0cd0038040 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.289+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f176c20 con 0x55dd2f165cf0 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.290+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.290+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94408466192784] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.290+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94408466196336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177040 con 0x55dd2f165cf0 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.290+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f175de0 con 0x55dd2f16a460 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.291+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94408466196336] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.291+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.291+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94408466197664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.291+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f1782e0 con 0x55dd2f16a460 2024-04-26T12:30:34.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.292+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.292+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94408466202064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f178bb0 con 0x55dd2f16a460 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.292+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f179620 con 0x55dd2f16a460 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.292+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94408466197664] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94408466202064] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94408466199936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f179170 con 0x55dd2f16a460 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 20 add_watcher() i=0 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 20 add_watcher() i=1 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 20 add_watcher() i=2 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 20 add_watcher() i=3 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 20 add_watcher() i=4 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 20 add_watcher() i=5 2024-04-26T12:30:34.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.293+0000 7f0ce1010800 20 add_watcher() i=6 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.294+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94408466199936] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.294+0000 7f0ce1010800 20 add_watcher() i=7 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.294+0000 7f0ce1010800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.294+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f17c570 con 0x55dd2f165cf0 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.294+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.295+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94408466204336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f179a30 con 0x55dd2f165cf0 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.295+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94408466204336] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0b927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0ce1010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0ce1010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0ce1010800 5 note: GC not initialized 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0b917e2640 20 reqs_thread_entry: start 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0ce1010800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0ce1010800 20 Filter name: none 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0b02ffd640 20 reqs_thread_entry: start 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.296+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f1af2c0 con 0x55dd2f16f030 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f1af2c0 con 0x55dd2f16f030 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f1af2c0 con 0x55dd2f165cf0 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.297+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.298+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.299+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.299+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.299+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.299+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.299+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.299+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16f030 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.300+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16f030 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x7f0cd0038040 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.301+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f165cf0 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f165cf0 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16f030 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x7f0cd0038040 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.302+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f165cf0 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16f030 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.303+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x7f0cd0038040 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16a460 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f165cf0 2024-04-26T12:30:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x55dd2f16f030 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.304+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f177a30 con 0x7f0cd0038040 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.305+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.305+0000 7f0ce1010800 20 RGWRados::pool_iterate: got myfoo 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.305+0000 7f0ce1010800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.305+0000 7f0b927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.305+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94408466204336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.306+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94408466204336] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.306+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94408466180624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x7f0cd0038040 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.307+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94408466180624] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.307+0000 7f0ce1010800 20 remove_watcher() i=0 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.307+0000 7f0ce1010800 2 removed watcher, disabling cache 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.307+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94408466182384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f165cf0 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.309+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94408466182384] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.309+0000 7f0ce1010800 20 remove_watcher() i=1 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.309+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94408466186592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f169930 con 0x55dd2f16f030 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.310+0000 7f0cdbf5b640 1 -- 172.21.15.170:0/1854197378 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94408466186592] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd0009050 con 0x55dd2f16f030 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.310+0000 7f0ce1010800 20 remove_watcher() i=2 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.310+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94408466192784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f172a10 con 0x7f0cd0038040 2024-04-26T12:30:34.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.310+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94408466192784] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x7f0cd0038040 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.310+0000 7f0ce1010800 20 remove_watcher() i=3 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.310+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94408466196336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f174160 con 0x55dd2f165cf0 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.311+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94408466196336] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cd400a4a0 con 0x55dd2f165cf0 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.311+0000 7f0ce1010800 20 remove_watcher() i=4 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.312+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94408466197664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f175990 con 0x55dd2f16a460 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.312+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94408466197664] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.312+0000 7f0ce1010800 20 remove_watcher() i=5 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.312+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94408466202064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f172a10 con 0x55dd2f16a460 2024-04-26T12:30:34.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.313+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94408466202064] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.313+0000 7f0ce1010800 20 remove_watcher() i=6 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.313+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94408466199936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55dd2f176770 con 0x55dd2f16a460 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.314+0000 7f0cdc75c640 1 -- 172.21.15.170:0/1854197378 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94408466199936] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ccc094020 con 0x55dd2f16a460 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.314+0000 7f0ce1010800 20 remove_watcher() i=7 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f16a460 msgr2=0x55dd2f16c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f16a460 0x55dd2f16c850 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2f165cf0 msgr2=0x55dd2f168190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2f165cf0 0x55dd2f168190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0cd0038040 msgr2=0x7f0cd001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0cd0038040 0x7f0cd001bab0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dd2f16f030 msgr2=0x55dd2f1714f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dd2f16f030 0x55dd2f1714f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bac036950 msgr2=0x7f0bac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bac036950 0x7f0bac038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0001b60 tx=0x7f0cd0010000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 msgr2=0x55dd2f15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f15a500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097e0 tx=0x7f0ccc05df60 comp rx=0 tx=0).stop 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/1854197378 reap_dead start 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 shutdown_connections 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/1854197378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f153190 0x55dd2f15a500 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 >> 172.21.15.170:0/1854197378 conn(0x55dd2f14f460 msgr2=0x55dd2f14cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 shutdown_connections 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/1854197378 wait complete. 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bb4036950 msgr2=0x7f0bb4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bb4036950 0x7f0bb4038e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000bf50 tx=0x7f0cd000f000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f145f50 msgr2=0x55dd2f146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f145f50 0x55dd2f146370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc08c680 tx=0x7f0ccc067f20 comp rx=0 tx=0).stop 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 shutdown_connections 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bb4036950 0x7f0bb4038e10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 --2- 172.21.15.170:0/517395588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2f145f50 0x55dd2f146370 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 >> 172.21.15.170:0/517395588 conn(0x55dd2f139ff0 msgr2=0x55dd2f13a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 shutdown_connections 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.315+0000 7f0ce1010800 1 -- 172.21.15.170:0/517395588 wait complete. 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f131010 msgr2=0x55dd2f133400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dd2f131010 0x55dd2f133400 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2efa2130 msgr2=0x55dd2f12e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dd2efa2130 0x55dd2f12e780 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dd2f134f50 msgr2=0x55dd2f1373c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dd2f134f50 0x55dd2f1373c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bc4036950 msgr2=0x7f0bc4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0bc4036950 0x7f0bc4038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0000f60 tx=0x7f0cd00012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 msgr2=0x55dd2f127710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 --2- 172.21.15.170:0/4228906910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dd2efa0c20 0x55dd2f127710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0cdcf5d640 1 -- 172.21.15.170:0/4228906910 reap_dead start 2024-04-26T12:30:34.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 shutdown_connections 2024-04-26T12:30:34.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 >> 172.21.15.170:0/4228906910 conn(0x55dd2f027b70 msgr2=0x55dd2f11e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 shutdown_connections 2024-04-26T12:30:34.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.316+0000 7f0ce1010800 1 -- 172.21.15.170:0/4228906910 wait complete. 2024-04-26T12:30:34.337 INFO:teuthology.orchestra.run.smithi170.stdout:["myfoo"] 2024-04-26T12:30:34.337 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-26T12:30:34.349 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.360 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.371 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.415 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-26T12:30:34.441 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.467 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.494 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:34.494 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:30:34.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:30:34.494 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T12:30:34.540 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:34.541 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:34.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.540+0000 7f7850e98800 1 Processor -- start 2024-04-26T12:30:34.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.540+0000 7f7850e98800 1 -- start start 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.540+0000 7f7850e98800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a88c16cff0 0x55a88c16f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.540+0000 7f7850e98800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a88c0190c0 con 0x55a88c16f920 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.540+0000 7f7850e98800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55a88bffd4d0 con 0x55a88c16cff0 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.541+0000 7f784e99e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a88c16cff0 0x55a88c16f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.541+0000 7f784619d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55a88c16f920 0x55a88c171d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46208/0 (socket says 172.21.15.170:46208) 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.541+0000 7f784619d640 1 -- 172.21.15.170:0/2464546529 learned_addr learned my addr 172.21.15.170:0/2464546529 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.541+0000 7f784e99e640 1 -- 172.21.15.170:0/2464546529 >> v1:172.21.15.132:6789/0 conn(0x55a88c16f920 legacy=0x55a88c171d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.541+0000 7f784e99e640 1 -- 172.21.15.170:0/2464546529 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88c02ad40 con 0x55a88c16cff0 2024-04-26T12:30:34.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f784e99e640 1 --2- 172.21.15.170:0/2464546529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16f3e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f784000a470 tx=0x7f784001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2552dcf0313e522 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f784e19d640 1 -- 172.21.15.170:0/2464546529 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840057070 con 0x55a88c16cff0 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f784e19d640 1 -- 172.21.15.170:0/2464546529 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840052570 con 0x55a88c16cff0 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f784e19d640 1 -- 172.21.15.170:0/2464546529 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840052870 con 0x55a88c16cff0 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f7850e98800 1 -- 172.21.15.170:0/2464546529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 msgr2=0x55a88c16f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f7850e98800 1 --2- 172.21.15.170:0/2464546529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16f3e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f784000a470 tx=0x7f784001ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f7850e98800 1 -- 172.21.15.170:0/2464546529 shutdown_connections 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f7850e98800 1 --2- 172.21.15.170:0/2464546529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16f3e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.543+0000 7f7850e98800 1 -- 172.21.15.170:0/2464546529 >> 172.21.15.170:0/2464546529 conn(0x55a88c1669e0 msgr2=0x55a88c168e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.544+0000 7f7850e98800 1 -- 172.21.15.170:0/2464546529 shutdown_connections 2024-04-26T12:30:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.544+0000 7f7850e98800 1 -- 172.21.15.170:0/2464546529 wait complete. 2024-04-26T12:30:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.555+0000 7f7850e98800 1 Processor -- start 2024-04-26T12:30:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.555+0000 7f7850e98800 1 -- start start 2024-04-26T12:30:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.555+0000 7f7850e98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.555+0000 7f7850e98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a88c0b7b40 con 0x55a88c16cff0 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42316/0 (socket says 172.21.15.170:42316) 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f784e99e640 1 -- 172.21.15.170:0/580549166 learned_addr learned my addr 172.21.15.170:0/580549166 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f784e99e640 1 -- 172.21.15.170:0/580549166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88c029590 con 0x55a88c16cff0 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f784e99e640 1 --2- 172.21.15.170:0/580549166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16c930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7840055040 tx=0x7f784004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1c83e2cbbba928 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f773ce09640 1 -- 172.21.15.170:0/580549166 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840057070 con 0x55a88c16cff0 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f773ce09640 1 -- 172.21.15.170:0/580549166 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840063070 con 0x55a88c16cff0 2024-04-26T12:30:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.556+0000 7f773ce09640 1 -- 172.21.15.170:0/580549166 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840052720 con 0x55a88c16cff0 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 -- 172.21.15.170:0/580549166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 msgr2=0x55a88c16c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 --2- 172.21.15.170:0/580549166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16c930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7840055040 tx=0x7f784004c000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 -- 172.21.15.170:0/580549166 shutdown_connections 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 --2- 172.21.15.170:0/580549166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c16c930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 -- 172.21.15.170:0/580549166 >> 172.21.15.170:0/580549166 conn(0x55a88c1669e0 msgr2=0x55a88c259050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 -- 172.21.15.170:0/580549166 shutdown_connections 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 -- 172.21.15.170:0/580549166 wait complete. 2024-04-26T12:30:34.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 Processor -- start 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.557+0000 7f7850e98800 1 -- start start 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.558+0000 7f7850e98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c267210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.558+0000 7f7850e98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a88c175740 con 0x55a88c16cff0 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.558+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c267210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.558+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c267210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42318/0 (socket says 172.21.15.170:42318) 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.558+0000 7f784e99e640 1 -- 172.21.15.170:0/2392892040 learned_addr learned my addr 172.21.15.170:0/2392892040 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.558+0000 7f784e99e640 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88c0208f0 con 0x55a88c16cff0 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.558+0000 7f784e99e640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c267210 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7840060040 tx=0x7f7840002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.559+0000 7f773b606640 1 -- 172.21.15.170:0/2392892040 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840052e30 con 0x55a88c16cff0 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.559+0000 7f773b606640 1 -- 172.21.15.170:0/2392892040 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784006c070 con 0x55a88c16cff0 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.559+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88c267750 con 0x55a88c16cff0 2024-04-26T12:30:34.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.559+0000 7f773b606640 1 -- 172.21.15.170:0/2392892040 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f784005e5d0 con 0x55a88c16cff0 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.559+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88c267cd0 con 0x55a88c16cff0 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.559+0000 7f773b606640 1 -- 172.21.15.170:0/2392892040 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f784005e7f0 con 0x55a88c16cff0 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f773b606640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7734036890 0x7f7734038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f773b606640 1 -- 172.21.15.170:0/2392892040 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f784008e060 con 0x55a88c16cff0 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f784619d640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7734036890 0x7f7734038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c16f920 0x55a88c26e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c26e8e0 con 0x55a88c16f920 2024-04-26T12:30:34.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f784f19f640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c16f920 0x55a88c26e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f784619d640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7734036890 0x7f7734038d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7838000f60 tx=0x7f78380012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f784f19f640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c16f920 0x55a88c26e2a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f784f19f640 1 -- 172.21.15.170:0/2392892040 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c16f920 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.560+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c26b850 con 0x55a88c16f920 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.561+0000 7f784f19f640 1 -- 172.21.15.170:0/2392892040 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c16f920 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.561+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c270c80 0x55a88c273070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.561+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c273740 con 0x55a88c270c80 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.561+0000 7f784e99e640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c270c80 0x55a88c273070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.561+0000 7f784e99e640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c270c80 0x55a88c273070 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.562+0000 7f784e99e640 1 -- 172.21.15.170:0/2392892040 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f784005ecc0 con 0x55a88c270c80 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.562+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c26fc00 con 0x55a88c16f920 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.562+0000 7f784f19f640 1 -- 172.21.15.170:0/2392892040 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c16f920 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.562+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a88c274b80 0x55a88c277010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.562+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2777a0 con 0x55a88c274b80 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.562+0000 7f784619d640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a88c274b80 0x55a88c277010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.562+0000 7f784619d640 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a88c274b80 0x55a88c277010 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f784619d640 1 -- 172.21.15.170:0/2392892040 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7838009050 con 0x55a88c274b80 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f7850e98800 1 Processor -- start 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f7850e98800 1 -- start start 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f7850e98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c285c00 0x55a88c286020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f7850e98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a88c05de60 con 0x55a88c285c00 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c285c00 0x55a88c286020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c285c00 0x55a88c286020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42322/0 (socket says 172.21.15.170:42322) 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f784e99e640 1 -- 172.21.15.170:0/1230278526 learned_addr learned my addr 172.21.15.170:0/1230278526 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.563+0000 7f784e99e640 1 -- 172.21.15.170:0/1230278526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88c286560 con 0x55a88c285c00 2024-04-26T12:30:34.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.564+0000 7f784e99e640 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c285c00 0x55a88c286020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f784005ef70 tx=0x7f7840071bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.564+0000 7f7738e01640 1 -- 172.21.15.170:0/1230278526 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840080070 con 0x55a88c285c00 2024-04-26T12:30:34.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.564+0000 7f7738e01640 1 -- 172.21.15.170:0/1230278526 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7840058040 con 0x55a88c285c00 2024-04-26T12:30:34.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.564+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88c286fd0 con 0x55a88c285c00 2024-04-26T12:30:34.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.564+0000 7f7738e01640 1 -- 172.21.15.170:0/1230278526 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840093060 con 0x55a88c285c00 2024-04-26T12:30:34.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.564+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88c2874d0 con 0x55a88c285c00 2024-04-26T12:30:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.564+0000 7f7738e01640 1 -- 172.21.15.170:0/1230278526 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f784008e9a0 con 0x55a88c285c00 2024-04-26T12:30:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f7738e01640 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7728036950 0x7f7728038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f7738e01640 1 -- 172.21.15.170:0/1230278526 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f7840085c60 con 0x55a88c285c00 2024-04-26T12:30:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f784619d640 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7728036950 0x7f7728038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f7850e98800 1 Processor -- start 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f7850e98800 1 -- start start 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f784619d640 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7728036950 0x7f7728038e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f783800bf50 tx=0x7f783800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f7850e98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c293000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f7850e98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a88c16aef0 con 0x55a88c292be0 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c293000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c293000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42324/0 (socket says 172.21.15.170:42324) 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.565+0000 7f784e99e640 1 -- 172.21.15.170:0/1109497265 learned_addr learned my addr 172.21.15.170:0/1109497265 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f784e99e640 1 -- 172.21.15.170:0/1109497265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88c2935d0 con 0x55a88c292be0 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f784e99e640 1 --2- 172.21.15.170:0/1109497265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c293000 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7840055040 tx=0x7f784007ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed048d37d7983f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f77327fc640 1 -- 172.21.15.170:0/1109497265 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78400a5020 con 0x55a88c292be0 2024-04-26T12:30:34.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f77327fc640 1 -- 172.21.15.170:0/1109497265 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784005c6e0 con 0x55a88c292be0 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f77327fc640 1 -- 172.21.15.170:0/1109497265 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f784008cdc0 con 0x55a88c292be0 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f7850e98800 1 -- 172.21.15.170:0/1109497265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 msgr2=0x55a88c293000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f7850e98800 1 --2- 172.21.15.170:0/1109497265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c293000 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7840055040 tx=0x7f784007ca70 comp rx=0 tx=0).stop 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f7850e98800 1 -- 172.21.15.170:0/1109497265 shutdown_connections 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f7850e98800 1 --2- 172.21.15.170:0/1109497265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c293000 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f7850e98800 1 -- 172.21.15.170:0/1109497265 >> 172.21.15.170:0/1109497265 conn(0x55a88c28ef40 msgr2=0x55a88c28cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f7850e98800 1 -- 172.21.15.170:0/1109497265 shutdown_connections 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.566+0000 7f7850e98800 1 -- 172.21.15.170:0/1109497265 wait complete. 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f7850e98800 1 Processor -- start 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f7850e98800 1 -- start start 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f7850e98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c299ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f7850e98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a88c293c80 con 0x55a88c292be0 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c299ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f784e99e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c299ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42336/0 (socket says 172.21.15.170:42336) 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 learned_addr learned my addr 172.21.15.170:0/1856356476 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.567+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88c29a430 con 0x55a88c292be0 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.568+0000 7f784e99e640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c299ef0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7840055040 tx=0x7f784009f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.568+0000 7f7730ff9640 1 -- 172.21.15.170:0/1856356476 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78400b9070 con 0x55a88c292be0 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.568+0000 7f7730ff9640 1 -- 172.21.15.170:0/1856356476 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784007cd10 con 0x55a88c292be0 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.568+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a88c29a430 con 0x55a88c292be0 2024-04-26T12:30:34.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.568+0000 7f7730ff9640 1 -- 172.21.15.170:0/1856356476 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7840007810 con 0x55a88c292be0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.568+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88c29a430 con 0x55a88c292be0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f7730ff9640 1 -- 172.21.15.170:0/1856356476 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f78400bc070 con 0x55a88c292be0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f7730ff9640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7718036950 0x7f7718038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f7730ff9640 1 -- 172.21.15.170:0/1856356476 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f78400b1050 con 0x55a88c292be0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f784619d640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7718036950 0x7f7718038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c2a5640 0x55a88c2a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a8250 con 0x55a88c2a5640 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f784f19f640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c2a5640 0x55a88c2a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f784619d640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7718036950 0x7f7718038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7838001b60 tx=0x7f7838010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.569+0000 7f784f19f640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c2a5640 0x55a88c2a7b00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 realm 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a8660 con 0x55a88c2a5640 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a8f00 con 0x55a88c2a5640 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c2aa000 0x55a88c2ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.570+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2ac970 con 0x55a88c2aa000 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f784e99e640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c2aa000 0x55a88c2ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f784e99e640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c2aa000 0x55a88c2ac3f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f7850e98800 20 searching for the correct realm 2024-04-26T12:30:34.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a88c2ae9a0 0x55a88c2b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b1530 con 0x55a88c2ae9a0 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f784619d640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a88c2ae9a0 0x55a88c2b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.571+0000 7f784619d640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a88c2ae9a0 0x55a88c2b0e60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.572+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.572+0000 7f784619d640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7838037040 0x7f7838036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.572+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b1530 con 0x7f7838037040 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.572+0000 7f784f19f640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7838037040 0x7f7838036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.572+0000 7f784f19f640 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7838037040 0x7f7838036410 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.573+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x7f7838037040 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.574+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x7f7838037040 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.575+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.576+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.577+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x7f7838037040 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.578+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.579+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.579+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x7f7838037040 2024-04-26T12:30:34.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.579+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.579+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.579+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.579+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2aa000 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x55a88c2a5640 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2a92a0 con 0x7f7838037040 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:34.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2ad2c0 con 0x55a88c2a5640 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.580+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2ad2c0 con 0x55a88c2a5640 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2ad290 con 0x7f7838037040 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 zone default found 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 4 Realm: () 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 zonegroup default 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2ad6b0 con 0x55a88c2aa000 2024-04-26T12:30:34.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.581+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b3390 con 0x55a88c2ae9a0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f7850e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b3730 con 0x55a88c2ae9a0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f7850e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f7850e98800 20 started sync module instance, tier type = 2024-04-26T12:30:34.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f7850e98800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.582+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b2830 con 0x7f7838037040 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.583+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.583+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182394506272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b2830 con 0x7f7838037040 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.583+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b3f80 con 0x55a88c2a5640 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.584+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182394506272] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.584+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.584+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182394504336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b3f80 con 0x55a88c2a5640 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.584+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b4940 con 0x55a88c2ae9a0 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.585+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.585+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182394512528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b5190 con 0x55a88c2ae9a0 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.585+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b5bf0 con 0x7f7838037040 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.585+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182394504336] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.586+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182394512528] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.586+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.586+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182394514656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b56d0 con 0x7f7838037040 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.586+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b6490 con 0x55a88c2a5640 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.587+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.587+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182394519440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b63b0 con 0x55a88c2a5640 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.587+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b7390 con 0x55a88c2aa000 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.588+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182394514656] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.588+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.588+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182394510032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b77b0 con 0x55a88c2aa000 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.588+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b8170 con 0x55a88c2aa000 2024-04-26T12:30:34.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.588+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182394519440] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.589+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.589+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182394521728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b8a10 con 0x55a88c2aa000 2024-04-26T12:30:34.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.589+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b93d0 con 0x55a88c2aa000 2024-04-26T12:30:34.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.589+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182394510032] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.590+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182394521728] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182394529120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b8980 con 0x55a88c2aa000 2024-04-26T12:30:34.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 20 add_watcher() i=0 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 20 add_watcher() i=1 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 20 add_watcher() i=2 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 20 add_watcher() i=3 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 20 add_watcher() i=4 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 20 add_watcher() i=5 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.593+0000 7f7850e98800 20 add_watcher() i=6 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.594+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182394529120] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.594+0000 7f7850e98800 20 add_watcher() i=7 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.594+0000 7f7850e98800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.594+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2bc400 con 0x55a88c2a5640 2024-04-26T12:30:34.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.595+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.595+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182394531616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2b97f0 con 0x55a88c2a5640 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182394531616] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f77057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f7850e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f7850e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f7850e98800 5 note: GC not initialized 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f767ffff640 20 reqs_thread_entry: start 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f7850e98800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f7850e98800 20 Filter name: none 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f767dffb640 20 reqs_thread_entry: start 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.596+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2ef750 con 0x7f7838037040 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2f0080 con 0x55a88c2a5640 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(63 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2f00c0 con 0x7f7838037040 2024-04-26T12:30:34.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.597+0000 7f7850e98800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2f17c0 con 0x55a88c2a5640 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 4.1 4:81b27428:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2f0dd0 con 0x7f7838037040 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 4.1 4:80dfd411:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2f6330 con 0x7f7838037040 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 4.1b 4:d872ae43:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2f8cc0 con 0x7f7838037040 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 4.3f 4:fcee3de0:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2fb600 con 0x7f7838037040 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 4.2f 4:f619a1d9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2fde90 con 0x55a88c2a5640 2024-04-26T12:30:34.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 4.1f 4:fb8cf372:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c300700 con 0x55a88c2ae9a0 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 4.34 4:2ee0f60e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c302f70 con 0x7f7838037040 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 4.1d 4:b8cf1840:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c305d50 con 0x55a88c2ae9a0 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 4.f 4:f359a0db:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c3086e0 con 0x55a88c2a5640 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 4.25 4:a46ce594:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c30b560 con 0x55a88c2ae9a0 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 4.11 4:89c8249d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a88c30dfb0 con 0x55a88c2aa000 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.598+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(71 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(66 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(68 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(70 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(74 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(76 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(67 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(73 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(75 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(72 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.599+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(69 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.600+0000 7f77057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.600+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182394531616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c30dfb0 con 0x55a88c2a5640 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.601+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94182394531616] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.601+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182394506272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x7f7838037040 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.601+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94182394506272] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.602+0000 7f7850e98800 20 remove_watcher() i=0 2024-04-26T12:30:34.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.602+0000 7f7850e98800 2 removed watcher, disabling cache 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.602+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182394504336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x55a88c2a5640 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.603+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94182394504336] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.603+0000 7f7850e98800 20 remove_watcher() i=1 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.603+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182394512528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x55a88c2ae9a0 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.604+0000 7f784619d640 1 -- 172.21.15.170:0/1856356476 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94182394512528] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7838009050 con 0x55a88c2ae9a0 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.604+0000 7f7850e98800 20 remove_watcher() i=2 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.604+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182394514656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x7f7838037040 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.604+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94182394514656] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x7f7838037040 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.605+0000 7f7850e98800 20 remove_watcher() i=3 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.605+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182394519440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x55a88c2a5640 2024-04-26T12:30:34.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.605+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94182394519440] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f784800a4a0 con 0x55a88c2a5640 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.605+0000 7f7850e98800 20 remove_watcher() i=4 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.605+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182394510032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x55a88c2aa000 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.606+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94182394510032] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.606+0000 7f7850e98800 20 remove_watcher() i=5 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.606+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182394521728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x55a88c2aa000 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.607+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94182394521728] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.607+0000 7f7850e98800 20 remove_watcher() i=6 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.607+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182394529120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a88c2d7fa0 con 0x55a88c2aa000 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f784e99e640 1 -- 172.21.15.170:0/1856356476 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94182394529120] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78400bb030 con 0x55a88c2aa000 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 20 remove_watcher() i=7 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c2aa000 msgr2=0x55a88c2ac3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c2aa000 0x55a88c2ac3f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c2a5640 msgr2=0x55a88c2a7b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c2a5640 0x55a88c2a7b00 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7838037040 msgr2=0x7f7838036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7838037040 0x7f7838036410 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a88c2ae9a0 msgr2=0x55a88c2b0e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.608+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a88c2ae9a0 0x55a88c2b0e60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7718036950 msgr2=0x7f7718038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7718036950 0x7f7718038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7838001b60 tx=0x7f7838010000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 msgr2=0x55a88c299ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f784f19f640 1 -- 172.21.15.170:0/1856356476 reap_dead start 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c299ef0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7840055040 tx=0x7f784009f000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 shutdown_connections 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/1856356476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c292be0 0x55a88c299ef0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 >> 172.21.15.170:0/1856356476 conn(0x55a88c28ef40 msgr2=0x55a88c28c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 shutdown_connections 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1856356476 wait complete. 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7728036950 msgr2=0x7f7728038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7728036950 0x7f7728038e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f783800bf50 tx=0x7f783800f000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c285c00 msgr2=0x55a88c286020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c285c00 0x55a88c286020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f784005ef70 tx=0x7f7840071bc0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 shutdown_connections 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7728036950 0x7f7728038e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/1230278526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c285c00 0x55a88c286020 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 >> 172.21.15.170:0/1230278526 conn(0x55a88c279ca0 msgr2=0x55a88c27a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 shutdown_connections 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/1230278526 wait complete. 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c270c80 msgr2=0x55a88c273070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a88c270c80 0x55a88c273070 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c16f920 msgr2=0x55a88c26e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a88c16f920 0x55a88c26e2a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a88c274b80 msgr2=0x55a88c277010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.609+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a88c274b80 0x55a88c277010 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7734036890 msgr2=0x7f7734038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7734036890 0x7f7734038d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7838000f60 tx=0x7f78380012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 msgr2=0x55a88c267210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 --2- 172.21.15.170:0/2392892040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a88c16cff0 0x55a88c267210 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7840060040 tx=0x7f7840002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f784f19f640 1 -- 172.21.15.170:0/2392892040 reap_dead start 2024-04-26T12:30:34.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 shutdown_connections 2024-04-26T12:30:34.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 >> 172.21.15.170:0/2392892040 conn(0x55a88c1669e0 msgr2=0x55a88c16b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 shutdown_connections 2024-04-26T12:30:34.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.610+0000 7f7850e98800 1 -- 172.21.15.170:0/2392892040 wait complete. 2024-04-26T12:30:34.635 INFO:teuthology.orchestra.run.smithi170.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"533c183d-6c44-41ed-a056-8506aff12524","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","marker":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:30:34.025118Z","creation_time":"2024-04-26T12:30:34.022086Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T12:30:34.635 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:30:34.025118Z', 'creation_time': '2024-04-26T12:30:34.022086Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:30:34.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:30:34.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-26T12:30:34.636 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-26T12:30:34.679 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:34.679 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:34.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.678+0000 7f1f97a11800 1 Processor -- start 2024-04-26T12:30:34.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.678+0000 7f1f97a11800 1 -- start start 2024-04-26T12:30:34.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.678+0000 7f1f97a11800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559f021cc970 0x559f021d5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.678+0000 7f1f97a11800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f020790c0 con 0x559f021cae30 2024-04-26T12:30:34.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.678+0000 7f1f97a11800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x559f0205d4d0 con 0x559f021cc970 2024-04-26T12:30:34.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.679+0000 7f1f92946640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559f021cc970 0x559f021d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.679+0000 7f1f93147640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559f021cae30 0x559f021cb250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46220/0 (socket says 172.21.15.170:46220) 2024-04-26T12:30:34.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.679+0000 7f1f93147640 1 -- 172.21.15.170:0/4257437737 learned_addr learned my addr 172.21.15.170:0/4257437737 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:34.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.679+0000 7f1f92946640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559f021cc970 0x559f021d5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42338/0 (socket says 172.21.15.170:42338) 2024-04-26T12:30:34.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.679+0000 7f1f92946640 1 -- 172.21.15.170:0/4257437737 >> v1:172.21.15.132:6789/0 conn(0x559f021cae30 legacy=0x559f021cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.679+0000 7f1f92145640 1 -- 172.21.15.170:0/4257437737 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182597528 0 0) 0x559f020790c0 con 0x559f021cae30 2024-04-26T12:30:34.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.679+0000 7f1f92946640 1 -- 172.21.15.170:0/4257437737 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0208ad40 con 0x559f021cc970 2024-04-26T12:30:34.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.681+0000 7f1f92946640 1 --2- 172.21.15.170:0/4257437737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cc970 0x559f021d5470 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800a470 tx=0x7f1f8801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6eea54e7f95bd06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.681+0000 7f1f92145640 1 -- 172.21.15.170:0/4257437737 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f88057070 con 0x559f021cc970 2024-04-26T12:30:34.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.681+0000 7f1f92145640 1 -- 172.21.15.170:0/4257437737 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f88052440 con 0x559f021cc970 2024-04-26T12:30:34.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.681+0000 7f1f92145640 1 -- 172.21.15.170:0/4257437737 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f88052740 con 0x559f021cc970 2024-04-26T12:30:34.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.682+0000 7f1f97a11800 1 -- 172.21.15.170:0/4257437737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cc970 msgr2=0x559f021d5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.682+0000 7f1f97a11800 1 --2- 172.21.15.170:0/4257437737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cc970 0x559f021d5470 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800a470 tx=0x7f1f8801ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:34.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.682+0000 7f1f97a11800 1 -- 172.21.15.170:0/4257437737 shutdown_connections 2024-04-26T12:30:34.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.682+0000 7f1f97a11800 1 --2- 172.21.15.170:0/4257437737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cc970 0x559f021d5470 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.682+0000 7f1f97a11800 1 -- 172.21.15.170:0/4257437737 >> 172.21.15.170:0/4257437737 conn(0x559f021c6990 msgr2=0x559f021c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.682+0000 7f1f97a11800 1 -- 172.21.15.170:0/4257437737 shutdown_connections 2024-04-26T12:30:34.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.682+0000 7f1f97a11800 1 -- 172.21.15.170:0/4257437737 wait complete. 2024-04-26T12:30:34.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.693+0000 7f1f97a11800 1 Processor -- start 2024-04-26T12:30:34.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.693+0000 7f1f97a11800 1 -- start start 2024-04-26T12:30:34.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.693+0000 7f1f97a11800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.693+0000 7f1f97a11800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f02117b40 con 0x559f021cae30 2024-04-26T12:30:34.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022bf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42348/0 (socket says 172.21.15.170:42348) 2024-04-26T12:30:34.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1f93147640 1 -- 172.21.15.170:0/435081511 learned_addr learned my addr 172.21.15.170:0/435081511 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1f93147640 1 -- 172.21.15.170:0/435081511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f02089590 con 0x559f021cae30 2024-04-26T12:30:34.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1f93147640 1 --2- 172.21.15.170:0/435081511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022bf980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1f84001630 tx=0x7f1f84001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7abe2b48cc9333 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1e8160a640 1 -- 172.21.15.170:0/435081511 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84003450 con 0x559f021cae30 2024-04-26T12:30:34.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1e8160a640 1 -- 172.21.15.170:0/435081511 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840035f0 con 0x559f021cae30 2024-04-26T12:30:34.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.694+0000 7f1e8160a640 1 -- 172.21.15.170:0/435081511 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84003990 con 0x559f021cae30 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 -- 172.21.15.170:0/435081511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 msgr2=0x559f022bf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 --2- 172.21.15.170:0/435081511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022bf980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1f84001630 tx=0x7f1f84001af0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 -- 172.21.15.170:0/435081511 shutdown_connections 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 --2- 172.21.15.170:0/435081511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022bf980 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 -- 172.21.15.170:0/435081511 >> 172.21.15.170:0/435081511 conn(0x559f021c6990 msgr2=0x559f022bb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 -- 172.21.15.170:0/435081511 shutdown_connections 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 -- 172.21.15.170:0/435081511 wait complete. 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 Processor -- start 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.695+0000 7f1f97a11800 1 -- start start 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f97a11800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f97a11800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f021d7c90 con 0x559f021cae30 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42350/0 (socket says 172.21.15.170:42350) 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f93147640 1 -- 172.21.15.170:0/1004977016 learned_addr learned my addr 172.21.15.170:0/1004977016 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f93147640 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f020808f0 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f93147640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022c7340 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1f84006fa0 tx=0x7f1f84001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1e7fe07640 1 -- 172.21.15.170:0/1004977016 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84013820 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1e7fe07640 1 -- 172.21.15.170:0/1004977016 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84023070 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1e7fe07640 1 -- 172.21.15.170:0/1004977016 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84013af0 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f022c7880 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.696+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f022c7d40 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.697+0000 7f1e7fe07640 1 -- 172.21.15.170:0/1004977016 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1f84010070 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.697+0000 7f1e7fe07640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e78036950 0x7f1e78038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.697+0000 7f1e7fe07640 1 -- 172.21.15.170:0/1004977016 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f84018070 con 0x559f021cae30 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.697+0000 7f1f92946640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e78036950 0x7f1e78038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.697+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f021cc970 0x559f022ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.697+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f022ce910 con 0x559f021cc970 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f93948640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f021cc970 0x559f022ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f92946640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e78036950 0x7f1e78038e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f88054000 tx=0x7f1f8804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f93948640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f021cc970 0x559f022ce2d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f93948640 1 -- 172.21.15.170:0/1004977016 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f021cc970 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f022cb960 con 0x559f021cc970 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f93948640 1 -- 172.21.15.170:0/1004977016 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f021cc970 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f022d0c10 0x559f022d3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.698+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f022d36f0 con 0x559f022d0c10 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.699+0000 7f1f93147640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f022d0c10 0x559f022d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.699+0000 7f1f93147640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f022d0c10 0x559f022d3000 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.699+0000 7f1f93147640 1 -- 172.21.15.170:0/1004977016 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f8401b040 con 0x559f022d0c10 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.699+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f022cfb90 con 0x559f021cc970 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.700+0000 7f1f93948640 1 -- 172.21.15.170:0/1004977016 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f021cc970 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.700+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f022d4b50 0x559f022d6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.700+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f022d7730 con 0x559f022d4b50 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.700+0000 7f1f92946640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f022d4b50 0x559f022d6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.700+0000 7f1f92946640 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f022d4b50 0x559f022d6fa0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.700+0000 7f1f92946640 1 -- 172.21.15.170:0/1004977016 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f880525f0 con 0x559f022d4b50 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f97a11800 1 Processor -- start 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f97a11800 1 -- start start 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f97a11800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022e5b90 0x559f022e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f97a11800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f020bde60 con 0x559f022e5b90 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022e5b90 0x559f022e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022e5b90 0x559f022e5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42356/0 (socket says 172.21.15.170:42356) 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f93147640 1 -- 172.21.15.170:0/1887087674 learned_addr learned my addr 172.21.15.170:0/1887087674 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f93147640 1 -- 172.21.15.170:0/1887087674 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f022e64f0 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.701+0000 7f1f93147640 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022e5b90 0x559f022e5fb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f8404a8c0 tx=0x7f1f84010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1e7d602640 1 -- 172.21.15.170:0/1887087674 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84036020 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1e7d602640 1 -- 172.21.15.170:0/1887087674 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840492d0 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f022e6f60 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1e7d602640 1 -- 172.21.15.170:0/1887087674 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84028460 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f022e7460 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1e7d602640 1 -- 172.21.15.170:0/1887087674 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1f84039020 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1e7d602640 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e6c036950 0x7f1e6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1e7d602640 1 -- 172.21.15.170:0/1887087674 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f84048610 con 0x559f022e5b90 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.702+0000 7f1f92946640 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e6c036950 0x7f1e6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f97a11800 1 Processor -- start 2024-04-26T12:30:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f97a11800 1 -- start start 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f92946640 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e6c036950 0x7f1e6c038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559f022cedb0 tx=0x7f1f88005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f97a11800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022f3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f97a11800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f022c0100 con 0x559f022f2e50 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42366/0 (socket says 172.21.15.170:42366) 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f93147640 1 -- 172.21.15.170:0/2983743618 learned_addr learned my addr 172.21.15.170:0/2983743618 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.703+0000 7f1f93147640 1 -- 172.21.15.170:0/2983743618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f022f3840 con 0x559f022f2e50 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f93147640 1 --2- 172.21.15.170:0/2983743618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022f3270 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1f84032fd0 tx=0x7f1f84028730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efb191a9271153 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1e76ffd640 1 -- 172.21.15.170:0/2983743618 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f840287e0 con 0x559f022f2e50 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1e76ffd640 1 -- 172.21.15.170:0/2983743618 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84027780 con 0x559f022f2e50 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1e76ffd640 1 -- 172.21.15.170:0/2983743618 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84043f20 con 0x559f022f2e50 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 -- 172.21.15.170:0/2983743618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 msgr2=0x559f022f3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2983743618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022f3270 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1f84032fd0 tx=0x7f1f84028730 comp rx=0 tx=0).stop 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 -- 172.21.15.170:0/2983743618 shutdown_connections 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2983743618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022f3270 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 -- 172.21.15.170:0/2983743618 >> 172.21.15.170:0/2983743618 conn(0x559f022ef170 msgr2=0x559f022ed1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 -- 172.21.15.170:0/2983743618 shutdown_connections 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 -- 172.21.15.170:0/2983743618 wait complete. 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 Processor -- start 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.704+0000 7f1f97a11800 1 -- start start 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f97a11800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022fa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f97a11800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f022f3f60 con 0x559f022f2e50 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022fa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f93147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022fa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42374/0 (socket says 172.21.15.170:42374) 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 learned_addr learned my addr 172.21.15.170:0/2824055899 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f022fa7a0 con 0x559f022f2e50 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f93147640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022fa260 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402dff0 tx=0x7f1f840482e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1e757fa640 1 -- 172.21.15.170:0/2824055899 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84032970 con 0x559f022f2e50 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1e757fa640 1 -- 172.21.15.170:0/2824055899 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f84069030 con 0x559f022f2e50 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f022fa7a0 con 0x559f022f2e50 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1e757fa640 1 -- 172.21.15.170:0/2824055899 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f84044050 con 0x559f022f2e50 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.705+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f022fa7a0 con 0x559f022f2e50 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.706+0000 7f1e757fa640 1 -- 172.21.15.170:0/2824055899 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1f8405f070 con 0x559f022f2e50 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.706+0000 7f1e757fa640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e5c036950 0x7f1e5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.706+0000 7f1e757fa640 1 -- 172.21.15.170:0/2824055899 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f8405d020 con 0x559f022f2e50 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.706+0000 7f1f92946640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e5c036950 0x7f1e5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.706+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.706+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f02305900 0x559f02307dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.706+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02308510 con 0x559f02305900 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f93948640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f02305900 0x559f02307dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f92946640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e5c036950 0x7f1e5c038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000c00 tx=0x7f1f8804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f93948640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f02305900 0x559f02307dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f02305900 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 20 realm 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02308920 con 0x559f02305900 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f02305900 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.707+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02305900 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f02305900 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f97a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02309590 con 0x559f02305900 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f02305900 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f02309f50 0x559f0230c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0230c880 con 0x559f02309f50 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f93147640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f02309f50 0x559f0230c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.708+0000 7f1f93147640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f02309f50 0x559f0230c340 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f97a11800 20 searching for the correct realm 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f0230e960 0x559f02310e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023114f0 con 0x559f0230e960 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f92946640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f0230e960 0x559f02310e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f92946640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f0230e960 0x559f02310e20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f92946640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1f88076040 0x7f1f88083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.709+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023114f0 con 0x7f1f88076040 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.710+0000 7f1f93948640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1f88076040 0x7f1f88083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.710+0000 7f1f93948640 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1f88076040 0x7f1f88083410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.710+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f8c0083e0 con 0x7f1f88076040 2024-04-26T12:30:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.710+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02309f50 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.710+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.710+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02305900 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c0083e0 con 0x559f02305900 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02305900 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02309f50 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02309f50 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x7f1f88076040 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.711+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f0230e960 2024-04-26T12:30:34.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02305900 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02309f50 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f02305900 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.712+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x7f1f88076040 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.713+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.713+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f023091f0 con 0x559f0230e960 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.713+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.713+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f0230e960 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.713+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.713+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02309f50 2024-04-26T12:30:34.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f0230e960 2024-04-26T12:30:34.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f0230e960 2024-04-26T12:30:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02305900 2024-04-26T12:30:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.714+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02305900 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02309f50 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f0230e960 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x7f1f88076040 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.715+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02305900 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02309f50 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f0230e960 2024-04-26T12:30:34.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02309f50 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.716+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x7f1f88076040 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f0230e960 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02309f50 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x559f02305900 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.717+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1f88090040 con 0x7f1f88076040 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0230d220 con 0x559f02305900 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0230d220 con 0x559f02305900 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0230d1d0 con 0x7f1f88076040 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 zone default found 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 4 Realm: () 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 zonegroup default 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.718+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0230d610 con 0x559f02309f50 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02313350 con 0x559f0230e960 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f023136f0 con 0x559f0230e960 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 20 started sync module instance, tier type = 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.719+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f0230de70 con 0x7f1f88076040 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.720+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.721+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94141424935744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02312cf0 con 0x7f1f88076040 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.721+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02313f40 con 0x559f02305900 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.722+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94141424935744] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.722+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.722+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94141424937504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02313f40 con 0x559f02305900 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.722+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02314900 con 0x559f0230e960 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.723+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.723+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94141424944208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02315150 con 0x559f0230e960 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.723+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02315bd0 con 0x7f1f88076040 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.723+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94141424937504] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.724+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94141424944208] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.724+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.724+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94141424946336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02313a90 con 0x7f1f88076040 2024-04-26T12:30:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.724+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02316470 con 0x559f02305900 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.725+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94141424946336] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.725+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.725+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94141424948928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f023163d0 con 0x559f02305900 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.725+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02316eb0 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.726+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94141424948928] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.726+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.726+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94141424951072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02316340 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.726+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02317c80 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.727+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.727+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94141424957264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02318520 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.727+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02318fe0 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.727+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94141424951072] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94141424957264] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94141424962224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02318070 con 0x559f02309f50 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 20 add_watcher() i=0 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 20 add_watcher() i=1 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 20 add_watcher() i=2 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 20 add_watcher() i=3 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 20 add_watcher() i=4 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 20 add_watcher() i=5 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.728+0000 7f1f97a11800 20 add_watcher() i=6 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.730+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94141424962224] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.730+0000 7f1f97a11800 20 add_watcher() i=7 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.730+0000 7f1f97a11800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:34.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.730+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0231c0e0 con 0x559f02305900 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.731+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.731+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94141424956064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02319560 con 0x559f02305900 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94141424956064] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f97a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f97a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f97a11800 5 note: GC not initialized 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1e48fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f97a11800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f97a11800 20 Filter name: none 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1dc27fc640 20 reqs_thread_entry: start 2024-04-26T12:30:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.732+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0234f070 con 0x559f02305900 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.733+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.733+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.733+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.733+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0234fa60 con 0x559f02305900 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.733+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.733+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.733+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02350a70 con 0x7f1f88076040 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0234e1e0 con 0x7f1f88076040 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f023507c0 con 0x559f02305900 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 4.1 4:81b27428:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0234fc10 con 0x7f1f88076040 2024-04-26T12:30:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 4.1 4:80dfd411:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02355370 con 0x7f1f88076040 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 4.1b 4:d872ae43:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0234fc10 con 0x7f1f88076040 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 4.3f 4:fcee3de0:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0234fc10 con 0x7f1f88076040 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 4.2f 4:f619a1d9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0235c9e0 con 0x559f02305900 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:72 4.1f 4:fb8cf372:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0235f3f0 con 0x559f0230e960 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 4.34 4:2ee0f60e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02361e60 con 0x7f1f88076040 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:74 4.1d 4:b8cf1840:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02364cf0 con 0x559f0230e960 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 4.f 4:f359a0db:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f02367a70 con 0x559f02305900 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:76 4.25 4:a46ce594:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0236a4e0 con 0x559f0230e960 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.734+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 4.11 4:89c8249d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f0236d370 con 0x559f02309f50 2024-04-26T12:30:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(72 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(67 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(69 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(74 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(70 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(68 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(73 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(76 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(71 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(75 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.735+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(77 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.736+0000 7f1e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.736+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94141424956064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02361e60 con 0x559f02305900 2024-04-26T12:30:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.737+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94141424956064] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.737+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94141424935744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x7f1f88076040 2024-04-26T12:30:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.738+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94141424935744] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.738+0000 7f1f97a11800 20 remove_watcher() i=0 2024-04-26T12:30:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.738+0000 7f1f97a11800 2 removed watcher, disabling cache 2024-04-26T12:30:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.738+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94141424937504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x559f02305900 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.739+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94141424937504] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.739+0000 7f1f97a11800 20 remove_watcher() i=1 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.739+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94141424944208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x559f0230e960 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.740+0000 7f1f92946640 1 -- 172.21.15.170:0/2824055899 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94141424944208] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f88081070 con 0x559f0230e960 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.740+0000 7f1f97a11800 20 remove_watcher() i=2 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.740+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94141424946336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x7f1f88076040 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.741+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94141424946336] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x7f1f88076040 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.741+0000 7f1f97a11800 20 remove_watcher() i=3 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.741+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94141424948928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x559f02305900 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.742+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94141424948928] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f8c026040 con 0x559f02305900 2024-04-26T12:30:34.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.742+0000 7f1f97a11800 20 remove_watcher() i=4 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.742+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94141424951072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x559f02309f50 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.743+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94141424951072] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.743+0000 7f1f97a11800 20 remove_watcher() i=5 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.743+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94141424957264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x559f02309f50 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.744+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94141424957264] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.744+0000 7f1f97a11800 20 remove_watcher() i=6 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.744+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94141424962224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f02337c90 con 0x559f02309f50 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f93147640 1 -- 172.21.15.170:0/2824055899 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94141424962224] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f84075070 con 0x559f02309f50 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 20 remove_watcher() i=7 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f02309f50 msgr2=0x559f0230c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f02309f50 0x559f0230c340 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f02305900 msgr2=0x559f02307dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f02305900 0x559f02307dc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1f88076040 msgr2=0x7f1f88083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1f88076040 0x7f1f88083410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f0230e960 msgr2=0x559f02310e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f0230e960 0x559f02310e20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e5c036950 msgr2=0x7f1e5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e5c036950 0x7f1e5c038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000c00 tx=0x7f1f8804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 msgr2=0x559f022fa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f93948640 1 -- 172.21.15.170:0/2824055899 reap_dead start 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022fa260 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1f8402dff0 tx=0x7f1f840482e0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 shutdown_connections 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/2824055899 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022f2e50 0x559f022fa260 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 >> 172.21.15.170:0/2824055899 conn(0x559f022ef170 msgr2=0x559f022ec7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 shutdown_connections 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/2824055899 wait complete. 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e6c036950 msgr2=0x7f1e6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e6c036950 0x7f1e6c038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559f022cedb0 tx=0x7f1f88005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022e5b90 msgr2=0x559f022e5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022e5b90 0x559f022e5fb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f8404a8c0 tx=0x7f1f84010e80 comp rx=0 tx=0).stop 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 shutdown_connections 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e6c036950 0x7f1e6c038e10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1887087674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f022e5b90 0x559f022e5fb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 >> 172.21.15.170:0/1887087674 conn(0x559f022d9c30 msgr2=0x559f022da030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 shutdown_connections 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.745+0000 7f1f97a11800 1 -- 172.21.15.170:0/1887087674 wait complete. 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f022d0c10 msgr2=0x559f022d3000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f022d0c10 0x559f022d3000 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f021cc970 msgr2=0x559f022ce2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f021cc970 0x559f022ce2d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f022d4b50 msgr2=0x559f022d6fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f022d4b50 0x559f022d6fa0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e78036950 msgr2=0x7f1e78038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e78036950 0x7f1e78038e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f88054000 tx=0x7f1f8804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 msgr2=0x559f022c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 --2- 172.21.15.170:0/1004977016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f021cae30 0x559f022c7340 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1f84006fa0 tx=0x7f1f84001250 comp rx=0 tx=0).stop 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f93948640 1 -- 172.21.15.170:0/1004977016 reap_dead start 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 shutdown_connections 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 >> 172.21.15.170:0/1004977016 conn(0x559f021c6990 msgr2=0x559f022be370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 shutdown_connections 2024-04-26T12:30:34.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.746+0000 7f1f97a11800 1 -- 172.21.15.170:0/1004977016 wait complete. 2024-04-26T12:30:34.763 INFO:teuthology.orchestra.run.smithi170.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"533c183d-6c44-41ed-a056-8506aff12524","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","marker":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:30:34.025118Z","creation_time":"2024-04-26T12:30:34.022086Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-04-26T12:30:34.763 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:30:34.025118Z', 'creation_time': '2024-04-26T12:30:34.022086Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-26T12:30:34.769 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:30:34.770 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:30:34.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:30:34.770 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T12:30:34.849 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:34.849 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:34.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.848+0000 7f5bb7003800 1 Processor -- start 2024-04-26T12:30:34.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.848+0000 7f5bb7003800 1 -- start start 2024-04-26T12:30:34.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb7003800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561365894120 0x5613658926d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb7003800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613657cb0c0 con 0x561365892c10 2024-04-26T12:30:34.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb7003800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5613657af4d0 con 0x561365894120 2024-04-26T12:30:34.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb4b02640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561365894120 0x5613658926d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb4301640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x561365892c10 0x561365926450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46224/0 (socket says 172.21.15.170:46224) 2024-04-26T12:30:34.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb4301640 1 -- 172.21.15.170:0/1030495531 learned_addr learned my addr 172.21.15.170:0/1030495531 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:34.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1030495531 >> v1:172.21.15.132:6789/0 conn(0x561365892c10 legacy=0x561365926450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.849+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1030495531 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613657dcd40 con 0x561365894120 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.851+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/1030495531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365894120 0x5613658926d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400a470 tx=0x7f5ba401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101cb9055afb9e45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.851+0000 7f5bb3b00640 1 -- 172.21.15.170:0/1030495531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4057070 con 0x561365894120 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.851+0000 7f5bb3b00640 1 -- 172.21.15.170:0/1030495531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4052570 con 0x561365894120 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.851+0000 7f5bb3b00640 1 -- 172.21.15.170:0/1030495531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4052870 con 0x561365894120 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.851+0000 7f5bb7003800 1 -- 172.21.15.170:0/1030495531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365894120 msgr2=0x5613658926d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.851+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1030495531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365894120 0x5613658926d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400a470 tx=0x7f5ba401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.852+0000 7f5bb7003800 1 -- 172.21.15.170:0/1030495531 shutdown_connections 2024-04-26T12:30:34.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.852+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1030495531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365894120 0x5613658926d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.852+0000 7f5bb7003800 1 -- 172.21.15.170:0/1030495531 >> 172.21.15.170:0/1030495531 conn(0x561365919b80 msgr2=0x56136591bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.852+0000 7f5bb7003800 1 -- 172.21.15.170:0/1030495531 shutdown_connections 2024-04-26T12:30:34.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.852+0000 7f5bb7003800 1 -- 172.21.15.170:0/1030495531 wait complete. 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.863+0000 7f5bb7003800 1 Processor -- start 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.863+0000 7f5bb7003800 1 -- start start 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.863+0000 7f5bb7003800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a11e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.863+0000 7f5bb7003800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561365869b40 con 0x561365892c10 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a11e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a11e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42400/0 (socket says 172.21.15.170:42400) 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5bb4b02640 1 -- 172.21.15.170:0/2026731159 learned_addr learned my addr 172.21.15.170:0/2026731159 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5bb4b02640 1 -- 172.21.15.170:0/2026731159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613657db590 con 0x561365892c10 2024-04-26T12:30:34.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/2026731159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a11e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4000c00 tx=0x7f5ba404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104eeae899053316 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5aa2e0d640 1 -- 172.21.15.170:0/2026731159 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4057070 con 0x561365892c10 2024-04-26T12:30:34.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5aa2e0d640 1 -- 172.21.15.170:0/2026731159 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4063070 con 0x561365892c10 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.864+0000 7f5aa2e0d640 1 -- 172.21.15.170:0/2026731159 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4052720 con 0x561365892c10 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 -- 172.21.15.170:0/2026731159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 msgr2=0x561365a11e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2026731159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a11e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4000c00 tx=0x7f5ba404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 -- 172.21.15.170:0/2026731159 shutdown_connections 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2026731159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a11e40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 -- 172.21.15.170:0/2026731159 >> 172.21.15.170:0/2026731159 conn(0x561365919b80 msgr2=0x561365a0d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 -- 172.21.15.170:0/2026731159 shutdown_connections 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 -- 172.21.15.170:0/2026731159 wait complete. 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 Processor -- start 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.865+0000 7f5bb7003800 1 -- start start 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb7003800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a19700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb7003800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561365929e20 con 0x561365892c10 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a19700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a19700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42412/0 (socket says 172.21.15.170:42412) 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb4b02640 1 -- 172.21.15.170:0/4053799460 learned_addr learned my addr 172.21.15.170:0/4053799460 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb4b02640 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613657d28f0 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a19700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4000c00 tx=0x7f5ba4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5aa160a640 1 -- 172.21.15.170:0/4053799460 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4052c70 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5aa160a640 1 -- 172.21.15.170:0/4053799460 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba406c070 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561365a19c40 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.866+0000 7f5aa160a640 1 -- 172.21.15.170:0/4053799460 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba405e480 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.867+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561365a1a100 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.867+0000 7f5aa160a640 1 -- 172.21.15.170:0/4053799460 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5ba406e030 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.867+0000 7f5aa160a640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a9c036950 0x7f5a9c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.867+0000 7f5aa160a640 1 -- 172.21.15.170:0/4053799460 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5ba408e270 con 0x561365892c10 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.867+0000 7f5bb4301640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a9c036950 0x7f5a9c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365894120 0x561365a20770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a20cf0 con 0x561365894120 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb5303640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365894120 0x561365a20770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb4301640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a9c036950 0x7f5a9c038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8000f60 tx=0x7f5ba80012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb5303640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365894120 0x561365a20770 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb5303640 1 -- 172.21.15.170:0/4053799460 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365894120 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a1dd40 con 0x561365894120 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb5303640 1 -- 172.21.15.170:0/4053799460 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365894120 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a23000 0x561365a253f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.868+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a25a90 con 0x561365a23000 2024-04-26T12:30:34.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.869+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a23000 0x561365a253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.869+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a23000 0x561365a253f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.869+0000 7f5bb4b02640 1 -- 172.21.15.170:0/4053799460 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ba4070410 con 0x561365a23000 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.869+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a21fb0 con 0x561365894120 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.870+0000 7f5bb5303640 1 -- 172.21.15.170:0/4053799460 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365894120 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.870+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561365a26f40 0x561365a293b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.870+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a29b10 con 0x561365a26f40 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.870+0000 7f5bb4301640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561365a26f40 0x561365a293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.870+0000 7f5bb4301640 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561365a26f40 0x561365a293b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.870+0000 7f5bb4301640 1 -- 172.21.15.170:0/4053799460 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a26f40 2024-04-26T12:30:34.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.870+0000 7f5bb7003800 1 Processor -- start 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb7003800 1 -- start start 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb7003800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a37f40 0x561365a38360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb7003800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56136580fe60 con 0x561365a37f40 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a37f40 0x561365a38360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a37f40 0x561365a38360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42414/0 (socket says 172.21.15.170:42414) 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb4b02640 1 -- 172.21.15.170:0/2238771319 learned_addr learned my addr 172.21.15.170:0/2238771319 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb4b02640 1 -- 172.21.15.170:0/2238771319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561365a388a0 con 0x561365a37f40 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a37f40 0x561365a38360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5ba406fb70 tx=0x7f5ba4067db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5a9a7fc640 1 -- 172.21.15.170:0/2238771319 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4084040 con 0x561365a37f40 2024-04-26T12:30:34.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5a9a7fc640 1 -- 172.21.15.170:0/2238771319 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4058040 con 0x561365a37f40 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561365a39310 con 0x561365a37f40 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.871+0000 7f5a9a7fc640 1 -- 172.21.15.170:0/2238771319 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4067a10 con 0x561365a37f40 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.872+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561365a39810 con 0x561365a37f40 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.872+0000 7f5a9a7fc640 1 -- 172.21.15.170:0/2238771319 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5ba4009af0 con 0x561365a37f40 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.872+0000 7f5a9a7fc640 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a8c036900 0x7f5a8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.872+0000 7f5a9a7fc640 1 -- 172.21.15.170:0/2238771319 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5ba409ca00 con 0x561365a37f40 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.872+0000 7f5bb4301640 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a8c036900 0x7f5a8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb7003800 1 Processor -- start 2024-04-26T12:30:34.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb4301640 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a8c036900 0x7f5a8c038dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800bf50 tx=0x7f5ba800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb7003800 1 -- start start 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb7003800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb7003800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561365a12500 con 0x561365a450b0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a454d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42424/0 (socket says 172.21.15.170:42424) 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.873+0000 7f5bb4b02640 1 -- 172.21.15.170:0/2626214710 learned_addr learned my addr 172.21.15.170:0/2626214710 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb4b02640 1 -- 172.21.15.170:0/2626214710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561365a45aa0 con 0x561365a450b0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/2626214710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a454d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ba408c940 tx=0x7f5ba406c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c97209bf9619cd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5a8bfff640 1 -- 172.21.15.170:0/2626214710 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba4002d60 con 0x561365a450b0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5a8bfff640 1 -- 172.21.15.170:0/2626214710 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40ac070 con 0x561365a450b0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5a8bfff640 1 -- 172.21.15.170:0/2626214710 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba404fba0 con 0x561365a450b0 2024-04-26T12:30:34.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb7003800 1 -- 172.21.15.170:0/2626214710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 msgr2=0x561365a454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2626214710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a454d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ba408c940 tx=0x7f5ba406c2e0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb7003800 1 -- 172.21.15.170:0/2626214710 shutdown_connections 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2626214710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a454d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb7003800 1 -- 172.21.15.170:0/2626214710 >> 172.21.15.170:0/2626214710 conn(0x561365a41410 msgr2=0x561365a3f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb7003800 1 -- 172.21.15.170:0/2626214710 shutdown_connections 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.874+0000 7f5bb7003800 1 -- 172.21.15.170:0/2626214710 wait complete. 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb7003800 1 Processor -- start 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb7003800 1 -- start start 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb7003800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a4c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb7003800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561365a46150 con 0x561365a450b0 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a4c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb4b02640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a4c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42426/0 (socket says 172.21.15.170:42426) 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 learned_addr learned my addr 172.21.15.170:0/1222463273 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561365a4c9a0 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a4c460 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4002ce0 tx=0x7f5ba406aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.875+0000 7f5a8a7fc640 1 -- 172.21.15.170:0/1222463273 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40622b0 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.876+0000 7f5a8a7fc640 1 -- 172.21.15.170:0/1222463273 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba40795d0 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.876+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561365a4c9a0 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.876+0000 7f5a8a7fc640 1 -- 172.21.15.170:0/1222463273 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ba40798f0 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.876+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561365a4c9a0 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.876+0000 7f5a8a7fc640 1 -- 172.21.15.170:0/1222463273 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5ba40a5040 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.876+0000 7f5a8a7fc640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a80036aa0 0x7f5a80038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.876+0000 7f5a8a7fc640 1 -- 172.21.15.170:0/1222463273 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5ba40a2040 con 0x561365a450b0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb4301640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a80036aa0 0x7f5a80038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365a57a30 0x561365a59ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5a640 con 0x561365a57a30 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb5303640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365a57a30 0x561365a59ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb4301640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a80036aa0 0x7f5a80038f60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001b60 tx=0x7f5ba8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb5303640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365a57a30 0x561365a59ef0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb7003800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb7003800 20 realm 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.877+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5aa50 con 0x561365a57a30 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b320 con 0x561365a57a30 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a5c1f0 0x561365a5e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5ed20 con 0x561365a5c1f0 2024-04-26T12:30:34.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.878+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a5c1f0 0x561365a5e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb4b02640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a5c1f0 0x561365a5e5e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb7003800 20 searching for the correct realm 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561365a60d80 0x561365a63220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a638f0 con 0x561365a60d80 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb4301640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561365a60d80 0x561365a63220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.879+0000 7f5bb4301640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561365a60d80 0x561365a63220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.880+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.880+0000 7f5bb4301640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5ba8038040 0x7f5ba801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.880+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a638f0 con 0x7f5ba8038040 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.880+0000 7f5bb5303640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5ba8038040 0x7f5ba801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.880+0000 7f5bb5303640 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5ba8038040 0x7f5ba801bab0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.880+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.880+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.881+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x7f5ba8038040 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.882+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x7f5ba8038040 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.883+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.884+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.885+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x7f5ba8038040 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.886+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.887+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.887+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x7f5ba8038040 2024-04-26T12:30:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.887+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.887+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a60d80 2024-04-26T12:30:34.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a5c1f0 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x561365a57a30 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561365a5b6c0 con 0x7f5ba8038040 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.888+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5f6a0 con 0x561365a57a30 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5f6a0 con 0x561365a57a30 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5f670 con 0x7f5ba8038040 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 zone default found 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 4 Realm: () 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:34.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 zonegroup default 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.889+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a5fa90 con 0x561365a5c1f0 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a65750 con 0x561365a60d80 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a65af0 con 0x561365a60d80 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 20 started sync module instance, tier type = 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.890+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a64bf0 con 0x7f5ba8038040 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.891+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.891+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94641309765600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a64bf0 con 0x7f5ba8038040 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.891+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a66340 con 0x561365a57a30 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.893+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94641309765600] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.893+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.893+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94641309763664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a66340 con 0x561365a57a30 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.893+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a66d00 con 0x561365a60d80 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.894+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.894+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94641309771856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a67550 con 0x561365a60d80 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.894+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a67fd0 con 0x7f5ba8038040 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.894+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94641309763664] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.895+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94641309771856] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.895+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.895+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94641309773984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a65e90 con 0x7f5ba8038040 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.895+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a68870 con 0x561365a57a30 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.896+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94641309773984] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.896+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.896+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94641309776576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a687f0 con 0x561365a57a30 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.896+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a69280 con 0x561365a5c1f0 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.897+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.897+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94641309781456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a69b20 con 0x561365a5c1f0 2024-04-26T12:30:34.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.897+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a6a570 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.898+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94641309776576] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.898+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94641309781456] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.898+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.898+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94641309786208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a6a910 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.898+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a6b160 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94641309786208] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94641309789360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a6b0d0 con 0x561365a5c1f0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 20 add_watcher() i=0 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 20 add_watcher() i=1 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 20 add_watcher() i=2 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 20 add_watcher() i=3 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 20 add_watcher() i=4 2024-04-26T12:30:34.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 20 add_watcher() i=5 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.899+0000 7f5bb7003800 20 add_watcher() i=6 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.900+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94641309789360] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.900+0000 7f5bb7003800 20 add_watcher() i=7 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.900+0000 7f5bb7003800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.900+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365a6ea30 con 0x561365a57a30 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.900+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.900+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94641309791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365a6bef0 con 0x561365a57a30 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.901+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94641309791568] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5a6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5bb7003800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5bb7003800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:34.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5bb7003800 5 note: GC not initialized 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5a69fe3640 20 reqs_thread_entry: start 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5bb7003800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5bb7003800 20 Filter name: none 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f59db7fe640 20 reqs_thread_entry: start 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.902+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aa1fd0 con 0x7f5ba8038040 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aa2900 con 0x561365a57a30 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(63 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:34.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aa2940 con 0x7f5ba8038040 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 20 rados->read ofs=0 len=0 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.903+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aa4030 con 0x561365a57a30 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 4.1 4:81b27428:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aa3680 con 0x7f5ba8038040 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 4.1 4:80dfd411:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aa8be0 con 0x7f5ba8038040 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 4.1b 4:d872ae43:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aab510 con 0x7f5ba8038040 2024-04-26T12:30:34.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 4.3f 4:fcee3de0:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365aa8be0 con 0x7f5ba8038040 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 4.2f 4:f619a1d9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365ab0370 con 0x561365a57a30 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 4.1f 4:fb8cf372:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365ab2d80 con 0x561365a60d80 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 4.34 4:2ee0f60e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365ab5780 con 0x7f5ba8038040 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 4.1d 4:b8cf1840:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365ab8640 con 0x561365a60d80 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 4.f 4:f359a0db:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365abb500 con 0x561365a57a30 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 4.25 4:a46ce594:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365abe3c0 con 0x561365a60d80 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 4.11 4:89c8249d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561365ac1280 con 0x561365a5c1f0 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(71 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(70 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(66 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(68 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(69 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(67 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(73 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(76 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.904+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(75 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.905+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(72 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.905+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(74 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.905+0000 7f5a6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.905+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94641309791568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365abe3c0 con 0x561365a57a30 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.906+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94641309791568] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.906+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94641309765600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365ab0370 con 0x7f5ba8038040 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.907+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94641309765600] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.907+0000 7f5bb7003800 20 remove_watcher() i=0 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.907+0000 7f5bb7003800 2 removed watcher, disabling cache 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.907+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94641309763664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365abe3c0 con 0x561365a57a30 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.908+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94641309763664] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.908+0000 7f5bb7003800 20 remove_watcher() i=1 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.908+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94641309771856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365ab0370 con 0x561365a60d80 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.909+0000 7f5bb4301640 1 -- 172.21.15.170:0/1222463273 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94641309771856] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba8009050 con 0x561365a60d80 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.909+0000 7f5bb7003800 20 remove_watcher() i=2 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.909+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94641309773984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365abe3c0 con 0x7f5ba8038040 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.910+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94641309773984] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x7f5ba8038040 2024-04-26T12:30:34.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.910+0000 7f5bb7003800 20 remove_watcher() i=3 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.910+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94641309776576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365ab0370 con 0x561365a57a30 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.911+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94641309776576] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bac00a4a0 con 0x561365a57a30 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.911+0000 7f5bb7003800 20 remove_watcher() i=4 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.911+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94641309781456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365abe3c0 con 0x561365a5c1f0 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.912+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94641309781456] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.912+0000 7f5bb7003800 20 remove_watcher() i=5 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.912+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94641309786208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365ab0370 con 0x561365a5c1f0 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.913+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94641309786208] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.913+0000 7f5bb7003800 20 remove_watcher() i=6 2024-04-26T12:30:34.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.913+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94641309789360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561365abe3c0 con 0x561365a5c1f0 2024-04-26T12:30:34.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb4b02640 1 -- 172.21.15.170:0/1222463273 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94641309789360] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ba40ce040 con 0x561365a5c1f0 2024-04-26T12:30:34.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 20 remove_watcher() i=7 2024-04-26T12:30:34.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a5c1f0 msgr2=0x561365a5e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a5c1f0 0x561365a5e5e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365a57a30 msgr2=0x561365a59ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365a57a30 0x561365a59ef0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5ba8038040 msgr2=0x7f5ba801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5ba8038040 0x7f5ba801bab0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561365a60d80 msgr2=0x561365a63220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561365a60d80 0x561365a63220 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a80036aa0 msgr2=0x7f5a80038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a80036aa0 0x7f5a80038f60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001b60 tx=0x7f5ba8010000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 msgr2=0x561365a4c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb5303640 1 -- 172.21.15.170:0/1222463273 reap_dead start 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a4c460 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4002ce0 tx=0x7f5ba406aeb0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 shutdown_connections 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 --2- 172.21.15.170:0/1222463273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a450b0 0x561365a4c460 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 >> 172.21.15.170:0/1222463273 conn(0x561365a41410 msgr2=0x561365a3ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 shutdown_connections 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.914+0000 7f5bb7003800 1 -- 172.21.15.170:0/1222463273 wait complete. 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a8c036900 msgr2=0x7f5a8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a8c036900 0x7f5a8c038dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800bf50 tx=0x7f5ba800f000 comp rx=0 tx=0).stop 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a37f40 msgr2=0x561365a38360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a37f40 0x561365a38360 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5ba406fb70 tx=0x7f5ba4067db0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 shutdown_connections 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a8c036900 0x7f5a8c038dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/2238771319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365a37f40 0x561365a38360 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 >> 172.21.15.170:0/2238771319 conn(0x561365a2bfe0 msgr2=0x561365a2c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 shutdown_connections 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/2238771319 wait complete. 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a23000 msgr2=0x561365a253f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561365a23000 0x561365a253f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365894120 msgr2=0x561365a20770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561365894120 0x561365a20770 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561365a26f40 msgr2=0x561365a293b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561365a26f40 0x561365a293b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a9c036950 msgr2=0x7f5a9c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5a9c036950 0x7f5a9c038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8000f60 tx=0x7f5ba80012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 msgr2=0x561365a19700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 --2- 172.21.15.170:0/4053799460 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561365892c10 0x561365a19700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4000c00 tx=0x7f5ba4002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb5303640 1 -- 172.21.15.170:0/4053799460 reap_dead start 2024-04-26T12:30:34.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 shutdown_connections 2024-04-26T12:30:34.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 >> 172.21.15.170:0/4053799460 conn(0x561365919b80 msgr2=0x561365a10830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 shutdown_connections 2024-04-26T12:30:34.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.915+0000 7f5bb7003800 1 -- 172.21.15.170:0/4053799460 wait complete. 2024-04-26T12:30:34.936 INFO:teuthology.orchestra.run.smithi170.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"533c183d-6c44-41ed-a056-8506aff12524","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","marker":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:30:34.025118Z","creation_time":"2024-04-26T12:30:34.022086Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T12:30:34.936 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:30:34.025118Z', 'creation_time': '2024-04-26T12:30:34.022086Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:30:34.936 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-26T12:30:34.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-26T12:30:34.936 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-26T12:30:34.980 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:34.980 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:34.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a43d29800 1 Processor -- start 2024-04-26T12:30:34.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a43d29800 1 -- start start 2024-04-26T12:30:34.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a43d29800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5601368fb890 0x5601368fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a43d29800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601367a50c0 con 0x5601368f7400 2024-04-26T12:30:34.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a43d29800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5601367894d0 con 0x5601368fb890 2024-04-26T12:30:34.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a3f14d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5601368fb890 0x5601368fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a3f14d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5601368fb890 0x5601368fdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42430/0 (socket says 172.21.15.170:42430) 2024-04-26T12:30:34.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a3f94e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5601368f7400 0x5601368f7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46230/0 (socket says 172.21.15.170:46230) 2024-04-26T12:30:34.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a3f14d640 1 -- 172.21.15.170:0/3490398382 learned_addr learned my addr 172.21.15.170:0/3490398382 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a3f14d640 1 -- 172.21.15.170:0/3490398382 >> v1:172.21.15.132:6789/0 conn(0x5601368f7400 legacy=0x5601368f7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.980+0000 7f8a3f14d640 1 -- 172.21.15.170:0/3490398382 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601367b6d40 con 0x5601368fb890 2024-04-26T12:30:34.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.982+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/3490398382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601368fdc80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400a520 tx=0x7f8a3401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2940be648e25242a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.982+0000 7f8a3e94c640 1 -- 172.21.15.170:0/3490398382 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a34057070 con 0x5601368fb890 2024-04-26T12:30:34.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.982+0000 7f8a3e94c640 1 -- 172.21.15.170:0/3490398382 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a34052570 con 0x5601368fb890 2024-04-26T12:30:34.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.982+0000 7f8a3e94c640 1 -- 172.21.15.170:0/3490398382 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3404ae60 con 0x5601368fb890 2024-04-26T12:30:34.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.983+0000 7f8a43d29800 1 -- 172.21.15.170:0/3490398382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 msgr2=0x5601368fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:34.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.983+0000 7f8a43d29800 1 --2- 172.21.15.170:0/3490398382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601368fdc80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400a520 tx=0x7f8a3401d010 comp rx=0 tx=0).stop 2024-04-26T12:30:34.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.983+0000 7f8a43d29800 1 -- 172.21.15.170:0/3490398382 shutdown_connections 2024-04-26T12:30:34.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.983+0000 7f8a43d29800 1 --2- 172.21.15.170:0/3490398382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601368fdc80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:34.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.983+0000 7f8a43d29800 1 -- 172.21.15.170:0/3490398382 >> 172.21.15.170:0/3490398382 conn(0x5601368f2a00 msgr2=0x5601368f4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:34.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.983+0000 7f8a43d29800 1 -- 172.21.15.170:0/3490398382 shutdown_connections 2024-04-26T12:30:34.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.983+0000 7f8a43d29800 1 -- 172.21.15.170:0/3490398382 wait complete. 2024-04-26T12:30:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.994+0000 7f8a43d29800 1 Processor -- start 2024-04-26T12:30:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.994+0000 7f8a43d29800 1 -- start start 2024-04-26T12:30:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.994+0000 7f8a43d29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368f7400 0x5601369e7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:34.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.994+0000 7f8a43d29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560136843b70 con 0x5601368f7400 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368f7400 0x5601369e7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368f7400 0x5601369e7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42438/0 (socket says 172.21.15.170:42438) 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f8a3f94e640 1 -- 172.21.15.170:0/976110255 learned_addr learned my addr 172.21.15.170:0/976110255 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f8a3f94e640 1 -- 172.21.15.170:0/976110255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601367b5590 con 0x5601368f7400 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/976110255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368f7400 0x5601369e7560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a30001650 tx=0x7f8a30001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a87e2a594448dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f892de0b640 1 -- 172.21.15.170:0/976110255 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30013420 con 0x5601368f7400 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f892de0b640 1 -- 172.21.15.170:0/976110255 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a300135c0 con 0x5601368f7400 2024-04-26T12:30:34.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.995+0000 7f892de0b640 1 -- 172.21.15.170:0/976110255 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a300138c0 con 0x5601368f7400 2024-04-26T12:30:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 -- 172.21.15.170:0/976110255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368f7400 msgr2=0x5601369e7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 --2- 172.21.15.170:0/976110255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368f7400 0x5601369e7560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a30001650 tx=0x7f8a30001b10 comp rx=0 tx=0).stop 2024-04-26T12:30:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 -- 172.21.15.170:0/976110255 shutdown_connections 2024-04-26T12:30:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 --2- 172.21.15.170:0/976110255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368f7400 0x5601369e7560 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 -- 172.21.15.170:0/976110255 >> 172.21.15.170:0/976110255 conn(0x5601368f2a00 msgr2=0x5601369e2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 -- 172.21.15.170:0/976110255 shutdown_connections 2024-04-26T12:30:35.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 -- 172.21.15.170:0/976110255 wait complete. 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.996+0000 7f8a43d29800 1 Processor -- start 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a43d29800 1 -- start start 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a43d29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601369f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a43d29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5601368fe550 con 0x5601368fb890 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601369f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601369f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42440/0 (socket says 172.21.15.170:42440) 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a3f94e640 1 -- 172.21.15.170:0/367429783 learned_addr learned my addr 172.21.15.170:0/367429783 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a3f94e640 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601367ac8f0 con 0x5601368fb890 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601369f3550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x5601369e82f0 tx=0x7f8a30001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8927fff640 1 -- 172.21.15.170:0/367429783 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30022020 con 0x5601368fb890 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8927fff640 1 -- 172.21.15.170:0/367429783 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a30006830 con 0x5601368fb890 2024-04-26T12:30:35.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8927fff640 1 -- 172.21.15.170:0/367429783 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30004a90 con 0x5601368fb890 2024-04-26T12:30:35.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.997+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601369f3a90 con 0x5601368fb890 2024-04-26T12:30:35.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.998+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601369f3fb0 con 0x5601368fb890 2024-04-26T12:30:35.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.998+0000 7f8927fff640 1 -- 172.21.15.170:0/367429783 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a30025020 con 0x5601368fb890 2024-04-26T12:30:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.998+0000 7f8927fff640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8928036950 0x7f8928038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.998+0000 7f8927fff640 1 -- 172.21.15.170:0/367429783 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8a30018030 con 0x5601368fb890 2024-04-26T12:30:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.998+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8928036950 0x7f8928038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5601369f85b0 0x5601369fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601369faee0 con 0x5601369f85b0 2024-04-26T12:30:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a4014f640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5601369f85b0 0x5601369fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8928036950 0x7f8928038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a34054000 tx=0x7f8a3404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a4014f640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5601369f85b0 0x5601369fa9a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a4014f640 1 -- 172.21.15.170:0/367429783 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x5601369f85b0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601369f7b70 con 0x5601369f85b0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:34.999+0000 7f8a4014f640 1 -- 172.21.15.170:0/367429783 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a380083e0 con 0x5601369f85b0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.000+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5601369fd1f0 0x5601369ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.000+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601369ffcd0 con 0x5601369fd1f0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.000+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5601369fd1f0 0x5601369ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.000+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5601369fd1f0 0x5601369ff5e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.000+0000 7f8a3f94e640 1 -- 172.21.15.170:0/367429783 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a3001b070 con 0x5601369fd1f0 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.000+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601369fc1a0 con 0x5601369f85b0 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.001+0000 7f8a4014f640 1 -- 172.21.15.170:0/367429783 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a380083e0 con 0x5601369f85b0 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.001+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560136a01130 0x560136a035a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.001+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a03d00 con 0x560136a01130 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.001+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560136a01130 0x560136a035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.001+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560136a01130 0x560136a035a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.001+0000 7f8a3f14d640 1 -- 172.21.15.170:0/367429783 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a3405a040 con 0x560136a01130 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a43d29800 1 Processor -- start 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a43d29800 1 -- start start 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a43d29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a12160 0x560136a12580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a43d29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5601367e9e60 con 0x560136a12160 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a12160 0x560136a12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a12160 0x560136a12580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42448/0 (socket says 172.21.15.170:42448) 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a3f94e640 1 -- 172.21.15.170:0/2371230924 learned_addr learned my addr 172.21.15.170:0/2371230924 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a3f94e640 1 -- 172.21.15.170:0/2371230924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560136a12ac0 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.002+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a12160 0x560136a12580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a3003efd0 tx=0x7f8a3001e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.003+0000 7f89257fa640 1 -- 172.21.15.170:0/2371230924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a300104e0 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.003+0000 7f89257fa640 1 -- 172.21.15.170:0/2371230924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a300106e0 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.003+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560136a13530 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.003+0000 7f89257fa640 1 -- 172.21.15.170:0/2371230924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30010a00 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.003+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560136a13a30 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.003+0000 7f89257fa640 1 -- 172.21.15.170:0/2371230924 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a30010070 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.003+0000 7f89257fa640 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8918036b10 0x7f8918038fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f89257fa640 1 -- 172.21.15.170:0/2371230924 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8a30039cc0 con 0x560136a12160 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8918036b10 0x7f8918038fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a43d29800 1 Processor -- start 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a43d29800 1 -- start start 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8918036b10 0x7f8918038fd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5601369fb7a0 tx=0x7f8a34005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a43d29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a1f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a43d29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5601369e7ce0 con 0x560136a1f230 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a1f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a1f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42456/0 (socket says 172.21.15.170:42456) 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.004+0000 7f8a3f94e640 1 -- 172.21.15.170:0/1753711832 learned_addr learned my addr 172.21.15.170:0/1753711832 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a3f94e640 1 -- 172.21.15.170:0/1753711832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560136a1fc20 con 0x560136a1f230 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/1753711832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a1f650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8a3001efd0 tx=0x7f8a300304c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f2bbe53051dae0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f891effd640 1 -- 172.21.15.170:0/1753711832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3003d070 con 0x560136a1f230 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f891effd640 1 -- 172.21.15.170:0/1753711832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a30027400 con 0x560136a1f230 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f891effd640 1 -- 172.21.15.170:0/1753711832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a300495a0 con 0x560136a1f230 2024-04-26T12:30:35.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a43d29800 1 -- 172.21.15.170:0/1753711832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 msgr2=0x560136a1f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a43d29800 1 --2- 172.21.15.170:0/1753711832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a1f650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8a3001efd0 tx=0x7f8a300304c0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a43d29800 1 -- 172.21.15.170:0/1753711832 shutdown_connections 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a43d29800 1 --2- 172.21.15.170:0/1753711832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a1f650 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a43d29800 1 -- 172.21.15.170:0/1753711832 >> 172.21.15.170:0/1753711832 conn(0x560136a1b590 msgr2=0x560136a195f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a43d29800 1 -- 172.21.15.170:0/1753711832 shutdown_connections 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.005+0000 7f8a43d29800 1 -- 172.21.15.170:0/1753711832 wait complete. 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a43d29800 1 Processor -- start 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a43d29800 1 -- start start 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a43d29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a26650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a43d29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560136a202d0 con 0x560136a1f230 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a26650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a3f94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a26650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42466/0 (socket says 172.21.15.170:42466) 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 learned_addr learned my addr 172.21.15.170:0/595126723 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.006+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560136a26b90 con 0x560136a1f230 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.007+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a26650 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a30026790 tx=0x7f8a30046930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.007+0000 7f891d7fa640 1 -- 172.21.15.170:0/595126723 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a300275b0 con 0x560136a1f230 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.007+0000 7f891d7fa640 1 -- 172.21.15.170:0/595126723 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a30066070 con 0x560136a1f230 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.007+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560136a26b90 con 0x560136a1f230 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.007+0000 7f891d7fa640 1 -- 172.21.15.170:0/595126723 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30012700 con 0x560136a1f230 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.007+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560136a26b90 con 0x560136a1f230 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.007+0000 7f891d7fa640 1 -- 172.21.15.170:0/595126723 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a30046a50 con 0x560136a1f230 2024-04-26T12:30:35.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f891d7fa640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8908036900 0x7f8908038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f891d7fa640 1 -- 172.21.15.170:0/595126723 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8a30016160 con 0x560136a1f230 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8908036900 0x7f8908038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560136a31d70 0x560136a34210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a34960 con 0x560136a31d70 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a4014f640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560136a31d70 0x560136a34210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8908036900 0x7f8908038dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x560136a04100 tx=0x7f8a3404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a4014f640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560136a31d70 0x560136a34210 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x560136a31d70 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a43d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a43d29800 20 realm 2024-04-26T12:30:35.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.008+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a34d90 con 0x560136a31d70 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x560136a31d70 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a31d70 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a380083e0 con 0x560136a31d70 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a359d0 con 0x560136a31d70 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a380083e0 con 0x560136a31d70 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560136a36390 0x560136a38780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a38cc0 con 0x560136a36390 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.009+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560136a36390 0x560136a38780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a3f94e640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560136a36390 0x560136a38780 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a43d29800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a43d29800 20 searching for the correct realm 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560136a3adb0 0x560136a3d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a3d940 con 0x560136a3adb0 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560136a3adb0 0x560136a3d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.010+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560136a3adb0 0x560136a3d270 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.011+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.011+0000 7f8a3f14d640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8a34074040 0x7f8a34081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.011+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a3d940 con 0x7f8a34074040 2024-04-26T12:30:35.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.011+0000 7f8a4014f640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8a34074040 0x7f8a34081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.011+0000 7f8a4014f640 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8a34074040 0x7f8a34081410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.011+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8a380083e0 con 0x7f8a34074040 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.011+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a36390 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a31d70 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a380083e0 con 0x560136a31d70 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a31d70 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a36390 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.012+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a36390 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x7f8a34074040 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a3adb0 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a31d70 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.013+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a36390 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a31d70 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x7f8a34074040 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560136a35630 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.014+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a36390 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.015+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a31d70 2024-04-26T12:30:35.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.016+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.016+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a31d70 2024-04-26T12:30:35.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.016+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.016+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a36390 2024-04-26T12:30:35.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.016+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.016+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a3adb0 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.017+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.017+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x7f8a34074040 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.017+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.017+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a31d70 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.017+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.017+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a36390 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.017+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a3adb0 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a36390 2024-04-26T12:30:35.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x7f8a34074040 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a3adb0 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.018+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a36390 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x560136a31d70 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8a3408e040 con 0x7f8a34074040 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:35.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.019+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a39670 con 0x560136a31d70 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a39670 con 0x560136a31d70 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a39640 con 0x7f8a34074040 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 zone default found 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 4 Realm: () 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 zonegroup default 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.020+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a39a60 con 0x560136a36390 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a39640 con 0x560136a3adb0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a3f7a0 con 0x560136a3adb0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 20 started sync module instance, tier type = 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.021+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a3ec40 con 0x7f8a34074040 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.022+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.022+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94563211669856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a3ec40 con 0x7f8a34074040 2024-04-26T12:30:35.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.022+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a401c0 con 0x560136a31d70 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.023+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94563211669856] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.023+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.023+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94563211672752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a3ec40 con 0x560136a31d70 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.023+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a40bd0 con 0x560136a3adb0 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.024+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.024+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94563211675424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a41470 con 0x560136a3adb0 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.025+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a41ef0 con 0x7f8a34074040 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.025+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94563211672752] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.025+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94563211675424] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.026+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.026+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94563211677632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a3e790 con 0x7f8a34074040 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.026+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a427c0 con 0x560136a31d70 2024-04-26T12:30:35.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.027+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.027+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94563211682496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a426e0 con 0x560136a31d70 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.027+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a436e0 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.027+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94563211677632] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.028+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.028+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94563211686352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a43ad0 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.028+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a44490 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.028+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94563211682496] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.030+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.030+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94563211689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a44400 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.030+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a44400 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.030+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94563211686352] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94563211689952] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94563211680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a44ea0 con 0x560136a36390 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 20 add_watcher() i=0 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 20 add_watcher() i=1 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 20 add_watcher() i=2 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 20 add_watcher() i=3 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 20 add_watcher() i=4 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 20 add_watcher() i=5 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.031+0000 7f8a43d29800 20 add_watcher() i=6 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.033+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94563211680224] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.033+0000 7f8a43d29800 20 add_watcher() i=7 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.033+0000 7f8a43d29800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.033+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a48380 con 0x560136a31d70 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.033+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.033+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94563211693728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a45770 con 0x560136a31d70 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.034+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94563211693728] v30'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.034+0000 7f88f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.034+0000 7f8a43d29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.034+0000 7f8a43d29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.034+0000 7f8a43d29800 5 note: GC not initialized 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f88f4fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f8a43d29800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f8a43d29800 20 Filter name: none 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f886e7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7b280 con 0x560136a31d70 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f8a43d29800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.035+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7c7d0 con 0x7f8a34074040 2024-04-26T12:30:35.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7c7d0 con 0x560136a31d70 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 4.1 4:81b27428:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7e280 con 0x7f8a34074040 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 4.1 4:80dfd411:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a80ed0 con 0x7f8a34074040 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 4.1b 4:d872ae43:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a83c20 con 0x7f8a34074040 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 4.3f 4:fcee3de0:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a86970 con 0x7f8a34074040 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 4.2f 4:f619a1d9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a89280 con 0x560136a31d70 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:70 4.1f 4:fb8cf372:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a83c20 con 0x560136a3adb0 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 4.34 4:2ee0f60e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a8e0e0 con 0x7f8a34074040 2024-04-26T12:30:35.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:72 4.1d 4:b8cf1840:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a90950 con 0x560136a3adb0 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.036+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(70 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 4.f 4:f359a0db:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7b9e0 con 0x560136a31d70 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(67 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:74 4.25 4:a46ce594:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a90950 con 0x560136a3adb0 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(68 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 4.11 4:89c8249d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7bea0 con 0x560136a36390 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(71 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(66 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(69 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(72 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(73 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(74 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(75 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.037+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a7bea0 con 0x7f8a34074040 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.038+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.038+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a7bea0 con 0x7f8a34074040 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.039+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.039+0000 7f8a43d29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.039+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7bea0 con 0x560136a31d70 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.040+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.040+0000 7f8a43d29800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.040+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560136a7bea0 con 0x7f8a34074040 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.040+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.041+0000 7f88f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.041+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94563211693728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a7bea0 con 0x560136a31d70 2024-04-26T12:30:35.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.042+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94563211693728] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.042+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94563211669856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x7f8a34074040 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.043+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94563211669856] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.043+0000 7f8a43d29800 20 remove_watcher() i=0 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.043+0000 7f8a43d29800 2 removed watcher, disabling cache 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.043+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94563211672752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x560136a31d70 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.044+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94563211672752] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.044+0000 7f8a43d29800 20 remove_watcher() i=1 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.044+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94563211675424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x560136a3adb0 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.045+0000 7f8a3f14d640 1 -- 172.21.15.170:0/595126723 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94563211675424] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3407f070 con 0x560136a3adb0 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.045+0000 7f8a43d29800 20 remove_watcher() i=2 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.045+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94563211677632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x7f8a34074040 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.046+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94563211677632] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x7f8a34074040 2024-04-26T12:30:35.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.046+0000 7f8a43d29800 20 remove_watcher() i=3 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.046+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94563211682496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x560136a31d70 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.047+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94563211682496] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a38026040 con 0x560136a31d70 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.047+0000 7f8a43d29800 20 remove_watcher() i=4 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.047+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94563211686352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x560136a36390 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.048+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94563211686352] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.048+0000 7f8a43d29800 20 remove_watcher() i=5 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.048+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94563211689952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x560136a36390 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.048+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94563211689952] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.048+0000 7f8a43d29800 20 remove_watcher() i=6 2024-04-26T12:30:35.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.048+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94563211680224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560136a63e80 con 0x560136a36390 2024-04-26T12:30:35.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a3f94e640 1 -- 172.21.15.170:0/595126723 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94563211680224] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a3001b070 con 0x560136a36390 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 20 remove_watcher() i=7 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560136a36390 msgr2=0x560136a38780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560136a36390 0x560136a38780 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560136a31d70 msgr2=0x560136a34210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560136a31d70 0x560136a34210 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8a34074040 msgr2=0x7f8a34081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8a34074040 0x7f8a34081410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.049+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560136a3adb0 msgr2=0x560136a3d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560136a3adb0 0x560136a3d270 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8908036900 msgr2=0x7f8908038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8908036900 0x7f8908038dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x560136a04100 tx=0x7f8a3404f000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 msgr2=0x560136a26650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a4014f640 1 -- 172.21.15.170:0/595126723 reap_dead start 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a26650 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a30026790 tx=0x7f8a30046930 comp rx=0 tx=0).stop 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 shutdown_connections 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/595126723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a1f230 0x560136a26650 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 >> 172.21.15.170:0/595126723 conn(0x560136a1b590 msgr2=0x560136a18bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 shutdown_connections 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/595126723 wait complete. 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8918036b10 msgr2=0x7f8918038fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8918036b10 0x7f8918038fd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5601369fb7a0 tx=0x7f8a34005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a12160 msgr2=0x560136a12580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a12160 0x560136a12580 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a3003efd0 tx=0x7f8a3001e4b0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 shutdown_connections 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8918036b10 0x7f8918038fd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/2371230924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560136a12160 0x560136a12580 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 >> 172.21.15.170:0/2371230924 conn(0x560136a06200 msgr2=0x560136a06600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 shutdown_connections 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/2371230924 wait complete. 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5601369fd1f0 msgr2=0x5601369ff5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5601369fd1f0 0x5601369ff5e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5601369f85b0 msgr2=0x5601369fa9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5601369f85b0 0x5601369fa9a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560136a01130 msgr2=0x560136a035a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.050+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560136a01130 0x560136a035a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8928036950 msgr2=0x7f8928038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8928036950 0x7f8928038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a34054000 tx=0x7f8a3404e000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 msgr2=0x5601369f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 --2- 172.21.15.170:0/367429783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5601368fb890 0x5601369f3550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x5601369e82f0 tx=0x7f8a30001250 comp rx=0 tx=0).stop 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a4014f640 1 -- 172.21.15.170:0/367429783 reap_dead start 2024-04-26T12:30:35.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 shutdown_connections 2024-04-26T12:30:35.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 >> 172.21.15.170:0/367429783 conn(0x5601368f2a00 msgr2=0x5601369e1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 shutdown_connections 2024-04-26T12:30:35.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.051+0000 7f8a43d29800 1 -- 172.21.15.170:0/367429783 wait complete. 2024-04-26T12:30:35.071 INFO:teuthology.orchestra.run.smithi170.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-04-26T12:30:35.039679Z","last_stats_update":"2024-04-26T12:30:35.038669Z"} 2024-04-26T12:30:35.071 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-26T12:30:35.039679Z', 'last_stats_update': '2024-04-26T12:30:35.038669Z'} 2024-04-26T12:30:35.076 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:35.076 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-26T12:30:35.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-26T12:30:35.077 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-26T12:30:35.155 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:35.155 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:35.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.155+0000 7f9863f33800 1 Processor -- start 2024-04-26T12:30:35.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.155+0000 7f9863f33800 1 -- start start 2024-04-26T12:30:35.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.155+0000 7f9863f33800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55de98a6a980 0x55de98a6cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.155+0000 7f9863f33800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de989130c0 con 0x55de98a665e0 2024-04-26T12:30:35.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.155+0000 7f9863f33800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55de988f74d0 con 0x55de98a6a980 2024-04-26T12:30:35.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.156+0000 7f9857fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55de98a6a980 0x55de98a6cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.156+0000 7f985fbf5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55de98a665e0 0x55de98a66a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46244/0 (socket says 172.21.15.170:46244) 2024-04-26T12:30:35.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.156+0000 7f985fbf5640 1 -- 172.21.15.170:0/249101985 learned_addr learned my addr 172.21.15.170:0/249101985 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:35.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.156+0000 7f9857fff640 1 -- 172.21.15.170:0/249101985 >> v1:172.21.15.132:6789/0 conn(0x55de98a665e0 legacy=0x55de98a66a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.156+0000 7f9857fff640 1 -- 172.21.15.170:0/249101985 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de98924d40 con 0x55de98a6a980 2024-04-26T12:30:35.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.158+0000 7f9857fff640 1 --2- 172.21.15.170:0/249101985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a6a980 0x55de98a6cd70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f984800a470 tx=0x7f984801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a088cd3469276f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.158+0000 7f985f3f4640 1 -- 172.21.15.170:0/249101985 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9848057070 con 0x55de98a6a980 2024-04-26T12:30:35.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.158+0000 7f985f3f4640 1 -- 172.21.15.170:0/249101985 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9848052570 con 0x55de98a6a980 2024-04-26T12:30:35.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.158+0000 7f985f3f4640 1 -- 172.21.15.170:0/249101985 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9848052870 con 0x55de98a6a980 2024-04-26T12:30:35.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.158+0000 7f9863f33800 1 -- 172.21.15.170:0/249101985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a6a980 msgr2=0x55de98a6cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.158+0000 7f9863f33800 1 --2- 172.21.15.170:0/249101985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a6a980 0x55de98a6cd70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f984800a470 tx=0x7f984801ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:35.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.159+0000 7f9863f33800 1 -- 172.21.15.170:0/249101985 shutdown_connections 2024-04-26T12:30:35.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.159+0000 7f9863f33800 1 --2- 172.21.15.170:0/249101985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a6a980 0x55de98a6cd70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.159+0000 7f9863f33800 1 -- 172.21.15.170:0/249101985 >> 172.21.15.170:0/249101985 conn(0x55de98a61ba0 msgr2=0x55de98a63fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.159+0000 7f9863f33800 1 -- 172.21.15.170:0/249101985 shutdown_connections 2024-04-26T12:30:35.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.159+0000 7f9863f33800 1 -- 172.21.15.170:0/249101985 wait complete. 2024-04-26T12:30:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.170+0000 7f9863f33800 1 Processor -- start 2024-04-26T12:30:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.170+0000 7f9863f33800 1 -- start start 2024-04-26T12:30:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.170+0000 7f9863f33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de98b57770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.170+0000 7f9863f33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55de989b1b70 con 0x55de98a665e0 2024-04-26T12:30:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de98b57770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de98b57770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42488/0 (socket says 172.21.15.170:42488) 2024-04-26T12:30:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f985fbf5640 1 -- 172.21.15.170:0/2414065172 learned_addr learned my addr 172.21.15.170:0/2414065172 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f985fbf5640 1 -- 172.21.15.170:0/2414065172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de98923590 con 0x55de98a665e0 2024-04-26T12:30:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f985fbf5640 1 --2- 172.21.15.170:0/2414065172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de98b57770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9850001e10 tx=0x7f985000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa29cb6d1330503e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f974de0b640 1 -- 172.21.15.170:0/2414065172 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9850012020 con 0x55de98a665e0 2024-04-26T12:30:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f974de0b640 1 -- 172.21.15.170:0/2414065172 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985000e5a0 con 0x55de98a665e0 2024-04-26T12:30:35.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.171+0000 7f974de0b640 1 -- 172.21.15.170:0/2414065172 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f985000e8e0 con 0x55de98a665e0 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 -- 172.21.15.170:0/2414065172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 msgr2=0x55de98b57770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 --2- 172.21.15.170:0/2414065172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de98b57770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9850001e10 tx=0x7f985000b780 comp rx=0 tx=0).stop 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 -- 172.21.15.170:0/2414065172 shutdown_connections 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 --2- 172.21.15.170:0/2414065172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de98b57770 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 -- 172.21.15.170:0/2414065172 >> 172.21.15.170:0/2414065172 conn(0x55de98a61ba0 msgr2=0x55de98b53090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 -- 172.21.15.170:0/2414065172 shutdown_connections 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 -- 172.21.15.170:0/2414065172 wait complete. 2024-04-26T12:30:35.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 Processor -- start 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 -- start start 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.172+0000 7f9863f33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de989dc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f9863f33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55de98a6d640 con 0x55de98a665e0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de989dc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de989dc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42490/0 (socket says 172.21.15.170:42490) 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f985fbf5640 1 -- 172.21.15.170:0/1096062334 learned_addr learned my addr 172.21.15.170:0/1096062334 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f985fbf5640 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9891a8f0 con 0x55de98a665e0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f985fbf5640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de989dc000 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f985000b7c0 tx=0x7f9850000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f9747fff640 1 -- 172.21.15.170:0/1096062334 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9850012030 con 0x55de98a665e0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f9747fff640 1 -- 172.21.15.170:0/1096062334 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9850001470 con 0x55de98a665e0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f9747fff640 1 -- 172.21.15.170:0/1096062334 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f985001a8d0 con 0x55de98a665e0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de989da6f0 con 0x55de98a665e0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.173+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de989dac10 con 0x55de98a665e0 2024-04-26T12:30:35.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.174+0000 7f9747fff640 1 -- 172.21.15.170:0/1096062334 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9850015020 con 0x55de98a665e0 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.174+0000 7f9747fff640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9748036900 0x7f9748038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.174+0000 7f9747fff640 1 -- 172.21.15.170:0/1096062334 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9850020030 con 0x55de98a665e0 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.174+0000 7f9857fff640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9748036900 0x7f9748038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.174+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98a6a980 0x55de98b68530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.174+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98b68a70 con 0x55de98a6a980 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f98603f6640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98a6a980 0x55de98b68530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f9857fff640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9748036900 0x7f9748038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9848054000 tx=0x7f984804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f98603f6640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98a6a980 0x55de98b68530 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f98603f6640 1 -- 172.21.15.170:0/1096062334 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98a6a980 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98b68e50 con 0x55de98a6a980 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f98603f6640 1 -- 172.21.15.170:0/1096062334 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98a6a980 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98b6ac60 0x55de98b6d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.175+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98b6d740 con 0x55de98b6ac60 2024-04-26T12:30:35.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.176+0000 7f985fbf5640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98b6ac60 0x55de98b6d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.176+0000 7f985fbf5640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98b6ac60 0x55de98b6d050 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.176+0000 7f985fbf5640 1 -- 172.21.15.170:0/1096062334 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f985002dcf0 con 0x55de98b6ac60 2024-04-26T12:30:35.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.176+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98b69c10 con 0x55de98a6a980 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.177+0000 7f98603f6640 1 -- 172.21.15.170:0/1096062334 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98a6a980 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.177+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55de98b6ebf0 0x55de98b71040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.177+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98b717a0 con 0x55de98b6ebf0 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.177+0000 7f9857fff640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55de98b6ebf0 0x55de98b71040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.177+0000 7f9857fff640 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55de98b6ebf0 0x55de98b71040 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.177+0000 7f9857fff640 1 -- 172.21.15.170:0/1096062334 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9848052a40 con 0x55de98b6ebf0 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f9863f33800 1 Processor -- start 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f9863f33800 1 -- start start 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f9863f33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b7fbc0 0x55de98b7ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f9863f33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55de98957e60 con 0x55de98b7fbc0 2024-04-26T12:30:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b7fbc0 0x55de98b7ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b7fbc0 0x55de98b7ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42494/0 (socket says 172.21.15.170:42494) 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f985fbf5640 1 -- 172.21.15.170:0/4267788005 learned_addr learned my addr 172.21.15.170:0/4267788005 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f985fbf5640 1 -- 172.21.15.170:0/4267788005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de98b80520 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f985fbf5640 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b7fbc0 0x55de98b7ffe0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f985004ad60 tx=0x7f985000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.178+0000 7f97457fa640 1 -- 172.21.15.170:0/4267788005 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f985000d500 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f97457fa640 1 -- 172.21.15.170:0/4267788005 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9850017c50 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de98b80f90 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f97457fa640 1 -- 172.21.15.170:0/4267788005 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f985001ac50 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de98b81490 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f97457fa640 1 -- 172.21.15.170:0/4267788005 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9850024420 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f97457fa640 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9738036950 0x7f9738038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f97457fa640 1 -- 172.21.15.170:0/4267788005 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9850036050 con 0x55de98b7fbc0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.179+0000 7f9857fff640 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9738036950 0x7f9738038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f9863f33800 1 Processor -- start 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f9863f33800 1 -- start start 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f9857fff640 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9738036950 0x7f9738038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55de98b69210 tx=0x7f9848005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f9863f33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b8d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f9863f33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55de98b57ef0 con 0x55de98b8cdb0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b8d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b8d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42504/0 (socket says 172.21.15.170:42504) 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.180+0000 7f985fbf5640 1 -- 172.21.15.170:0/3339922008 learned_addr learned my addr 172.21.15.170:0/3339922008 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f985fbf5640 1 -- 172.21.15.170:0/3339922008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de98b8d7a0 con 0x55de98b8cdb0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f985fbf5640 1 --2- 172.21.15.170:0/3339922008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b8d1d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f985000d6c0 tx=0x7f9850016ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ec643ccfa240d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f973effd640 1 -- 172.21.15.170:0/3339922008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9850065070 con 0x55de98b8cdb0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f973effd640 1 -- 172.21.15.170:0/3339922008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985004c370 con 0x55de98b8cdb0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f973effd640 1 -- 172.21.15.170:0/3339922008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9850024840 con 0x55de98b8cdb0 2024-04-26T12:30:35.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f9863f33800 1 -- 172.21.15.170:0/3339922008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 msgr2=0x55de98b8d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f9863f33800 1 --2- 172.21.15.170:0/3339922008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b8d1d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f985000d6c0 tx=0x7f9850016ce0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f9863f33800 1 -- 172.21.15.170:0/3339922008 shutdown_connections 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f9863f33800 1 --2- 172.21.15.170:0/3339922008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b8d1d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f9863f33800 1 -- 172.21.15.170:0/3339922008 >> 172.21.15.170:0/3339922008 conn(0x55de98b89080 msgr2=0x55de98b870e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f9863f33800 1 -- 172.21.15.170:0/3339922008 shutdown_connections 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.181+0000 7f9863f33800 1 -- 172.21.15.170:0/3339922008 wait complete. 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f9863f33800 1 Processor -- start 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f9863f33800 1 -- start start 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f9863f33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f9863f33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55de98b8de70 con 0x55de98b8cdb0 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f985fbf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b941d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42510/0 (socket says 172.21.15.170:42510) 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 learned_addr learned my addr 172.21.15.170:0/240791011 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de98b94710 con 0x55de98b8cdb0 2024-04-26T12:30:35.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.182+0000 7f985fbf5640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b941d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f985000d6c0 tx=0x7f9850005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.183+0000 7f973d7fa640 1 -- 172.21.15.170:0/240791011 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f985006f070 con 0x55de98b8cdb0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.183+0000 7f973d7fa640 1 -- 172.21.15.170:0/240791011 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9850030db0 con 0x55de98b8cdb0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.183+0000 7f973d7fa640 1 -- 172.21.15.170:0/240791011 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9850065040 con 0x55de98b8cdb0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.183+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de98b94710 con 0x55de98b8cdb0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.183+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de98b94710 con 0x55de98b8cdb0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.183+0000 7f973d7fa640 1 -- 172.21.15.170:0/240791011 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9850072070 con 0x55de98b8cdb0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f973d7fa640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9728036950 0x7f9728038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f973d7fa640 1 -- 172.21.15.170:0/240791011 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f985005d070 con 0x55de98b8cdb0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f9857fff640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9728036950 0x7f9728038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f9857fff640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9728036950 0x7f9728038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9848052fd0 tx=0x7f984804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98b9f9d0 0x55de98ba1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba25e0 con 0x55de98b9f9d0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f98603f6640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98b9f9d0 0x55de98ba1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.184+0000 7f98603f6640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98b9f9d0 0x55de98ba1e90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 realm 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba29f0 con 0x55de98b9f9d0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba32c0 con 0x55de98b9f9d0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98b9f9d0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98ba43c0 0x55de98ba67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.185+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba6dc0 con 0x55de98ba43c0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f985fbf5640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98ba43c0 0x55de98ba67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f985fbf5640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98ba43c0 0x55de98ba67b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f9863f33800 20 searching for the correct realm 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55de98ba8d70 0x55de98bab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98bab900 con 0x55de98ba8d70 2024-04-26T12:30:35.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.186+0000 7f9857fff640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55de98ba8d70 0x55de98bab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.187+0000 7f9857fff640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55de98ba8d70 0x55de98bab230 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.187+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.187+0000 7f9857fff640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9848076040 0x7f9848083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.187+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98bab900 con 0x7f9848076040 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.187+0000 7f98603f6640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9848076040 0x7f9848083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f98603f6640 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9848076040 0x7f9848083410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98ba43c0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98b9f9d0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98b9f9d0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.188+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98ba43c0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98ba43c0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x7f9848076040 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98ba8d70 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.189+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98b9f9d0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98ba43c0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98b9f9d0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x7f9848076040 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.190+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba3660 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba43c0 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.191+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98b9f9d0 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98b9f9d0 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba43c0 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba8d70 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.192+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x7f9848076040 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.193+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.193+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98b9f9d0 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.193+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.193+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba43c0 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.193+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.193+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba8d70 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba43c0 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x7f9848076040 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba8d70 2024-04-26T12:30:35.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.194+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98ba43c0 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.195+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.195+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x55de98b9f9d0 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.195+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.195+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9848090040 con 0x7f9848076040 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.195+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba7680 con 0x55de98b9f9d0 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba7680 con 0x55de98b9f9d0 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba7680 con 0x7f9848076040 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 zone default found 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 4 Realm: () 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:35.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 zonegroup default 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.196+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98ba7f20 con 0x55de98ba43c0 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f9863f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98bad760 con 0x55de98ba8d70 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f9863f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.197+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98badb00 con 0x55de98ba8d70 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.198+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.198+0000 7f9863f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.198+0000 7f9863f33800 20 started sync module instance, tier type = 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.198+0000 7f9863f33800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.198+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bacc00 con 0x7f9848076040 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.199+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.199+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94414533480736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bacc00 con 0x7f9848076040 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.199+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bae350 con 0x55de98b9f9d0 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.200+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94414533480736] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.200+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.200+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94414533484672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bacc00 con 0x55de98b9f9d0 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.200+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98baedd0 con 0x55de98ba8d70 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.201+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.201+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94414533486816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98baf6a0 con 0x55de98ba8d70 2024-04-26T12:30:35.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.201+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb0120 con 0x7f9848076040 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.202+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94414533484672] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.202+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94414533486816] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.203+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.203+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94414533489136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bac750 con 0x7f9848076040 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.203+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb09c0 con 0x55de98b9f9d0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.204+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94414533489136] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.204+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.204+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94414533491728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb0970 con 0x55de98b9f9d0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.204+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb13d0 con 0x55de98ba43c0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.205+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.205+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94414533496608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb1c70 con 0x55de98ba43c0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.205+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb26c0 con 0x55de98ba43c0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.205+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94414533491728] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.205+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.205+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94414533501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb2680 con 0x55de98ba43c0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.206+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb3100 con 0x55de98ba43c0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.206+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94414533496608] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94414533503984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb30c0 con 0x55de98ba43c0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 20 add_watcher() i=0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 20 add_watcher() i=1 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 20 add_watcher() i=2 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 20 add_watcher() i=3 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 20 add_watcher() i=4 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 20 add_watcher() i=5 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94414533501360] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.207+0000 7f9863f33800 20 add_watcher() i=6 2024-04-26T12:30:35.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.208+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94414533503984] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.208+0000 7f9863f33800 20 add_watcher() i=7 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.208+0000 7f9863f33800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.208+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb04c0 con 0x55de98b9f9d0 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.208+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.208+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94414533498736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb04c0 con 0x55de98b9f9d0 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.209+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94414533498736] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 5 note: GC not initialized 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9714fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 20 Filter name: none 2024-04-26T12:30:35.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f968e7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98be9780 con 0x55de98b9f9d0 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.210+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98be92a0 con 0x7f9848076040 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:35.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98bed020 con 0x55de98b9f9d0 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f985800a4a0 con 0x55de98b9f9d0 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T12:30:35.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.211+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf0720 con 0x7f9848076040 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98bef860 con 0x7f9848076040 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f985800a4a0 con 0x7f9848076040 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.213+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf4420 con 0x7f9848076040 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f985804d040 con 0x7f9848076040 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f9863f33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f9863f33800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f9863f33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94414533770928 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf1240 con 0x55de98ba43c0 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== watch-notify(notify (1) cookie 94414533501360 notify 128849018887 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55de98b80f90 con 0x55de98ba43c0 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f973effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94414533501360 notifier 4488 bl.length()=338 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f973effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f973effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(68 notify.6 [notify cookie 94414533770928 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.214+0000 7f973effd640 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9724003ea0 con 0x55de98ba43c0 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.215+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.215+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== watch-notify(notify_complete (2) cookie 94414533770928 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55de98b80520 con 0x55de98ba43c0 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.215+0000 7f9715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.215+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94414533498736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf3eb0 con 0x55de98b9f9d0 2024-04-26T12:30:35.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.216+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94414533498736] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f985804d040 con 0x55de98b9f9d0 2024-04-26T12:30:35.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.216+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94414533480736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf3eb0 con 0x7f9848076040 2024-04-26T12:30:35.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.217+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94414533480736] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985804d040 con 0x7f9848076040 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.217+0000 7f9863f33800 20 remove_watcher() i=0 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.217+0000 7f9863f33800 2 removed watcher, disabling cache 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.217+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94414533484672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf3eb0 con 0x55de98b9f9d0 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.218+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94414533484672] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985804d040 con 0x55de98b9f9d0 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.219+0000 7f9863f33800 20 remove_watcher() i=1 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.219+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94414533486816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bae080 con 0x55de98ba8d70 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.219+0000 7f9857fff640 1 -- 172.21.15.170:0/240791011 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94414533486816] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9848081070 con 0x55de98ba8d70 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.220+0000 7f9863f33800 20 remove_watcher() i=2 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.220+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94414533489136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf3eb0 con 0x7f9848076040 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.221+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94414533489136] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985804d040 con 0x7f9848076040 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.221+0000 7f9863f33800 20 remove_watcher() i=3 2024-04-26T12:30:35.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.221+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94414533491728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf3eb0 con 0x55de98b9f9d0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.222+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94414533491728] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f985804d040 con 0x55de98b9f9d0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.222+0000 7f9863f33800 20 remove_watcher() i=4 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.222+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94414533496608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bafc10 con 0x55de98ba43c0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.222+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94414533496608] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.222+0000 7f9863f33800 20 remove_watcher() i=5 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.222+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94414533501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bf3eb0 con 0x55de98ba43c0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.223+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94414533501360] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.223+0000 7f9863f33800 20 remove_watcher() i=6 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.223+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94414533503984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55de98bb0f20 con 0x55de98ba43c0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f985fbf5640 1 -- 172.21.15.170:0/240791011 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94414533503984] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9850071030 con 0x55de98ba43c0 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 20 remove_watcher() i=7 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98ba43c0 msgr2=0x55de98ba67b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98ba43c0 0x55de98ba67b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98b9f9d0 msgr2=0x55de98ba1e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98b9f9d0 0x55de98ba1e90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9848076040 msgr2=0x7f9848083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9848076040 0x7f9848083410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55de98ba8d70 msgr2=0x55de98bab230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55de98ba8d70 0x55de98bab230 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9728036950 msgr2=0x7f9728038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.224+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9728036950 0x7f9728038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9848052fd0 tx=0x7f984804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f98603f6640 1 -- 172.21.15.170:0/240791011 reap_dead start 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 msgr2=0x55de98b941d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b941d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f985000d6c0 tx=0x7f9850005f40 comp rx=0 tx=0).stop 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 shutdown_connections 2024-04-26T12:30:35.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/240791011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b8cdb0 0x55de98b941d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 >> 172.21.15.170:0/240791011 conn(0x55de98b89080 msgr2=0x55de98b866e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 shutdown_connections 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/240791011 wait complete. 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9738036950 msgr2=0x7f9738038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9738036950 0x7f9738038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55de98b69210 tx=0x7f9848005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b7fbc0 msgr2=0x55de98b7ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b7fbc0 0x55de98b7ffe0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f985004ad60 tx=0x7f985000db20 comp rx=0 tx=0).stop 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 shutdown_connections 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9738036950 0x7f9738038e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/4267788005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98b7fbc0 0x55de98b7ffe0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 >> 172.21.15.170:0/4267788005 conn(0x55de98b73c60 msgr2=0x55de98b74060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 shutdown_connections 2024-04-26T12:30:35.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/4267788005 wait complete. 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98b6ac60 msgr2=0x55de98b6d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55de98b6ac60 0x55de98b6d050 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98a6a980 msgr2=0x55de98b68530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55de98a6a980 0x55de98b68530 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55de98b6ebf0 msgr2=0x55de98b71040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55de98b6ebf0 0x55de98b71040 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9748036900 msgr2=0x7f9748038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9748036900 0x7f9748038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9848054000 tx=0x7f984804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 msgr2=0x55de989dc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 --2- 172.21.15.170:0/1096062334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de98a665e0 0x55de989dc000 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f985000b7c0 tx=0x7f9850000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f98603f6640 1 -- 172.21.15.170:0/1096062334 reap_dead start 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.225+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 shutdown_connections 2024-04-26T12:30:35.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.226+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 >> 172.21.15.170:0/1096062334 conn(0x55de98a61ba0 msgr2=0x55de98b56160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.226+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 shutdown_connections 2024-04-26T12:30:35.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.226+0000 7f9863f33800 1 -- 172.21.15.170:0/1096062334 wait complete. 2024-04-26T12:30:35.240 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:30:35.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:30:35.240 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-26T12:30:35.291 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:35.291 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:35.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.291+0000 7fd958a30800 1 Processor -- start 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.291+0000 7fd958a30800 1 -- start start 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.291+0000 7fd958a30800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x563e864878c0 0x563e86489cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.291+0000 7fd958a30800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e863310c0 con 0x563e86483430 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.291+0000 7fd958a30800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x563e863154d0 con 0x563e864878c0 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.291+0000 7fd95352d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x563e864878c0 0x563e86489cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.292+0000 7fd95352d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x563e864878c0 0x563e86489cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42524/0 (socket says 172.21.15.170:42524) 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.291+0000 7fd953d2e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x563e86483430 0x563e86483850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46254/0 (socket says 172.21.15.170:46254) 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.292+0000 7fd95352d640 1 -- 172.21.15.170:0/1786191605 learned_addr learned my addr 172.21.15.170:0/1786191605 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.292+0000 7fd95352d640 1 -- 172.21.15.170:0/1786191605 >> v1:172.21.15.132:6789/0 conn(0x563e86483430 legacy=0x563e86483850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.292+0000 7fd952d2c640 1 -- 172.21.15.170:0/1786191605 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447637722 0 0) 0x563e863310c0 con 0x563e86483430 2024-04-26T12:30:35.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.292+0000 7fd95352d640 1 -- 172.21.15.170:0/1786191605 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e86342d40 con 0x563e864878c0 2024-04-26T12:30:35.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd95352d640 1 --2- 172.21.15.170:0/1786191605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e864878c0 0x563e86489cb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd94800a6b0 tx=0x7fd94801eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9479c6093bb5039 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd952d2c640 1 -- 172.21.15.170:0/1786191605 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd948059070 con 0x563e864878c0 2024-04-26T12:30:35.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd952d2c640 1 -- 172.21.15.170:0/1786191605 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd948050050 con 0x563e864878c0 2024-04-26T12:30:35.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd952d2c640 1 -- 172.21.15.170:0/1786191605 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94800a350 con 0x563e864878c0 2024-04-26T12:30:35.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd958a30800 1 -- 172.21.15.170:0/1786191605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e864878c0 msgr2=0x563e86489cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd958a30800 1 --2- 172.21.15.170:0/1786191605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e864878c0 0x563e86489cb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd94800a6b0 tx=0x7fd94801eed0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd958a30800 1 -- 172.21.15.170:0/1786191605 shutdown_connections 2024-04-26T12:30:35.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd958a30800 1 --2- 172.21.15.170:0/1786191605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e864878c0 0x563e86489cb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd958a30800 1 -- 172.21.15.170:0/1786191605 >> 172.21.15.170:0/1786191605 conn(0x563e8647ea30 msgr2=0x563e86480e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd958a30800 1 -- 172.21.15.170:0/1786191605 shutdown_connections 2024-04-26T12:30:35.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.294+0000 7fd958a30800 1 -- 172.21.15.170:0/1786191605 wait complete. 2024-04-26T12:30:35.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.306+0000 7fd958a30800 1 Processor -- start 2024-04-26T12:30:35.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.306+0000 7fd958a30800 1 -- start start 2024-04-26T12:30:35.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.306+0000 7fd958a30800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e86577840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.306+0000 7fd958a30800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e863cfba0 con 0x563e86483430 2024-04-26T12:30:35.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e86577840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e86577840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42540/0 (socket says 172.21.15.170:42540) 2024-04-26T12:30:35.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd953d2e640 1 -- 172.21.15.170:0/1475059015 learned_addr learned my addr 172.21.15.170:0/1475059015 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd953d2e640 1 -- 172.21.15.170:0/1475059015 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e86341590 con 0x563e86483430 2024-04-26T12:30:35.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd953d2e640 1 --2- 172.21.15.170:0/1475059015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e86577840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b260 tx=0x7fd94400b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d440e4829309f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd841e0b640 1 -- 172.21.15.170:0/1475059015 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd944008070 con 0x563e86483430 2024-04-26T12:30:35.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd841e0b640 1 -- 172.21.15.170:0/1475059015 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94400d500 con 0x563e86483430 2024-04-26T12:30:35.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.307+0000 7fd841e0b640 1 -- 172.21.15.170:0/1475059015 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94400d820 con 0x563e86483430 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 -- 172.21.15.170:0/1475059015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 msgr2=0x563e86577840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 --2- 172.21.15.170:0/1475059015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e86577840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b260 tx=0x7fd94400b720 comp rx=0 tx=0).stop 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 -- 172.21.15.170:0/1475059015 shutdown_connections 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 --2- 172.21.15.170:0/1475059015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e86577840 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 -- 172.21.15.170:0/1475059015 >> 172.21.15.170:0/1475059015 conn(0x563e8647ea30 msgr2=0x563e8656ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 -- 172.21.15.170:0/1475059015 shutdown_connections 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 -- 172.21.15.170:0/1475059015 wait complete. 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 Processor -- start 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.308+0000 7fd958a30800 1 -- start start 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd958a30800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e8657f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd958a30800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e8648a580 con 0x563e86483430 2024-04-26T12:30:35.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e8657f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e8657f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42542/0 (socket says 172.21.15.170:42542) 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd953d2e640 1 -- 172.21.15.170:0/2188172845 learned_addr learned my addr 172.21.15.170:0/2188172845 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd953d2e640 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e863388f0 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd953d2e640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e8657f250 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b760 tx=0x7fd944000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd83bfff640 1 -- 172.21.15.170:0/2188172845 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94400f950 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd83bfff640 1 -- 172.21.15.170:0/2188172845 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94400fb10 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e8657f790 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd83bfff640 1 -- 172.21.15.170:0/2188172845 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94400fe30 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.309+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e8657fcb0 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.310+0000 7fd83bfff640 1 -- 172.21.15.170:0/2188172845 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd944017040 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.310+0000 7fd83bfff640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd83c036950 0x7fd83c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.310+0000 7fd83bfff640 1 -- 172.21.15.170:0/2188172845 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd944015020 con 0x563e86483430 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.310+0000 7fd95352d640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd83c036950 0x7fd83c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e864878c0 0x563e865862c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e86586800 con 0x563e864878c0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd95452f640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e864878c0 0x563e865862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd95352d640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd83c036950 0x7fd83c038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd948056000 tx=0x7fd94800a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd95452f640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e864878c0 0x563e865862c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd95452f640 1 -- 172.21.15.170:0/2188172845 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e864878c0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e86583890 con 0x563e864878c0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd95452f640 1 -- 172.21.15.170:0/2188172845 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e864878c0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.311+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e86588b30 0x563e8658af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.312+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e8658b610 con 0x563e86588b30 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.312+0000 7fd953d2e640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e86588b30 0x563e8658af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.312+0000 7fd953d2e640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e86588b30 0x563e8658af20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.312+0000 7fd953d2e640 1 -- 172.21.15.170:0/2188172845 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd94402d070 con 0x563e86588b30 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.312+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e86587ae0 con 0x563e864878c0 2024-04-26T12:30:35.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.313+0000 7fd95452f640 1 -- 172.21.15.170:0/2188172845 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e864878c0 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.313+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e8658cac0 0x563e8658ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.313+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e8658f670 con 0x563e8658cac0 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.313+0000 7fd95352d640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e8658cac0 0x563e8658ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.313+0000 7fd95352d640 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e8658cac0 0x563e8658ef10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.313+0000 7fd95352d640 1 -- 172.21.15.170:0/2188172845 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd948054510 con 0x563e8658cac0 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd958a30800 1 Processor -- start 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd958a30800 1 -- start start 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd958a30800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e8659da90 0x563e8659deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd958a30800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e86375e60 con 0x563e8659da90 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e8659da90 0x563e8659deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e8659da90 0x563e8659deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42556/0 (socket says 172.21.15.170:42556) 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd953d2e640 1 -- 172.21.15.170:0/3318812044 learned_addr learned my addr 172.21.15.170:0/3318812044 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd953d2e640 1 -- 172.21.15.170:0/3318812044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e8659e3f0 con 0x563e8659da90 2024-04-26T12:30:35.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd953d2e640 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e8659da90 0x563e8659deb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd94404b350 tx=0x7fd94400e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.314+0000 7fd8397fa640 1 -- 172.21.15.170:0/3318812044 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94402b040 con 0x563e8659da90 2024-04-26T12:30:35.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd8397fa640 1 -- 172.21.15.170:0/3318812044 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd944019470 con 0x563e8659da90 2024-04-26T12:30:35.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e8659ee60 con 0x563e8659da90 2024-04-26T12:30:35.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd8397fa640 1 -- 172.21.15.170:0/3318812044 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd944019750 con 0x563e8659da90 2024-04-26T12:30:35.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e8659f360 con 0x563e8659da90 2024-04-26T12:30:35.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd8397fa640 1 -- 172.21.15.170:0/3318812044 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd944044980 con 0x563e8659da90 2024-04-26T12:30:35.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd8397fa640 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd82c036900 0x7fd82c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd8397fa640 1 -- 172.21.15.170:0/3318812044 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd94403bc50 con 0x563e8659da90 2024-04-26T12:30:35.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.315+0000 7fd95352d640 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd82c036900 0x7fd82c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd958a30800 1 Processor -- start 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd958a30800 1 -- start start 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd95352d640 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd82c036900 0x7fd82c038dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x563e865870e0 tx=0x7fd948005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd958a30800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865ab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd958a30800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e86577fc0 con 0x563e865aae40 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42558/0 (socket says 172.21.15.170:42558) 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd953d2e640 1 -- 172.21.15.170:0/3268769778 learned_addr learned my addr 172.21.15.170:0/3268769778 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.316+0000 7fd953d2e640 1 -- 172.21.15.170:0/3268769778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e865ab830 con 0x563e865aae40 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd953d2e640 1 --2- 172.21.15.170:0/3268769778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865ab260 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd94400c670 tx=0x7fd94403f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08e56265f3e6384 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd832ffd640 1 -- 172.21.15.170:0/3268769778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94400c4b0 con 0x563e865aae40 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd832ffd640 1 -- 172.21.15.170:0/3268769778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94405b070 con 0x563e865aae40 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd832ffd640 1 -- 172.21.15.170:0/3268769778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd944026cc0 con 0x563e865aae40 2024-04-26T12:30:35.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 -- 172.21.15.170:0/3268769778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 msgr2=0x563e865ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 --2- 172.21.15.170:0/3268769778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865ab260 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd94400c670 tx=0x7fd94403f7f0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 -- 172.21.15.170:0/3268769778 shutdown_connections 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 --2- 172.21.15.170:0/3268769778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865ab260 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 -- 172.21.15.170:0/3268769778 >> 172.21.15.170:0/3268769778 conn(0x563e865a7110 msgr2=0x563e865a5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 -- 172.21.15.170:0/3268769778 shutdown_connections 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 -- 172.21.15.170:0/3268769778 wait complete. 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 Processor -- start 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.317+0000 7fd958a30800 1 -- start start 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd958a30800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd958a30800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e865abd80 con 0x563e865aae40 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd953d2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42570/0 (socket says 172.21.15.170:42570) 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 learned_addr learned my addr 172.21.15.170:0/423896265 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e865b2590 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd953d2e640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865b2050 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd944058040 tx=0x7fd94401d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd8317fa640 1 -- 172.21.15.170:0/423896265 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94400c280 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd8317fa640 1 -- 172.21.15.170:0/423896265 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd944066070 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd8317fa640 1 -- 172.21.15.170:0/423896265 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd94402f3e0 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.318+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e865b2590 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.319+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e865b2590 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.319+0000 7fd8317fa640 1 -- 172.21.15.170:0/423896265 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd944026430 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.319+0000 7fd8317fa640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd81c036900 0x7fd81c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.319+0000 7fd8317fa640 1 -- 172.21.15.170:0/423896265 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd94404c7f0 con 0x563e865aae40 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.320+0000 7fd95352d640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd81c036900 0x7fd81c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.320+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.320+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e865bd660 0x563e865bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.320+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c0270 con 0x563e865bd660 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.320+0000 7fd95352d640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd81c036900 0x7fd81c038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd948057040 tx=0x7fd948061040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.320+0000 7fd95452f640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e865bd660 0x563e865bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.320+0000 7fd95452f640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e865bd660 0x563e865bfb20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 realm 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c0680 con 0x563e865bd660 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c0f50 con 0x563e865bd660 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865bd660 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e865c2050 0x563e865c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c4a50 con 0x563e865c2050 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.321+0000 7fd953d2e640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e865c2050 0x563e865c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd953d2e640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e865c2050 0x563e865c4440 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd958a30800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd958a30800 20 searching for the correct realm 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e865c6a00 0x563e865c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c9590 con 0x563e865c6a00 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd95352d640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e865c6a00 0x563e865c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.322+0000 7fd95352d640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e865c6a00 0x563e865c8ec0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.323+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.323+0000 7fd95352d640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd948075040 0x7fd94805f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.323+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c9590 con 0x7fd948075040 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.323+0000 7fd95452f640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd948075040 0x7fd94805f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.323+0000 7fd95452f640 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd948075040 0x7fd94805f930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.323+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865c2050 2024-04-26T12:30:35.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865bd660 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865bd660 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865c2050 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.324+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865c2050 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x7fd948075040 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865c6a00 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865bd660 2024-04-26T12:30:35.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.325+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865c2050 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865bd660 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x7fd948075040 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563e865c12f0 con 0x563e865c6a00 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.326+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c6a00 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c2050 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c6a00 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c6a00 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.327+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865bd660 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865bd660 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c2050 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c6a00 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.328+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x7fd948075040 2024-04-26T12:30:35.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.329+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.329+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865bd660 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.329+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.329+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c2050 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.329+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.329+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c6a00 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.329+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.330+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c2050 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.330+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.330+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x7fd948075040 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.330+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.330+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c6a00 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.330+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.330+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865c2050 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x563e865bd660 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fd94808f040 con 0x7fd948075040 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c5310 con 0x563e865bd660 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.331+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c5310 con 0x563e865bd660 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c5310 con 0x7fd948075040 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 zone default found 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 4 Realm: () 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:35.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 zonegroup default 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865c5bb0 con 0x563e865c2050 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865cb3f0 con 0x563e865c6a00 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.332+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865cb790 con 0x563e865c6a00 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.333+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.333+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.333+0000 7fd958a30800 20 started sync module instance, tier type = 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.333+0000 7fd958a30800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.333+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865ca890 con 0x7fd948075040 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.334+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.334+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94826542181504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865ca890 con 0x7fd948075040 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.334+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cc020 con 0x563e865bd660 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.335+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94826542181504] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.335+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.335+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94826542185264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865ca890 con 0x563e865bd660 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.335+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865ccab0 con 0x563e865c6a00 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.336+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.336+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94826542187904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cd350 con 0x563e865c6a00 2024-04-26T12:30:35.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.336+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cde10 con 0x7fd948075040 2024-04-26T12:30:35.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.336+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94826542185264] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.337+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.337+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94826542192864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865ce200 con 0x7fd948075040 2024-04-26T12:30:35.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.337+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cec00 con 0x563e865bd660 2024-04-26T12:30:35.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.337+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94826542187904] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.338+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.338+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94826542192864] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.338+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94826542190240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cebc0 con 0x563e865bd660 2024-04-26T12:30:35.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.338+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865ca3e0 con 0x563e865c2050 2024-04-26T12:30:35.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.339+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.339+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94826542198992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cf9a0 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.339+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865d0360 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.339+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94826542190240] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.340+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94826542198992] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.340+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.340+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94826542196496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865d0360 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.340+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865d0c30 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94826542196496] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94826542203024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865d0c30 con 0x563e865c2050 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 20 add_watcher() i=0 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 20 add_watcher() i=1 2024-04-26T12:30:35.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 20 add_watcher() i=2 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 20 add_watcher() i=3 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 20 add_watcher() i=4 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 20 add_watcher() i=5 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.341+0000 7fd958a30800 20 add_watcher() i=6 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.342+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94826542203024] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.342+0000 7fd958a30800 20 add_watcher() i=7 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.342+0000 7fd958a30800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.342+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e865d3f90 con 0x563e865bd660 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.342+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.342+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94826542217616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865d0da0 con 0x563e865bd660 2024-04-26T12:30:35.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.343+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94826542217616] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.343+0000 7fd809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.343+0000 7fd958a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.343+0000 7fd958a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.343+0000 7fd958a30800 5 note: GC not initialized 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd808fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 20 Filter name: none 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd7827fc640 20 reqs_thread_entry: start 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e866077b0 con 0x563e865c2050 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e86605df0 con 0x563e865c2050 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.344+0000 7fd958a30800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.345+0000 7fd958a30800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.345+0000 7fd958a30800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.345+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e866066e0 con 0x563e865c2050 2024-04-26T12:30:35.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd958a30800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd958a30800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd958a30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94826542424624 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e8660ada0 con 0x563e865c2050 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== watch-notify(notify (1) cookie 94826542198992 notify 128849018888 ret 0) ==== 598+0+0 (crc 0 0 0) 0x563e86607200 con 0x563e865c2050 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd832ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94826542198992 notifier 4495 bl.length()=556 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd832ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd832ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:35.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd832ffd640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd818003ea0 con 0x563e865c2050 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(65 notify.5 [notify cookie 94826542424624 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== watch-notify(notify_complete (2) cookie 94826542424624 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e8659ee60 con 0x563e865c2050 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.346+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e86606690 con 0x563e865c2050 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.347+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.347+0000 7fd958a30800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.347+0000 7fd958a30800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.347+0000 7fd958a30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.347+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94826542424544 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563e8660b230 con 0x563e865c6a00 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== watch-notify(notify (1) cookie 94826542187904 notify 128849018882 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fd948089040 con 0x563e865c6a00 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd8327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94826542187904 notifier 4495 bl.length()=177 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd8327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd8327fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:35.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(68 notify.2 [notify cookie 94826542424544 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd8327fc640 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd788003400 con 0x563e865c6a00 2024-04-26T12:30:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== watch-notify(notify_complete (2) cookie 94826542424544 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e86342d40 con 0x563e865c6a00 2024-04-26T12:30:35.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.348+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.366 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:30:35.345833Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:35.345813Z","tags":[],"group_ids":[]} 2024-04-26T12:30:35.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.349+0000 7fd809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.349+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94826542217616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865ba080 con 0x563e865bd660 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.350+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94826542217616] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.350+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94826542181504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865b96e0 con 0x7fd948075040 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.351+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94826542181504] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.351+0000 7fd958a30800 20 remove_watcher() i=0 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.351+0000 7fd958a30800 2 removed watcher, disabling cache 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.351+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94826542185264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cac80 con 0x563e865bd660 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.352+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94826542185264] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.352+0000 7fd958a30800 20 remove_watcher() i=1 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.352+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94826542187904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cac80 con 0x563e865c6a00 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.353+0000 7fd95352d640 1 -- 172.21.15.170:0/423896265 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94826542187904] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd948080070 con 0x563e865c6a00 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.353+0000 7fd958a30800 20 remove_watcher() i=2 2024-04-26T12:30:35.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.353+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94826542192864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cc580 con 0x7fd948075040 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.354+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94826542192864] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x7fd948075040 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.354+0000 7fd958a30800 20 remove_watcher() i=3 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.354+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94826542190240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cac80 con 0x563e865bd660 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.355+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94826542190240] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd94c00a4a0 con 0x563e865bd660 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.355+0000 7fd958a30800 20 remove_watcher() i=4 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.355+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94826542198992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cd8e0 con 0x563e865c2050 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.356+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94826542198992] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.356+0000 7fd958a30800 20 remove_watcher() i=5 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.356+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94826542196496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cc580 con 0x563e865c2050 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.357+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94826542196496] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.357+0000 7fd958a30800 20 remove_watcher() i=6 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.357+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94826542203024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563e865cac80 con 0x563e865c2050 2024-04-26T12:30:35.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd953d2e640 1 -- 172.21.15.170:0/423896265 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94826542203024] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd944053070 con 0x563e865c2050 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 20 remove_watcher() i=7 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e865c2050 msgr2=0x563e865c4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e865c2050 0x563e865c4440 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e865bd660 msgr2=0x563e865bfb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e865bd660 0x563e865bfb20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd948075040 msgr2=0x7fd94805f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd948075040 0x7fd94805f930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e865c6a00 msgr2=0x563e865c8ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e865c6a00 0x563e865c8ec0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd81c036900 msgr2=0x7fd81c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd81c036900 0x7fd81c038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd948057040 tx=0x7fd948061040 comp rx=0 tx=0).stop 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 msgr2=0x563e865b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865b2050 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd944058040 tx=0x7fd94401d280 comp rx=0 tx=0).stop 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd95452f640 1 -- 172.21.15.170:0/423896265 reap_dead start 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 shutdown_connections 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 --2- 172.21.15.170:0/423896265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e865aae40 0x563e865b2050 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 >> 172.21.15.170:0/423896265 conn(0x563e865a7110 msgr2=0x563e865a4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 shutdown_connections 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.358+0000 7fd958a30800 1 -- 172.21.15.170:0/423896265 wait complete. 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd82c036900 msgr2=0x7fd82c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd82c036900 0x7fd82c038dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x563e865870e0 tx=0x7fd948005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e8659da90 msgr2=0x563e8659deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e8659da90 0x563e8659deb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd94404b350 tx=0x7fd94400e630 comp rx=0 tx=0).stop 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 shutdown_connections 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd82c036900 0x7fd82c038dc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/3318812044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e8659da90 0x563e8659deb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 >> 172.21.15.170:0/3318812044 conn(0x563e86591b30 msgr2=0x563e86591f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 shutdown_connections 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/3318812044 wait complete. 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e86588b30 msgr2=0x563e8658af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e86588b30 0x563e8658af20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e864878c0 msgr2=0x563e865862c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e864878c0 0x563e865862c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e8658cac0 msgr2=0x563e8658ef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e8658cac0 0x563e8658ef10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd83c036950 msgr2=0x7fd83c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd83c036950 0x7fd83c038e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd948056000 tx=0x7fd94800a000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 msgr2=0x563e8657f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 --2- 172.21.15.170:0/2188172845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e86483430 0x563e8657f250 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b760 tx=0x7fd944000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd95452f640 1 -- 172.21.15.170:0/2188172845 reap_dead start 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 shutdown_connections 2024-04-26T12:30:35.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 >> 172.21.15.170:0/2188172845 conn(0x563e8647ea30 msgr2=0x563e86571e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 shutdown_connections 2024-04-26T12:30:35.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.359+0000 7fd958a30800 1 -- 172.21.15.170:0/2188172845 wait complete. 2024-04-26T12:30:35.377 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:30:35.345833Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:35.345813Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:35.382 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:30:35.387 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:35.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-26T12:30:35.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-26T12:30:35.387 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-26T12:30:35.429 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:35.429 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47d1611800 1 Processor -- start 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47d1611800 1 -- start start 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47d1611800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558a161f3140 0x558a161f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47d1611800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a1612a0c0 con 0x558a161f1c30 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47d1611800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x558a1610e4d0 con 0x558a161f3140 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47ccc6e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x558a161f3140 0x558a161f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47cc46d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x558a161f1c30 0x558a16285430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46270/0 (socket says 172.21.15.170:46270) 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.429+0000 7f47cc46d640 1 -- 172.21.15.170:0/1880304533 learned_addr learned my addr 172.21.15.170:0/1880304533 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.430+0000 7f47ccc6e640 1 -- 172.21.15.170:0/1880304533 >> v1:172.21.15.132:6789/0 conn(0x558a161f1c30 legacy=0x558a16285430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.430+0000 7f47cbc6c640 1 -- 172.21.15.170:0/1880304533 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595084091 0 0) 0x558a1612a0c0 con 0x558a161f1c30 2024-04-26T12:30:35.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.430+0000 7f47ccc6e640 1 -- 172.21.15.170:0/1880304533 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a1613bd40 con 0x558a161f3140 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/1880304533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f3140 0x558a161f16f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a470 tx=0x7f47bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b64414b586638ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47cbc6c640 1 -- 172.21.15.170:0/1880304533 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc057070 con 0x558a161f3140 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47cbc6c640 1 -- 172.21.15.170:0/1880304533 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc052570 con 0x558a161f3140 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47cbc6c640 1 -- 172.21.15.170:0/1880304533 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc052870 con 0x558a161f3140 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47d1611800 1 -- 172.21.15.170:0/1880304533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f3140 msgr2=0x558a161f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47d1611800 1 --2- 172.21.15.170:0/1880304533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f3140 0x558a161f16f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00a470 tx=0x7f47bc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47d1611800 1 -- 172.21.15.170:0/1880304533 shutdown_connections 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47d1611800 1 --2- 172.21.15.170:0/1880304533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f3140 0x558a161f16f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47d1611800 1 -- 172.21.15.170:0/1880304533 >> 172.21.15.170:0/1880304533 conn(0x558a16278b80 msgr2=0x558a1627afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47d1611800 1 -- 172.21.15.170:0/1880304533 shutdown_connections 2024-04-26T12:30:35.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.432+0000 7f47d1611800 1 -- 172.21.15.170:0/1880304533 wait complete. 2024-04-26T12:30:35.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.444+0000 7f47d1611800 1 Processor -- start 2024-04-26T12:30:35.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.444+0000 7f47d1611800 1 -- start start 2024-04-26T12:30:35.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.444+0000 7f47d1611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16370ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.444+0000 7f47d1611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558a161c8b40 con 0x558a161f1c30 2024-04-26T12:30:35.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.444+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16370ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.444+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16370ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42578/0 (socket says 172.21.15.170:42578) 2024-04-26T12:30:35.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.444+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2037134252 learned_addr learned my addr 172.21.15.170:0/2037134252 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.445+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2037134252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a1613a590 con 0x558a161f1c30 2024-04-26T12:30:35.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.445+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2037134252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16370ca0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c00 tx=0x7f47bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad471f757baaf765 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.445+0000 7f46bae0d640 1 -- 172.21.15.170:0/2037134252 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc057070 con 0x558a161f1c30 2024-04-26T12:30:35.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.445+0000 7f46bae0d640 1 -- 172.21.15.170:0/2037134252 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc063070 con 0x558a161f1c30 2024-04-26T12:30:35.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.445+0000 7f46bae0d640 1 -- 172.21.15.170:0/2037134252 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc052720 con 0x558a161f1c30 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 -- 172.21.15.170:0/2037134252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 msgr2=0x558a16370ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 --2- 172.21.15.170:0/2037134252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16370ca0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c00 tx=0x7f47bc04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 -- 172.21.15.170:0/2037134252 shutdown_connections 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 --2- 172.21.15.170:0/2037134252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16370ca0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 -- 172.21.15.170:0/2037134252 >> 172.21.15.170:0/2037134252 conn(0x558a16278b80 msgr2=0x558a1636c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 -- 172.21.15.170:0/2037134252 shutdown_connections 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 -- 172.21.15.170:0/2037134252 wait complete. 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 Processor -- start 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 -- start start 2024-04-26T12:30:35.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16378530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47d1611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558a16288e60 con 0x558a161f1c30 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16378530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16378530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42592/0 (socket says 172.21.15.170:42592) 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.446+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2750807996 learned_addr learned my addr 172.21.15.170:0/2750807996 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.447+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a161318f0 con 0x558a161f1c30 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.447+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16378530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c00 tx=0x7f47bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.447+0000 7f46b960a640 1 -- 172.21.15.170:0/2750807996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc052c70 con 0x558a161f1c30 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.447+0000 7f46b960a640 1 -- 172.21.15.170:0/2750807996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc06c070 con 0x558a161f1c30 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.447+0000 7f46b960a640 1 -- 172.21.15.170:0/2750807996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc05e480 con 0x558a161f1c30 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.447+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a16378a70 con 0x558a161f1c30 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.447+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a16378f30 con 0x558a161f1c30 2024-04-26T12:30:35.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f46b960a640 1 -- 172.21.15.170:0/2750807996 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f47bc06e030 con 0x558a161f1c30 2024-04-26T12:30:35.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f46b960a640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46b4036950 0x7f46b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f46b960a640 1 -- 172.21.15.170:0/2750807996 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f47bc08e1f0 con 0x558a161f1c30 2024-04-26T12:30:35.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46b4036950 0x7f46b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a161f3140 0x558a1637f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a1637fb20 con 0x558a161f3140 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f47cd46f640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a161f3140 0x558a1637f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46b4036950 0x7f46b4038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47c0000c00 tx=0x7f47c00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.448+0000 7f47cd46f640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a161f3140 0x558a1637f5a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.449+0000 7f47cd46f640 1 -- 172.21.15.170:0/2750807996 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a161f3140 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.449+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a1637cb30 con 0x558a161f3140 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.449+0000 7f47cd46f640 1 -- 172.21.15.170:0/2750807996 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a161f3140 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.449+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a16381e30 0x558a16384220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.449+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a16384880 con 0x558a16381e30 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.449+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a16381e30 0x558a16384220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.449+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a16381e30 0x558a16384220 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.450+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2750807996 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47bc070410 con 0x558a16381e30 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.450+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a16380de0 con 0x558a161f3140 2024-04-26T12:30:35.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.450+0000 7f47cd46f640 1 -- 172.21.15.170:0/2750807996 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a161f3140 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.450+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558a16385d30 0x558a163881a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.450+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a16388900 con 0x558a16385d30 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.450+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558a16385d30 0x558a163881a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.450+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558a16385d30 0x558a163881a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47cc46d640 1 -- 172.21.15.170:0/2750807996 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47c000f670 con 0x558a16385d30 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47d1611800 1 Processor -- start 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47d1611800 1 -- start start 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47d1611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a16396d30 0x558a16397150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47d1611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558a1616ee60 con 0x558a16396d30 2024-04-26T12:30:35.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a16396d30 0x558a16397150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a16396d30 0x558a16397150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42600/0 (socket says 172.21.15.170:42600) 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.451+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2296542841 learned_addr learned my addr 172.21.15.170:0/2296542841 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.452+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2296542841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a16397690 con 0x558a16396d30 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.452+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a16396d30 0x558a16397150 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f47bc08c680 tx=0x7f47bc009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.452+0000 7f46b27fc640 1 -- 172.21.15.170:0/2296542841 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc084040 con 0x558a16396d30 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.452+0000 7f46b27fc640 1 -- 172.21.15.170:0/2296542841 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc058040 con 0x558a16396d30 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.452+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a16398100 con 0x558a16396d30 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.452+0000 7f46b27fc640 1 -- 172.21.15.170:0/2296542841 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc009af0 con 0x558a16396d30 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.452+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a16398600 con 0x558a16396d30 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f46b27fc640 1 -- 172.21.15.170:0/2296542841 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f47bc009c90 con 0x558a16396d30 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f46b27fc640 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46a4036950 0x7f46a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f46b27fc640 1 -- 172.21.15.170:0/2296542841 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f47bc09ca00 con 0x558a16396d30 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46a4036950 0x7f46a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f47d1611800 1 Processor -- start 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f47d1611800 1 -- start start 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46a4036950 0x7f46a4038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x558a1637ca90 tx=0x7f47c0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f47d1611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163a4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.453+0000 7f47d1611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558a16371360 con 0x558a163a3f30 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42606/0 (socket says 172.21.15.170:42606) 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47ccc6e640 1 -- 172.21.15.170:0/3859653724 learned_addr learned my addr 172.21.15.170:0/3859653724 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47ccc6e640 1 -- 172.21.15.170:0/3859653724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a163a4920 con 0x558a163a3f30 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/3859653724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163a4350 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f47bc079030 tx=0x7f47bc05e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f65068b05a0404 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f46a3fff640 1 -- 172.21.15.170:0/3859653724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc04f900 con 0x558a163a3f30 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f46a3fff640 1 -- 172.21.15.170:0/3859653724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc0ac070 con 0x558a163a3f30 2024-04-26T12:30:35.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f46a3fff640 1 -- 172.21.15.170:0/3859653724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc068770 con 0x558a163a3f30 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47d1611800 1 -- 172.21.15.170:0/3859653724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 msgr2=0x558a163a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47d1611800 1 --2- 172.21.15.170:0/3859653724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163a4350 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f47bc079030 tx=0x7f47bc05e750 comp rx=0 tx=0).stop 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47d1611800 1 -- 172.21.15.170:0/3859653724 shutdown_connections 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.454+0000 7f47d1611800 1 --2- 172.21.15.170:0/3859653724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163a4350 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47d1611800 1 -- 172.21.15.170:0/3859653724 >> 172.21.15.170:0/3859653724 conn(0x558a163a0240 msgr2=0x558a1639e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47d1611800 1 -- 172.21.15.170:0/3859653724 shutdown_connections 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47d1611800 1 -- 172.21.15.170:0/3859653724 wait complete. 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47d1611800 1 Processor -- start 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47d1611800 1 -- start start 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47d1611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47d1611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x558a163a4fb0 con 0x558a163a3f30 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47ccc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42620/0 (socket says 172.21.15.170:42620) 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 learned_addr learned my addr 172.21.15.170:0/2995831160 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.455+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a163ab820 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.456+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163ab2e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f47bc044810 tx=0x7f47bc06af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.456+0000 7f46a27fc640 1 -- 172.21.15.170:0/2995831160 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc091ad0 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.456+0000 7f46a27fc640 1 -- 172.21.15.170:0/2995831160 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc091c70 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.456+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a163ab820 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.456+0000 7f46a27fc640 1 -- 172.21.15.170:0/2995831160 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47bc04f3f0 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.456+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a163ab820 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.456+0000 7f46a27fc640 1 -- 172.21.15.170:0/2995831160 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f47bc0a5040 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f46a27fc640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4698036900 0x7f4698038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f46a27fc640 1 -- 172.21.15.170:0/2995831160 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f47bc0a2040 con 0x558a163a3f30 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4698036900 0x7f4698038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a163b6850 0x558a163b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163b9460 con 0x558a163b6850 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f47cd46f640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a163b6850 0x558a163b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4698036900 0x7f4698038dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47c000ffd0 tx=0x7f47c0023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.457+0000 7f47cd46f640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a163b6850 0x558a163b8d10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 realm 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163b9870 con 0x558a163b6850 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba140 con 0x558a163b6850 2024-04-26T12:30:35.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a163bb010 0x558a163bd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163bdb40 con 0x558a163bb010 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.458+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a163bb010 0x558a163bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47ccc6e640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a163bb010 0x558a163bd400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47d1611800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47d1611800 20 searching for the correct realm 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558a163bfba0 0x558a163c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163c2710 con 0x558a163bfba0 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558a163bfba0 0x558a163c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.459+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558a163bfba0 0x558a163c2040 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.460+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.460+0000 7f47cc46d640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f47c002e910 0x7f47c003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.460+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163c2710 con 0x7f47c002e910 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.460+0000 7f47cd46f640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f47c002e910 0x7f47c003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.460+0000 7f47cd46f640 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f47c002e910 0x7f47c003a3c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.461+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.461+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.461+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.461+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.461+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.461+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x7f47c002e910 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.462+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.463+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x7f47c002e910 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.464+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.464+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.464+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.464+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.464+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.464+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.465+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x7f47c002e910 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.466+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.467+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.467+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.467+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.467+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.467+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.467+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x7f47c002e910 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bfba0 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163bb010 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x558a163b6850 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.468+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558a163ba4e0 con 0x7f47c002e910 2024-04-26T12:30:35.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163be4c0 con 0x558a163b6850 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163be4c0 con 0x558a163b6850 2024-04-26T12:30:35.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163be490 con 0x7f47c002e910 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 zone default found 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 4 Realm: () 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 zonegroup default 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.469+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163be8b0 con 0x558a163bb010 2024-04-26T12:30:35.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163c4570 con 0x558a163bfba0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163c4910 con 0x558a163bfba0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 20 started sync module instance, tier type = 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.470+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c3a10 con 0x7f47c002e910 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.471+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.471+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94051566894640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c3a10 con 0x7f47c002e910 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.471+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c5160 con 0x558a163b6850 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.472+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94051566894640] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.473+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.473+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94051566892656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c5160 con 0x558a163b6850 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.473+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c5b20 con 0x558a163bfba0 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.473+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.474+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94051566900848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c6370 con 0x558a163bfba0 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.474+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c6df0 con 0x7f47c002e910 2024-04-26T12:30:35.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.474+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94051566892656] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.475+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94051566900848] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.475+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.475+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94051566902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c4cb0 con 0x7f47c002e910 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.475+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c7690 con 0x558a163b6850 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.476+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.476+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94051566907712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c7af0 con 0x558a163b6850 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.476+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94051566902976] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.476+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c83c0 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.477+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.477+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94051566911248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c8c10 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.477+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c9460 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.477+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94051566907712] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.478+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94051566911248] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.478+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.478+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94051566915504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c9800 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.478+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163ca050 con 0x558a163bb010 2024-04-26T12:30:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94051566915504] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94051566918560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163ca470 con 0x558a163bb010 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 20 add_watcher() i=0 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 20 add_watcher() i=1 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 20 add_watcher() i=2 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 20 add_watcher() i=3 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 20 add_watcher() i=4 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 20 add_watcher() i=5 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.479+0000 7f47d1611800 20 add_watcher() i=6 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.480+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94051566918560] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.480+0000 7f47d1611800 20 add_watcher() i=7 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.480+0000 7f47d1611800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.480+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a163cd750 con 0x558a163b6850 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.480+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.480+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94051566919984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163caa00 con 0x558a163b6850 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.481+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94051566919984] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.481+0000 7f4682fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.481+0000 7f47d1611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.481+0000 7f47d1611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.481+0000 7f47d1611800 5 note: GC not initialized 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f4681fe3640 20 reqs_thread_entry: start 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f47d1611800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f47d1611800 20 Filter name: none 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f45f37fe640 20 reqs_thread_entry: start 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f47d1611800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558a16400860 con 0x7f47c002e910 2024-04-26T12:30:35.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.482+0000 7f47d1611800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.483+0000 7f4682fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.483+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94051566919984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163fe660 con 0x558a163b6850 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.484+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94051566919984] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.484+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94051566894640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163fe660 con 0x7f47c002e910 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.485+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94051566894640] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.485+0000 7f47d1611800 20 remove_watcher() i=0 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.485+0000 7f47d1611800 2 removed watcher, disabling cache 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.485+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94051566892656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c3e30 con 0x558a163b6850 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.486+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94051566892656] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.486+0000 7f47d1611800 20 remove_watcher() i=1 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.486+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94051566900848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163fe660 con 0x558a163bfba0 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.487+0000 7f47cc46d640 1 -- 172.21.15.170:0/2995831160 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94051566900848] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c0037040 con 0x558a163bfba0 2024-04-26T12:30:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.487+0000 7f47d1611800 20 remove_watcher() i=2 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.487+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94051566902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c3670 con 0x7f47c002e910 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.488+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94051566902976] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x7f47c002e910 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.488+0000 7f47d1611800 20 remove_watcher() i=3 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.488+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94051566907712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c3e30 con 0x558a163b6850 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.489+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94051566907712] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47c400a4a0 con 0x558a163b6850 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.489+0000 7f47d1611800 20 remove_watcher() i=4 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.489+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94051566911248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c5ec0 con 0x558a163bb010 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.490+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94051566911248] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.490+0000 7f47d1611800 20 remove_watcher() i=5 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.490+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94051566915504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c3670 con 0x558a163bb010 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.491+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94051566915504] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.491+0000 7f47d1611800 20 remove_watcher() i=6 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.491+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94051566918560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558a163c7140 con 0x558a163bb010 2024-04-26T12:30:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47ccc6e640 1 -- 172.21.15.170:0/2995831160 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94051566918560] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47bc0ce040 con 0x558a163bb010 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 20 remove_watcher() i=7 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a163bb010 msgr2=0x558a163bd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a163bb010 0x558a163bd400 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a163b6850 msgr2=0x558a163b8d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a163b6850 0x558a163b8d10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f47c002e910 msgr2=0x7f47c003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f47c002e910 0x7f47c003a3c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558a163bfba0 msgr2=0x558a163c2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x558a163bfba0 0x558a163c2040 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4698036900 msgr2=0x7f4698038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4698036900 0x7f4698038dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47c000ffd0 tx=0x7f47c0023040 comp rx=0 tx=0).stop 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 msgr2=0x558a163ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47cd46f640 1 -- 172.21.15.170:0/2995831160 reap_dead start 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.492+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163ab2e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f47bc044810 tx=0x7f47bc06af10 comp rx=0 tx=0).stop 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 shutdown_connections 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2995831160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a163a3f30 0x558a163ab2e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 >> 172.21.15.170:0/2995831160 conn(0x558a163a0240 msgr2=0x558a1639d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 shutdown_connections 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2995831160 wait complete. 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46a4036950 msgr2=0x7f46a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46a4036950 0x7f46a4038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x558a1637ca90 tx=0x7f47c0006000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a16396d30 msgr2=0x558a16397150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a16396d30 0x558a16397150 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f47bc08c680 tx=0x7f47bc009770 comp rx=0 tx=0).stop 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 shutdown_connections 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46a4036950 0x7f46a4038e10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2296542841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a16396d30 0x558a16397150 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 >> 172.21.15.170:0/2296542841 conn(0x558a1638add0 msgr2=0x558a1638b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 shutdown_connections 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2296542841 wait complete. 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a16381e30 msgr2=0x558a16384220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x558a16381e30 0x558a16384220 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a161f3140 msgr2=0x558a1637f5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x558a161f3140 0x558a1637f5a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558a16385d30 msgr2=0x558a163881a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x558a16385d30 0x558a163881a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46b4036950 msgr2=0x7f46b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f46b4036950 0x7f46b4038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47c0000c00 tx=0x7f47c00013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 msgr2=0x558a16378530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 --2- 172.21.15.170:0/2750807996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558a161f1c30 0x558a16378530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c00 tx=0x7f47bc002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47cd46f640 1 -- 172.21.15.170:0/2750807996 reap_dead start 2024-04-26T12:30:35.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 shutdown_connections 2024-04-26T12:30:35.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 >> 172.21.15.170:0/2750807996 conn(0x558a16278b80 msgr2=0x558a1636f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 shutdown_connections 2024-04-26T12:30:35.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.493+0000 7f47d1611800 1 -- 172.21.15.170:0/2750807996 wait complete. 2024-04-26T12:30:35.508 INFO:teuthology.orchestra.run.smithi170.stdout:{"key":"bucket:myfoo","ver":{"tag":"_Aqj2dy3HV_O2F_rvke26z4P","ver":2},"mtime":"2024-04-26T12:30:35.214181Z","data":{"bucket":{"name":"myfoo","marker":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","bucket_id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-04-26T12:30:34.022086Z","linked":false,"has_bucket_info":false}} 2024-04-26T12:30:35.508 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_Aqj2dy3HV_O2F_rvke26z4P', 'ver': 2}, 'mtime': '2024-04-26T12:30:35.214181Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'bucket_id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-26T12:30:34.022086Z', 'linked': False, 'has_bucket_info': False}} 2024-04-26T12:30:35.508 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1'] 2024-04-26T12:30:35.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1'] 2024-04-26T12:30:35.508 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:35.594 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:35.595 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.594+0000 7f16c7d42800 1 Processor -- start 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.594+0000 7f16c7d42800 1 -- start start 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.594+0000 7f16c7d42800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5578fe64fe00 0x5578fe6e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.594+0000 7f16c7d42800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578fe5880c0 con 0x5578fe651140 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.594+0000 7f16c7d42800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5578fe56c4d0 con 0x5578fe64fe00 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.595+0000 7f16c5040640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5578fe64fe00 0x5578fe6e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.595+0000 7f16c5841640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5578fe651140 0x5578fe64f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46278/0 (socket says 172.21.15.170:46278) 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.595+0000 7f16c5040640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5578fe64fe00 0x5578fe6e4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42624/0 (socket says 172.21.15.170:42624) 2024-04-26T12:30:35.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.595+0000 7f16c5841640 1 -- 172.21.15.170:0/3063625116 learned_addr learned my addr 172.21.15.170:0/3063625116 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:35.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.595+0000 7f16c5040640 1 -- 172.21.15.170:0/3063625116 >> v1:172.21.15.132:6789/0 conn(0x5578fe651140 legacy=0x5578fe64f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.595+0000 7f16c5040640 1 -- 172.21.15.170:0/3063625116 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fe599d40 con 0x5578fe64fe00 2024-04-26T12:30:35.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.595+0000 7f16c483f640 1 -- 172.21.15.170:0/3063625116 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491381680 0 0) 0x5578fe5880c0 con 0x5578fe651140 2024-04-26T12:30:35.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.597+0000 7f16c5040640 1 --2- 172.21.15.170:0/3063625116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe6e4480 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00a470 tx=0x7f16bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cb29992b045174 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.597+0000 7f16c483f640 1 -- 172.21.15.170:0/3063625116 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16bc057070 con 0x5578fe64fe00 2024-04-26T12:30:35.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.597+0000 7f16c483f640 1 -- 172.21.15.170:0/3063625116 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16bc052570 con 0x5578fe64fe00 2024-04-26T12:30:35.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.597+0000 7f16c483f640 1 -- 172.21.15.170:0/3063625116 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16bc052870 con 0x5578fe64fe00 2024-04-26T12:30:35.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.598+0000 7f16c7d42800 1 -- 172.21.15.170:0/3063625116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 msgr2=0x5578fe6e4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.598+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3063625116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe6e4480 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f16bc00a470 tx=0x7f16bc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:35.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.598+0000 7f16c7d42800 1 -- 172.21.15.170:0/3063625116 shutdown_connections 2024-04-26T12:30:35.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.598+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3063625116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe6e4480 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.598+0000 7f16c7d42800 1 -- 172.21.15.170:0/3063625116 >> 172.21.15.170:0/3063625116 conn(0x5578fe6d6ba0 msgr2=0x5578fe6d8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.598+0000 7f16c7d42800 1 -- 172.21.15.170:0/3063625116 shutdown_connections 2024-04-26T12:30:35.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.598+0000 7f16c7d42800 1 -- 172.21.15.170:0/3063625116 wait complete. 2024-04-26T12:30:35.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.609+0000 7f16c7d42800 1 Processor -- start 2024-04-26T12:30:35.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.609+0000 7f16c7d42800 1 -- start start 2024-04-26T12:30:35.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.609+0000 7f16c7d42800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe7ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.609+0000 7f16c7d42800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578fe626b60 con 0x5578fe64fe00 2024-04-26T12:30:35.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe7ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe7ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42626/0 (socket says 172.21.15.170:42626) 2024-04-26T12:30:35.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f16c5841640 1 -- 172.21.15.170:0/3277807177 learned_addr learned my addr 172.21.15.170:0/3277807177 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f16c5841640 1 -- 172.21.15.170:0/3277807177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fe598590 con 0x5578fe64fe00 2024-04-26T12:30:35.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f16c5841640 1 --2- 172.21.15.170:0/3277807177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe7ceb90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001e00 tx=0x7f16b800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48925b40df01f4d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f15b3e07640 1 -- 172.21.15.170:0/3277807177 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8012020 con 0x5578fe64fe00 2024-04-26T12:30:35.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f15b3e07640 1 -- 172.21.15.170:0/3277807177 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b800e5c0 con 0x5578fe64fe00 2024-04-26T12:30:35.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.610+0000 7f15b3e07640 1 -- 172.21.15.170:0/3277807177 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b800e8e0 con 0x5578fe64fe00 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 -- 172.21.15.170:0/3277807177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 msgr2=0x5578fe7ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3277807177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe7ceb90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001e00 tx=0x7f16b800b780 comp rx=0 tx=0).stop 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 -- 172.21.15.170:0/3277807177 shutdown_connections 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3277807177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe64fe00 0x5578fe7ceb90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 -- 172.21.15.170:0/3277807177 >> 172.21.15.170:0/3277807177 conn(0x5578fe6d6ba0 msgr2=0x5578fe7ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 -- 172.21.15.170:0/3277807177 shutdown_connections 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 -- 172.21.15.170:0/3277807177 wait complete. 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 Processor -- start 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.611+0000 7f16c7d42800 1 -- start start 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c7d42800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe651140 0x5578fe7d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c7d42800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578fe6e6cd0 con 0x5578fe651140 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe651140 0x5578fe7d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe651140 0x5578fe7d67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42636/0 (socket says 172.21.15.170:42636) 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c5841640 1 -- 172.21.15.170:0/3824754386 learned_addr learned my addr 172.21.15.170:0/3824754386 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c5841640 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fe58f8f0 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c5841640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe651140 0x5578fe7d67a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5578fe7cf920 tx=0x7f16b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f15b2604640 1 -- 172.21.15.170:0/3824754386 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8012030 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f15b2604640 1 -- 172.21.15.170:0/3824754386 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b801a700 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f15b2604640 1 -- 172.21.15.170:0/3824754386 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b801a9e0 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578fe7d6ce0 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.612+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578fe7d7200 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.613+0000 7f15b2604640 1 -- 172.21.15.170:0/3824754386 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16b8015020 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.613+0000 7f15b2604640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15ac036900 0x7f15ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.613+0000 7f15b2604640 1 -- 172.21.15.170:0/3824754386 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f16b8020030 con 0x5578fe651140 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.613+0000 7f16c5040640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15ac036900 0x7f15ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.613+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe7db800 0x5578fe7ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.613+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe7de130 con 0x5578fe7db800 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c6042640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe7db800 0x5578fe7ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c5040640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15ac036900 0x7f15ac038dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16bc054000 tx=0x7f16bc04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c6042640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe7db800 0x5578fe7ddbf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c6042640 1 -- 172.21.15.170:0/3824754386 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe7db800 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe7dade0 con 0x5578fe7db800 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c6042640 1 -- 172.21.15.170:0/3824754386 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe7db800 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe7e0410 0x5578fe7e2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.614+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe7e2ed0 con 0x5578fe7e0410 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.615+0000 7f16c5841640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe7e0410 0x5578fe7e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.615+0000 7f16c5841640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe7e0410 0x5578fe7e2800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.615+0000 7f16c5841640 1 -- 172.21.15.170:0/3824754386 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16b800dcd0 con 0x5578fe7e0410 2024-04-26T12:30:35.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.615+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe7df3c0 con 0x5578fe7db800 2024-04-26T12:30:35.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.616+0000 7f16c6042640 1 -- 172.21.15.170:0/3824754386 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe7db800 2024-04-26T12:30:35.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.616+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578fe7e4310 0x5578fe7e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.616+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe7e6f60 con 0x5578fe7e4310 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.616+0000 7f16c5040640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578fe7e4310 0x5578fe7e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.616+0000 7f16c5040640 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578fe7e4310 0x5578fe7e67d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.616+0000 7f16c5040640 1 -- 172.21.15.170:0/3824754386 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16bc052940 con 0x5578fe7e4310 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c7d42800 1 Processor -- start 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c7d42800 1 -- start start 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c7d42800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe7f53c0 0x5578fe7f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c7d42800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578fe5cce60 con 0x5578fe7f53c0 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe7f53c0 0x5578fe7f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe7f53c0 0x5578fe7f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42646/0 (socket says 172.21.15.170:42646) 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c5841640 1 -- 172.21.15.170:0/4044958361 learned_addr learned my addr 172.21.15.170:0/4044958361 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c5841640 1 -- 172.21.15.170:0/4044958361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fe7f5d20 con 0x5578fe7f53c0 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f16c5841640 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe7f53c0 0x5578fe7f57e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001400 tx=0x7f16b801af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f15ab7fe640 1 -- 172.21.15.170:0/4044958361 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b804c1a0 con 0x5578fe7f53c0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.617+0000 7f15ab7fe640 1 -- 172.21.15.170:0/4044958361 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b804c340 con 0x5578fe7f53c0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.618+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578fe7f6790 con 0x5578fe7f53c0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.618+0000 7f15ab7fe640 1 -- 172.21.15.170:0/4044958361 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b80440f0 con 0x5578fe7f53c0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.618+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578fe7f6c90 con 0x5578fe7f53c0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.618+0000 7f15ab7fe640 1 -- 172.21.15.170:0/4044958361 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16b8044290 con 0x5578fe7f53c0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.618+0000 7f15ab7fe640 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15a00369c0 0x7f15a0038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.618+0000 7f15ab7fe640 1 -- 172.21.15.170:0/4044958361 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f16b8037c80 con 0x5578fe7f53c0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.618+0000 7f16c5040640 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15a00369c0 0x7f15a0038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c7d42800 1 Processor -- start 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c7d42800 1 -- start start 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c5040640 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15a00369c0 0x7f15a0038e80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5578fe7de590 tx=0x7f16bc005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c7d42800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe802b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c7d42800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578fe7cf310 con 0x5578fe802700 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe802b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe802b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42652/0 (socket says 172.21.15.170:42652) 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c5841640 1 -- 172.21.15.170:0/657467033 learned_addr learned my addr 172.21.15.170:0/657467033 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c5841640 1 -- 172.21.15.170:0/657467033 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fe8030f0 con 0x5578fe802700 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.619+0000 7f16c5841640 1 --2- 172.21.15.170:0/657467033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe802b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f16b804c640 tx=0x7f16b8039e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64aaa11269f4836 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f15a97fa640 1 -- 172.21.15.170:0/657467033 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b8053040 con 0x5578fe802700 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f15a97fa640 1 -- 172.21.15.170:0/657467033 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8044580 con 0x5578fe802700 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f15a97fa640 1 -- 172.21.15.170:0/657467033 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b803ed80 con 0x5578fe802700 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 -- 172.21.15.170:0/657467033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 msgr2=0x5578fe802b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 --2- 172.21.15.170:0/657467033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe802b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f16b804c640 tx=0x7f16b8039e60 comp rx=0 tx=0).stop 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 -- 172.21.15.170:0/657467033 shutdown_connections 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 --2- 172.21.15.170:0/657467033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe802b20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 -- 172.21.15.170:0/657467033 >> 172.21.15.170:0/657467033 conn(0x5578fe7fea20 msgr2=0x5578fe7fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 -- 172.21.15.170:0/657467033 shutdown_connections 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 -- 172.21.15.170:0/657467033 wait complete. 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 Processor -- start 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.620+0000 7f16c7d42800 1 -- start start 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c7d42800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe809b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c7d42800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5578fe803810 con 0x5578fe802700 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe809b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c5841640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe809b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42654/0 (socket says 172.21.15.170:42654) 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 learned_addr learned my addr 172.21.15.170:0/1651298129 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fe80a050 con 0x5578fe802700 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c5841640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe809b10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001da0 tx=0x7f16b8003460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f15977fe640 1 -- 172.21.15.170:0/1651298129 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b803eba0 con 0x5578fe802700 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f15977fe640 1 -- 172.21.15.170:0/1651298129 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b8067030 con 0x5578fe802700 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578fe80a050 con 0x5578fe802700 2024-04-26T12:30:35.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.621+0000 7f15977fe640 1 -- 172.21.15.170:0/1651298129 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16b80030d0 con 0x5578fe802700 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.622+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578fe80a050 con 0x5578fe802700 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.622+0000 7f15977fe640 1 -- 172.21.15.170:0/1651298129 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16b803e350 con 0x5578fe802700 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.622+0000 7f15977fe640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1590036900 0x7f1590038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.622+0000 7f15977fe640 1 -- 172.21.15.170:0/1651298129 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f16b8071a00 con 0x5578fe802700 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.622+0000 7f16c5040640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1590036900 0x7f1590038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.623+0000 7f16c5040640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1590036900 0x7f1590038dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16bc052fd0 tx=0x7f16bc04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.623+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.623+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe8151a0 0x5578fe817660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.623+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe817db0 con 0x5578fe8151a0 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.623+0000 7f16c6042640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe8151a0 0x5578fe817660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.623+0000 7f16c6042640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe8151a0 0x5578fe817660 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 realm 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8181c0 con 0x5578fe8151a0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818a90 con 0x5578fe8151a0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe8151a0 2024-04-26T12:30:35.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe819b90 0x5578fe81bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.624+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe81c540 con 0x5578fe819b90 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c5841640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe819b90 0x5578fe81bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c5841640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe819b90 0x5578fe81bf80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c7d42800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c7d42800 20 searching for the correct realm 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578fe81e4f0 0x5578fe8209b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe821080 con 0x5578fe81e4f0 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c5040640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578fe81e4f0 0x5578fe8209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.625+0000 7f16c5040640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578fe81e4f0 0x5578fe8209b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.626+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.626+0000 7f16c5040640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16bc076040 0x7f16bc083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.626+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe821080 con 0x7f16bc076040 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.626+0000 7f16c6042640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16bc076040 0x7f16bc083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.626+0000 7f16c6042640 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16bc076040 0x7f16bc083410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.626+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.626+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe819b90 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe8151a0 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe8151a0 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe819b90 2024-04-26T12:30:35.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.627+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe819b90 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x7f16bc076040 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe81e4f0 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe8151a0 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.628+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe819b90 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe8151a0 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x7f16bc076040 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5578fe818e30 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.629+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe819b90 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe8151a0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.630+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe8151a0 2024-04-26T12:30:35.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe819b90 2024-04-26T12:30:35.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe81e4f0 2024-04-26T12:30:35.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x7f16bc076040 2024-04-26T12:30:35.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.631+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe8151a0 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe819b90 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe81e4f0 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe819b90 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.632+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x7f16bc076040 2024-04-26T12:30:35.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.633+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.633+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe81e4f0 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.633+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.633+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe819b90 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.633+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.633+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x5578fe8151a0 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.633+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f16bc090040 con 0x7f16bc076040 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:35.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe81ce00 con 0x5578fe8151a0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe81ce00 con 0x5578fe8151a0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe81ce00 con 0x7f16bc076040 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 zone default found 2024-04-26T12:30:35.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 4 Realm: () 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 zonegroup default 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.634+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe81d6a0 con 0x5578fe819b90 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe822ee0 con 0x5578fe81e4f0 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823280 con 0x5578fe81e4f0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 20 started sync module instance, tier type = 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.635+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe822380 con 0x7f16bc076040 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.636+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.636+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93978154379392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe822380 con 0x7f16bc076040 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.637+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823c40 con 0x5578fe8151a0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.638+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93978154379392] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.638+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.638+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93978154377392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823c40 con 0x5578fe8151a0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.638+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe824600 con 0x5578fe81e4f0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.639+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93978154377392] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.639+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.639+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93978154383248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823bb0 con 0x5578fe81e4f0 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.639+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe825370 con 0x7f16bc076040 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.640+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.640+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93978154389152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe825c10 con 0x7f16bc076040 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.640+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8266b0 con 0x5578fe8151a0 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.640+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93978154383248] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.641+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.641+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93978154394016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe826670 con 0x5578fe8151a0 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.641+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8270f0 con 0x5578fe819b90 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.641+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93978154389152] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.642+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.642+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93978154396736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8274e0 con 0x5578fe819b90 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.642+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe827ea0 con 0x5578fe819b90 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.642+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93978154394016] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.643+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93978154396736] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.643+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.643+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93978154400240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe828290 con 0x5578fe819b90 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.643+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe828ae0 con 0x5578fe819b90 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93978154400240] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93978154402448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe828b60 con 0x5578fe819b90 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 20 add_watcher() i=0 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 20 add_watcher() i=1 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 20 add_watcher() i=2 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 20 add_watcher() i=3 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 20 add_watcher() i=4 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 20 add_watcher() i=5 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.644+0000 7f16c7d42800 20 add_watcher() i=6 2024-04-26T12:30:35.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.645+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93978154402448] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.645+0000 7f16c7d42800 20 add_watcher() i=7 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.645+0000 7f16c7d42800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.645+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe82be90 con 0x5578fe8151a0 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.645+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.645+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93978154403872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8290f0 con 0x5578fe8151a0 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93978154403872] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f15777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f16c7d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f16c7d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f16c7d42800 5 note: GC not initialized 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f15767fc640 20 reqs_thread_entry: start 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f16c7d42800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.646+0000 7f16c7d42800 20 Filter name: none 2024-04-26T12:30:35.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f14e7fff640 20 reqs_thread_entry: start 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe85f5e0 con 0x5578fe819b90 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.647+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8616c0 con 0x7f16bc076040 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:35.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe863100 con 0x5578fe8151a0 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(64 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.648+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe867710 con 0x7f16bc076040 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.649+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.649+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe86d5f0 con 0x5578fe8151a0 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(66 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c7d42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c7d42800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c7d42800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c7d42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93978154641872 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe867b40 con 0x5578fe8151a0 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 93978154394016 notify 128849018892 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5578fe8634f0 con 0x5578fe8151a0 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f15a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 93978154394016 notifier 4509 bl.length()=752 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f15a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f15a97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f15a97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f15a97fa640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1588003ea0 con 0x5578fe8151a0 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.650+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(67 notify.4 [notify cookie 93978154641872 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.651+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.651+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 93978154641872 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5578fe862640 con 0x5578fe8151a0 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.651+0000 7f16c7d42800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_sources= new_sources= 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.651+0000 7f16c7d42800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential sources added=[] removed=[] 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.651+0000 7f16c7d42800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_dests= new_dests= 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.651+0000 7f16c7d42800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential dests added=[] removed=[] 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.651+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe86be30 con 0x5578fe819b90 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.652+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 fud.buckets [call] v30'3 uv3 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.652+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe86ce40 con 0x7f16bc076040 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.653+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.653+0000 7f16c7d42800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.653+0000 7f16c7d42800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.653+0000 7f16c7d42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.653+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93978154641872 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5578fe86c2e0 con 0x5578fe819b90 2024-04-26T12:30:35.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== watch-notify(notify (1) cookie 93978154400240 notify 128849018889 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5578fe7f6790 con 0x5578fe819b90 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f15a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 93978154400240 notifier 4509 bl.length()=314 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f15a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(71 notify.6 [notify cookie 93978154641872 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f15a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f15a8ff9640 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f14f0003400 con 0x5578fe819b90 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.654+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== watch-notify(notify_complete (2) cookie 93978154641872 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5578fe7f5d20 con 0x5578fe819b90 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.655+0000 7f15777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.655+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93978154403872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe864050 con 0x5578fe8151a0 2024-04-26T12:30:35.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.656+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93978154403872] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.656+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93978154379392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe864050 con 0x7f16bc076040 2024-04-26T12:30:35.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.657+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93978154379392] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.657+0000 7f16c7d42800 20 remove_watcher() i=0 2024-04-26T12:30:35.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.657+0000 7f16c7d42800 2 removed watcher, disabling cache 2024-04-26T12:30:35.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.657+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93978154377392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe822880 con 0x5578fe8151a0 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.658+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93978154377392] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.658+0000 7f16c7d42800 20 remove_watcher() i=1 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.658+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93978154383248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8220b0 con 0x5578fe81e4f0 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.659+0000 7f16c5040640 1 -- 172.21.15.170:0/1651298129 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93978154383248] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16bc081070 con 0x5578fe81e4f0 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.659+0000 7f16c7d42800 20 remove_watcher() i=2 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.659+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93978154389152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823790 con 0x7f16bc076040 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.660+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93978154389152] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x7f16bc076040 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.660+0000 7f16c7d42800 20 remove_watcher() i=3 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.660+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93978154394016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823790 con 0x5578fe8151a0 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.661+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93978154394016] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16c000a4a0 con 0x5578fe8151a0 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.661+0000 7f16c7d42800 20 remove_watcher() i=4 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.661+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93978154396736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823790 con 0x5578fe819b90 2024-04-26T12:30:35.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.662+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93978154396736] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.662+0000 7f16c7d42800 20 remove_watcher() i=5 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.662+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93978154400240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe823790 con 0x5578fe819b90 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.663+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93978154400240] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.663+0000 7f16c7d42800 20 remove_watcher() i=6 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.663+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93978154402448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5578fe8279f0 con 0x5578fe819b90 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c5841640 1 -- 172.21.15.170:0/1651298129 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93978154402448] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16b803d070 con 0x5578fe819b90 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 20 remove_watcher() i=7 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe819b90 msgr2=0x5578fe81bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe819b90 0x5578fe81bf80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe8151a0 msgr2=0x5578fe817660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe8151a0 0x5578fe817660 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16bc076040 msgr2=0x7f16bc083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16bc076040 0x7f16bc083410 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578fe81e4f0 msgr2=0x5578fe8209b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5578fe81e4f0 0x5578fe8209b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1590036900 msgr2=0x7f1590038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1590036900 0x7f1590038dc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16bc052fd0 tx=0x7f16bc04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c6042640 1 -- 172.21.15.170:0/1651298129 reap_dead start 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 msgr2=0x5578fe809b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe809b10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001da0 tx=0x7f16b8003460 comp rx=0 tx=0).stop 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 shutdown_connections 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 --2- 172.21.15.170:0/1651298129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe802700 0x5578fe809b10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 >> 172.21.15.170:0/1651298129 conn(0x5578fe7fea20 msgr2=0x5578fe7fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 shutdown_connections 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.664+0000 7f16c7d42800 1 -- 172.21.15.170:0/1651298129 wait complete. 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15a00369c0 msgr2=0x7f15a0038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15a00369c0 0x7f15a0038e80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5578fe7de590 tx=0x7f16bc005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe7f53c0 msgr2=0x5578fe7f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe7f53c0 0x5578fe7f57e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f16b8001400 tx=0x7f16b801af50 comp rx=0 tx=0).stop 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 shutdown_connections 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15a00369c0 0x7f15a0038e80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/4044958361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe7f53c0 0x5578fe7f57e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 >> 172.21.15.170:0/4044958361 conn(0x5578fe7e9460 msgr2=0x5578fe7e9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 shutdown_connections 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/4044958361 wait complete. 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe7e0410 msgr2=0x5578fe7e2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5578fe7e0410 0x5578fe7e2800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe7db800 msgr2=0x5578fe7ddbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5578fe7db800 0x5578fe7ddbf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578fe7e4310 msgr2=0x5578fe7e67d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5578fe7e4310 0x5578fe7e67d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15ac036900 msgr2=0x7f15ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15ac036900 0x7f15ac038dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16bc054000 tx=0x7f16bc04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe651140 msgr2=0x5578fe7d67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 --2- 172.21.15.170:0/3824754386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5578fe651140 0x5578fe7d67a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5578fe7cf920 tx=0x7f16b8000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c6042640 1 -- 172.21.15.170:0/3824754386 reap_dead start 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 shutdown_connections 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 >> 172.21.15.170:0/3824754386 conn(0x5578fe6d6ba0 msgr2=0x5578fe7c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 shutdown_connections 2024-04-26T12:30:35.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.665+0000 7f16c7d42800 1 -- 172.21.15.170:0/3824754386 wait complete. 2024-04-26T12:30:35.679 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T12:30:35.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T12:30:35.679 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T12:30:35.722 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:35.722 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:35.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.721+0000 7f5d8ad46800 1 Processor -- start 2024-04-26T12:30:35.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.721+0000 7f5d8ad46800 1 -- start start 2024-04-26T12:30:35.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8ad46800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b451da4960 0x55b451da6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8ad46800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b451c4d0c0 con 0x55b451da05c0 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8ad46800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55b451c314d0 con 0x55b451da4960 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8004b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b451da4960 0x55b451da6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8884c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55b451da05c0 0x55b451da09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46294/0 (socket says 172.21.15.170:46294) 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8004b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b451da4960 0x55b451da6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42670/0 (socket says 172.21.15.170:42670) 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8884c640 1 -- 172.21.15.170:0/2965548735 learned_addr learned my addr 172.21.15.170:0/2965548735 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8004b640 1 -- 172.21.15.170:0/2965548735 >> v1:172.21.15.132:6789/0 conn(0x55b451da05c0 legacy=0x55b451da09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.722+0000 7f5d8004b640 1 -- 172.21.15.170:0/2965548735 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b451c5ed40 con 0x55b451da4960 2024-04-26T12:30:35.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.724+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2965548735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da4960 0x55b451da6d50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000a470 tx=0x7f5d7001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2f2067af36ffc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.724+0000 7f5d83fff640 1 -- 172.21.15.170:0/2965548735 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d70057070 con 0x55b451da4960 2024-04-26T12:30:35.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.724+0000 7f5d83fff640 1 -- 172.21.15.170:0/2965548735 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d70052570 con 0x55b451da4960 2024-04-26T12:30:35.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.724+0000 7f5d83fff640 1 -- 172.21.15.170:0/2965548735 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d70052870 con 0x55b451da4960 2024-04-26T12:30:35.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.725+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2965548735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da4960 msgr2=0x55b451da6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.725+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2965548735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da4960 0x55b451da6d50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000a470 tx=0x7f5d7001ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:35.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.725+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2965548735 shutdown_connections 2024-04-26T12:30:35.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.725+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2965548735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da4960 0x55b451da6d50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.725+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2965548735 >> 172.21.15.170:0/2965548735 conn(0x55b451d9bb80 msgr2=0x55b451d9dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.725+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2965548735 shutdown_connections 2024-04-26T12:30:35.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.725+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2965548735 wait complete. 2024-04-26T12:30:35.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8ad46800 1 Processor -- start 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8ad46800 1 -- start start 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8ad46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451e91730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8ad46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b451cebb40 con 0x55b451da05c0 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451e91730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451e91730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42680/0 (socket says 172.21.15.170:42680) 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8884c640 1 -- 172.21.15.170:0/2422216062 learned_addr learned my addr 172.21.15.170:0/2422216062 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8884c640 1 -- 172.21.15.170:0/2422216062 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b451c5d590 con 0x55b451da05c0 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.737+0000 7f5d8884c640 1 --2- 172.21.15.170:0/2422216062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451e91730 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d78001e10 tx=0x7f5d7800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4effbc59b38a4f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5c76e0d640 1 -- 172.21.15.170:0/2422216062 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78012020 con 0x55b451da05c0 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5c76e0d640 1 -- 172.21.15.170:0/2422216062 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7800e5a0 con 0x55b451da05c0 2024-04-26T12:30:35.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5c76e0d640 1 -- 172.21.15.170:0/2422216062 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7800e8e0 con 0x55b451da05c0 2024-04-26T12:30:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2422216062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 msgr2=0x55b451e91730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2422216062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451e91730 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d78001e10 tx=0x7f5d7800b780 comp rx=0 tx=0).stop 2024-04-26T12:30:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2422216062 shutdown_connections 2024-04-26T12:30:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2422216062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451e91730 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2422216062 >> 172.21.15.170:0/2422216062 conn(0x55b451d9bb80 msgr2=0x55b451e8d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2422216062 shutdown_connections 2024-04-26T12:30:35.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.738+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2422216062 wait complete. 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8ad46800 1 Processor -- start 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8ad46800 1 -- start start 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8ad46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451d15f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8ad46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b451da7620 con 0x55b451da05c0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451d15f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451d15f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42686/0 (socket says 172.21.15.170:42686) 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8884c640 1 -- 172.21.15.170:0/805349475 learned_addr learned my addr 172.21.15.170:0/805349475 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.739+0000 7f5d8884c640 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b451c548f0 con 0x55b451da05c0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.740+0000 7f5d8884c640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451d15f90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800b7c0 tx=0x7f5d78000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.740+0000 7f5c7560a640 1 -- 172.21.15.170:0/805349475 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78012030 con 0x55b451da05c0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.740+0000 7f5c7560a640 1 -- 172.21.15.170:0/805349475 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78001470 con 0x55b451da05c0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.740+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b451d164d0 con 0x55b451da05c0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.740+0000 7f5c7560a640 1 -- 172.21.15.170:0/805349475 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7801a8d0 con 0x55b451da05c0 2024-04-26T12:30:35.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.740+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b451d14a20 con 0x55b451da05c0 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.740+0000 7f5c7560a640 1 -- 172.21.15.170:0/805349475 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d78015020 con 0x55b451da05c0 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5c7560a640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c70036950 0x7f5c70038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5c7560a640 1 -- 172.21.15.170:0/805349475 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5d78020030 con 0x55b451da05c0 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5d8004b640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c70036950 0x7f5c70038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451da4960 0x55b451ea2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ea2a60 con 0x55b451da4960 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5d8904d640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451da4960 0x55b451ea2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5d8004b640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c70036950 0x7f5c70038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d70054000 tx=0x7f5d7004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.741+0000 7f5d8904d640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451da4960 0x55b451ea2520 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.742+0000 7f5d8904d640 1 -- 172.21.15.170:0/805349475 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451da4960 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.742+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ea2e00 con 0x55b451da4960 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.742+0000 7f5d8904d640 1 -- 172.21.15.170:0/805349475 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451da4960 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.742+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451ea4bc0 0x55b451ea6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.742+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ea7650 con 0x55b451ea4bc0 2024-04-26T12:30:35.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.742+0000 7f5d8884c640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451ea4bc0 0x55b451ea6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.742+0000 7f5d8884c640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451ea4bc0 0x55b451ea6fb0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.743+0000 7f5d8884c640 1 -- 172.21.15.170:0/805349475 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d7802dcf0 con 0x55b451ea4bc0 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.743+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ea3b70 con 0x55b451da4960 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.743+0000 7f5d8904d640 1 -- 172.21.15.170:0/805349475 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451da4960 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.743+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b451ea8b00 0x55b451eaaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.743+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451eab6d0 con 0x55b451ea8b00 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.743+0000 7f5d8004b640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b451ea8b00 0x55b451eaaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.743+0000 7f5d8004b640 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b451ea8b00 0x55b451eaaf70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8004b640 1 -- 172.21.15.170:0/805349475 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d70052a40 con 0x55b451ea8b00 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8ad46800 1 Processor -- start 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8ad46800 1 -- start start 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8ad46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451eb9af0 0x55b451eb9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8ad46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b451c91e60 con 0x55b451eb9af0 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451eb9af0 0x55b451eb9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451eb9af0 0x55b451eb9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42696/0 (socket says 172.21.15.170:42696) 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.744+0000 7f5d8884c640 1 -- 172.21.15.170:0/2106515320 learned_addr learned my addr 172.21.15.170:0/2106515320 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.745+0000 7f5d8884c640 1 -- 172.21.15.170:0/2106515320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b451eba450 con 0x55b451eb9af0 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.745+0000 7f5d8884c640 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451eb9af0 0x55b451eb9f10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5d7804ae70 tx=0x7f5d78045f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.745+0000 7f5c6e7fc640 1 -- 172.21.15.170:0/2106515320 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78017e30 con 0x55b451eb9af0 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.745+0000 7f5c6e7fc640 1 -- 172.21.15.170:0/2106515320 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7803d070 con 0x55b451eb9af0 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.745+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b451ebaec0 con 0x55b451eb9af0 2024-04-26T12:30:35.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.745+0000 7f5c6e7fc640 1 -- 172.21.15.170:0/2106515320 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7804cc50 con 0x55b451eb9af0 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.745+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b451ebaec0 con 0x55b451eb9af0 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5c6e7fc640 1 -- 172.21.15.170:0/2106515320 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d78041040 con 0x55b451eb9af0 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5c6e7fc640 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c60036950 0x7f5c60038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5c6e7fc640 1 -- 172.21.15.170:0/2106515320 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5d78019070 con 0x55b451eb9af0 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c60036950 0x7f5c60038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8ad46800 1 Processor -- start 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8ad46800 1 -- start start 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c60036950 0x7f5c60038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55b451ea7a20 tx=0x7f5d70005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8ad46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ec6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8ad46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b451e91eb0 con 0x55b451ec6b50 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ec6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ec6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42702/0 (socket says 172.21.15.170:42702) 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.746+0000 7f5d8884c640 1 -- 172.21.15.170:0/3363309182 learned_addr learned my addr 172.21.15.170:0/3363309182 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8884c640 1 -- 172.21.15.170:0/3363309182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b451ec7540 con 0x55b451ec6b50 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8884c640 1 --2- 172.21.15.170:0/3363309182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ec6f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5d78038f00 tx=0x7f5d78044570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3fa82ad174fe1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5c5ffff640 1 -- 172.21.15.170:0/3363309182 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78024550 con 0x55b451ec6b50 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5c5ffff640 1 -- 172.21.15.170:0/3363309182 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d780446d0 con 0x55b451ec6b50 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5c5ffff640 1 -- 172.21.15.170:0/3363309182 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78038470 con 0x55b451ec6b50 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8ad46800 1 -- 172.21.15.170:0/3363309182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 msgr2=0x55b451ec6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/3363309182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ec6f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5d78038f00 tx=0x7f5d78044570 comp rx=0 tx=0).stop 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8ad46800 1 -- 172.21.15.170:0/3363309182 shutdown_connections 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/3363309182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ec6f70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8ad46800 1 -- 172.21.15.170:0/3363309182 >> 172.21.15.170:0/3363309182 conn(0x55b451ec2e20 msgr2=0x55b451ec0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8ad46800 1 -- 172.21.15.170:0/3363309182 shutdown_connections 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.747+0000 7f5d8ad46800 1 -- 172.21.15.170:0/3363309182 wait complete. 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8ad46800 1 Processor -- start 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8ad46800 1 -- start start 2024-04-26T12:30:35.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8ad46800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ecde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8ad46800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b451ec7c10 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ecde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8884c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ecde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42712/0 (socket says 172.21.15.170:42712) 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 learned_addr learned my addr 172.21.15.170:0/2183858798 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b451ece3c0 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.748+0000 7f5d8884c640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ecde80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5d78053000 tx=0x7f5d78007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.749+0000 7f5c5e7fc640 1 -- 172.21.15.170:0/2183858798 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d78070070 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.749+0000 7f5c5e7fc640 1 -- 172.21.15.170:0/2183858798 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7802d520 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.749+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b451ece3c0 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.749+0000 7f5c5e7fc640 1 -- 172.21.15.170:0/2183858798 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d7802d800 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.749+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b451ece3c0 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5c5e7fc640 1 -- 172.21.15.170:0/2183858798 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d78073070 con 0x55b451ec6b50 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5c5e7fc640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c54036950 0x7f5c54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5c5e7fc640 1 -- 172.21.15.170:0/2183858798 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f5d78066070 con 0x55b451ec6b50 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c54036950 0x7f5c54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451ed95a0 0x55b451edba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451edc1b0 con 0x55b451ed95a0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c54036950 0x7f5c54038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5d70052fd0 tx=0x7f5d7004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.750+0000 7f5d8904d640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451ed95a0 0x55b451edba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8904d640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451ed95a0 0x55b451edba60 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 20 realm 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451edc5c0 con 0x55b451ed95a0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451edce90 con 0x55b451ed95a0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451ed95a0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.751+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451eddf90 0x55b451ee0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee0940 con 0x55b451eddf90 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8884c640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451eddf90 0x55b451ee0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8884c640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451eddf90 0x55b451ee0380 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 20 searching for the correct realm 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b451ee28f0 0x55b451ee4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee5480 con 0x55b451ee28f0 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.752+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b451ee28f0 0x55b451ee4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.753+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b451ee28f0 0x55b451ee4db0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.753+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.753+0000 7f5d8004b640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5d70076040 0x7f5d70083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.753+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee5480 con 0x7f5d70076040 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.753+0000 7f5d8904d640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5d70076040 0x7f5d70083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.753+0000 7f5d8904d640 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5d70076040 0x7f5d70083410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451eddf90 2024-04-26T12:30:35.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451ed95a0 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451ed95a0 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.754+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451eddf90 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451eddf90 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x7f5d70076040 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451ee28f0 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.755+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451ed95a0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451eddf90 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451ed95a0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x7f5d70076040 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.756+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b451edd230 con 0x55b451ee28f0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ee28f0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451eddf90 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ee28f0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ee28f0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.757+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ed95a0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ed95a0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451eddf90 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ee28f0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x7f5d70076040 2024-04-26T12:30:35.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.758+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.759+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ed95a0 2024-04-26T12:30:35.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.759+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.759+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451eddf90 2024-04-26T12:30:35.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.759+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.759+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ee28f0 2024-04-26T12:30:35.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.759+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.759+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451eddf90 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x7f5d70076040 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ee28f0 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451eddf90 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.760+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x55b451ed95a0 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f5d70090040 con 0x7f5d70076040 2024-04-26T12:30:35.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee1200 con 0x55b451ed95a0 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee1200 con 0x55b451ed95a0 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.761+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee1200 con 0x7f5d70076040 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 zone default found 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 4 Realm: () 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 zonegroup default 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee1aa0 con 0x55b451eddf90 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee72e0 con 0x55b451ee28f0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.762+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee7680 con 0x55b451ee28f0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.763+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.763+0000 7f5d8ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.763+0000 7f5d8ad46800 20 started sync module instance, tier type = 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.763+0000 7f5d8ad46800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.763+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee6780 con 0x7f5d70076040 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.764+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.764+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232957053808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee6780 con 0x7f5d70076040 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.764+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee8040 con 0x55b451ed95a0 2024-04-26T12:30:35.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.765+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94232957053808] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.765+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.765+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94232957052080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee8040 con 0x55b451ed95a0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.765+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee8a40 con 0x55b451ee28f0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.766+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.766+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94232957060432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee92e0 con 0x55b451ee28f0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.766+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee9d80 con 0x7f5d70076040 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.766+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94232957052080] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.767+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94232957060432] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.767+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.767+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94232957062704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee7b90 con 0x7f5d70076040 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.767+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eea620 con 0x55b451ed95a0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.768+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94232957062704] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.768+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.768+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94232957065296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eea5a0 con 0x55b451ed95a0 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.768+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eeb030 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.769+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.769+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94232957070208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eeb880 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.769+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eec2d0 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.769+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94232957065296] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.772+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94232957070208] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.772+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.772+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94232957074880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eec6c0 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.772+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eecf10 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.773+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94232957074880] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94232957078112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eece80 con 0x55b451eddf90 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 20 add_watcher() i=0 2024-04-26T12:30:35.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 20 add_watcher() i=1 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 20 add_watcher() i=2 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 20 add_watcher() i=3 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 20 add_watcher() i=4 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 20 add_watcher() i=5 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.775+0000 7f5d8ad46800 20 add_watcher() i=6 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.776+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94232957078112] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.776+0000 7f5d8ad46800 20 add_watcher() i=7 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.776+0000 7f5d8ad46800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.776+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef07e0 con 0x55b451ed95a0 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.776+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.776+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94232957080320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eedc10 con 0x55b451ed95a0 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.777+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94232957080320] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.777+0000 7f5c3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.777+0000 7f5d8ad46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:35.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.777+0000 7f5d8ad46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:35.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.777+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef91f0 con 0x55b451ed95a0 2024-04-26T12:30:35.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.779+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.779+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef9840 con 0x55b451eddf90 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.780+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.780+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef9840 con 0x55b451ee28f0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.781+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.781+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef8ce0 con 0x55b451ed95a0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.782+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.782+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451efa550 con 0x7f5d70076040 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.783+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.783+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451efaac0 con 0x55b451ee28f0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.784+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.784+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451efb030 con 0x55b451ed95a0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.785+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.785+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451efb4e0 con 0x55b451eddf90 2024-04-26T12:30:35.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.786+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.786+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451efb4e0 con 0x7f5d70076040 2024-04-26T12:30:35.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.787+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.787+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451efb4e0 con 0x55b451ee28f0 2024-04-26T12:30:35.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.788+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.788+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6ee0 con 0x7f5d70076040 2024-04-26T12:30:35.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.789+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.789+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6ee0 con 0x55b451eddf90 2024-04-26T12:30:35.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.790+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.790+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6ee0 con 0x7f5d70076040 2024-04-26T12:30:35.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.791+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.791+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x55b451eddf90 2024-04-26T12:30:35.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.792+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.792+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x55b451ed95a0 2024-04-26T12:30:35.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.793+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.793+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x55b451ee28f0 2024-04-26T12:30:35.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.794+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.794+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x7f5d70076040 2024-04-26T12:30:35.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.795+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.795+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x55b451ee28f0 2024-04-26T12:30:35.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.796+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.796+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x55b451ed95a0 2024-04-26T12:30:35.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.797+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.797+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x55b451ed95a0 2024-04-26T12:30:35.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.798+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.798+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef6d10 con 0x55b451ee28f0 2024-04-26T12:30:35.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.799+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.799+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x7f5d70076040 2024-04-26T12:30:35.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.800+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.800+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451ee28f0 2024-04-26T12:30:35.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.801+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.801+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451ee28f0 2024-04-26T12:30:35.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.802+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.802+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451ee28f0 2024-04-26T12:30:35.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.803+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.803+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451ee28f0 2024-04-26T12:30:35.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.804+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.804+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451eddf90 2024-04-26T12:30:35.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.805+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.805+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451ee28f0 2024-04-26T12:30:35.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.806+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.806+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451eddf90 2024-04-26T12:30:35.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.807+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.807+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451ee28f0 2024-04-26T12:30:35.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.808+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.808+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x55b451eddf90 2024-04-26T12:30:35.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.809+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.809+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ef7150 con 0x7f5d70076040 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.810+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5c3dfe3640 20 reqs_thread_entry: start 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 20 Filter name: none 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5baf7fe640 20 reqs_thread_entry: start 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451f269d0 con 0x55b451eddf90 2024-04-26T12:30:35.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.811+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b451f29460 con 0x55b451eddf90 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.812+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.812+0000 7f5c3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.812+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94232957080320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ed6700 con 0x55b451ed95a0 2024-04-26T12:30:35.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.813+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94232957080320] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.813+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94232957053808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eed300 con 0x7f5d70076040 2024-04-26T12:30:35.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.814+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94232957053808] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.814+0000 7f5d8ad46800 20 remove_watcher() i=0 2024-04-26T12:30:35.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.814+0000 7f5d8ad46800 2 removed watcher, disabling cache 2024-04-26T12:30:35.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.814+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94232957052080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee6b70 con 0x55b451ed95a0 2024-04-26T12:30:35.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.816+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94232957052080] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.816+0000 7f5d8ad46800 20 remove_watcher() i=1 2024-04-26T12:30:35.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.816+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94232957060432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee64b0 con 0x55b451ee28f0 2024-04-26T12:30:35.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.817+0000 7f5d8004b640 1 -- 172.21.15.170:0/2183858798 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94232957060432] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d70081070 con 0x55b451ee28f0 2024-04-26T12:30:35.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.817+0000 7f5d8ad46800 20 remove_watcher() i=2 2024-04-26T12:30:35.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.817+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94232957062704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee8550 con 0x7f5d70076040 2024-04-26T12:30:35.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.818+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94232957062704] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x7f5d70076040 2024-04-26T12:30:35.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.818+0000 7f5d8ad46800 20 remove_watcher() i=3 2024-04-26T12:30:35.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.818+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94232957065296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee8e30 con 0x55b451ed95a0 2024-04-26T12:30:35.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.819+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94232957065296] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8400a4a0 con 0x55b451ed95a0 2024-04-26T12:30:35.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.819+0000 7f5d8ad46800 20 remove_watcher() i=4 2024-04-26T12:30:35.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.819+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94232957070208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee8e30 con 0x55b451eddf90 2024-04-26T12:30:35.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.820+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94232957070208] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.820+0000 7f5d8ad46800 20 remove_watcher() i=5 2024-04-26T12:30:35.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.820+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94232957074880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451eeab80 con 0x55b451eddf90 2024-04-26T12:30:35.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.821+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94232957074880] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.821+0000 7f5d8ad46800 20 remove_watcher() i=6 2024-04-26T12:30:35.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.821+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94232957078112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b451ee8e30 con 0x55b451eddf90 2024-04-26T12:30:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8884c640 1 -- 172.21.15.170:0/2183858798 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94232957078112] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d7807c070 con 0x55b451eddf90 2024-04-26T12:30:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 20 remove_watcher() i=7 2024-04-26T12:30:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451eddf90 msgr2=0x55b451ee0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451eddf90 0x55b451ee0380 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451ed95a0 msgr2=0x55b451edba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451ed95a0 0x55b451edba60 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5d70076040 msgr2=0x7f5d70083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5d70076040 0x7f5d70083410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b451ee28f0 msgr2=0x55b451ee4db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b451ee28f0 0x55b451ee4db0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c54036950 msgr2=0x7f5c54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c54036950 0x7f5c54038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5d70052fd0 tx=0x7f5d7004f000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 msgr2=0x55b451ecde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8904d640 1 -- 172.21.15.170:0/2183858798 reap_dead start 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ecde80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5d78053000 tx=0x7f5d78007e80 comp rx=0 tx=0).stop 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 shutdown_connections 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2183858798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451ec6b50 0x55b451ecde80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 >> 172.21.15.170:0/2183858798 conn(0x55b451ec2e20 msgr2=0x55b451ec0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 shutdown_connections 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2183858798 wait complete. 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c60036950 msgr2=0x7f5c60038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.822+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c60036950 0x7f5c60038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55b451ea7a20 tx=0x7f5d70005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451eb9af0 msgr2=0x55b451eb9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451eb9af0 0x55b451eb9f10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5d7804ae70 tx=0x7f5d78045f80 comp rx=0 tx=0).stop 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 shutdown_connections 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c60036950 0x7f5c60038e10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/2106515320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451eb9af0 0x55b451eb9f10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 >> 172.21.15.170:0/2106515320 conn(0x55b451eadb90 msgr2=0x55b451eadf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 shutdown_connections 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/2106515320 wait complete. 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451ea4bc0 msgr2=0x55b451ea6fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b451ea4bc0 0x55b451ea6fb0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451da4960 msgr2=0x55b451ea2520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b451da4960 0x55b451ea2520 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b451ea8b00 msgr2=0x55b451eaaf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b451ea8b00 0x55b451eaaf70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c70036950 msgr2=0x7f5c70038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5c70036950 0x7f5c70038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d70054000 tx=0x7f5d7004e000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 msgr2=0x55b451d15f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 --2- 172.21.15.170:0/805349475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b451da05c0 0x55b451d15f90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800b7c0 tx=0x7f5d78000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8904d640 1 -- 172.21.15.170:0/805349475 reap_dead start 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 shutdown_connections 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 >> 172.21.15.170:0/805349475 conn(0x55b451d9bb80 msgr2=0x55b451e90120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 shutdown_connections 2024-04-26T12:30:35.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.823+0000 7f5d8ad46800 1 -- 172.21.15.170:0/805349475 wait complete. 2024-04-26T12:30:35.832 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:30:35.832 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-26T12:30:35.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-26T12:30:35.833 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-26T12:30:35.917 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.917+0000 7f4035131800 1 Processor -- start 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.917+0000 7f4035131800 1 -- start start 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.917+0000 7f4035131800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562181c31de0 0x562181cc64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.917+0000 7f4035131800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562181b6a0c0 con 0x562181c33120 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.917+0000 7f4035131800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x562181b4e4d0 con 0x562181c31de0 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.917+0000 7f40286f1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562181c31de0 0x562181cc64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.918+0000 7f40286f1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562181c31de0 0x562181cc64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42714/0 (socket says 172.21.15.170:42714) 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.918+0000 7f40286f1640 1 -- 172.21.15.170:0/3392011436 learned_addr learned my addr 172.21.15.170:0/3392011436 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.918+0000 7f4030ef2640 1 --1- 172.21.15.170:0/3392011436 >> v1:172.21.15.132:6789/0 conn(0x562181c33120 0x562181c316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46308/0 (socket says 172.21.15.170:46308) 2024-04-26T12:30:35.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.918+0000 7f40286f1640 1 -- 172.21.15.170:0/3392011436 >> v1:172.21.15.132:6789/0 conn(0x562181c33120 legacy=0x562181c316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.918+0000 7f40286f1640 1 -- 172.21.15.170:0/3392011436 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562181b7bd40 con 0x562181c31de0 2024-04-26T12:30:35.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f40286f1640 1 --2- 172.21.15.170:0/3392011436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181cc64a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f401800a520 tx=0x7f401801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9446c0e3112a4e41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f402bfff640 1 -- 172.21.15.170:0/3392011436 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018057070 con 0x562181c31de0 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f402bfff640 1 -- 172.21.15.170:0/3392011436 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018052570 con 0x562181c31de0 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f402bfff640 1 -- 172.21.15.170:0/3392011436 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401804ae60 con 0x562181c31de0 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f4035131800 1 -- 172.21.15.170:0/3392011436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 msgr2=0x562181cc64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f4035131800 1 --2- 172.21.15.170:0/3392011436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181cc64a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f401800a520 tx=0x7f401801d010 comp rx=0 tx=0).stop 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f4035131800 1 -- 172.21.15.170:0/3392011436 shutdown_connections 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f4035131800 1 --2- 172.21.15.170:0/3392011436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181cc64a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f4035131800 1 -- 172.21.15.170:0/3392011436 >> 172.21.15.170:0/3392011436 conn(0x562181cb8ba0 msgr2=0x562181cbafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f4035131800 1 -- 172.21.15.170:0/3392011436 shutdown_connections 2024-04-26T12:30:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.920+0000 7f4035131800 1 -- 172.21.15.170:0/3392011436 wait complete. 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.932+0000 7f4035131800 1 Processor -- start 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.932+0000 7f4035131800 1 -- start start 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.932+0000 7f4035131800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.932+0000 7f4035131800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562181c08b70 con 0x562181c31de0 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.932+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.933+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42722/0 (socket says 172.21.15.170:42722) 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.933+0000 7f4030ef2640 1 -- 172.21.15.170:0/29183250 learned_addr learned my addr 172.21.15.170:0/29183250 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.933+0000 7f4030ef2640 1 -- 172.21.15.170:0/29183250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562181b7a590 con 0x562181c31de0 2024-04-26T12:30:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.933+0000 7f4030ef2640 1 --2- 172.21.15.170:0/29183250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db0cd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4020001eb0 tx=0x7f402000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e39800e0958c17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.933+0000 7f3f1ee0d640 1 -- 172.21.15.170:0/29183250 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f402000e5c0 con 0x562181c31de0 2024-04-26T12:30:35.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.933+0000 7f3f1ee0d640 1 -- 172.21.15.170:0/29183250 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4020006070 con 0x562181c31de0 2024-04-26T12:30:35.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.933+0000 7f3f1ee0d640 1 -- 172.21.15.170:0/29183250 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f402000e8b0 con 0x562181c31de0 2024-04-26T12:30:35.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 -- 172.21.15.170:0/29183250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 msgr2=0x562181db0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 --2- 172.21.15.170:0/29183250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db0cd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4020001eb0 tx=0x7f402000b6c0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 -- 172.21.15.170:0/29183250 shutdown_connections 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 --2- 172.21.15.170:0/29183250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db0cd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 -- 172.21.15.170:0/29183250 >> 172.21.15.170:0/29183250 conn(0x562181cb8ba0 msgr2=0x562181dac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 -- 172.21.15.170:0/29183250 shutdown_connections 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 -- 172.21.15.170:0/29183250 wait complete. 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 Processor -- start 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 -- start start 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4035131800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562181cc8cf0 con 0x562181c31de0 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42736/0 (socket says 172.21.15.170:42736) 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.934+0000 7f4030ef2640 1 -- 172.21.15.170:0/3093393710 learned_addr learned my addr 172.21.15.170:0/3093393710 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.935+0000 7f4030ef2640 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562181b718f0 con 0x562181c31de0 2024-04-26T12:30:35.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.935+0000 7f4030ef2640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db86b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f402000c010 tx=0x7f4020000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.935+0000 7f3f1d60a640 1 -- 172.21.15.170:0/3093393710 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f402001a7c0 con 0x562181c31de0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.935+0000 7f3f1d60a640 1 -- 172.21.15.170:0/3093393710 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402001a980 con 0x562181c31de0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.935+0000 7f3f1d60a640 1 -- 172.21.15.170:0/3093393710 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f402001ace0 con 0x562181c31de0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.935+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562181db8bf0 con 0x562181c31de0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.935+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562181db9110 con 0x562181c31de0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f3f1d60a640 1 -- 172.21.15.170:0/3093393710 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4020017070 con 0x562181c31de0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f3f1d60a640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f18036950 0x7f3f18038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f3f1d60a640 1 -- 172.21.15.170:0/3093393710 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4020015020 con 0x562181c31de0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f40286f1640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f18036950 0x7f3f18038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181c33120 0x562181dbf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dbfc50 con 0x562181c33120 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f40316f3640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181c33120 0x562181dbf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.936+0000 7f40286f1640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f18036950 0x7f3f18038e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f401800a520 tx=0x7f401804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.937+0000 7f40316f3640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181c33120 0x562181dbf6d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.937+0000 7f40316f3640 1 -- 172.21.15.170:0/3093393710 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181c33120 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.937+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dbcca0 con 0x562181c33120 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.937+0000 7f40316f3640 1 -- 172.21.15.170:0/3093393710 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181c33120 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.937+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dc1fa0 0x562181dc4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.937+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dc4a80 con 0x562181dc1fa0 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.937+0000 7f4030ef2640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dc1fa0 0x562181dc4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.938+0000 7f4030ef2640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dc1fa0 0x562181dc4390 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.938+0000 7f4030ef2640 1 -- 172.21.15.170:0/3093393710 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4020049040 con 0x562181dc1fa0 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.938+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dc0f50 con 0x562181c33120 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.938+0000 7f40316f3640 1 -- 172.21.15.170:0/3093393710 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181c33120 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.938+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562181dc5f30 0x562181dc8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.938+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dc8ae0 con 0x562181dc5f30 2024-04-26T12:30:35.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.938+0000 7f40286f1640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562181dc5f30 0x562181dc8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.939+0000 7f40286f1640 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562181dc5f30 0x562181dc8380 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.939+0000 7f40286f1640 1 -- 172.21.15.170:0/3093393710 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f401805a040 con 0x562181dc5f30 2024-04-26T12:30:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.939+0000 7f4035131800 1 Processor -- start 2024-04-26T12:30:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.939+0000 7f4035131800 1 -- start start 2024-04-26T12:30:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.939+0000 7f4035131800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181dd6f40 0x562181dd7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.939+0000 7f4035131800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562181baee60 con 0x562181dd6f40 2024-04-26T12:30:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181dd6f40 0x562181dd7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181dd6f40 0x562181dd7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42744/0 (socket says 172.21.15.170:42744) 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f4030ef2640 1 -- 172.21.15.170:0/3455259602 learned_addr learned my addr 172.21.15.170:0/3455259602 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f4030ef2640 1 -- 172.21.15.170:0/3455259602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562181dd78a0 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f4030ef2640 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181dd6f40 0x562181dd7360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4020017b10 tx=0x7f4020019e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f3f167fc640 1 -- 172.21.15.170:0/3455259602 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4020040c30 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f3f167fc640 1 -- 172.21.15.170:0/3455259602 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4020040df0 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562181dd8310 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f3f167fc640 1 -- 172.21.15.170:0/3455259602 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4020044be0 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.940+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562181dd8310 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.941+0000 7f3f167fc640 1 -- 172.21.15.170:0/3455259602 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4020044d80 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.941+0000 7f3f167fc640 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f08036950 0x7f3f08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.941+0000 7f3f167fc640 1 -- 172.21.15.170:0/3455259602 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4020046040 con 0x562181dd6f40 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.941+0000 7f40286f1640 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f08036950 0x7f3f08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.941+0000 7f4035131800 1 Processor -- start 2024-04-26T12:30:35.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.941+0000 7f4035131800 1 -- start start 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.941+0000 7f40286f1640 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f08036950 0x7f3f08038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x562181dc0550 tx=0x7f4018005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f4035131800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181de42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f4035131800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562181db1450 con 0x562181de3eb0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181de42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181de42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42748/0 (socket says 172.21.15.170:42748) 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f4030ef2640 1 -- 172.21.15.170:0/1361240193 learned_addr learned my addr 172.21.15.170:0/1361240193 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f4030ef2640 1 -- 172.21.15.170:0/1361240193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562181de48a0 con 0x562181de3eb0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f4030ef2640 1 --2- 172.21.15.170:0/1361240193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181de42d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f402002aff0 tx=0x7f4020031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4319785a6df42370 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f3f07fff640 1 -- 172.21.15.170:0/1361240193 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4020044530 con 0x562181de3eb0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f3f07fff640 1 -- 172.21.15.170:0/1361240193 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402003c440 con 0x562181de3eb0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.942+0000 7f3f07fff640 1 -- 172.21.15.170:0/1361240193 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40200446d0 con 0x562181de3eb0 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 -- 172.21.15.170:0/1361240193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 msgr2=0x562181de42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 --2- 172.21.15.170:0/1361240193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181de42d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f402002aff0 tx=0x7f4020031ec0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 -- 172.21.15.170:0/1361240193 shutdown_connections 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 --2- 172.21.15.170:0/1361240193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181de42d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 -- 172.21.15.170:0/1361240193 >> 172.21.15.170:0/1361240193 conn(0x562181de0210 msgr2=0x562181dde270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 -- 172.21.15.170:0/1361240193 shutdown_connections 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 -- 172.21.15.170:0/1361240193 wait complete. 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 Processor -- start 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 -- start start 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181deb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.943+0000 7f4035131800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562181de4f50 con 0x562181de3eb0 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181deb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f4030ef2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181deb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42760/0 (socket says 172.21.15.170:42760) 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 learned_addr learned my addr 172.21.15.170:0/130010800 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562181deb7f0 con 0x562181de3eb0 2024-04-26T12:30:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f4030ef2640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181deb2b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f402004cdf0 tx=0x7f402001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f3f067fc640 1 -- 172.21.15.170:0/130010800 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4020031660 con 0x562181de3eb0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f3f067fc640 1 -- 172.21.15.170:0/130010800 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402006b030 con 0x562181de3eb0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562181deb7f0 con 0x562181de3eb0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f3f067fc640 1 -- 172.21.15.170:0/130010800 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f402003f150 con 0x562181de3eb0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.944+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562181deb7f0 con 0x562181de3eb0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.945+0000 7f3f067fc640 1 -- 172.21.15.170:0/130010800 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4020062040 con 0x562181de3eb0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.945+0000 7f3f067fc640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3efc036950 0x7f3efc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.945+0000 7f3f067fc640 1 -- 172.21.15.170:0/130010800 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4020055040 con 0x562181de3eb0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.945+0000 7f40286f1640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3efc036950 0x7f3efc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f40286f1640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3efc036950 0x7f3efc038e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4018055040 tx=0x7f401804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181df69f0 0x562181df8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181df9600 con 0x562181df69f0 2024-04-26T12:30:35.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f40316f3640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181df69f0 0x562181df8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f40316f3640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181df69f0 0x562181df8eb0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f4035131800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f4035131800 20 realm 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181df9a10 con 0x562181df69f0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.946+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa2e0 con 0x562181df69f0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dfb3e0 0x562181dfd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dfdde0 con 0x562181dfb3e0 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4030ef2640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dfb3e0 0x562181dfd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.947+0000 7f4030ef2640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dfb3e0 0x562181dfd7d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.948+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.948+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.948+0000 7f4035131800 20 searching for the correct realm 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.948+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562181dffd90 0x562181e02250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.948+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181e02920 con 0x562181dffd90 2024-04-26T12:30:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.948+0000 7f40286f1640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562181dffd90 0x562181e02250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.948+0000 7f40286f1640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562181dffd90 0x562181e02250 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.949+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.949+0000 7f40286f1640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4018082040 0x7f401805d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.949+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181e02920 con 0x7f4018082040 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.949+0000 7f40316f3640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4018082040 0x7f401805d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.949+0000 7f40316f3640 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4018082040 0x7f401805d440 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.949+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.949+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.950+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x7f4018082040 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.951+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x7f4018082040 2024-04-26T12:30:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.952+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.953+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.954+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x7f4018082040 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.955+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.956+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.956+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x7f4018082040 2024-04-26T12:30:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.956+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.956+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dffd90 2024-04-26T12:30:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.956+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.956+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181dfb3e0 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x562181df69f0 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562181dfa680 con 0x7f4018082040 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dfe6a0 con 0x562181df69f0 2024-04-26T12:30:35.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.957+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dfe6a0 con 0x562181df69f0 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dfe6a0 con 0x7f4018082040 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 zone default found 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 4 Realm: () 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:35.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 zonegroup default 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181dfef40 con 0x562181dfb3e0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.958+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e04780 con 0x562181dffd90 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f4035131800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e04b20 con 0x562181dffd90 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f4035131800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f4035131800 20 started sync module instance, tier type = 2024-04-26T12:30:35.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f4035131800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.959+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e03c20 con 0x7f4018082040 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.960+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.960+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94701912866880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e03c20 con 0x7f4018082040 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.960+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e05370 con 0x562181df69f0 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.961+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94701912866880] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.961+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.961+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94701912871072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e03c20 con 0x562181df69f0 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.961+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e05dc0 con 0x562181dffd90 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.962+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94701912871072] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.963+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.963+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94701912864624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e03b90 con 0x562181dffd90 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.963+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e06cb0 con 0x7f4018082040 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.964+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.964+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94701912877536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e073f0 con 0x7f4018082040 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.964+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94701912864624] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.964+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e079e0 con 0x562181df69f0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.965+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94701912877536] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.965+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.965+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94701912875488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e079e0 con 0x562181df69f0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.965+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e083f0 con 0x562181dfb3e0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.966+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94701912875488] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.966+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.966+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94701912883008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e087e0 con 0x562181dfb3e0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.966+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e091a0 con 0x562181dfb3e0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.967+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94701912883008] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.967+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.967+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94701912878656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e09a40 con 0x562181dfb3e0 2024-04-26T12:30:35.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.967+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e0a400 con 0x562181dfb3e0 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94701912878656] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94701912891696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e09650 con 0x562181dfb3e0 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 20 add_watcher() i=0 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 20 add_watcher() i=1 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 20 add_watcher() i=2 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 20 add_watcher() i=3 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 20 add_watcher() i=4 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 20 add_watcher() i=5 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.968+0000 7f4035131800 20 add_watcher() i=6 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.969+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94701912891696] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.969+0000 7f4035131800 20 add_watcher() i=7 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.969+0000 7f4035131800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.969+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e0db50 con 0x562181df69f0 2024-04-26T12:30:35.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.969+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.969+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94701912892752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e0b010 con 0x562181df69f0 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.970+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94701912892752] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.970+0000 7f3ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.970+0000 7f4035131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.970+0000 7f4035131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.970+0000 7f4035131800 5 note: GC not initialized 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.970+0000 7f3ee5fe3640 20 reqs_thread_entry: start 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 20 Filter name: none 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f3e577fe640 20 reqs_thread_entry: start 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e41210 con 0x562181dfb3e0 2024-04-26T12:30:35.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.971+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e432f0 con 0x7f4018082040 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e44d30 con 0x562181df69f0 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(64 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.972+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e462a0 con 0x562181dfb3e0 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(65 fud.buckets [call] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 20 rados->read ofs=0 len=0 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e466a0 con 0x7f4018082040 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.973+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e4c290 con 0x7f4018082040 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4035131800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4035131800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4035131800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94701913144736 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562181e49780 con 0x562181dfb3e0 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== watch-notify(notify (1) cookie 94701912878656 notify 128849018890 ret 0) ==== 380+0+0 (crc 0 0 0) 0x562181dd78a0 con 0x562181dfb3e0 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f3f07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94701912878656 notifier 4523 bl.length()=338 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f3f07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f3f07fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(68 notify.6 [notify cookie 94701913144736 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f3f07fff640 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3ef4003ea0 con 0x562181dfb3e0 2024-04-26T12:30:35.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.975+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== watch-notify(notify_complete (2) cookie 94701913144736 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4020037030 con 0x562181dfb3e0 2024-04-26T12:30:35.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.976+0000 7f3ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:35.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.976+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94701912892752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e41c30 con 0x562181df69f0 2024-04-26T12:30:35.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.977+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94701912892752] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.977+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94701912866880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e0a550 con 0x7f4018082040 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.978+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94701912866880] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.978+0000 7f4035131800 20 remove_watcher() i=0 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.978+0000 7f4035131800 2 removed watcher, disabling cache 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.978+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94701912871072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e0a550 con 0x562181df69f0 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.980+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94701912871072] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.980+0000 7f4035131800 20 remove_watcher() i=1 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.980+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94701912864624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e0a550 con 0x562181dffd90 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.981+0000 7f40286f1640 1 -- 172.21.15.170:0/130010800 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94701912864624] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401807f070 con 0x562181dffd90 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.981+0000 7f4035131800 20 remove_watcher() i=2 2024-04-26T12:30:35.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.981+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94701912877536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e03770 con 0x7f4018082040 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.982+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94701912877536] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x7f4018082040 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.982+0000 7f4035131800 20 remove_watcher() i=3 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.982+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94701912875488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e069e0 con 0x562181df69f0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.983+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94701912875488] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402c00a4a0 con 0x562181df69f0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.983+0000 7f4035131800 20 remove_watcher() i=4 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.983+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94701912883008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e03770 con 0x562181dfb3e0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.984+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94701912883008] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.984+0000 7f4035131800 20 remove_watcher() i=5 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.984+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94701912878656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e07f40 con 0x562181dfb3e0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.985+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94701912878656] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.985+0000 7f4035131800 20 remove_watcher() i=6 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.985+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94701912891696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562181e03770 con 0x562181dfb3e0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4030ef2640 1 -- 172.21.15.170:0/130010800 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94701912891696] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4020049040 con 0x562181dfb3e0 2024-04-26T12:30:35.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 20 remove_watcher() i=7 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dfb3e0 msgr2=0x562181dfd7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dfb3e0 0x562181dfd7d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181df69f0 msgr2=0x562181df8eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181df69f0 0x562181df8eb0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4018082040 msgr2=0x7f401805d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4018082040 0x7f401805d440 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562181dffd90 msgr2=0x562181e02250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562181dffd90 0x562181e02250 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3efc036950 msgr2=0x7f3efc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3efc036950 0x7f3efc038e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4018055040 tx=0x7f401804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 msgr2=0x562181deb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f40316f3640 1 -- 172.21.15.170:0/130010800 reap_dead start 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181deb2b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f402004cdf0 tx=0x7f402001e040 comp rx=0 tx=0).stop 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 shutdown_connections 2024-04-26T12:30:35.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/130010800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181de3eb0 0x562181deb2b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 >> 172.21.15.170:0/130010800 conn(0x562181de0210 msgr2=0x562181ddd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 shutdown_connections 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/130010800 wait complete. 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f08036950 msgr2=0x7f3f08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f08036950 0x7f3f08038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x562181dc0550 tx=0x7f4018005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181dd6f40 msgr2=0x562181dd7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181dd6f40 0x562181dd7360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4020017b10 tx=0x7f4020019e90 comp rx=0 tx=0).stop 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 shutdown_connections 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f08036950 0x7f3f08038e10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 --2- 172.21.15.170:0/3455259602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181dd6f40 0x562181dd7360 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 >> 172.21.15.170:0/3455259602 conn(0x562181dcafe0 msgr2=0x562181dcb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 shutdown_connections 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.986+0000 7f4035131800 1 -- 172.21.15.170:0/3455259602 wait complete. 2024-04-26T12:30:35.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dc1fa0 msgr2=0x562181dc4390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562181dc1fa0 0x562181dc4390 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181c33120 msgr2=0x562181dbf6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562181c33120 0x562181dbf6d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562181dc5f30 msgr2=0x562181dc8380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562181dc5f30 0x562181dc8380 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f18036950 msgr2=0x7f3f18038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f18036950 0x7f3f18038e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f401800a520 tx=0x7f401804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 msgr2=0x562181db86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 --2- 172.21.15.170:0/3093393710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562181c31de0 0x562181db86b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f402000c010 tx=0x7f4020000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f40316f3640 1 -- 172.21.15.170:0/3093393710 reap_dead start 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 shutdown_connections 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 >> 172.21.15.170:0/3093393710 conn(0x562181cb8ba0 msgr2=0x562181daf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 shutdown_connections 2024-04-26T12:30:35.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:35.987+0000 7f4035131800 1 -- 172.21.15.170:0/3093393710 wait complete. 2024-04-26T12:30:35.999 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1'] 2024-04-26T12:30:35.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1'] 2024-04-26T12:30:36.000 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:36.046 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:36.046 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad37a3a800 1 Processor -- start 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad37a3a800 1 -- start start 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad37a3a800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x56428b87d8b0 0x56428b87fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad37a3a800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56428b7270c0 con 0x56428b879900 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad37a3a800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x56428b70b4d0 con 0x56428b87d8b0 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad29ed4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x56428b87d8b0 0x56428b87fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad326d5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x56428b879900 0x56428b879d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46310/0 (socket says 172.21.15.170:46310) 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.046+0000 7fad326d5640 1 -- 172.21.15.170:0/1904449380 learned_addr learned my addr 172.21.15.170:0/1904449380 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.047+0000 7fad29ed4640 1 -- 172.21.15.170:0/1904449380 >> v1:172.21.15.132:6789/0 conn(0x56428b879900 legacy=0x56428b879d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.047+0000 7fad29ed4640 1 -- 172.21.15.170:0/1904449380 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b738d40 con 0x56428b87d8b0 2024-04-26T12:30:36.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad29ed4640 1 --2- 172.21.15.170:0/1904449380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b87d8b0 0x56428b87fca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a470 tx=0x7fad1c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cf5903547ee8ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad31ed4640 1 -- 172.21.15.170:0/1904449380 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c057070 con 0x56428b87d8b0 2024-04-26T12:30:36.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad31ed4640 1 -- 172.21.15.170:0/1904449380 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c052570 con 0x56428b87d8b0 2024-04-26T12:30:36.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad31ed4640 1 -- 172.21.15.170:0/1904449380 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c052870 con 0x56428b87d8b0 2024-04-26T12:30:36.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad37a3a800 1 -- 172.21.15.170:0/1904449380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b87d8b0 msgr2=0x56428b87fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1904449380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b87d8b0 0x56428b87fca0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a470 tx=0x7fad1c01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:36.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad37a3a800 1 -- 172.21.15.170:0/1904449380 shutdown_connections 2024-04-26T12:30:36.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1904449380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b87d8b0 0x56428b87fca0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad37a3a800 1 -- 172.21.15.170:0/1904449380 >> 172.21.15.170:0/1904449380 conn(0x56428b874180 msgr2=0x56428b8765a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad37a3a800 1 -- 172.21.15.170:0/1904449380 shutdown_connections 2024-04-26T12:30:36.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.049+0000 7fad37a3a800 1 -- 172.21.15.170:0/1904449380 wait complete. 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad37a3a800 1 Processor -- start 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad37a3a800 1 -- start start 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad37a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b96a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad37a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56428b7c5b60 con 0x56428b879900 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b96a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b96a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42766/0 (socket says 172.21.15.170:42766) 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad326d5640 1 -- 172.21.15.170:0/525162435 learned_addr learned my addr 172.21.15.170:0/525162435 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.061+0000 7fad326d5640 1 -- 172.21.15.170:0/525162435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b737590 con 0x56428b879900 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fad326d5640 1 --2- 172.21.15.170:0/525162435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b96a6f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad24001de0 tx=0x7fad2400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c4ce65e2839974 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fac20608640 1 -- 172.21.15.170:0/525162435 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad24012020 con 0x56428b879900 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fac20608640 1 -- 172.21.15.170:0/525162435 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2400e5a0 con 0x56428b879900 2024-04-26T12:30:36.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fac20608640 1 -- 172.21.15.170:0/525162435 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2400e8c0 con 0x56428b879900 2024-04-26T12:30:36.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fad37a3a800 1 -- 172.21.15.170:0/525162435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 msgr2=0x56428b96a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fad37a3a800 1 --2- 172.21.15.170:0/525162435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b96a6f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad24001de0 tx=0x7fad2400b6c0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fad37a3a800 1 -- 172.21.15.170:0/525162435 shutdown_connections 2024-04-26T12:30:36.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fad37a3a800 1 --2- 172.21.15.170:0/525162435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b96a6f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.062+0000 7fad37a3a800 1 -- 172.21.15.170:0/525162435 >> 172.21.15.170:0/525162435 conn(0x56428b874180 msgr2=0x56428b966010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad37a3a800 1 -- 172.21.15.170:0/525162435 shutdown_connections 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad37a3a800 1 -- 172.21.15.170:0/525162435 wait complete. 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad37a3a800 1 Processor -- start 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad37a3a800 1 -- start start 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad37a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b968c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad37a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56428b880570 con 0x56428b879900 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b968c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b968c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42770/0 (socket says 172.21.15.170:42770) 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.063+0000 7fad326d5640 1 -- 172.21.15.170:0/841153352 learned_addr learned my addr 172.21.15.170:0/841153352 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.064+0000 7fad326d5640 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b72e8f0 con 0x56428b879900 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.064+0000 7fad326d5640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b968c20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fad24001de0 tx=0x7fad24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.064+0000 7fac1ee05640 1 -- 172.21.15.170:0/841153352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad24012030 con 0x56428b879900 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.064+0000 7fac1ee05640 1 -- 172.21.15.170:0/841153352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2401a7a0 con 0x56428b879900 2024-04-26T12:30:36.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.064+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56428b967310 con 0x56428b879900 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.064+0000 7fac1ee05640 1 -- 172.21.15.170:0/841153352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2401aac0 con 0x56428b879900 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.064+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428b967830 con 0x56428b879900 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fac1ee05640 1 -- 172.21.15.170:0/841153352 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad24015020 con 0x56428b879900 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fac1ee05640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac18036950 0x7fac18038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fac1ee05640 1 -- 172.21.15.170:0/841153352 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fad24020070 con 0x56428b879900 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fad29ed4640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac18036950 0x7fac18038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b87d8b0 0x56428b97c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b97ca80 con 0x56428b87d8b0 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fad32ed6640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b87d8b0 0x56428b97c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.065+0000 7fad29ed4640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac18036950 0x7fac18038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad1c054000 tx=0x7fad1c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.066+0000 7fad32ed6640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b87d8b0 0x56428b97c540 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.066+0000 7fad32ed6640 1 -- 172.21.15.170:0/841153352 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b87d8b0 2024-04-26T12:30:36.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.066+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b97d2d0 con 0x56428b87d8b0 2024-04-26T12:30:36.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.066+0000 7fad32ed6640 1 -- 172.21.15.170:0/841153352 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b87d8b0 2024-04-26T12:30:36.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.066+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b97ec20 0x56428b9810c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.066+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b981850 con 0x56428b97ec20 2024-04-26T12:30:36.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.066+0000 7fad326d5640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b97ec20 0x56428b9810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.067+0000 7fad326d5640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b97ec20 0x56428b9810c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.067+0000 7fad326d5640 1 -- 172.21.15.170:0/841153352 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad24024980 con 0x56428b97ec20 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.067+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b97db50 con 0x56428b87d8b0 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.067+0000 7fad32ed6640 1 -- 172.21.15.170:0/841153352 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b87d8b0 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.067+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56428b982d00 0x56428b985170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.067+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9858d0 con 0x56428b982d00 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.067+0000 7fad29ed4640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56428b982d00 0x56428b985170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.068+0000 7fad29ed4640 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56428b982d00 0x56428b985170 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.068+0000 7fad29ed4640 1 -- 172.21.15.170:0/841153352 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad1c052940 con 0x56428b982d00 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.068+0000 7fad37a3a800 1 Processor -- start 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.068+0000 7fad37a3a800 1 -- start start 2024-04-26T12:30:36.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.068+0000 7fad37a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b993d30 0x56428b994150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.068+0000 7fad37a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56428b969160 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.068+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b993d30 0x56428b994150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b993d30 0x56428b994150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42774/0 (socket says 172.21.15.170:42774) 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fad326d5640 1 -- 172.21.15.170:0/42434848 learned_addr learned my addr 172.21.15.170:0/42434848 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fad326d5640 1 -- 172.21.15.170:0/42434848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b994690 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fad326d5640 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b993d30 0x56428b994150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad240015f0 tx=0x7fad24018f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fac17fff640 1 -- 172.21.15.170:0/42434848 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2403d020 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fac17fff640 1 -- 172.21.15.170:0/42434848 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad24032070 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56428b995100 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fac17fff640 1 -- 172.21.15.170:0/42434848 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad24044720 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.069+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428b995600 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fac17fff640 1 -- 172.21.15.170:0/42434848 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad240448c0 con 0x56428b993d30 2024-04-26T12:30:36.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fac17fff640 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac0c036900 0x7fac0c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fac17fff640 1 -- 172.21.15.170:0/42434848 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fad24046050 con 0x56428b993d30 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fad29ed4640 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac0c036900 0x7fac0c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fad37a3a800 1 Processor -- start 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fad37a3a800 1 -- start start 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fad29ed4640 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac0c036900 0x7fac0c038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56428b967c50 tx=0x7fad1c005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fad37a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.070+0000 7fad37a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56428b76be60 con 0x56428b9a0eb0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42784/0 (socket says 172.21.15.170:42784) 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fad326d5640 1 -- 172.21.15.170:0/466671070 learned_addr learned my addr 172.21.15.170:0/466671070 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fad326d5640 1 -- 172.21.15.170:0/466671070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b9a18a0 con 0x56428b9a0eb0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fad326d5640 1 --2- 172.21.15.170:0/466671070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a12d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fad2401a6f0 tx=0x7fad2404cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce73745ec209499 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fac15ffb640 1 -- 172.21.15.170:0/466671070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad24016910 con 0x56428b9a0eb0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fac15ffb640 1 -- 172.21.15.170:0/466671070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad24016ab0 con 0x56428b9a0eb0 2024-04-26T12:30:36.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.071+0000 7fac15ffb640 1 -- 172.21.15.170:0/466671070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad24022540 con 0x56428b9a0eb0 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 -- 172.21.15.170:0/466671070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 msgr2=0x56428b9a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 --2- 172.21.15.170:0/466671070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a12d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fad2401a6f0 tx=0x7fad2404cf70 comp rx=0 tx=0).stop 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 -- 172.21.15.170:0/466671070 shutdown_connections 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 --2- 172.21.15.170:0/466671070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a12d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 -- 172.21.15.170:0/466671070 >> 172.21.15.170:0/466671070 conn(0x56428b99d210 msgr2=0x56428b99b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 -- 172.21.15.170:0/466671070 shutdown_connections 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 -- 172.21.15.170:0/466671070 wait complete. 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 Processor -- start 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 -- start start 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad37a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56428b9a1dd0 con 0x56428b9a0eb0 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad326d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42790/0 (socket says 172.21.15.170:42790) 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.072+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 learned_addr learned my addr 172.21.15.170:0/1493017099 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.073+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b9a8630 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.073+0000 7fad326d5640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a80f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad24019d30 tx=0x7fad24029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.073+0000 7fac03fff640 1 -- 172.21.15.170:0/1493017099 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2406e020 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.073+0000 7fac03fff640 1 -- 172.21.15.170:0/1493017099 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2402dc90 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.073+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56428b9a8630 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.073+0000 7fac03fff640 1 -- 172.21.15.170:0/1493017099 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad24049210 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.073+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428b9a8ad0 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.074+0000 7fac03fff640 1 -- 172.21.15.170:0/1493017099 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad24071020 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.074+0000 7fac03fff640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fabfc036950 0x7fabfc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.074+0000 7fac03fff640 1 -- 172.21.15.170:0/1493017099 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fad24066070 con 0x56428b9a0eb0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.074+0000 7fad29ed4640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fabfc036950 0x7fabfc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.074+0000 7fad29ed4640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fabfc036950 0x7fabfc038e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad1c052fd0 tx=0x7fad1c04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b9b3880 0x56428b9b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b6490 con 0x56428b9b3880 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad32ed6640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b9b3880 0x56428b9b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad32ed6640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b9b3880 0x56428b9b5d40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad37a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad37a3a800 20 realm 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.075+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b68a0 con 0x56428b9b3880 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7170 con 0x56428b9b3880 2024-04-26T12:30:36.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b3880 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b9b8270 0x56428b9ba660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9bac70 con 0x56428b9b8270 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.076+0000 7fad326d5640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b9b8270 0x56428b9ba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad326d5640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b9b8270 0x56428b9ba660 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad37a3a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad37a3a800 20 searching for the correct realm 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56428b9bcc20 0x56428b9bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9bf7b0 con 0x56428b9bcc20 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad29ed4640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56428b9bcc20 0x56428b9bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.077+0000 7fad29ed4640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56428b9bcc20 0x56428b9bf0e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.078+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.078+0000 7fad29ed4640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad1c076040 0x7fad1c083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.078+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9bf7b0 con 0x7fad1c076040 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.078+0000 7fad32ed6640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad1c076040 0x7fad1c083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.078+0000 7fad32ed6640 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad1c076040 0x7fad1c083410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.078+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.078+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b8270 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.079+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.079+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b3880 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.079+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.079+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b3880 2024-04-26T12:30:36.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.079+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.079+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b8270 2024-04-26T12:30:36.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b8270 2024-04-26T12:30:36.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x7fad1c076040 2024-04-26T12:30:36.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9bcc20 2024-04-26T12:30:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.080+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b3880 2024-04-26T12:30:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b8270 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9b3880 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x7fad1c076040 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.081+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56428b9b7510 con 0x56428b9bcc20 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9bcc20 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b8270 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9bcc20 2024-04-26T12:30:36.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9bcc20 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.082+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b3880 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.083+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.083+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b3880 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.083+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.083+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b8270 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9bcc20 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x7fad1c076040 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b3880 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b8270 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.084+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9bcc20 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b8270 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x7fad1c076040 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9bcc20 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.085+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b8270 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x56428b9b3880 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fad1c090040 con 0x7fad1c076040 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9bb530 con 0x56428b9b3880 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.086+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9bb530 con 0x56428b9b3880 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9bb530 con 0x7fad1c076040 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 zone default found 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 4 Realm: () 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 zonegroup default 2024-04-26T12:30:36.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9bbdd0 con 0x56428b9b8270 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.087+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c1610 con 0x56428b9bcc20 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad37a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c19b0 con 0x56428b9bcc20 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad37a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad37a3a800 20 started sync module instance, tier type = 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad37a3a800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:36.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.088+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c0ab0 con 0x7fad1c076040 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.089+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.089+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94843810090656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c0ab0 con 0x7fad1c076040 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.089+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c2240 con 0x56428b9b3880 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.090+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.090+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94843810090656] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.090+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94843810094416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c2210 con 0x56428b9b3880 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.090+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c0640 con 0x56428b9bcc20 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.091+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.091+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94843810098432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c35d0 con 0x56428b9bcc20 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.091+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c3ff0 con 0x7fad1c076040 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.091+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94843810094416] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.092+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94843810098432] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.092+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.092+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94843810099488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c25e0 con 0x7fad1c076040 2024-04-26T12:30:36.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.092+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c4a00 con 0x56428b9b3880 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.093+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.093+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94843810104656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c4e20 con 0x56428b9b3880 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.093+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c57e0 con 0x56428b9b8270 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.093+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94843810099488] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.094+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.094+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94843810108208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c5b80 con 0x56428b9b8270 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.094+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c6540 con 0x56428b9b8270 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.094+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94843810104656] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.095+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94843810108208] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.097+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.097+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94843810111632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c6930 con 0x56428b9b8270 2024-04-26T12:30:36.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.097+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c7180 con 0x56428b9b8270 2024-04-26T12:30:36.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94843810111632] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94843810114768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c75a0 con 0x56428b9b8270 2024-04-26T12:30:36.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 20 add_watcher() i=0 2024-04-26T12:30:36.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 20 add_watcher() i=1 2024-04-26T12:30:36.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 20 add_watcher() i=2 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 20 add_watcher() i=3 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 20 add_watcher() i=4 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 20 add_watcher() i=5 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.098+0000 7fad37a3a800 20 add_watcher() i=6 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.099+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94843810114768] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.099+0000 7fad37a3a800 20 add_watcher() i=7 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.099+0000 7fad37a3a800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.099+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9ca860 con 0x56428b9b3880 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.099+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.099+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94843810116192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c7b30 con 0x56428b9b3880 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.100+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94843810116192] v30'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.100+0000 7fabe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.100+0000 7fad37a3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:36.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.100+0000 7fad37a3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 5 note: GC not initialized 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fab637fe640 20 reqs_thread_entry: start 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 20 Filter name: none 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fab617fa640 20 reqs_thread_entry: start 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428b9fe030 con 0x56428b9b3880 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:36.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.101+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428ba00110 con 0x7fad1c076040 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fad2c00a4a0 con 0x7fad1c076040 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428ba01930 con 0x56428b9b3880 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:36.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.102+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428ba060e0 con 0x56428b9b8270 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.103+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(65 fud.buckets [call] v30'5 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.103+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428ba0c020 con 0x56428b9b3880 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94843810357232 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428ba06510 con 0x56428b9b3880 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify (1) cookie 94843810104656 notify 128849018893 ret 0) ==== 794+0+0 (crc 0 0 0) 0x56428ba01d20 con 0x56428b9b3880 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fac15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94843810104656 notifier 4530 bl.length()=752 2024-04-26T12:30:36.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fac15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fac15ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fac15ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fac15ffb640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fabf8003ea0 con 0x56428b9b3880 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(67 notify.4 [notify cookie 94843810357232 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad2c00a4a0 con 0x56428b9b3880 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x56428b9b3880 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== watch-notify(notify_complete (2) cookie 94843810357232 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56428ba00e50 con 0x56428b9b3880 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_sources= new_sources= 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential sources added=[] removed=[] 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_dests= new_dests= 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential dests added=[] removed=[] 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.105+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428ba0a800 con 0x7fad1c076040 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.106+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x7fad1c076040 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.107+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428ba0b810 con 0x7fad1c076040 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x7fad1c076040 2024-04-26T12:30:36.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad37a3a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad37a3a800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad37a3a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94843810357200 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56428ba0b810 con 0x56428b9b8270 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== watch-notify(notify (1) cookie 94843810111632 notify 128849018891 ret 0) ==== 356+0+0 (crc 0 0 0) 0x56428b994690 con 0x56428b9b8270 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fac157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94843810111632 notifier 4530 bl.length()=314 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fac157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fac157fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.6 [notify cookie 94843810357200 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fac157fa640 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fab68003400 con 0x56428b9b8270 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.108+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== watch-notify(notify_complete (2) cookie 94843810357200 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56428b967830 con 0x56428b9b8270 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.109+0000 7fabe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.109+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94843810116192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428ba02b80 con 0x56428b9b3880 2024-04-26T12:30:36.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.110+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94843810116192] v30'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x56428b9b3880 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.110+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94843810090656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c7260 con 0x7fad1c076040 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.111+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94843810090656] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x7fad1c076040 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.111+0000 7fad37a3a800 20 remove_watcher() i=0 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.111+0000 7fad37a3a800 2 removed watcher, disabling cache 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.111+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94843810094416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c7260 con 0x56428b9b3880 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.112+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94843810094416] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x56428b9b3880 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.112+0000 7fad37a3a800 20 remove_watcher() i=1 2024-04-26T12:30:36.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.112+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94843810098432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c7260 con 0x56428b9bcc20 2024-04-26T12:30:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.113+0000 7fad29ed4640 1 -- 172.21.15.170:0/1493017099 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94843810098432] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c081070 con 0x56428b9bcc20 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.113+0000 7fad37a3a800 20 remove_watcher() i=2 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.113+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94843810099488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c2d00 con 0x7fad1c076040 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.114+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94843810099488] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x7fad1c076040 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.114+0000 7fad37a3a800 20 remove_watcher() i=3 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.114+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94843810104656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c1d50 con 0x56428b9b3880 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.115+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94843810104656] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c04d040 con 0x56428b9b3880 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.115+0000 7fad37a3a800 20 remove_watcher() i=4 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.115+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94843810108208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c4550 con 0x56428b9b8270 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.116+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94843810108208] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.116+0000 7fad37a3a800 20 remove_watcher() i=5 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.116+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94843810111632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c4550 con 0x56428b9b8270 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.117+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94843810111632] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.117+0000 7fad37a3a800 20 remove_watcher() i=6 2024-04-26T12:30:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.117+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94843810114768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56428b9c4550 con 0x56428b9b8270 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad326d5640 1 -- 172.21.15.170:0/1493017099 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94843810114768] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403f020 con 0x56428b9b8270 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 20 remove_watcher() i=7 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b9b8270 msgr2=0x56428b9ba660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b9b8270 0x56428b9ba660 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b9b3880 msgr2=0x56428b9b5d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b9b3880 0x56428b9b5d40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad1c076040 msgr2=0x7fad1c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad1c076040 0x7fad1c083410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56428b9bcc20 msgr2=0x56428b9bf0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56428b9bcc20 0x56428b9bf0e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fabfc036950 msgr2=0x7fabfc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fabfc036950 0x7fabfc038e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad1c052fd0 tx=0x7fad1c04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 msgr2=0x56428b9a80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad32ed6640 1 -- 172.21.15.170:0/1493017099 reap_dead start 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a80f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad24019d30 tx=0x7fad24029fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 shutdown_connections 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 --2- 172.21.15.170:0/1493017099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b9a0eb0 0x56428b9a80f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 >> 172.21.15.170:0/1493017099 conn(0x56428b99d210 msgr2=0x56428b99a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 shutdown_connections 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.118+0000 7fad37a3a800 1 -- 172.21.15.170:0/1493017099 wait complete. 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac0c036900 msgr2=0x7fac0c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac0c036900 0x7fac0c038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56428b967c50 tx=0x7fad1c005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b993d30 msgr2=0x56428b994150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b993d30 0x56428b994150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad240015f0 tx=0x7fad24018f80 comp rx=0 tx=0).stop 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 shutdown_connections 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac0c036900 0x7fac0c038dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/42434848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b993d30 0x56428b994150 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 >> 172.21.15.170:0/42434848 conn(0x56428b987dd0 msgr2=0x56428b9881d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 shutdown_connections 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/42434848 wait complete. 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b97ec20 msgr2=0x56428b9810c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56428b97ec20 0x56428b9810c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b87d8b0 msgr2=0x56428b97c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56428b87d8b0 0x56428b97c540 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56428b982d00 msgr2=0x56428b985170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56428b982d00 0x56428b985170 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac18036950 msgr2=0x7fac18038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac18036950 0x7fac18038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad1c054000 tx=0x7fad1c04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 msgr2=0x56428b968c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 --2- 172.21.15.170:0/841153352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56428b879900 0x56428b968c20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fad24001de0 tx=0x7fad24000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad32ed6640 1 -- 172.21.15.170:0/841153352 reap_dead start 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 shutdown_connections 2024-04-26T12:30:36.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.119+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 >> 172.21.15.170:0/841153352 conn(0x56428b874180 msgr2=0x56428b9692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.120+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 shutdown_connections 2024-04-26T12:30:36.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.120+0000 7fad37a3a800 1 -- 172.21.15.170:0/841153352 wait complete. 2024-04-26T12:30:36.129 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-26T12:30:36.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-26T12:30:36.130 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-26T12:30:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.172+0000 7f622a498800 1 Processor -- start 2024-04-26T12:30:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.172+0000 7f622a498800 1 -- start start 2024-04-26T12:30:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f622a498800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ea30939b10 0x55ea3093bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f622a498800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea307e20c0 con 0x55ea30936000 2024-04-26T12:30:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f622a498800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55ea307c64d0 con 0x55ea30939b10 2024-04-26T12:30:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f621f796640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ea30939b10 0x55ea3093bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f621f796640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ea30939b10 0x55ea3093bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42796/0 (socket says 172.21.15.170:42796) 2024-04-26T12:30:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f621f796640 1 -- 172.21.15.170:0/2454209441 learned_addr learned my addr 172.21.15.170:0/2454209441 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f6227f97640 1 --1- 172.21.15.170:0/2454209441 >> v1:172.21.15.132:6789/0 conn(0x55ea30936000 0x55ea309383f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:46324/0 (socket says 172.21.15.170:46324) 2024-04-26T12:30:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f621f796640 1 -- 172.21.15.170:0/2454209441 >> v1:172.21.15.132:6789/0 conn(0x55ea30936000 legacy=0x55ea309383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f6227796640 1 -- 172.21.15.170:0/2454209441 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315400417 0 0) 0x55ea307e20c0 con 0x55ea30936000 2024-04-26T12:30:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.173+0000 7f621f796640 1 -- 172.21.15.170:0/2454209441 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea307f3d40 con 0x55ea30939b10 2024-04-26T12:30:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.175+0000 7f621f796640 1 --2- 172.21.15.170:0/2454209441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30939b10 0x55ea3093bf00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f621000a520 tx=0x7f621001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647fc0726c69a648 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.175+0000 7f6227796640 1 -- 172.21.15.170:0/2454209441 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6210057070 con 0x55ea30939b10 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.175+0000 7f6227796640 1 -- 172.21.15.170:0/2454209441 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210052570 con 0x55ea30939b10 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.175+0000 7f6227796640 1 -- 172.21.15.170:0/2454209441 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621004ae60 con 0x55ea30939b10 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.175+0000 7f622a498800 1 -- 172.21.15.170:0/2454209441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30939b10 msgr2=0x55ea3093bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.175+0000 7f622a498800 1 --2- 172.21.15.170:0/2454209441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30939b10 0x55ea3093bf00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f621000a520 tx=0x7f621001d010 comp rx=0 tx=0).stop 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.176+0000 7f622a498800 1 -- 172.21.15.170:0/2454209441 shutdown_connections 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.176+0000 7f622a498800 1 --2- 172.21.15.170:0/2454209441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30939b10 0x55ea3093bf00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.176+0000 7f622a498800 1 -- 172.21.15.170:0/2454209441 >> 172.21.15.170:0/2454209441 conn(0x55ea3092f990 msgr2=0x55ea30931db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.176+0000 7f622a498800 1 -- 172.21.15.170:0/2454209441 shutdown_connections 2024-04-26T12:30:36.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.176+0000 7f622a498800 1 -- 172.21.15.170:0/2454209441 wait complete. 2024-04-26T12:30:36.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.187+0000 7f622a498800 1 Processor -- start 2024-04-26T12:30:36.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.187+0000 7f622a498800 1 -- start start 2024-04-26T12:30:36.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f622a498800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30935940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f622a498800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ea30880b40 con 0x55ea30936000 2024-04-26T12:30:36.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30935940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30935940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42808/0 (socket says 172.21.15.170:42808) 2024-04-26T12:30:36.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6227f97640 1 -- 172.21.15.170:0/3961772684 learned_addr learned my addr 172.21.15.170:0/3961772684 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6227f97640 1 -- 172.21.15.170:0/3961772684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea307f2590 con 0x55ea30936000 2024-04-26T12:30:36.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6227f97640 1 --2- 172.21.15.170:0/3961772684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30935940 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f621800b210 tx=0x7f621800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f35146a6eee4c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6115e0b640 1 -- 172.21.15.170:0/3961772684 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6218008070 con 0x55ea30936000 2024-04-26T12:30:36.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6115e0b640 1 -- 172.21.15.170:0/3961772684 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621800d500 con 0x55ea30936000 2024-04-26T12:30:36.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.188+0000 7f6115e0b640 1 -- 172.21.15.170:0/3961772684 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621800d840 con 0x55ea30936000 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.189+0000 7f622a498800 1 -- 172.21.15.170:0/3961772684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 msgr2=0x55ea30935940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.189+0000 7f622a498800 1 --2- 172.21.15.170:0/3961772684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30935940 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f621800b210 tx=0x7f621800b6d0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.189+0000 7f622a498800 1 -- 172.21.15.170:0/3961772684 shutdown_connections 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.189+0000 7f622a498800 1 --2- 172.21.15.170:0/3961772684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30935940 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.189+0000 7f622a498800 1 -- 172.21.15.170:0/3961772684 >> 172.21.15.170:0/3961772684 conn(0x55ea3092f990 msgr2=0x55ea30a21de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.189+0000 7f622a498800 1 -- 172.21.15.170:0/3961772684 shutdown_connections 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.189+0000 7f622a498800 1 -- 172.21.15.170:0/3961772684 wait complete. 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f622a498800 1 Processor -- start 2024-04-26T12:30:36.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f622a498800 1 -- start start 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f622a498800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30a30110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f622a498800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ea3093e750 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30a30110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30a30110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42810/0 (socket says 172.21.15.170:42810) 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f6227f97640 1 -- 172.21.15.170:0/194316334 learned_addr learned my addr 172.21.15.170:0/194316334 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f6227f97640 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea307e98f0 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f6227f97640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30a30110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f621800b210 tx=0x7f6218000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.190+0000 7f610ffff640 1 -- 172.21.15.170:0/194316334 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621800f950 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.191+0000 7f610ffff640 1 -- 172.21.15.170:0/194316334 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621800faf0 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.191+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea30a30650 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.191+0000 7f610ffff640 1 -- 172.21.15.170:0/194316334 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621800fdd0 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.191+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea30a30b70 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.191+0000 7f610ffff640 1 -- 172.21.15.170:0/194316334 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6218017040 con 0x55ea30936000 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.191+0000 7f610ffff640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6110036900 0x7f6110038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.191+0000 7f610ffff640 1 -- 172.21.15.170:0/194316334 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6218015020 con 0x55ea30936000 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f621f796640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6110036900 0x7f6110038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30939b10 0x55ea30a37130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a37670 con 0x55ea30939b10 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f6228798640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30939b10 0x55ea30a37130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f621f796640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6110036900 0x7f6110038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6210054000 tx=0x7f621004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f6228798640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30939b10 0x55ea30a37130 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f6228798640 1 -- 172.21.15.170:0/194316334 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30939b10 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.192+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a34700 con 0x55ea30939b10 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.193+0000 7f6228798640 1 -- 172.21.15.170:0/194316334 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30939b10 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.193+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a39980 0x55ea30a3bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.193+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a3c410 con 0x55ea30a39980 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.193+0000 7f6227f97640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a39980 0x55ea30a3bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.193+0000 7f6227f97640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a39980 0x55ea30a3bd70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.193+0000 7f6227f97640 1 -- 172.21.15.170:0/194316334 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f621802d070 con 0x55ea30a39980 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.194+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a38930 con 0x55ea30939b10 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.194+0000 7f6228798640 1 -- 172.21.15.170:0/194316334 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30939b10 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.194+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ea30a3d8c0 0x55ea30a3fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.194+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a40470 con 0x55ea30a3d8c0 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.194+0000 7f621f796640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ea30a3d8c0 0x55ea30a3fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.194+0000 7f621f796640 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ea30a3d8c0 0x55ea30a3fd10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f621f796640 1 -- 172.21.15.170:0/194316334 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f621005a040 con 0x55ea30a3d8c0 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f622a498800 1 Processor -- start 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f622a498800 1 -- start start 2024-04-26T12:30:36.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f622a498800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a4e8d0 0x55ea30a4ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f622a498800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ea30826e60 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a4e8d0 0x55ea30a4ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a4e8d0 0x55ea30a4ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42820/0 (socket says 172.21.15.170:42820) 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.195+0000 7f6227f97640 1 -- 172.21.15.170:0/3540378156 learned_addr learned my addr 172.21.15.170:0/3540378156 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.196+0000 7f6227f97640 1 -- 172.21.15.170:0/3540378156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea30a4f230 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.196+0000 7f6227f97640 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a4e8d0 0x55ea30a4ecf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f621804b4b0 tx=0x7f621801aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.196+0000 7f610d7fa640 1 -- 172.21.15.170:0/3540378156 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6218019470 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.196+0000 7f610d7fa640 1 -- 172.21.15.170:0/3540378156 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6218019610 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.196+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea30a4fca0 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.196+0000 7f610d7fa640 1 -- 172.21.15.170:0/3540378156 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62180198f0 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.196+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea30a501a0 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f610d7fa640 1 -- 172.21.15.170:0/3540378156 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f621803f1b0 con 0x55ea30a4e8d0 2024-04-26T12:30:36.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f610d7fa640 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61000368b0 0x7f6100038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f610d7fa640 1 -- 172.21.15.170:0/3540378156 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f621803cc50 con 0x55ea30a4e8d0 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f621f796640 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61000368b0 0x7f6100038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f622a498800 1 Processor -- start 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f622a498800 1 -- start start 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f621f796640 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61000368b0 0x7f6100038d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55ea30a34620 tx=0x7f6210005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f622a498800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a5c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.197+0000 7f622a498800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ea30933fc0 con 0x55ea30a5bc70 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a5c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a5c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42822/0 (socket says 172.21.15.170:42822) 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6227f97640 1 -- 172.21.15.170:0/4176810752 learned_addr learned my addr 172.21.15.170:0/4176810752 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6227f97640 1 -- 172.21.15.170:0/4176810752 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea30a5c640 con 0x55ea30a5bc70 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6227f97640 1 --2- 172.21.15.170:0/4176810752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a5c070 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f621803cfd0 tx=0x7f6218026920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1fe3d128ce79b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6106ffd640 1 -- 172.21.15.170:0/4176810752 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621804b530 con 0x55ea30a5bc70 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6106ffd640 1 -- 172.21.15.170:0/4176810752 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6218041dd0 con 0x55ea30a5bc70 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f6106ffd640 1 -- 172.21.15.170:0/4176810752 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6218040a30 con 0x55ea30a5bc70 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f622a498800 1 -- 172.21.15.170:0/4176810752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 msgr2=0x55ea30a5c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f622a498800 1 --2- 172.21.15.170:0/4176810752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a5c070 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f621803cfd0 tx=0x7f6218026920 comp rx=0 tx=0).stop 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f622a498800 1 -- 172.21.15.170:0/4176810752 shutdown_connections 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f622a498800 1 --2- 172.21.15.170:0/4176810752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a5c070 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.198+0000 7f622a498800 1 -- 172.21.15.170:0/4176810752 >> 172.21.15.170:0/4176810752 conn(0x55ea30a57ef0 msgr2=0x55ea30a55f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f622a498800 1 -- 172.21.15.170:0/4176810752 shutdown_connections 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f622a498800 1 -- 172.21.15.170:0/4176810752 wait complete. 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f622a498800 1 Processor -- start 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f622a498800 1 -- start start 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f622a498800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a63030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f622a498800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ea30a5ccd0 con 0x55ea30a5bc70 2024-04-26T12:30:36.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a63030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f6227f97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a63030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42828/0 (socket says 172.21.15.170:42828) 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.199+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 learned_addr learned my addr 172.21.15.170:0/1982028344 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.200+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea30a63570 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.200+0000 7f6227f97640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a63030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6218041d50 tx=0x7f6218027540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.200+0000 7f61057fa640 1 -- 172.21.15.170:0/1982028344 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6218030450 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.200+0000 7f61057fa640 1 -- 172.21.15.170:0/1982028344 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62180305f0 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.200+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea30a63570 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.200+0000 7f61057fa640 1 -- 172.21.15.170:0/1982028344 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62180308f0 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.200+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea30a63570 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f61057fa640 1 -- 172.21.15.170:0/1982028344 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f621804b960 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f61057fa640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f60f0036900 0x7f60f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f61057fa640 1 -- 172.21.15.170:0/1982028344 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6218059150 con 0x55ea30a5bc70 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f621f796640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f60f0036900 0x7f60f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f621f796640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f60f0036900 0x7f60f0038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6210055040 tx=0x7f621004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30a6e590 0x55ea30a70a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.201+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a711a0 con 0x55ea30a6e590 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f6228798640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30a6e590 0x55ea30a70a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f6228798640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30a6e590 0x55ea30a70a50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 20 realm 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a715b0 con 0x55ea30a6e590 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.202+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a71e80 con 0x55ea30a6e590 2024-04-26T12:30:36.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a72f80 0x55ea30a75370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a75980 con 0x55ea30a72f80 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f6227f97640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a72f80 0x55ea30a75370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f6227f97640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a72f80 0x55ea30a75370 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.203+0000 7f622a498800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f622a498800 20 searching for the correct realm 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ea30a77930 0x55ea30a79df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7a4c0 con 0x55ea30a77930 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f621f796640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ea30a77930 0x55ea30a79df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f621f796640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ea30a77930 0x55ea30a79df0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f621f796640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6210082040 0x7f6210083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7a4c0 con 0x7f6210082040 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.204+0000 7f6228798640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6210082040 0x7f6210083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.205+0000 7f6228798640 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6210082040 0x7f6210083430 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.205+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.205+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.206+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x7f6210082040 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.207+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x7f6210082040 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.208+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.209+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.210+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x7f6210082040 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.211+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.211+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.211+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.211+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.211+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.211+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x7f6210082040 2024-04-26T12:30:36.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a77930 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.212+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a72f80 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x55ea30a6e590 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a72220 con 0x7f6210082040 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:36.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a76240 con 0x55ea30a6e590 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.213+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a76240 con 0x55ea30a6e590 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a76240 con 0x7f6210082040 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:36.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 zone default found 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 4 Realm: () 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 zonegroup default 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a76ae0 con 0x55ea30a72f80 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7c320 con 0x55ea30a77930 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.214+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f622a498800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7c6c0 con 0x55ea30a77930 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f622a498800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f622a498800 20 started sync module instance, tier type = 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f622a498800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.215+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7b7c0 con 0x7f6210082040 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.216+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.216+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94464327007152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7b7c0 con 0x7f6210082040 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.216+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7cf10 con 0x55ea30a6e590 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.217+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94464327007152] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.217+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.217+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94464327005424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7cf10 con 0x55ea30a6e590 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.217+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7d910 con 0x55ea30a77930 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.218+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94464327005424] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.218+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.218+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94464327010912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7ce80 con 0x55ea30a77930 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.218+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7e7d0 con 0x7f6210082040 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.219+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94464327010912] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.219+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.219+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94464327017248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7ebf0 con 0x7f6210082040 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.219+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7f5b0 con 0x55ea30a6e590 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.220+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.220+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94464327020800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7f520 con 0x55ea30a6e590 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.220+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a80520 con 0x55ea30a72f80 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.220+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94464327017248] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.221+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.221+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94464327024624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a80910 con 0x55ea30a72f80 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.221+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94464327020800] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.221+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a81310 con 0x55ea30a72f80 2024-04-26T12:30:36.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.222+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.222+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94464327023008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a81bb0 con 0x55ea30a72f80 2024-04-26T12:30:36.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.222+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a82570 con 0x55ea30a72f80 2024-04-26T12:30:36.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.222+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94464327024624] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94464327023008] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94464327018304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a82570 con 0x55ea30a72f80 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 20 add_watcher() i=0 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 20 add_watcher() i=1 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 20 add_watcher() i=2 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 20 add_watcher() i=3 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 20 add_watcher() i=4 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 20 add_watcher() i=5 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.223+0000 7f622a498800 20 add_watcher() i=6 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.224+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94464327018304] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.224+0000 7f622a498800 20 add_watcher() i=7 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.224+0000 7f622a498800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.224+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a856a0 con 0x55ea30a6e590 2024-04-26T12:30:36.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.225+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.225+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94464327033024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a82990 con 0x55ea30a6e590 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.226+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94464327033024] v30'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.226+0000 7f60ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.226+0000 7f622a498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.226+0000 7f622a498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.226+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a85090 con 0x55ea30a6e590 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.227+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.227+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a8e930 con 0x55ea30a72f80 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.228+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.228+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a8e930 con 0x55ea30a77930 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.229+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.229+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a8f350 con 0x55ea30a6e590 2024-04-26T12:30:36.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.230+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.230+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a8ddd0 con 0x7f6210082040 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.231+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.231+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a8ddd0 con 0x55ea30a77930 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.232+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.232+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90530 con 0x55ea30a6e590 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.233+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.233+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90530 con 0x55ea30a72f80 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.234+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.234+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90640 con 0x7f6210082040 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.235+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.235+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90b20 con 0x55ea30a77930 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.236+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.236+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90b20 con 0x7f6210082040 2024-04-26T12:30:36.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.237+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.237+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90b20 con 0x55ea30a72f80 2024-04-26T12:30:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.239+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.239+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90b20 con 0x7f6210082040 2024-04-26T12:30:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.240+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.240+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90b20 con 0x55ea30a72f80 2024-04-26T12:30:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.241+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.241+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90b20 con 0x55ea30a6e590 2024-04-26T12:30:36.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.242+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.242+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90b20 con 0x55ea30a77930 2024-04-26T12:30:36.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.243+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.243+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a910b0 con 0x7f6210082040 2024-04-26T12:30:36.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.244+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.244+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a91090 con 0x55ea30a77930 2024-04-26T12:30:36.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.244+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.245+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a91060 con 0x55ea30a6e590 2024-04-26T12:30:36.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.245+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.245+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a91060 con 0x55ea30a6e590 2024-04-26T12:30:36.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.246+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.246+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a91060 con 0x55ea30a77930 2024-04-26T12:30:36.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.248+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.248+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x7f6210082040 2024-04-26T12:30:36.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.249+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.249+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a77930 2024-04-26T12:30:36.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.250+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.250+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a77930 2024-04-26T12:30:36.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.251+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.251+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a77930 2024-04-26T12:30:36.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.251+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.252+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a77930 2024-04-26T12:30:36.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.253+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.253+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a72f80 2024-04-26T12:30:36.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.254+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.254+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a77930 2024-04-26T12:30:36.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.255+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.255+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a72f80 2024-04-26T12:30:36.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.256+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.256+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a77930 2024-04-26T12:30:36.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.257+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.257+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x55ea30a72f80 2024-04-26T12:30:36.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.258+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.258+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a90fd0 con 0x7f6210082040 2024-04-26T12:30:36.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.259+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.259+0000 7f60dcfe1640 20 reqs_thread_entry: start 2024-04-26T12:30:36.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.259+0000 7f622a498800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:36.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.259+0000 7f622a498800 20 Filter name: none 2024-04-26T12:30:36.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f60567fc640 20 reqs_thread_entry: start 2024-04-26T12:30:36.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:30:36.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abbd50 con 0x55ea30a72f80 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.260+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abe7e0 con 0x55ea30a72f80 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.261+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.261+0000 7f622a498800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T12:30:36.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.261+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abc7c0 con 0x55ea30a72f80 2024-04-26T12:30:36.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.261+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.261+0000 7f622a498800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:30:36.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.261+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94464327275216 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abedd0 con 0x55ea30a77930 2024-04-26T12:30:36.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== watch-notify(notify (1) cookie 94464327010912 notify 128849018883 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ea30a90080 con 0x55ea30a77930 2024-04-26T12:30:36.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f6106ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94464327010912 notifier 4537 bl.length()=170 2024-04-26T12:30:36.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f6106ffd640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f60ec003d60 con 0x55ea30a77930 2024-04-26T12:30:36.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(97 notify.2 [notify cookie 94464327275216 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== watch-notify(notify_complete (2) cookie 94464327275216 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea30a8feb0 con 0x55ea30a77930 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f622a498800 10 removing email index: 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f622a498800 10 removing user buckets index 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.262+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abecd0 con 0x55ea30a72f80 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.263+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(99 fud.buckets [delete] v30'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.263+0000 7f622a498800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.263+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94464327280672 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abe2e0 con 0x55ea30a72f80 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== watch-notify(notify (1) cookie 94464327023008 notify 128849018892 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ea30a90770 con 0x55ea30a72f80 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f61067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94464327023008 notifier 4537 bl.length()=160 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f61067fc640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f605c0032c0 con 0x55ea30a72f80 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(100 notify.6 [notify cookie 94464327280672 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== watch-notify(notify_complete (2) cookie 94464327280672 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea30a4fca0 con 0x55ea30a72f80 2024-04-26T12:30:36.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f622a498800 10 removing user index: fud 2024-04-26T12:30:36.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.264+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abecd0 con 0x55ea30a72f80 2024-04-26T12:30:36.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(102 fud [call,call,delete] v30'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f622a498800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-26T12:30:36.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f622a498800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:30:36.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94464327280672 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abd2d0 con 0x55ea30a72f80 2024-04-26T12:30:36.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== watch-notify(notify (1) cookie 94464327024624 notify 128849018893 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ea30a4fca0 con 0x55ea30a72f80 2024-04-26T12:30:36.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f6106ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94464327024624 notifier 4537 bl.length()=152 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f6106ffd640 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f60ec003d60 con 0x55ea30a72f80 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== osd_op_reply(103 notify.5 [notify cookie 94464327280672 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.265+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== watch-notify(notify_complete (2) cookie 94464327280672 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea30a4f230 con 0x55ea30a72f80 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.266+0000 7f60ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.266+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94464327033024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30abecd0 con 0x55ea30a6e590 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.267+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94464327033024] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.267+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94464327007152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a820c0 con 0x7f6210082040 2024-04-26T12:30:36.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.268+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94464327007152] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.268+0000 7f622a498800 20 remove_watcher() i=0 2024-04-26T12:30:36.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.268+0000 7f622a498800 2 removed watcher, disabling cache 2024-04-26T12:30:36.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.268+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94464327005424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a820c0 con 0x55ea30a6e590 2024-04-26T12:30:36.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.269+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94464327005424] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.269+0000 7f622a498800 20 remove_watcher() i=1 2024-04-26T12:30:36.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.269+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94464327010912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7b4f0 con 0x55ea30a77930 2024-04-26T12:30:36.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.270+0000 7f621f796640 1 -- 172.21.15.170:0/1982028344 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94464327010912] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621007f070 con 0x55ea30a77930 2024-04-26T12:30:36.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.270+0000 7f622a498800 20 remove_watcher() i=2 2024-04-26T12:30:36.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.270+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94464327017248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a820c0 con 0x7f6210082040 2024-04-26T12:30:36.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.271+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94464327017248] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x7f6210082040 2024-04-26T12:30:36.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.271+0000 7f622a498800 20 remove_watcher() i=3 2024-04-26T12:30:36.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.271+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94464327020800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7ca60 con 0x55ea30a6e590 2024-04-26T12:30:36.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.272+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94464327020800] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622000a4a0 con 0x55ea30a6e590 2024-04-26T12:30:36.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.272+0000 7f622a498800 20 remove_watcher() i=4 2024-04-26T12:30:36.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.272+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94464327024624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7e320 con 0x55ea30a72f80 2024-04-26T12:30:36.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.273+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94464327024624] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.273+0000 7f622a498800 20 remove_watcher() i=5 2024-04-26T12:30:36.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.273+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94464327023008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a820c0 con 0x55ea30a72f80 2024-04-26T12:30:36.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.274+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94464327023008] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.274+0000 7f622a498800 20 remove_watcher() i=6 2024-04-26T12:30:36.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.274+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94464327018304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ea30a7f100 con 0x55ea30a72f80 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f6227f97640 1 -- 172.21.15.170:0/1982028344 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94464327018304] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6218077070 con 0x55ea30a72f80 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 20 remove_watcher() i=7 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a72f80 msgr2=0x55ea30a75370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a72f80 0x55ea30a75370 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30a6e590 msgr2=0x55ea30a70a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30a6e590 0x55ea30a70a50 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6210082040 msgr2=0x7f6210083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f6210082040 0x7f6210083430 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ea30a77930 msgr2=0x55ea30a79df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ea30a77930 0x55ea30a79df0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f60f0036900 msgr2=0x7f60f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f60f0036900 0x7f60f0038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6210055040 tx=0x7f621004f000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 msgr2=0x55ea30a63030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f622a498800 1 --2- 172.21.15.170:0/1982028344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a5bc70 0x55ea30a63030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6218041d50 tx=0x7f6218027540 comp rx=0 tx=0).stop 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 reap_dead start 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.275+0000 7f6228798640 1 -- 172.21.15.170:0/1982028344 reap_dead start 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 shutdown_connections 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 >> 172.21.15.170:0/1982028344 conn(0x55ea30a57ef0 msgr2=0x55ea30a55550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 shutdown_connections 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/1982028344 wait complete. 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61000368b0 msgr2=0x7f6100038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61000368b0 0x7f6100038d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55ea30a34620 tx=0x7f6210005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a4e8d0 msgr2=0x55ea30a4ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a4e8d0 0x55ea30a4ecf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f621804b4b0 tx=0x7f621801aaf0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 shutdown_connections 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f61000368b0 0x7f6100038d70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/3540378156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30a4e8d0 0x55ea30a4ecf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 >> 172.21.15.170:0/3540378156 conn(0x55ea30a42970 msgr2=0x55ea30a42d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 shutdown_connections 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/3540378156 wait complete. 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a39980 msgr2=0x55ea30a3bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ea30a39980 0x55ea30a3bd70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30939b10 msgr2=0x55ea30a37130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ea30939b10 0x55ea30a37130 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ea30a3d8c0 msgr2=0x55ea30a3fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ea30a3d8c0 0x55ea30a3fd10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6110036900 msgr2=0x7f6110038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6110036900 0x7f6110038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6210054000 tx=0x7f621004e000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 msgr2=0x55ea30a30110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 --2- 172.21.15.170:0/194316334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ea30936000 0x55ea30a30110 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f621800b210 tx=0x7f6218000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f6228798640 1 -- 172.21.15.170:0/194316334 reap_dead start 2024-04-26T12:30:36.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 shutdown_connections 2024-04-26T12:30:36.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.276+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 >> 172.21.15.170:0/194316334 conn(0x55ea3092f990 msgr2=0x55ea30a219b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.277+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 shutdown_connections 2024-04-26T12:30:36.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.277+0000 7f622a498800 1 -- 172.21.15.170:0/194316334 wait complete. 2024-04-26T12:30:36.285 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:30:36.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-26T12:30:36.286 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-26T12:30:36.379 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:36.379 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:36.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0916d3e800 1 Processor -- start 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0916d3e800 1 -- start start 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0916d3e800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d69bcc87c0 0x55d69bd58040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0916d3e800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d69bc020c0 con 0x55d69bd585b0 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0916d3e800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55d69bbe64d0 con 0x55d69bcc87c0 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0912a3f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d69bcc87c0 0x55d69bd58040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0912a3f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d69bcc87c0 0x55d69bd58040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42832/0 (socket says 172.21.15.170:42832) 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.379+0000 7f0912a3f640 1 -- 172.21.15.170:0/1762390307 learned_addr learned my addr 172.21.15.170:0/1762390307 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.380+0000 7f0912a3f640 1 -- 172.21.15.170:0/1762390307 >> v1:172.21.15.132:6789/0 conn(0x55d69bd585b0 legacy=0x55d69bd5aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.380+0000 7f091223e640 1 -- 172.21.15.170:0/1762390307 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1483335727 0 0) 0x55d69bc020c0 con 0x55d69bd585b0 2024-04-26T12:30:36.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.380+0000 7f0912a3f640 1 -- 172.21.15.170:0/1762390307 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69bc13d40 con 0x55d69bcc87c0 2024-04-26T12:30:36.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.381+0000 7f0912a3f640 1 --2- 172.21.15.170:0/1762390307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69bd58040 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f090400a520 tx=0x7f090401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84609fd4b5ba4441 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f091223e640 1 -- 172.21.15.170:0/1762390307 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0904057070 con 0x55d69bcc87c0 2024-04-26T12:30:36.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f091223e640 1 -- 172.21.15.170:0/1762390307 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904052570 con 0x55d69bcc87c0 2024-04-26T12:30:36.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f091223e640 1 -- 172.21.15.170:0/1762390307 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f090404ae60 con 0x55d69bcc87c0 2024-04-26T12:30:36.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f0916d3e800 1 -- 172.21.15.170:0/1762390307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 msgr2=0x55d69bd58040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f0916d3e800 1 --2- 172.21.15.170:0/1762390307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69bd58040 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f090400a520 tx=0x7f090401d010 comp rx=0 tx=0).stop 2024-04-26T12:30:36.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f0916d3e800 1 -- 172.21.15.170:0/1762390307 shutdown_connections 2024-04-26T12:30:36.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f0916d3e800 1 --2- 172.21.15.170:0/1762390307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69bd58040 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f0916d3e800 1 -- 172.21.15.170:0/1762390307 >> 172.21.15.170:0/1762390307 conn(0x55d69bd4f980 msgr2=0x55d69bd51da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f0916d3e800 1 -- 172.21.15.170:0/1762390307 shutdown_connections 2024-04-26T12:30:36.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.382+0000 7f0916d3e800 1 -- 172.21.15.170:0/1762390307 wait complete. 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.394+0000 7f0916d3e800 1 Processor -- start 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.394+0000 7f0916d3e800 1 -- start start 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.394+0000 7f0916d3e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be46510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.394+0000 7f0916d3e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d69bca0ae0 con 0x55d69bcc87c0 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.394+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be46510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.394+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be46510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42844/0 (socket says 172.21.15.170:42844) 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.394+0000 7f0912a3f640 1 -- 172.21.15.170:0/2572868607 learned_addr learned my addr 172.21.15.170:0/2572868607 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.395+0000 7f0912a3f640 1 -- 172.21.15.170:0/2572868607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69bc12590 con 0x55d69bcc87c0 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.395+0000 7f0912a3f640 1 --2- 172.21.15.170:0/2572868607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be46510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0904055040 tx=0x7f090404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa70a8140a9c077 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.395+0000 7f0800e09640 1 -- 172.21.15.170:0/2572868607 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0904062070 con 0x55d69bcc87c0 2024-04-26T12:30:36.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.395+0000 7f0800e09640 1 -- 172.21.15.170:0/2572868607 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904052720 con 0x55d69bcc87c0 2024-04-26T12:30:36.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.395+0000 7f0800e09640 1 -- 172.21.15.170:0/2572868607 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0904057040 con 0x55d69bcc87c0 2024-04-26T12:30:36.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 -- 172.21.15.170:0/2572868607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 msgr2=0x55d69be46510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 --2- 172.21.15.170:0/2572868607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be46510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0904055040 tx=0x7f090404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 -- 172.21.15.170:0/2572868607 shutdown_connections 2024-04-26T12:30:36.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 --2- 172.21.15.170:0/2572868607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be46510 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 -- 172.21.15.170:0/2572868607 >> 172.21.15.170:0/2572868607 conn(0x55d69bd4f980 msgr2=0x55d69be41e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 -- 172.21.15.170:0/2572868607 shutdown_connections 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 -- 172.21.15.170:0/2572868607 wait complete. 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 Processor -- start 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 -- start start 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be4ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0916d3e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d69bd5c600 con 0x55d69bcc87c0 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be4ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be4ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42856/0 (socket says 172.21.15.170:42856) 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.396+0000 7f0912a3f640 1 -- 172.21.15.170:0/909763182 learned_addr learned my addr 172.21.15.170:0/909763182 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.397+0000 7f0912a3f640 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69bc098f0 con 0x55d69bcc87c0 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.397+0000 7f0912a3f640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be4ddf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09040057e0 tx=0x7f0904002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.397+0000 7f07ff606640 1 -- 172.21.15.170:0/909763182 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0904057050 con 0x55d69bcc87c0 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.397+0000 7f07ff606640 1 -- 172.21.15.170:0/909763182 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904067450 con 0x55d69bcc87c0 2024-04-26T12:30:36.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.397+0000 7f07ff606640 1 -- 172.21.15.170:0/909763182 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0904062040 con 0x55d69bcc87c0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.397+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d69be4e330 con 0x55d69bcc87c0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.397+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d69be4e8b0 con 0x55d69bcc87c0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f07ff606640 1 -- 172.21.15.170:0/909763182 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0904067750 con 0x55d69bcc87c0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f07ff606640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07f8036950 0x7f07f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f07ff606640 1 -- 172.21.15.170:0/909763182 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f090408e0f0 con 0x55d69bcc87c0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f090a23e640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07f8036950 0x7f07f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69bd585b0 0x55d69be54e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be553a0 con 0x55d69bd585b0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f0913240640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69bd585b0 0x55d69be54e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f090a23e640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07f8036950 0x7f07f8038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08fc000f60 tx=0x7f08fc0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.398+0000 7f0913240640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69bd585b0 0x55d69be54e60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.399+0000 7f0913240640 1 -- 172.21.15.170:0/909763182 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69bd585b0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.399+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be52410 con 0x55d69bd585b0 2024-04-26T12:30:36.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.399+0000 7f0913240640 1 -- 172.21.15.170:0/909763182 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69bd585b0 2024-04-26T12:30:36.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.399+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be57690 0x55d69be59a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.399+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be5a170 con 0x55d69be57690 2024-04-26T12:30:36.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.399+0000 7f0912a3f640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be57690 0x55d69be59a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f0912a3f640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be57690 0x55d69be59a80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f0912a3f640 1 -- 172.21.15.170:0/909763182 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0904064070 con 0x55d69be57690 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be56640 con 0x55d69bd585b0 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f0913240640 1 -- 172.21.15.170:0/909763182 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69bd585b0 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d69be5b620 0x55d69be5da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be5e1d0 con 0x55d69be5b620 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f090a23e640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d69be5b620 0x55d69be5da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.400+0000 7f090a23e640 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d69be5b620 0x55d69be5da70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f090a23e640 1 -- 172.21.15.170:0/909763182 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08fc010590 con 0x55d69be5b620 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f0916d3e800 1 Processor -- start 2024-04-26T12:30:36.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f0916d3e800 1 -- start start 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f0916d3e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be6c630 0x55d69be6ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f0916d3e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d69bc46e60 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be6c630 0x55d69be6ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be6c630 0x55d69be6ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42858/0 (socket says 172.21.15.170:42858) 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.401+0000 7f0912a3f640 1 -- 172.21.15.170:0/2678922353 learned_addr learned my addr 172.21.15.170:0/2678922353 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.402+0000 7f0912a3f640 1 -- 172.21.15.170:0/2678922353 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69be6cf90 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.402+0000 7f0912a3f640 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be6c630 0x55d69be6ca50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f090408c4c0 tx=0x7f090405d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.402+0000 7f07fce01640 1 -- 172.21.15.170:0/2678922353 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0904089070 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.402+0000 7f07fce01640 1 -- 172.21.15.170:0/2678922353 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904008010 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.402+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d69be6da00 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.402+0000 7f07fce01640 1 -- 172.21.15.170:0/2678922353 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f090408c980 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.402+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d69be6df00 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f07fce01640 1 -- 172.21.15.170:0/2678922353 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f090408cb20 con 0x55d69be6c630 2024-04-26T12:30:36.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f07fce01640 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07ec036950 0x7f07ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f07fce01640 1 -- 172.21.15.170:0/2678922353 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0904090c90 con 0x55d69be6c630 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f090a23e640 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07ec036950 0x7f07ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f0916d3e800 1 Processor -- start 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f0916d3e800 1 -- start start 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f090a23e640 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07ec036950 0x7f07ec038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55d69be55c40 tx=0x7f08fc006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f0916d3e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be7beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.403+0000 7f0916d3e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d69be46bd0 con 0x55d69be7ba90 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be7beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be7beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42864/0 (socket says 172.21.15.170:42864) 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f0912a3f640 1 -- 172.21.15.170:0/113633197 learned_addr learned my addr 172.21.15.170:0/113633197 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f0912a3f640 1 -- 172.21.15.170:0/113633197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69be7c3f0 con 0x55d69be7ba90 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f0912a3f640 1 --2- 172.21.15.170:0/113633197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be7beb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0904081010 tx=0x7f0904085920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff23bdf50ab6ec6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f07f67fc640 1 -- 172.21.15.170:0/113633197 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09040910c0 con 0x55d69be7ba90 2024-04-26T12:30:36.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f07f67fc640 1 -- 172.21.15.170:0/113633197 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904098d60 con 0x55d69be7ba90 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f07f67fc640 1 -- 172.21.15.170:0/113633197 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f090405b570 con 0x55d69be7ba90 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.404+0000 7f0916d3e800 1 -- 172.21.15.170:0/113633197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 msgr2=0x55d69be7beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 --2- 172.21.15.170:0/113633197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be7beb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0904081010 tx=0x7f0904085920 comp rx=0 tx=0).stop 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 -- 172.21.15.170:0/113633197 shutdown_connections 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 --2- 172.21.15.170:0/113633197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be7beb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 -- 172.21.15.170:0/113633197 >> 172.21.15.170:0/113633197 conn(0x55d69be75a80 msgr2=0x55d69be73ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 -- 172.21.15.170:0/113633197 shutdown_connections 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 -- 172.21.15.170:0/113633197 wait complete. 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 Processor -- start 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 -- start start 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be82d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0916d3e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d69be7c930 con 0x55d69be7ba90 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be82d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0912a3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be82d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42878/0 (socket says 172.21.15.170:42878) 2024-04-26T12:30:36.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 learned_addr learned my addr 172.21.15.170:0/3453942909 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.405+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d69be83270 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.406+0000 7f0912a3f640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be82d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0904085780 tx=0x7f09040912b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.406+0000 7f07f4ff9640 1 -- 172.21.15.170:0/3453942909 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09040ab040 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.406+0000 7f07f4ff9640 1 -- 172.21.15.170:0/3453942909 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904098440 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.406+0000 7f07f4ff9640 1 -- 172.21.15.170:0/3453942909 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0904085c20 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.406+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d69be83270 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.406+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d69be83270 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f07f4ff9640 1 -- 172.21.15.170:0/3453942909 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f09040b8020 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f07f4ff9640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07dc036950 0x7f07dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f07f4ff9640 1 -- 172.21.15.170:0/3453942909 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f09040b6020 con 0x55d69be7ba90 2024-04-26T12:30:36.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f090a23e640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07dc036950 0x7f07dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f090a23e640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07dc036950 0x7f07dc038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d69be5e5d0 tx=0x7f08fc022040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69be8e400 0x55d69be908c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be91010 con 0x55d69be8e400 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.407+0000 7f0913240640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69be8e400 0x55d69be908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0913240640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69be8e400 0x55d69be908c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 20 realm 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be91420 con 0x55d69be8e400 2024-04-26T12:30:36.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be91cf0 con 0x55d69be8e400 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.408+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be92df0 0x55d69be951e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be957f0 con 0x55d69be92df0 2024-04-26T12:30:36.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0912a3f640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be92df0 0x55d69be951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0912a3f640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be92df0 0x55d69be951e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 20 searching for the correct realm 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d69be977a0 0x55d69be99c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.409+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9a330 con 0x55d69be977a0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.410+0000 7f090a23e640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d69be977a0 0x55d69be99c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.410+0000 7f090a23e640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d69be977a0 0x55d69be99c60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.410+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.410+0000 7f090a23e640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f08fc0393c0 0x7f08fc039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.410+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9a330 con 0x7f08fc0393c0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.410+0000 7f0913240640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f08fc0393c0 0x7f08fc039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.411+0000 7f0913240640 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f08fc0393c0 0x7f08fc039810 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.411+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.411+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.411+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.411+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x7f08fc0393c0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.412+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.413+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x7f08fc0393c0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.414+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.415+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x7f08fc0393c0 2024-04-26T12:30:36.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.416+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x7f08fc0393c0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.417+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be977a0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be92df0 2024-04-26T12:30:36.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x55d69be8e400 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d69be92090 con 0x7f08fc0393c0 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.418+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be960b0 con 0x55d69be8e400 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be960b0 con 0x55d69be8e400 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be960b0 con 0x7f08fc0393c0 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 zone default found 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 4 Realm: () 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:36.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 zonegroup default 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be96950 con 0x55d69be92df0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.419+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9c190 con 0x55d69be977a0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9c530 con 0x55d69be977a0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 20 started sync module instance, tier type = 2024-04-26T12:30:36.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.420+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9b630 con 0x7f08fc0393c0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.421+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.421+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94380227148672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9b630 con 0x7f08fc0393c0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.421+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9cd80 con 0x55d69be8e400 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.422+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94380227148672] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.422+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.422+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94380227152560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9b630 con 0x55d69be8e400 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.422+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9d7f0 con 0x55d69be977a0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.423+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94380227152560] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.424+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.424+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94380227146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9b5a0 con 0x55d69be977a0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.424+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9e580 con 0x7f08fc0393c0 2024-04-26T12:30:36.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.425+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.425+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94380227146112] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.425+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94380227158160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9ee50 con 0x7f08fc0393c0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.425+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9dbe0 con 0x55d69be8e400 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.426+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94380227158160] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.426+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.426+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94380227160400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9dbe0 con 0x55d69be8e400 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.426+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9fd90 con 0x55d69be92df0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.427+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.427+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94380227164256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea0630 con 0x55d69be92df0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.427+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea10b0 con 0x55d69be92df0 2024-04-26T12:30:36.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.427+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94380227160400] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.428+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.428+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94380227169184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea1370 con 0x55d69be92df0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.428+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea1e90 con 0x55d69be92df0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.428+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94380227164256] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94380227169184] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94380227162688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea0180 con 0x55d69be92df0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 20 add_watcher() i=0 2024-04-26T12:30:36.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 20 add_watcher() i=1 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 20 add_watcher() i=2 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 20 add_watcher() i=3 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 20 add_watcher() i=4 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 20 add_watcher() i=5 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.429+0000 7f0916d3e800 20 add_watcher() i=6 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.430+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94380227162688] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.430+0000 7f0916d3e800 20 add_watcher() i=7 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.430+0000 7f0916d3e800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.430+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea4e80 con 0x55d69be8e400 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.430+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.430+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94380227172704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea2300 con 0x55d69be8e400 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.431+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94380227172704] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.431+0000 7f07c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.431+0000 7f0916d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.431+0000 7f0916d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.431+0000 7f0916d3e800 5 note: GC not initialized 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0743fff640 20 reqs_thread_entry: start 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 20 Filter name: none 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0741ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69bed85b0 con 0x55d69be92df0 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:30:36.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.432+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69bed6b40 con 0x55d69be92df0 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.433+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.433+0000 7f0916d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.433+0000 7f0916d3e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.433+0000 7f0916d3e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.433+0000 7f0916d3e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.433+0000 7f0916d3e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.433+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bedb310 con 0x55d69be92df0 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0916d3e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0916d3e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0916d3e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-26T12:30:36.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94380227407200 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69bedbde0 con 0x7f08fc0393c0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== watch-notify(notify (1) cookie 94380227158160 notify 128849018892 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f090c018b60 con 0x7f08fc0393c0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f07f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94380227158160 notifier 4544 bl.length()=610 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f07f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f07f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 notify.3 [notify cookie 94380227407200 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f07f67fc640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f07d8003ea0 con 0x7f08fc0393c0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== watch-notify(notify_complete (2) cookie 94380227407200 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f090c018e00 con 0x7f08fc0393c0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.434+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bedb310 con 0x55d69be92df0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.435+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.435+0000 7f0916d3e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f0916d3e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f0916d3e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:30:36.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94380227402464 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d69bedb310 con 0x55d69be977a0 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== watch-notify(notify (1) cookie 94380227146112 notify 128849018884 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f08fc039d50 con 0x55d69be977a0 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f07f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94380227146112 notifier 4544 bl.length()=192 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f07f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f07f5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(68 notify.2 [notify cookie 94380227402464 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f07f5ffb640 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f0748003400 con 0x55d69be977a0 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.436+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== watch-notify(notify_complete (2) cookie 94380227402464 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f08fc003ad0 con 0x55d69be977a0 2024-04-26T12:30:36.450 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:30:36.433860Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:36.433847Z","tags":[],"group_ids":[]} 2024-04-26T12:30:36.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.437+0000 7f07c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.437+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94380227172704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bed9ae0 con 0x55d69be8e400 2024-04-26T12:30:36.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.438+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94380227172704] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.438+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94380227148672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69bea1960 con 0x7f08fc0393c0 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.439+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94380227148672] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.439+0000 7f0916d3e800 20 remove_watcher() i=0 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.439+0000 7f0916d3e800 2 removed watcher, disabling cache 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.439+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94380227152560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9bb80 con 0x55d69be8e400 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.440+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94380227152560] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.440+0000 7f0916d3e800 20 remove_watcher() i=1 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.440+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94380227146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9bb80 con 0x55d69be977a0 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.441+0000 7f090a23e640 1 -- 172.21.15.170:0/3453942909 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94380227146112] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08fc036040 con 0x55d69be977a0 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.441+0000 7f0916d3e800 20 remove_watcher() i=2 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.441+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94380227158160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9bb80 con 0x7f08fc0393c0 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.442+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94380227158160] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x7f08fc0393c0 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.442+0000 7f0916d3e800 20 remove_watcher() i=3 2024-04-26T12:30:36.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.442+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94380227160400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9bb80 con 0x55d69be8e400 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.443+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94380227160400] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f090c00a4a0 con 0x55d69be8e400 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.443+0000 7f0916d3e800 20 remove_watcher() i=4 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.443+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94380227164256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9e950 con 0x55d69be92df0 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.444+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94380227164256] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.444+0000 7f0916d3e800 20 remove_watcher() i=5 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.444+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94380227169184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9bb80 con 0x55d69be92df0 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.445+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94380227169184] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.445+0000 7f0916d3e800 20 remove_watcher() i=6 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.445+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94380227162688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d69be9f860 con 0x55d69be92df0 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0912a3f640 1 -- 172.21.15.170:0/3453942909 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94380227162688] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0904095020 con 0x55d69be92df0 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 20 remove_watcher() i=7 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be92df0 msgr2=0x55d69be951e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be92df0 0x55d69be951e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69be8e400 msgr2=0x55d69be908c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69be8e400 0x55d69be908c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f08fc0393c0 msgr2=0x7f08fc039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f08fc0393c0 0x7f08fc039810 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d69be977a0 msgr2=0x55d69be99c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d69be977a0 0x55d69be99c60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07dc036950 msgr2=0x7f07dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07dc036950 0x7f07dc038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d69be5e5d0 tx=0x7f08fc022040 comp rx=0 tx=0).stop 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 msgr2=0x55d69be82d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be82d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0904085780 tx=0x7f09040912b0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0913240640 1 -- 172.21.15.170:0/3453942909 reap_dead start 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 shutdown_connections 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 --2- 172.21.15.170:0/3453942909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be7ba90 0x55d69be82d30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.446+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 >> 172.21.15.170:0/3453942909 conn(0x55d69be75a80 msgr2=0x55d69be730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 shutdown_connections 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/3453942909 wait complete. 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07ec036950 msgr2=0x7f07ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07ec036950 0x7f07ec038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55d69be55c40 tx=0x7f08fc006000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be6c630 msgr2=0x55d69be6ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be6c630 0x55d69be6ca50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f090408c4c0 tx=0x7f090405d710 comp rx=0 tx=0).stop 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 shutdown_connections 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07ec036950 0x7f07ec038e10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/2678922353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69be6c630 0x55d69be6ca50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 >> 172.21.15.170:0/2678922353 conn(0x55d69be606d0 msgr2=0x55d69be60ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 shutdown_connections 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/2678922353 wait complete. 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be57690 msgr2=0x55d69be59a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d69be57690 0x55d69be59a80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69bd585b0 msgr2=0x55d69be54e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d69bd585b0 0x55d69be54e60 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d69be5b620 msgr2=0x55d69be5da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d69be5b620 0x55d69be5da70 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07f8036950 msgr2=0x7f07f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f07f8036950 0x7f07f8038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f08fc000f60 tx=0x7f08fc0013f0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 msgr2=0x55d69be4ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 --2- 172.21.15.170:0/909763182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d69bcc87c0 0x55d69be4ddf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f09040057e0 tx=0x7f0904002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0913240640 1 -- 172.21.15.170:0/909763182 reap_dead start 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 shutdown_connections 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 >> 172.21.15.170:0/909763182 conn(0x55d69bd4f980 msgr2=0x55d69be44f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 shutdown_connections 2024-04-26T12:30:36.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.447+0000 7f0916d3e800 1 -- 172.21.15.170:0/909763182 wait complete. 2024-04-26T12:30:36.461 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:30:36.433860Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:36.433847Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:36.461 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:30:36.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:30:36.462 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-26T12:30:36.510 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:36.510 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:36.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f799db21800 1 Processor -- start 2024-04-26T12:30:36.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f799db21800 1 -- start start 2024-04-26T12:30:36.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f799db21800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x56107f388a70 0x56107f388e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f799db21800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56107f2350c0 con 0x56107f3893d0 2024-04-26T12:30:36.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f799db21800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x56107f2194d0 con 0x56107f388a70 2024-04-26T12:30:36.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f7999859640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x56107f388a70 0x56107f388e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f7999058640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x56107f3893d0 0x56107f38fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:56638/0 (socket says 172.21.15.170:56638) 2024-04-26T12:30:36.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f7999058640 1 -- 172.21.15.170:0/3223945186 learned_addr learned my addr 172.21.15.170:0/3223945186 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:36.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f7999859640 1 -- 172.21.15.170:0/3223945186 >> v1:172.21.15.132:6789/0 conn(0x56107f3893d0 legacy=0x56107f38fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f7998857640 1 -- 172.21.15.170:0/3223945186 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541191649 0 0) 0x56107f2350c0 con 0x56107f3893d0 2024-04-26T12:30:36.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.510+0000 7f7999859640 1 -- 172.21.15.170:0/3223945186 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107f246d40 con 0x56107f388a70 2024-04-26T12:30:36.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.512+0000 7f7999859640 1 --2- 172.21.15.170:0/3223945186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f388e90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f798c00a470 tx=0x7f798c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992d497ff3b627aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.512+0000 7f7998857640 1 -- 172.21.15.170:0/3223945186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c057070 con 0x56107f388a70 2024-04-26T12:30:36.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.512+0000 7f7998857640 1 -- 172.21.15.170:0/3223945186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c052570 con 0x56107f388a70 2024-04-26T12:30:36.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f7998857640 1 -- 172.21.15.170:0/3223945186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c052870 con 0x56107f388a70 2024-04-26T12:30:36.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f799db21800 1 -- 172.21.15.170:0/3223945186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 msgr2=0x56107f388e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f799db21800 1 --2- 172.21.15.170:0/3223945186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f388e90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f798c00a470 tx=0x7f798c01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:36.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f799db21800 1 -- 172.21.15.170:0/3223945186 shutdown_connections 2024-04-26T12:30:36.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f799db21800 1 --2- 172.21.15.170:0/3223945186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f388e90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f799db21800 1 -- 172.21.15.170:0/3223945186 >> 172.21.15.170:0/3223945186 conn(0x56107f382180 msgr2=0x56107f3845a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f799db21800 1 -- 172.21.15.170:0/3223945186 shutdown_connections 2024-04-26T12:30:36.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.513+0000 7f799db21800 1 -- 172.21.15.170:0/3223945186 wait complete. 2024-04-26T12:30:36.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f799db21800 1 Processor -- start 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f799db21800 1 -- start start 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f799db21800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f47b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f799db21800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56107f2d3b60 con 0x56107f388a70 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f47b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f47b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36438/0 (socket says 172.21.15.170:36438) 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f7999859640 1 -- 172.21.15.170:0/1015812154 learned_addr learned my addr 172.21.15.170:0/1015812154 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.525+0000 7f7999859640 1 -- 172.21.15.170:0/1015812154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107f245590 con 0x56107f388a70 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.526+0000 7f7999859640 1 --2- 172.21.15.170:0/1015812154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f47b6a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f798c055040 tx=0x7f798c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2294515fe8565c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.526+0000 7f7887e07640 1 -- 172.21.15.170:0/1015812154 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c063070 con 0x56107f388a70 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.526+0000 7f7887e07640 1 -- 172.21.15.170:0/1015812154 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c058040 con 0x56107f388a70 2024-04-26T12:30:36.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.526+0000 7f7887e07640 1 -- 172.21.15.170:0/1015812154 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c057070 con 0x56107f388a70 2024-04-26T12:30:36.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 -- 172.21.15.170:0/1015812154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 msgr2=0x56107f47b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 --2- 172.21.15.170:0/1015812154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f47b6a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f798c055040 tx=0x7f798c04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 -- 172.21.15.170:0/1015812154 shutdown_connections 2024-04-26T12:30:36.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 --2- 172.21.15.170:0/1015812154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f47b6a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 -- 172.21.15.170:0/1015812154 >> 172.21.15.170:0/1015812154 conn(0x56107f382180 msgr2=0x56107f476fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 -- 172.21.15.170:0/1015812154 shutdown_connections 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 -- 172.21.15.170:0/1015812154 wait complete. 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 Processor -- start 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 -- start start 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f483080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f799db21800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56107f3917b0 con 0x56107f388a70 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f483080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f483080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36454/0 (socket says 172.21.15.170:36454) 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.527+0000 7f7999859640 1 -- 172.21.15.170:0/814258756 learned_addr learned my addr 172.21.15.170:0/814258756 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.528+0000 7f7999859640 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107f23c8f0 con 0x56107f388a70 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.528+0000 7f7999859640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f483080 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f798c061040 tx=0x7f798c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.528+0000 7f7886604640 1 -- 172.21.15.170:0/814258756 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c063030 con 0x56107f388a70 2024-04-26T12:30:36.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.528+0000 7f7886604640 1 -- 172.21.15.170:0/814258756 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c052d90 con 0x56107f388a70 2024-04-26T12:30:36.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.528+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56107f4835c0 con 0x56107f388a70 2024-04-26T12:30:36.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.528+0000 7f7886604640 1 -- 172.21.15.170:0/814258756 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c05e5b0 con 0x56107f388a70 2024-04-26T12:30:36.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.528+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107f483a20 con 0x56107f388a70 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.529+0000 7f7886604640 1 -- 172.21.15.170:0/814258756 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f798c05e750 con 0x56107f388a70 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.529+0000 7f7886604640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7880036950 0x7f7880038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.529+0000 7f7886604640 1 -- 172.21.15.170:0/814258756 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f798c064070 con 0x56107f388a70 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.529+0000 7f7999058640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7880036950 0x7f7880038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.529+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f3893d0 0x56107f48a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.529+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f48a620 con 0x56107f3893d0 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.529+0000 7f799a05a640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f3893d0 0x56107f48a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.530+0000 7f7999058640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7880036950 0x7f7880038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7990000c00 tx=0x7f79900013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.530+0000 7f799a05a640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f3893d0 0x56107f48a0a0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.530+0000 7f799a05a640 1 -- 172.21.15.170:0/814258756 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f3893d0 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.530+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f487650 con 0x56107f3893d0 2024-04-26T12:30:36.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.530+0000 7f799a05a640 1 -- 172.21.15.170:0/814258756 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f3893d0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.530+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f48c8f0 0x56107f48ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.531+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f48f380 con 0x56107f48c8f0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.531+0000 7f7999859640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f48c8f0 0x56107f48ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.531+0000 7f7999859640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f48c8f0 0x56107f48ece0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.531+0000 7f7999859640 1 -- 172.21.15.170:0/814258756 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f798c070020 con 0x56107f48c8f0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.531+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f48b8a0 con 0x56107f3893d0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.532+0000 7f799a05a640 1 -- 172.21.15.170:0/814258756 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f3893d0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.532+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56107f490830 0x56107f492c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.532+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4933e0 con 0x56107f490830 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.532+0000 7f7999058640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56107f490830 0x56107f492c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.532+0000 7f7999058640 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56107f490830 0x56107f492c80 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.532+0000 7f7999058640 1 -- 172.21.15.170:0/814258756 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f799000f670 con 0x56107f490830 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f799db21800 1 Processor -- start 2024-04-26T12:30:36.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f799db21800 1 -- start start 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f799db21800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4a17d0 0x56107f4a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f799db21800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56107f279e60 con 0x56107f4a17d0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4a17d0 0x56107f4a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4a17d0 0x56107f4a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36462/0 (socket says 172.21.15.170:36462) 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f7999859640 1 -- 172.21.15.170:0/833802812 learned_addr learned my addr 172.21.15.170:0/833802812 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f7999859640 1 -- 172.21.15.170:0/833802812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107f4a2130 con 0x56107f4a17d0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.533+0000 7f7999859640 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4a17d0 0x56107f4a1bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f798c08cc30 tx=0x7f798c05c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f787f7fe640 1 -- 172.21.15.170:0/833802812 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c073d50 con 0x56107f4a17d0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f787f7fe640 1 -- 172.21.15.170:0/833802812 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c05c700 con 0x56107f4a17d0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56107f4a2ba0 con 0x56107f4a17d0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f787f7fe640 1 -- 172.21.15.170:0/833802812 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c05c9e0 con 0x56107f4a17d0 2024-04-26T12:30:36.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107f4a2ba0 con 0x56107f4a17d0 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f787f7fe640 1 -- 172.21.15.170:0/833802812 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f798c08e940 con 0x56107f4a17d0 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f787f7fe640 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7874036900 0x7f7874038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.534+0000 7f787f7fe640 1 -- 172.21.15.170:0/833802812 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f798c089030 con 0x56107f4a17d0 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f7999058640 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7874036900 0x7f7874038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f799db21800 1 Processor -- start 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f799db21800 1 -- start start 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f799db21800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f799db21800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56107f47bd60 con 0x56107f4ae830 2024-04-26T12:30:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f7999058640 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7874036900 0x7f7874038dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56107f487590 tx=0x7f7990006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36466/0 (socket says 172.21.15.170:36466) 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f7999859640 1 -- 172.21.15.170:0/304016583 learned_addr learned my addr 172.21.15.170:0/304016583 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f7999859640 1 -- 172.21.15.170:0/304016583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107f4af1e0 con 0x56107f4ae830 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.535+0000 7f7999859640 1 --2- 172.21.15.170:0/304016583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4aec10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f798c05ef50 tx=0x7f798c07ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a00b93962ff5a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f787d7fa640 1 -- 172.21.15.170:0/304016583 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c07ed30 con 0x56107f4ae830 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f787d7fa640 1 -- 172.21.15.170:0/304016583 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c08b260 con 0x56107f4ae830 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f787d7fa640 1 -- 172.21.15.170:0/304016583 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c07c3f0 con 0x56107f4ae830 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 -- 172.21.15.170:0/304016583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 msgr2=0x56107f4aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 --2- 172.21.15.170:0/304016583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4aec10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f798c05ef50 tx=0x7f798c07ca60 comp rx=0 tx=0).stop 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 -- 172.21.15.170:0/304016583 shutdown_connections 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 --2- 172.21.15.170:0/304016583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4aec10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 -- 172.21.15.170:0/304016583 >> 172.21.15.170:0/304016583 conn(0x56107f4aab00 msgr2=0x56107f4a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 -- 172.21.15.170:0/304016583 shutdown_connections 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 -- 172.21.15.170:0/304016583 wait complete. 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 Processor -- start 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.536+0000 7f799db21800 1 -- start start 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f799db21800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f799db21800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56107f4af8f0 con 0x56107f4ae830 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f7999859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36476/0 (socket says 172.21.15.170:36476) 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 learned_addr learned my addr 172.21.15.170:0/1324387810 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107f4b60c0 con 0x56107f4ae830 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f7999859640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4b5b80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f798c07cb60 tx=0x7f798c08cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f786b7fe640 1 -- 172.21.15.170:0/1324387810 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c0b3020 con 0x56107f4ae830 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f786b7fe640 1 -- 172.21.15.170:0/1324387810 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c0a9040 con 0x56107f4ae830 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f786b7fe640 1 -- 172.21.15.170:0/1324387810 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798c0a8070 con 0x56107f4ae830 2024-04-26T12:30:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56107f4b60c0 con 0x56107f4ae830 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.537+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107f4b60c0 con 0x56107f4ae830 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.538+0000 7f786b7fe640 1 -- 172.21.15.170:0/1324387810 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f798c0b6020 con 0x56107f4ae830 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.538+0000 7f786b7fe640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7864036950 0x7f7864038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.538+0000 7f786b7fe640 1 -- 172.21.15.170:0/1324387810 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f798c0b9c60 con 0x56107f4ae830 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.539+0000 7f7999058640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7864036950 0x7f7864038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.539+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.539+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f4c1200 0x56107f4c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.539+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c3e10 con 0x56107f4c1200 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.539+0000 7f7999058640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7864036950 0x7f7864038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f799000ffd0 tx=0x7f7990023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.539+0000 7f799a05a640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f4c1200 0x56107f4c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.539+0000 7f799a05a640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f4c1200 0x56107f4c36c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 realm 2024-04-26T12:30:36.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4220 con 0x56107f4c1200 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4af0 con 0x56107f4c1200 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f4c5bf0 0x56107f4c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c85f0 con 0x56107f4c5bf0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.540+0000 7f7999859640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f4c5bf0 0x56107f4c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f7999859640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f4c5bf0 0x56107f4c7fe0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f799db21800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f799db21800 20 searching for the correct realm 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56107f4ca5a0 0x56107f4cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cd130 con 0x56107f4ca5a0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f7999058640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56107f4ca5a0 0x56107f4cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.541+0000 7f7999058640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56107f4ca5a0 0x56107f4cca60 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.542+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.542+0000 7f7999058640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f799002e910 0x7f799003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.542+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cd130 con 0x7f799002e910 2024-04-26T12:30:36.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.542+0000 7f799a05a640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f799002e910 0x7f799003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.542+0000 7f799a05a640 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f799002e910 0x7f799003a3c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.543+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x7f799002e910 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.544+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x7f799002e910 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.545+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.546+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.547+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x7f799002e910 2024-04-26T12:30:36.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.548+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.548+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.548+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.548+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.548+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x7f799002e910 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4ca5a0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.549+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c5bf0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x56107f4c1200 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c4e90 con 0x7f799002e910 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c8eb0 con 0x56107f4c1200 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.550+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c8eb0 con 0x56107f4c1200 2024-04-26T12:30:36.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c8eb0 con 0x7f799002e910 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 zone default found 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 4 Realm: () 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 zonegroup default 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4c9750 con 0x56107f4c5bf0 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.551+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cef90 con 0x56107f4ca5a0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f799db21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cf330 con 0x56107f4ca5a0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f799db21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f799db21800 20 started sync module instance, tier type = 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f799db21800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.552+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4ce430 con 0x7f799002e910 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.553+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.553+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94628855212112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4ce430 con 0x7f799002e910 2024-04-26T12:30:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.553+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cfcf0 con 0x56107f4c1200 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.554+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94628855212112] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.554+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.554+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94628855210336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cfcf0 con 0x56107f4c1200 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.554+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d06b0 con 0x56107f4ca5a0 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.555+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94628855210336] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.555+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.555+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94628855216192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cfc60 con 0x56107f4ca5a0 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.556+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d1470 con 0x7f799002e910 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.556+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94628855216192] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.557+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.557+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94628855220896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d1860 con 0x7f799002e910 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.557+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d2220 con 0x56107f4c1200 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.558+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.558+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94628855225712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d2190 con 0x56107f4c1200 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.558+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94628855220896] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.558+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d0ef0 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.559+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.559+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94628855229584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d3560 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.559+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d3f20 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.559+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94628855225712] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.560+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.560+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94628855227968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d4770 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.560+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d5130 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.560+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94628855229584] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94628855227968] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94628855230640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d5130 con 0x56107f4c5bf0 2024-04-26T12:30:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=0 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=1 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=2 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=3 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=4 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=5 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=6 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94628855230640] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 20 add_watcher() i=7 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.561+0000 7f799db21800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.562+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d82a0 con 0x56107f4c1200 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.562+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.562+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94628855237760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d5550 con 0x56107f4c1200 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94628855237760] v30'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f784b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f799db21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f799db21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f799db21800 5 note: GC not initialized 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f784a7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f799db21800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.563+0000 7f799db21800 20 Filter name: none 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f77bbfff640 20 reqs_thread_entry: start 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f50bb90 con 0x56107f4c5bf0 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 20 rados_obj.operate() r=0 bl.length=419 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:36.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.564+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f50b5e0 con 0x7f799002e910 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f50f360 con 0x56107f4c1200 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(64 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.565+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f513a60 con 0x7f799002e910 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.566+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.566+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.5 8:a6c3d596:root::.bucket.meta.testx%3amyfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f517370 con 0x56107f4c1200 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.567+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [create,call,writefull 0~412,setxattr (203)] v30'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.567+0000 7f799db21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x7 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.567+0000 7f799db21800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.567+0000 7f799db21800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799db21800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94628855501216 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f516e20 con 0x7f799002e910 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== watch-notify(notify (1) cookie 94628855220896 notify 128849018893 ret 0) ==== 889+0+0 (crc 0 0 0) 0x56107f517710 con 0x7f799002e910 2024-04-26T12:30:36.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f787d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94628855220896 notifier 4551 bl.length()=847 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f787d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x7 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f787d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f787d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f787d7fa640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f785c003ea0 con 0x7f799002e910 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(67 notify.3 [notify cookie 94628855501216 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== watch-notify(notify_complete (2) cookie 94628855501216 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56107f513560 con 0x7f799002e910 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799db21800 20 handle_bi_update(): bucket=testx:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_sources= new_sources= 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799db21800 20 handle_bi_update(): bucket=testx:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential sources added=[] removed=[] 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799db21800 20 handle_bi_update(): bucket=testx:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_dests= new_dests= 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799db21800 20 handle_bi_update(): bucket=testx:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential dests added=[] removed=[] 2024-04-26T12:30:36.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.568+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f517250 con 0x56107f4c1200 2024-04-26T12:30:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.569+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.569+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f516da0 con 0x56107f4c1200 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.570+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'2 uv2 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.570+0000 7f799db21800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.570+0000 7f799db21800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.570+0000 7f799db21800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.570+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94628855501216 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f516da0 con 0x56107f4c1200 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.570+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== watch-notify(notify (1) cookie 94628855225712 notify 128849018894 ret 0) ==== 390+0+0 (crc 0 0 0) 0x56107f517140 con 0x56107f4c1200 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f787cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94628855225712 notifier 4551 bl.length()=348 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f787cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f787cff9640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f787cff9640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f77c4003400 con 0x56107f4c1200 2024-04-26T12:30:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(71 notify.4 [notify cookie 94628855501216 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== watch-notify(notify_complete (2) cookie 94628855501216 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7994050040 con 0x56107f4c1200 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.571+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f516da0 con 0x7f799002e910 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f799db21800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f799db21800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94628855508048 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f514640 con 0x56107f4c5bf0 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== watch-notify(notify (1) cookie 94628855227968 notify 128849018894 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56107f4a2130 con 0x56107f4c5bf0 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f787d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94628855227968 notifier 4551 bl.length()=149 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f787d7fa640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f785c003ea0 con 0x56107f4c5bf0 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.572+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(74 notify.6 [notify cookie 94628855508048 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.573+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.573+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== watch-notify(notify_complete (2) cookie 94628855508048 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56107f483a20 con 0x56107f4c5bf0 2024-04-26T12:30:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.573+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f514190 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(76 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call,delete] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799db21800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 from cache 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799db21800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94628855508048 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56107f50d7c0 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== watch-notify(notify (1) cookie 94628855225712 notify 128849018895 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f7994050040 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f787cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94628855225712 notifier 4551 bl.length()=206 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f787cff9640 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f77c40033c0 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(77 notify.4 [notify cookie 94628855508048 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.574+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== watch-notify(notify_complete (2) cookie 94628855508048 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56107f516a50 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.575+0000 7f784b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.575+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94628855237760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f50f9e0 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.576+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94628855237760] v30'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.576+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94628855212112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d4c80 con 0x7f799002e910 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.577+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94628855212112] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.577+0000 7f799db21800 20 remove_watcher() i=0 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.577+0000 7f799db21800 2 removed watcher, disabling cache 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.577+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94628855210336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f517330 con 0x56107f4c1200 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.578+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94628855210336] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.578+0000 7f799db21800 20 remove_watcher() i=1 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.578+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94628855216192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f517330 con 0x56107f4ca5a0 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.579+0000 7f7999058640 1 -- 172.21.15.170:0/1324387810 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94628855216192] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7990037040 con 0x56107f4ca5a0 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.579+0000 7f799db21800 20 remove_watcher() i=2 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.579+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94628855220896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d4c80 con 0x7f799002e910 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.580+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94628855220896] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x7f799002e910 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.580+0000 7f799db21800 20 remove_watcher() i=3 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.580+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94628855225712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cf840 con 0x56107f4c1200 2024-04-26T12:30:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.581+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94628855225712] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f799400a4a0 con 0x56107f4c1200 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.581+0000 7f799db21800 20 remove_watcher() i=4 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.581+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94628855229584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d4c80 con 0x56107f4c5bf0 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.582+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94628855229584] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.583+0000 7f799db21800 20 remove_watcher() i=5 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.583+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94628855227968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4d1d70 con 0x56107f4c5bf0 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.583+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94628855227968] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.583+0000 7f799db21800 20 remove_watcher() i=6 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.583+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94628855230640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56107f4cf840 con 0x56107f4c5bf0 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f7999859640 1 -- 172.21.15.170:0/1324387810 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94628855230640] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f798c0a2030 con 0x56107f4c5bf0 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f799db21800 20 remove_watcher() i=7 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f4c5bf0 msgr2=0x56107f4c7fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f4c5bf0 0x56107f4c7fe0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f4c1200 msgr2=0x56107f4c36c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f4c1200 0x56107f4c36c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f799002e910 msgr2=0x7f799003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.584+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f799002e910 0x7f799003a3c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56107f4ca5a0 msgr2=0x56107f4cca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56107f4ca5a0 0x56107f4cca60 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7864036950 msgr2=0x7f7864038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7864036950 0x7f7864038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f799000ffd0 tx=0x7f7990023040 comp rx=0 tx=0).stop 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 msgr2=0x56107f4b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799a05a640 1 -- 172.21.15.170:0/1324387810 reap_dead start 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4b5b80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f798c07cb60 tx=0x7f798c08cfa0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 shutdown_connections 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/1324387810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4ae830 0x56107f4b5b80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 >> 172.21.15.170:0/1324387810 conn(0x56107f4aab00 msgr2=0x56107f4a8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 shutdown_connections 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/1324387810 wait complete. 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7874036900 msgr2=0x7f7874038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7874036900 0x7f7874038dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56107f487590 tx=0x7f7990006000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4a17d0 msgr2=0x56107f4a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4a17d0 0x56107f4a1bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f798c08cc30 tx=0x7f798c05c650 comp rx=0 tx=0).stop 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 shutdown_connections 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7874036900 0x7f7874038dc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/833802812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f4a17d0 0x56107f4a1bf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 >> 172.21.15.170:0/833802812 conn(0x56107f495870 msgr2=0x56107f495c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 shutdown_connections 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/833802812 wait complete. 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f48c8f0 msgr2=0x56107f48ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56107f48c8f0 0x56107f48ece0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f3893d0 msgr2=0x56107f48a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56107f3893d0 0x56107f48a0a0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56107f490830 msgr2=0x56107f492c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56107f490830 0x56107f492c80 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.585+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7880036950 msgr2=0x7f7880038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7880036950 0x7f7880038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7990000c00 tx=0x7f79900013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 msgr2=0x56107f483080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799db21800 1 --2- 172.21.15.170:0/814258756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56107f388a70 0x56107f483080 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f798c061040 tx=0x7f798c002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799a05a640 1 -- 172.21.15.170:0/814258756 reap_dead start 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 shutdown_connections 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 >> 172.21.15.170:0/814258756 conn(0x56107f382180 msgr2=0x56107f47a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 shutdown_connections 2024-04-26T12:30:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.586+0000 7f799db21800 1 -- 172.21.15.170:0/814258756 wait complete. 2024-04-26T12:30:36.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-26T12:30:36.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-26T12:30:36.597 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-26T12:30:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.639+0000 7fd2a290c800 1 Processor -- start 2024-04-26T12:30:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.639+0000 7fd2a290c800 1 -- start start 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.639+0000 7fd2a290c800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5618fbfdd3e0 0x5618fbfdd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.639+0000 7fd2a290c800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618fbe8b0c0 con 0x5618fbfde640 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.639+0000 7fd2a290c800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5618fbe6f4d0 con 0x5618fbfdd3e0 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.640+0000 7fd2a040b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5618fbfdd3e0 0x5618fbfdd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.640+0000 7fd29fc0a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5618fbfde640 0x5618fbfdeac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:56644/0 (socket says 172.21.15.170:56644) 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.640+0000 7fd29fc0a640 1 -- 172.21.15.170:0/595796116 learned_addr learned my addr 172.21.15.170:0/595796116 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.640+0000 7fd2a040b640 1 -- 172.21.15.170:0/595796116 >> v1:172.21.15.132:6789/0 conn(0x5618fbfde640 legacy=0x5618fbfdeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.640+0000 7fd29f409640 1 -- 172.21.15.170:0/595796116 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928392236 0 0) 0x5618fbe8b0c0 con 0x5618fbfde640 2024-04-26T12:30:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.640+0000 7fd2a040b640 1 -- 172.21.15.170:0/595796116 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fbe9cd40 con 0x5618fbfdd3e0 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a040b640 1 --2- 172.21.15.170:0/595796116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbfdd800 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd29000a470 tx=0x7fd29001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6650a4b3d7992794 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd29f409640 1 -- 172.21.15.170:0/595796116 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290057070 con 0x5618fbfdd3e0 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd29f409640 1 -- 172.21.15.170:0/595796116 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd290052570 con 0x5618fbfdd3e0 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd29f409640 1 -- 172.21.15.170:0/595796116 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290052870 con 0x5618fbfdd3e0 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a290c800 1 -- 172.21.15.170:0/595796116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 msgr2=0x5618fbfdd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a290c800 1 --2- 172.21.15.170:0/595796116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbfdd800 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd29000a470 tx=0x7fd29001ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a290c800 1 -- 172.21.15.170:0/595796116 shutdown_connections 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a290c800 1 --2- 172.21.15.170:0/595796116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbfdd800 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a290c800 1 -- 172.21.15.170:0/595796116 >> 172.21.15.170:0/595796116 conn(0x5618fbfd89e0 msgr2=0x5618fbfdae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a290c800 1 -- 172.21.15.170:0/595796116 shutdown_connections 2024-04-26T12:30:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.642+0000 7fd2a290c800 1 -- 172.21.15.170:0/595796116 wait complete. 2024-04-26T12:30:36.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.654+0000 7fd2a290c800 1 Processor -- start 2024-04-26T12:30:36.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.654+0000 7fd2a290c800 1 -- start start 2024-04-26T12:30:36.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.654+0000 7fd2a290c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbf51650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.654+0000 7fd2a290c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5618fbf29b40 con 0x5618fbfdd3e0 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.654+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbf51650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.655+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbf51650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36488/0 (socket says 172.21.15.170:36488) 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.655+0000 7fd2a040b640 1 -- 172.21.15.170:0/3275368318 learned_addr learned my addr 172.21.15.170:0/3275368318 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.655+0000 7fd2a040b640 1 -- 172.21.15.170:0/3275368318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fbe9b590 con 0x5618fbfdd3e0 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.655+0000 7fd2a040b640 1 --2- 172.21.15.170:0/3275368318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbf51650 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd290055040 tx=0x7fd29004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a11157f46f1d857 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.655+0000 7fd18e60c640 1 -- 172.21.15.170:0/3275368318 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290063070 con 0x5618fbfdd3e0 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.655+0000 7fd18e60c640 1 -- 172.21.15.170:0/3275368318 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd290058040 con 0x5618fbfdd3e0 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.655+0000 7fd18e60c640 1 -- 172.21.15.170:0/3275368318 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290057070 con 0x5618fbfdd3e0 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 -- 172.21.15.170:0/3275368318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 msgr2=0x5618fbf51650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 --2- 172.21.15.170:0/3275368318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbf51650 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd290055040 tx=0x7fd29004c000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 -- 172.21.15.170:0/3275368318 shutdown_connections 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 --2- 172.21.15.170:0/3275368318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fbf51650 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 -- 172.21.15.170:0/3275368318 >> 172.21.15.170:0/3275368318 conn(0x5618fbfd89e0 msgr2=0x5618fc0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 -- 172.21.15.170:0/3275368318 shutdown_connections 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 -- 172.21.15.170:0/3275368318 wait complete. 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 Processor -- start 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 -- start start 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fc0d72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.656+0000 7fd2a290c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5618fbfe6ae0 con 0x5618fbfdd3e0 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fc0d72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fc0d72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36500/0 (socket says 172.21.15.170:36500) 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd2a040b640 1 -- 172.21.15.170:0/2544663915 learned_addr learned my addr 172.21.15.170:0/2544663915 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd2a040b640 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fbe928f0 con 0x5618fbfdd3e0 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd2a040b640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fc0d72d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd290061040 tx=0x7fd290002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd18ce09640 1 -- 172.21.15.170:0/2544663915 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290063030 con 0x5618fbfdd3e0 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd18ce09640 1 -- 172.21.15.170:0/2544663915 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd290052a60 con 0x5618fbfdd3e0 2024-04-26T12:30:36.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618fc0d7810 con 0x5618fbfdd3e0 2024-04-26T12:30:36.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd18ce09640 1 -- 172.21.15.170:0/2544663915 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290052d40 con 0x5618fbfdd3e0 2024-04-26T12:30:36.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.657+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fc0d7d30 con 0x5618fbfdd3e0 2024-04-26T12:30:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.658+0000 7fd18ce09640 1 -- 172.21.15.170:0/2544663915 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd29005e480 con 0x5618fbfdd3e0 2024-04-26T12:30:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.658+0000 7fd18ce09640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd188036950 0x7fd188038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.658+0000 7fd18ce09640 1 -- 172.21.15.170:0/2544663915 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd290064070 con 0x5618fbfdd3e0 2024-04-26T12:30:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.658+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd188036950 0x7fd188038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.658+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fbfde640 0x5618fc0de340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.658+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc0de880 con 0x5618fbfde640 2024-04-26T12:30:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.658+0000 7fd2a0c0c640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fbfde640 0x5618fc0de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd188036950 0x7fd188038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd294000c00 tx=0x7fd2940013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd2a0c0c640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fbfde640 0x5618fc0de340 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2544663915 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fbfde640 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc0db8f0 con 0x5618fbfde640 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2544663915 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fbfde640 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc0e0b90 0x5618fc0e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc0e3620 con 0x5618fc0e0b90 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.659+0000 7fd2a040b640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc0e0b90 0x5618fc0e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.660+0000 7fd2a040b640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc0e0b90 0x5618fc0e2f80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.660+0000 7fd2a040b640 1 -- 172.21.15.170:0/2544663915 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd290070020 con 0x5618fc0e0b90 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.660+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc0dfb40 con 0x5618fbfde640 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.660+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2544663915 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fbfde640 2024-04-26T12:30:36.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.660+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5618fc0e4ad0 0x5618fc0e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.660+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc0e7680 con 0x5618fc0e4ad0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.661+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5618fc0e4ad0 0x5618fc0e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.661+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5618fc0e4ad0 0x5618fc0e6f20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.661+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2544663915 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd29400f670 con 0x5618fc0e4ad0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.661+0000 7fd2a290c800 1 Processor -- start 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.661+0000 7fd2a290c800 1 -- start start 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a290c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc0f5ae0 0x5618fc0f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a290c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5618fbecfe60 con 0x5618fc0f5ae0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc0f5ae0 0x5618fc0f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc0f5ae0 0x5618fc0f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36514/0 (socket says 172.21.15.170:36514) 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a040b640 1 -- 172.21.15.170:0/176979273 learned_addr learned my addr 172.21.15.170:0/176979273 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a040b640 1 -- 172.21.15.170:0/176979273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fc0f6440 con 0x5618fc0f5ae0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a040b640 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc0f5ae0 0x5618fc0f5f00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd29008c8b0 tx=0x7fd290069f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd185ffb640 1 -- 172.21.15.170:0/176979273 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd290073c90 con 0x5618fc0f5ae0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd185ffb640 1 -- 172.21.15.170:0/176979273 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29008b120 con 0x5618fc0f5ae0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618fc0f6eb0 con 0x5618fc0f5ae0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd185ffb640 1 -- 172.21.15.170:0/176979273 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd29008b400 con 0x5618fc0f5ae0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.662+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fc0f6eb0 con 0x5618fc0f5ae0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.663+0000 7fd185ffb640 1 -- 172.21.15.170:0/176979273 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd290087070 con 0x5618fc0f5ae0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.663+0000 7fd185ffb640 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd178036900 0x7fd178038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.663+0000 7fd185ffb640 1 -- 172.21.15.170:0/176979273 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd2900073e0 con 0x5618fc0f5ae0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.663+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd178036900 0x7fd178038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.663+0000 7fd2a290c800 1 Processor -- start 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a290c800 1 -- start start 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd178036900 0x7fd178038dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5618fc0db830 tx=0x7fd294006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a290c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc102f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a290c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5618fc0d2770 con 0x5618fc102b40 2024-04-26T12:30:36.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc102f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36520/0 (socket says 172.21.15.170:36520) 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a040b640 1 -- 172.21.15.170:0/3069720554 learned_addr learned my addr 172.21.15.170:0/3069720554 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a040b640 1 -- 172.21.15.170:0/3069720554 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fc103530 con 0x5618fc102b40 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd2a040b640 1 --2- 172.21.15.170:0/3069720554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc102f60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd290097fd0 tx=0x7fd29007e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a538b812489921de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd17f7fe640 1 -- 172.21.15.170:0/3069720554 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2900a8070 con 0x5618fc102b40 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd17f7fe640 1 -- 172.21.15.170:0/3069720554 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd290069a70 con 0x5618fc102b40 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.664+0000 7fd17f7fe640 1 -- 172.21.15.170:0/3069720554 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2900697b0 con 0x5618fc102b40 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 -- 172.21.15.170:0/3069720554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 msgr2=0x5618fc102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 --2- 172.21.15.170:0/3069720554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc102f60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd290097fd0 tx=0x7fd29007e4d0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 -- 172.21.15.170:0/3069720554 shutdown_connections 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 --2- 172.21.15.170:0/3069720554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc102f60 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 -- 172.21.15.170:0/3069720554 >> 172.21.15.170:0/3069720554 conn(0x5618fc0fee50 msgr2=0x5618fc0fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 -- 172.21.15.170:0/3069720554 shutdown_connections 2024-04-26T12:30:36.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 -- 172.21.15.170:0/3069720554 wait complete. 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 Processor -- start 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 -- start start 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a290c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5618fc103bc0 con 0x5618fc102b40 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a040b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc109f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36530/0 (socket says 172.21.15.170:36530) 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.665+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 learned_addr learned my addr 172.21.15.170:0/2644550112 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.666+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fc10a480 con 0x5618fc102b40 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.666+0000 7fd2a040b640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc109f40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd29008b6b0 tx=0x7fd290061f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.666+0000 7fd17dffb640 1 -- 172.21.15.170:0/2644550112 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2900b3020 con 0x5618fc102b40 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.666+0000 7fd17dffb640 1 -- 172.21.15.170:0/2644550112 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd290076a40 con 0x5618fc102b40 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.666+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5618fc10a480 con 0x5618fc102b40 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.666+0000 7fd17dffb640 1 -- 172.21.15.170:0/2644550112 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2900a8030 con 0x5618fc102b40 2024-04-26T12:30:36.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.666+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fc10a480 con 0x5618fc102b40 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd17dffb640 1 -- 172.21.15.170:0/2644550112 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd2900b6020 con 0x5618fc102b40 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd17dffb640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd170036950 0x7fd170038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd17dffb640 1 -- 172.21.15.170:0/2644550112 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fd2900a9070 con 0x5618fc102b40 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd170036950 0x7fd170038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fc115510 0x5618fc1179d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc118120 con 0x5618fc115510 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.667+0000 7fd2a0c0c640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fc115510 0x5618fc1179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd170036950 0x7fd170038e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd29400ffd0 tx=0x7fd294023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a0c0c640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fc115510 0x5618fc1179d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 20 realm 2024-04-26T12:30:36.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc118530 con 0x5618fc115510 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc118dd0 con 0x5618fc115510 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.668+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc119ed0 0x5618fc11c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc11c800 con 0x5618fc119ed0 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a040b640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc119ed0 0x5618fc11c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a040b640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc119ed0 0x5618fc11c2c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 20 searching for the correct realm 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5618fc11e880 0x5618fc120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.669+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc121410 con 0x5618fc11e880 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.670+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5618fc11e880 0x5618fc120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.670+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5618fc11e880 0x5618fc120d40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.670+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.670+0000 7fd29fc0a640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd29402e910 0x7fd29403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.670+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc121410 con 0x7fd29402e910 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.670+0000 7fd2a0c0c640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd29402e910 0x7fd29403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.671+0000 7fd2a0c0c640 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd29402e910 0x7fd29403a3c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.671+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.671+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.671+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.671+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.672+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x7fd29402e910 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.673+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.673+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.673+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.673+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.673+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.673+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x7fd29402e910 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.674+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.675+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.676+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x7fd29402e910 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.677+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.678+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.678+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x7fd29402e910 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.678+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.678+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc11e880 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.678+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.678+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc119ed0 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x5618fc115510 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5618fc119170 con 0x7fd29402e910 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc11d180 con 0x5618fc115510 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.679+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc11d180 con 0x5618fc115510 2024-04-26T12:30:36.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc11d150 con 0x7fd29402e910 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 zone default found 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 4 Realm: () 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 zonegroup default 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc11d570 con 0x5618fc119ed0 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.680+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc123270 con 0x5618fc11e880 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd2a290c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc123610 con 0x5618fc11e880 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd2a290c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd2a290c800 20 started sync module instance, tier type = 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd2a290c800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.681+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc11d180 con 0x7fd29402e910 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.682+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.682+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94665308250720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc122b30 con 0x7fd29402e910 2024-04-26T12:30:36.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.682+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc123e60 con 0x5618fc115510 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.683+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94665308250720] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.683+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.683+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94665308252256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc123e60 con 0x5618fc115510 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.683+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc124820 con 0x5618fc11e880 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.684+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94665308252256] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.685+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.685+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94665308256688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc123dd0 con 0x5618fc11e880 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.685+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc125690 con 0x7fd29402e910 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.685+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94665308256688] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.686+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.686+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94665308262880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc125ab0 con 0x7fd29402e910 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.686+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc126470 con 0x5618fc115510 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.687+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94665308262880] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.687+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.687+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94665308266912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc125ab0 con 0x5618fc115510 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.687+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc126e80 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.688+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94665308266912] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.688+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.688+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94665308263936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc125a20 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.688+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc127d40 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.689+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.689+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94665308274912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc1289b0 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.689+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc129370 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.689+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94665308263936] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94665308274912] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94665308275968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc128920 con 0x5618fc119ed0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 20 add_watcher() i=0 2024-04-26T12:30:36.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 20 add_watcher() i=1 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 20 add_watcher() i=2 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 20 add_watcher() i=3 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 20 add_watcher() i=4 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 20 add_watcher() i=5 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.690+0000 7fd2a290c800 20 add_watcher() i=6 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.691+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94665308275968] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.691+0000 7fd2a290c800 20 add_watcher() i=7 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.691+0000 7fd2a290c800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.691+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc12c3a0 con 0x5618fc115510 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.691+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.691+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94665308278464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc129790 con 0x5618fc115510 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.692+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94665308278464] v30'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd1567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd2a290c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd2a290c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd2a290c800 5 note: GC not initialized 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd1557e2640 20 reqs_thread_entry: start 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd2a290c800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd2a290c800 20 Filter name: none 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd0c6ffd640 20 reqs_thread_entry: start 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd2a290c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.693+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5618fc15f340 con 0x5618fc115510 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.694+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.694+0000 7fd2a290c800 20 rados_obj.operate() r=0 bl.length=193 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.694+0000 7fd1567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.694+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94665308278464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc129790 con 0x5618fc115510 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.695+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94665308278464] v30'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.695+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94665308250720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc129370 con 0x7fd29402e910 2024-04-26T12:30:36.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.696+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94665308250720] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.696+0000 7fd2a290c800 20 remove_watcher() i=0 2024-04-26T12:30:36.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.696+0000 7fd2a290c800 2 removed watcher, disabling cache 2024-04-26T12:30:36.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.696+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94665308252256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc122260 con 0x5618fc115510 2024-04-26T12:30:36.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.697+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94665308252256] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.697+0000 7fd2a290c800 20 remove_watcher() i=1 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.697+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94665308256688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc122260 con 0x5618fc11e880 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.698+0000 7fd29fc0a640 1 -- 172.21.15.170:0/2644550112 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94665308256688] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd294037040 con 0x5618fc11e880 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.698+0000 7fd2a290c800 20 remove_watcher() i=2 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.698+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94665308262880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc1239b0 con 0x7fd29402e910 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.699+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94665308262880] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x7fd29402e910 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.700+0000 7fd2a290c800 20 remove_watcher() i=3 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.700+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94665308266912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc1251e0 con 0x5618fc115510 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.701+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94665308266912] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd29800a4a0 con 0x5618fc115510 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.701+0000 7fd2a290c800 20 remove_watcher() i=4 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.701+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94665308263936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc1239b0 con 0x5618fc119ed0 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.702+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94665308263936] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.702+0000 7fd2a290c800 20 remove_watcher() i=5 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.702+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94665308274912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc1239b0 con 0x5618fc119ed0 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.703+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94665308274912] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.703+0000 7fd2a290c800 20 remove_watcher() i=6 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.703+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94665308275968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5618fc1280e0 con 0x5618fc119ed0 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a040b640 1 -- 172.21.15.170:0/2644550112 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94665308275968] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd290094020 con 0x5618fc119ed0 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 20 remove_watcher() i=7 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc119ed0 msgr2=0x5618fc11c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc119ed0 0x5618fc11c2c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fc115510 msgr2=0x5618fc1179d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fc115510 0x5618fc1179d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd29402e910 msgr2=0x7fd29403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd29402e910 0x7fd29403a3c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5618fc11e880 msgr2=0x5618fc120d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5618fc11e880 0x5618fc120d40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd170036950 msgr2=0x7fd170038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd170036950 0x7fd170038e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd29400ffd0 tx=0x7fd294023040 comp rx=0 tx=0).stop 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2644550112 reap_dead start 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 msgr2=0x5618fc109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc109f40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd29008b6b0 tx=0x7fd290061f50 comp rx=0 tx=0).stop 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 shutdown_connections 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2644550112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc102b40 0x5618fc109f40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 >> 172.21.15.170:0/2644550112 conn(0x5618fc0fee50 msgr2=0x5618fc0fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 shutdown_connections 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/2644550112 wait complete. 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd178036900 msgr2=0x7fd178038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd178036900 0x7fd178038dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5618fc0db830 tx=0x7fd294006000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc0f5ae0 msgr2=0x5618fc0f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.704+0000 7fd2a290c800 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc0f5ae0 0x5618fc0f5f00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd29008c8b0 tx=0x7fd290069f80 comp rx=0 tx=0).stop 2024-04-26T12:30:36.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 shutdown_connections 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd178036900 0x7fd178038dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 --2- 172.21.15.170:0/176979273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fc0f5ae0 0x5618fc0f5f00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 >> 172.21.15.170:0/176979273 conn(0x5618fc0e9b80 msgr2=0x5618fc0e9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 shutdown_connections 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/176979273 wait complete. 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc0e0b90 msgr2=0x5618fc0e2f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5618fc0e0b90 0x5618fc0e2f80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fbfde640 msgr2=0x5618fc0de340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5618fbfde640 0x5618fc0de340 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5618fc0e4ad0 msgr2=0x5618fc0e6f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5618fc0e4ad0 0x5618fc0e6f20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd188036950 msgr2=0x7fd188038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd188036950 0x7fd188038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd294000c00 tx=0x7fd2940013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 msgr2=0x5618fc0d72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 --2- 172.21.15.170:0/2544663915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5618fbfdd3e0 0x5618fc0d72d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd290061040 tx=0x7fd290002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a0c0c640 1 -- 172.21.15.170:0/2544663915 reap_dead start 2024-04-26T12:30:36.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 shutdown_connections 2024-04-26T12:30:36.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 >> 172.21.15.170:0/2544663915 conn(0x5618fbfd89e0 msgr2=0x5618fc0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 shutdown_connections 2024-04-26T12:30:36.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.705+0000 7fd2a290c800 1 -- 172.21.15.170:0/2544663915 wait complete. 2024-04-26T12:30:36.717 INFO:teuthology.orchestra.run.smithi170.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"L+hifQF0hX1luAC7A+YeqeCc","ver":2},"mtime":"2024-04-26T12:30:36.570552Z","data":{"bucket":{"name":"myfoo","marker":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","bucket_id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-04-26T12:30:34.022086Z","linked":true,"has_bucket_info":false}} 2024-04-26T12:30:36.717 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'L+hifQF0hX1luAC7A+YeqeCc', 'ver': 2}, 'mtime': '2024-04-26T12:30:36.570552Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'bucket_id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-26T12:30:34.022086Z', 'linked': True, 'has_bucket_info': False}} 2024-04-26T12:30:36.717 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-26T12:30:36.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-26T12:30:36.717 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-26T12:30:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.801+0000 7f330843c800 1 Processor -- start 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.801+0000 7f330843c800 1 -- start start 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.801+0000 7f330843c800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5650741045e0 0x565074104a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.801+0000 7f330843c800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565073fb10c0 con 0x565074105750 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.801+0000 7f330843c800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x565073f954d0 con 0x5650741045e0 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.801+0000 7f33030d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5650741045e0 0x565074104a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.801+0000 7f33028d4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x565074105750 0x565074105bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:56648/0 (socket says 172.21.15.170:56648) 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.802+0000 7f33028d4640 1 -- 172.21.15.170:0/4030432380 learned_addr learned my addr 172.21.15.170:0/4030432380 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.802+0000 7f33030d5640 1 -- 172.21.15.170:0/4030432380 >> v1:172.21.15.132:6789/0 conn(0x565074105750 legacy=0x565074105bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.802+0000 7f33020d3640 1 -- 172.21.15.170:0/4030432380 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551937429 0 0) 0x565073fb10c0 con 0x565074105750 2024-04-26T12:30:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.802+0000 7f33030d5640 1 -- 172.21.15.170:0/4030432380 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565073fc2d40 con 0x5650741045e0 2024-04-26T12:30:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f33030d5640 1 --2- 172.21.15.170:0/4030432380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x565074104a00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f32f400a470 tx=0x7f32f401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b176dc2d1f096f3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f33020d3640 1 -- 172.21.15.170:0/4030432380 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4057070 con 0x5650741045e0 2024-04-26T12:30:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f33020d3640 1 -- 172.21.15.170:0/4030432380 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4052570 con 0x5650741045e0 2024-04-26T12:30:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f33020d3640 1 -- 172.21.15.170:0/4030432380 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4052870 con 0x5650741045e0 2024-04-26T12:30:36.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f330843c800 1 -- 172.21.15.170:0/4030432380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 msgr2=0x565074104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f330843c800 1 --2- 172.21.15.170:0/4030432380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x565074104a00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f32f400a470 tx=0x7f32f401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:36.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f330843c800 1 -- 172.21.15.170:0/4030432380 shutdown_connections 2024-04-26T12:30:36.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f330843c800 1 --2- 172.21.15.170:0/4030432380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x565074104a00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f330843c800 1 -- 172.21.15.170:0/4030432380 >> 172.21.15.170:0/4030432380 conn(0x5650740ffba0 msgr2=0x565074101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f330843c800 1 -- 172.21.15.170:0/4030432380 shutdown_connections 2024-04-26T12:30:36.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.804+0000 7f330843c800 1 -- 172.21.15.170:0/4030432380 wait complete. 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.816+0000 7f330843c800 1 Processor -- start 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.816+0000 7f330843c800 1 -- start start 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.816+0000 7f330843c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x5650741f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.816+0000 7f330843c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56507404fb70 con 0x5650741045e0 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.816+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x5650741f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.817+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x5650741f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36538/0 (socket says 172.21.15.170:36538) 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.817+0000 7f33030d5640 1 -- 172.21.15.170:0/113329823 learned_addr learned my addr 172.21.15.170:0/113329823 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.817+0000 7f33030d5640 1 -- 172.21.15.170:0/113329823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565073fc1590 con 0x5650741045e0 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.817+0000 7f33030d5640 1 --2- 172.21.15.170:0/113329823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x5650741f5a30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f32f4055040 tx=0x7f32f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fa9a0b4b46e1ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.817+0000 7f31f160a640 1 -- 172.21.15.170:0/113329823 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4057070 con 0x5650741045e0 2024-04-26T12:30:36.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.817+0000 7f31f160a640 1 -- 172.21.15.170:0/113329823 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4063070 con 0x5650741045e0 2024-04-26T12:30:36.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.817+0000 7f31f160a640 1 -- 172.21.15.170:0/113329823 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4052720 con 0x5650741045e0 2024-04-26T12:30:36.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 -- 172.21.15.170:0/113329823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 msgr2=0x5650741f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 --2- 172.21.15.170:0/113329823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x5650741f5a30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f32f4055040 tx=0x7f32f404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 -- 172.21.15.170:0/113329823 shutdown_connections 2024-04-26T12:30:36.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 --2- 172.21.15.170:0/113329823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x5650741f5a30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 -- 172.21.15.170:0/113329823 >> 172.21.15.170:0/113329823 conn(0x5650740ffba0 msgr2=0x5650741f1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 -- 172.21.15.170:0/113329823 shutdown_connections 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 -- 172.21.15.170:0/113329823 wait complete. 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 Processor -- start 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 -- start start 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x56507407a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.818+0000 7f330843c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56507410dbf0 con 0x5650741045e0 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x56507407a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x56507407a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36544/0 (socket says 172.21.15.170:36544) 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f33030d5640 1 -- 172.21.15.170:0/1287098416 learned_addr learned my addr 172.21.15.170:0/1287098416 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f33030d5640 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565073fb88f0 con 0x5650741045e0 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f33030d5640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x56507407a020 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f32f4060040 tx=0x7f32f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f31efe07640 1 -- 172.21.15.170:0/1287098416 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4052c70 con 0x5650741045e0 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f31efe07640 1 -- 172.21.15.170:0/1287098416 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f406c070 con 0x5650741045e0 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f31efe07640 1 -- 172.21.15.170:0/1287098416 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f405e480 con 0x5650741045e0 2024-04-26T12:30:36.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565074078710 con 0x5650741045e0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.819+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565074078c90 con 0x5650741045e0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.820+0000 7f31efe07640 1 -- 172.21.15.170:0/1287098416 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f32f405e620 con 0x5650741045e0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.820+0000 7f31efe07640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31e8036950 0x7f31e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.820+0000 7f31efe07640 1 -- 172.21.15.170:0/1287098416 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f32f408e720 con 0x5650741045e0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.820+0000 7f33028d4640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31e8036950 0x7f31e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.820+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x565074105750 0x565074206670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.820+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074206bb0 con 0x565074105750 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.820+0000 7f33038d6640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x565074105750 0x565074206670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f33028d4640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31e8036950 0x7f31e8038e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f33038d6640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x565074105750 0x565074206670 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f33038d6640 1 -- 172.21.15.170:0/1287098416 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x565074105750 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074207400 con 0x565074105750 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f33038d6640 1 -- 172.21.15.170:0/1287098416 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32fc00a4a0 con 0x565074105750 2024-04-26T12:30:36.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x565074208e30 0x56507420b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56507420b9d0 con 0x565074208e30 2024-04-26T12:30:36.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.821+0000 7f33030d5640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x565074208e30 0x56507420b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.822+0000 7f33030d5640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x565074208e30 0x56507420b240 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.822+0000 7f33030d5640 1 -- 172.21.15.170:0/1287098416 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32f4009d10 con 0x565074208e30 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.822+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074207c80 con 0x565074105750 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.822+0000 7f33038d6640 1 -- 172.21.15.170:0/1287098416 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32fc00a4a0 con 0x565074105750 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.822+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56507420ce80 0x56507420f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.822+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56507420fa50 con 0x56507420ce80 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.823+0000 7f33028d4640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56507420ce80 0x56507420f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.823+0000 7f33028d4640 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56507420ce80 0x56507420f2f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.823+0000 7f33028d4640 1 -- 172.21.15.170:0/1287098416 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32f800f670 con 0x56507420ce80 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.823+0000 7f330843c800 1 Processor -- start 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.823+0000 7f330843c800 1 -- start start 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f330843c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507421deb0 0x56507421e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f330843c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56507407a560 con 0x56507421deb0 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507421deb0 0x56507421e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507421deb0 0x56507421e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36548/0 (socket says 172.21.15.170:36548) 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f33030d5640 1 -- 172.21.15.170:0/2113804829 learned_addr learned my addr 172.21.15.170:0/2113804829 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f33030d5640 1 -- 172.21.15.170:0/2113804829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507421e810 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f33030d5640 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507421deb0 0x56507421e2d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f32f408cab0 tx=0x7f32f4067df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f31ed602640 1 -- 172.21.15.170:0/2113804829 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4093070 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f31ed602640 1 -- 172.21.15.170:0/2113804829 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4058040 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56507421f280 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f31ed602640 1 -- 172.21.15.170:0/2113804829 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f408ce60 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.824+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507421f780 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.825+0000 7f31ed602640 1 -- 172.21.15.170:0/2113804829 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f32f4096070 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.825+0000 7f31ed602640 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31dc036900 0x7f31dc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.825+0000 7f31ed602640 1 -- 172.21.15.170:0/2113804829 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f32f4099ca0 con 0x56507421deb0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.825+0000 7f33028d4640 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31dc036900 0x7f31dc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f330843c800 1 Processor -- start 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f330843c800 1 -- start start 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f33028d4640 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31dc036900 0x7f31dc038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x565074079750 tx=0x7f32f8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f330843c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x56507422b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f330843c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x565073ff5e60 con 0x56507422afb0 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x56507422b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x56507422b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36558/0 (socket says 172.21.15.170:36558) 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f33030d5640 1 -- 172.21.15.170:0/3385574656 learned_addr learned my addr 172.21.15.170:0/3385574656 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f33030d5640 1 -- 172.21.15.170:0/3385574656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507422b9a0 con 0x56507422afb0 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f33030d5640 1 --2- 172.21.15.170:0/3385574656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x56507422b3d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f32f405efd0 tx=0x7f32f405fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11976fb293eef4cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f31e6ffd640 1 -- 172.21.15.170:0/3385574656 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f40799d0 con 0x56507422afb0 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f31e6ffd640 1 -- 172.21.15.170:0/3385574656 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40669e0 con 0x56507422afb0 2024-04-26T12:30:36.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.826+0000 7f31e6ffd640 1 -- 172.21.15.170:0/3385574656 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f408b310 con 0x56507422afb0 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 -- 172.21.15.170:0/3385574656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 msgr2=0x56507422b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 --2- 172.21.15.170:0/3385574656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x56507422b3d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f32f405efd0 tx=0x7f32f405fea0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 -- 172.21.15.170:0/3385574656 shutdown_connections 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 --2- 172.21.15.170:0/3385574656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x56507422b3d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 -- 172.21.15.170:0/3385574656 >> 172.21.15.170:0/3385574656 conn(0x5650742272c0 msgr2=0x565074225320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 -- 172.21.15.170:0/3385574656 shutdown_connections 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 -- 172.21.15.170:0/3385574656 wait complete. 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 Processor -- start 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 -- start start 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x5650742321d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.827+0000 7f330843c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56507422beb0 con 0x56507422afb0 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x5650742321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f33030d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x5650742321d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36564/0 (socket says 172.21.15.170:36564) 2024-04-26T12:30:36.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 learned_addr learned my addr 172.21.15.170:0/1540553671 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565074232710 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f33030d5640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x5650742321d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f32f407afd0 tx=0x7f32f4075f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f31e57fa640 1 -- 172.21.15.170:0/1540553671 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4066b90 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f31e57fa640 1 -- 172.21.15.170:0/1540553671 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f405e910 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565074232710 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f31e57fa640 1 -- 172.21.15.170:0/1540553671 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f405ebf0 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.828+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565074232710 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.829+0000 7f31e57fa640 1 -- 172.21.15.170:0/1540553671 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f32f4009410 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.829+0000 7f31e57fa640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31cc036950 0x7f31cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.829+0000 7f31e57fa640 1 -- 172.21.15.170:0/1540553671 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f32f40a3070 con 0x56507422afb0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.829+0000 7f33028d4640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31cc036950 0x7f31cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f33028d4640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31cc036950 0x7f31cc038e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56507420fe50 tx=0x7f32f8023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56507423d8d0 0x56507423fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650742404e0 con 0x56507423d8d0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f33038d6640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56507423d8d0 0x56507423fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f33038d6640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56507423d8d0 0x56507423fd90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 20 realm 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650742408f0 con 0x56507423d8d0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.830+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5650742411c0 con 0x56507423d8d0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f330843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f330843c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5650742422c0 0x5650742446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074244cc0 con 0x5650742422c0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f33030d5640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5650742422c0 0x5650742446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.831+0000 7f33030d5640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5650742422c0 0x5650742446b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f330843c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:36.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f330843c800 20 searching for the correct realm 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x565074246c70 0x565074249130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074249800 con 0x565074246c70 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f33028d4640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x565074246c70 0x565074249130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f33028d4640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x565074246c70 0x565074249130 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f33028d4640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f32f803a3c0 0x7f32f803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.832+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074249800 con 0x7f32f803a3c0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.833+0000 7f33038d6640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f32f803a3c0 0x7f32f803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.833+0000 7f33038d6640 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f32f803a3c0 0x7f32f803a810 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.833+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.833+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.833+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.833+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.834+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x7f32f803a3c0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.835+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x7f32f803a3c0 2024-04-26T12:30:36.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.836+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.837+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.837+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.837+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.837+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.837+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.837+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.838+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x7f32f803a3c0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.839+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x7f32f803a3c0 2024-04-26T12:30:36.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x565074246c70 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x5650742422c0 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.840+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x56507423d8d0 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x565074241560 con 0x7f32f803a3c0 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:36.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074245580 con 0x56507423d8d0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074245580 con 0x56507423d8d0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.841+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074245580 con 0x7f32f803a3c0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:36.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 zone default found 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 4 Realm: () 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 zonegroup default 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074245e20 con 0x5650742422c0 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56507424b660 con 0x565074246c70 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.842+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56507424ba00 con 0x565074246c70 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.843+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.843+0000 7f330843c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.843+0000 7f330843c800 20 started sync module instance, tier type = 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.843+0000 7f330843c800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.843+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424ab00 con 0x7f32f803a3c0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.844+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.844+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903545933872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424ab00 con 0x7f32f803a3c0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.844+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424c290 con 0x56507423d8d0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.845+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94903545933872] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.845+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.845+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903545937312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424ab00 con 0x56507423d8d0 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.845+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424cd20 con 0x565074246c70 2024-04-26T12:30:36.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.846+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94903545937312] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.846+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.846+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94903545931344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424aa70 con 0x565074246c70 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.846+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424dae0 con 0x7f32f803a3c0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.847+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94903545931344] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.847+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.847+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94903545942288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424ded0 con 0x7f32f803a3c0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.847+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424e890 con 0x56507423d8d0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.848+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94903545942288] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.849+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.849+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903545943344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424e890 con 0x56507423d8d0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.849+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424f2d0 con 0x5650742422c0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.849+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94903545943344] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.850+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.850+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903545947104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424e800 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.850+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074250040 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.851+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.851+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94903545955376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074250d00 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.851+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074251740 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.851+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94903545947104] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94903545955376] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94903545958928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074250850 con 0x5650742422c0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 20 add_watcher() i=0 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 20 add_watcher() i=1 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 20 add_watcher() i=2 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 20 add_watcher() i=3 2024-04-26T12:30:36.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 20 add_watcher() i=4 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 20 add_watcher() i=5 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.852+0000 7f330843c800 20 add_watcher() i=6 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.853+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94903545958928] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.853+0000 7f330843c800 20 add_watcher() i=7 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.853+0000 7f330843c800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.853+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074254840 con 0x56507423d8d0 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.854+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.854+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94903545951936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074251cc0 con 0x56507423d8d0 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94903545951936] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f31b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 5 note: GC not initialized 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f31b8fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 20 Filter name: none 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f31327fc640 20 reqs_thread_entry: start 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.855+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074287c30 con 0x56507423d8d0 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074289d10 con 0x56507423d8d0 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv2 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 20 rados_obj.operate() r=0 bl.length=193 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 20 rados->read ofs=0 len=0 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 8.5 8:a6c3d596:root::.bucket.meta.testx%3amyfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56507428b550 con 0x56507423d8d0 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 20 rados_obj.operate() r=0 bl.length=412 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-26T12:30:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-26T12:30:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.856+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507428fbb0 con 0x56507423d8d0 2024-04-26T12:30:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.857+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.857+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5650742934c0 con 0x56507423d8d0 2024-04-26T12:30:36.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [create,call,writefull 0~379,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x7 2024-04-26T12:30:36.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94903546221056 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074292f00 con 0x56507423d8d0 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify (1) cookie 94903545943344 notify 128849018896 ret 0) ==== 770+0+0 (crc 0 0 0) 0x5650742938b0 con 0x56507423d8d0 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f31e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94903545943344 notifier 4565 bl.length()=728 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f31e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x7 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f31e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f31e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f31e6ffd640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f31c8003ea0 con 0x56507423d8d0 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(67 notify.4 [notify cookie 94903546221056 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== watch-notify(notify_complete (2) cookie 94903546221056 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56507428f5e0 con 0x56507423d8d0 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_sources= new_sources= 2024-04-26T12:30:36.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential sources added=[] removed=[] 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_dests= new_dests= 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential dests added=[] removed=[] 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.859+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074292fc0 con 0x7f32f803a3c0 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.861+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.861+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074292fc0 con 0x7f32f803a3c0 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.862+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.862+0000 7f330843c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.862+0000 7f330843c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.862+0000 7f330843c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.862+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94903546227472 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074292f30 con 0x5650742422c0 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== watch-notify(notify (1) cookie 94903545955376 notify 128849018895 ret 0) ==== 356+0+0 (crc 0 0 0) 0x56507421e810 con 0x5650742422c0 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f31e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94903545955376 notifier 4565 bl.length()=314 2024-04-26T12:30:36.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f31e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f31e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [notify cookie 94903546227472 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f31e67fc640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3138003400 con 0x5650742422c0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== watch-notify(notify_complete (2) cookie 94903546227472 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565074078c90 con 0x5650742422c0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.863+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074292fc0 con 0x56507423d8d0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'3 uv3 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f330843c800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f330843c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94903546227472 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074292f30 con 0x56507423d8d0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== watch-notify(notify (1) cookie 94903545943344 notify 128849018897 ret 0) ==== 197+0+0 (crc 0 0 0) 0x565074293360 con 0x56507423d8d0 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f31e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94903545943344 notifier 4565 bl.length()=155 2024-04-26T12:30:36.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f31e6ffd640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f31c8003ea0 con 0x56507423d8d0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.864+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(74 notify.4 [notify cookie 94903546227472 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.865+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== watch-notify(notify_complete (2) cookie 94903546227472 notify 128849018897 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565074292210 con 0x56507423d8d0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.865+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.865+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 8.5 8:a6c3d596:root::.bucket.meta.testx%3amyfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074292fc0 con 0x56507423d8d0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f330843c800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 from cache 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f330843c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94903546195488 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x565074292fc0 con 0x7f32f803a3c0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== watch-notify(notify (1) cookie 94903545942288 notify 128849018894 ret 0) ==== 254+0+0 (crc 0 0 0) 0x565074292210 con 0x7f32f803a3c0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f31e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94903545942288 notifier 4565 bl.length()=212 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f31e67fc640 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3138003470 con 0x7f32f803a3c0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(77 notify.3 [notify cookie 94903546195488 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== watch-notify(notify_complete (2) cookie 94903546195488 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56507428f5e0 con 0x7f32f803a3c0 2024-04-26T12:30:36.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.866+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.867+0000 7f31b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.867+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94903545951936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x565074292b10 con 0x56507423d8d0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.868+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94903545951936] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.868+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94903545933872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424f6c0 con 0x7f32f803a3c0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.869+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94903545933872] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.869+0000 7f330843c800 20 remove_watcher() i=0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.869+0000 7f330843c800 2 removed watcher, disabling cache 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.869+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94903545937312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424f6c0 con 0x56507423d8d0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.870+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94903545937312] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.870+0000 7f330843c800 20 remove_watcher() i=1 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.870+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94903545931344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424bda0 con 0x565074246c70 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.871+0000 7f33028d4640 1 -- 172.21.15.170:0/1540553671 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94903545931344] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8037040 con 0x565074246c70 2024-04-26T12:30:36.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.871+0000 7f330843c800 20 remove_watcher() i=2 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.871+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94903545942288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424f6c0 con 0x7f32f803a3c0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.872+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94903545942288] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x7f32f803a3c0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.872+0000 7f330843c800 20 remove_watcher() i=3 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.872+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94903545943344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424a650 con 0x56507423d8d0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.873+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94903545943344] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32fc00a4a0 con 0x56507423d8d0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.873+0000 7f330843c800 20 remove_watcher() i=4 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.873+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94903545947104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424f6c0 con 0x5650742422c0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.874+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94903545947104] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.874+0000 7f330843c800 20 remove_watcher() i=5 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.874+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94903545955376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424a650 con 0x5650742422c0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.875+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94903545955376] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.875+0000 7f330843c800 20 remove_watcher() i=6 2024-04-26T12:30:36.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.875+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94903545958928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56507424e3e0 con 0x5650742422c0 2024-04-26T12:30:36.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f33030d5640 1 -- 172.21.15.170:0/1540553671 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94903545958928] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f4095030 con 0x5650742422c0 2024-04-26T12:30:36.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 20 remove_watcher() i=7 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5650742422c0 msgr2=0x5650742446b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5650742422c0 0x5650742446b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56507423d8d0 msgr2=0x56507423fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56507423d8d0 0x56507423fd90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f32f803a3c0 msgr2=0x7f32f803a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f32f803a3c0 0x7f32f803a810 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x565074246c70 msgr2=0x565074249130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x565074246c70 0x565074249130 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31cc036950 msgr2=0x7f31cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31cc036950 0x7f31cc038e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x56507420fe50 tx=0x7f32f8023040 comp rx=0 tx=0).stop 2024-04-26T12:30:36.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f33038d6640 1 -- 172.21.15.170:0/1540553671 reap_dead start 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 msgr2=0x5650742321d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x5650742321d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f32f407afd0 tx=0x7f32f4075f90 comp rx=0 tx=0).stop 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 shutdown_connections 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 --2- 172.21.15.170:0/1540553671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507422afb0 0x5650742321d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 >> 172.21.15.170:0/1540553671 conn(0x5650742272c0 msgr2=0x565074224920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 shutdown_connections 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.876+0000 7f330843c800 1 -- 172.21.15.170:0/1540553671 wait complete. 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31dc036900 msgr2=0x7f31dc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31dc036900 0x7f31dc038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x565074079750 tx=0x7f32f8006000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507421deb0 msgr2=0x56507421e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507421deb0 0x56507421e2d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f32f408cab0 tx=0x7f32f4067df0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 shutdown_connections 2024-04-26T12:30:36.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31dc036900 0x7f31dc038dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/2113804829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56507421deb0 0x56507421e2d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 >> 172.21.15.170:0/2113804829 conn(0x565074211f50 msgr2=0x565074212350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 shutdown_connections 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/2113804829 wait complete. 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x565074208e30 msgr2=0x56507420b240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x565074208e30 0x56507420b240 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x565074105750 msgr2=0x565074206670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x565074105750 0x565074206670 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56507420ce80 msgr2=0x56507420f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56507420ce80 0x56507420f2f0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31e8036950 msgr2=0x7f31e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f31e8036950 0x7f31e8038e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f80013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 msgr2=0x56507407a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 --2- 172.21.15.170:0/1287098416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5650741045e0 0x56507407a020 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f32f4060040 tx=0x7f32f4002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f33038d6640 1 -- 172.21.15.170:0/1287098416 reap_dead start 2024-04-26T12:30:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 shutdown_connections 2024-04-26T12:30:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 >> 172.21.15.170:0/1287098416 conn(0x5650740ffba0 msgr2=0x5650741f4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 shutdown_connections 2024-04-26T12:30:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.877+0000 7f330843c800 1 -- 172.21.15.170:0/1287098416 wait complete. 2024-04-26T12:30:36.890 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:30:36.890 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-26T12:30:36.890 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-26T12:30:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.974+0000 7f1808f75800 1 Processor -- start 2024-04-26T12:30:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.974+0000 7f1808f75800 1 -- start start 2024-04-26T12:30:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.974+0000 7f1808f75800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559f7a1e6040 0x559f7a1e8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.974+0000 7f1808f75800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f7a0920c0 con 0x559f7a1e8970 2024-04-26T12:30:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.974+0000 7f1808f75800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x559f7a0764d0 con 0x559f7a1e6040 2024-04-26T12:30:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.975+0000 7f1806a74640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559f7a1e6040 0x559f7a1e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.975+0000 7f1806273640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559f7a1e8970 0x559f7a1ead60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:56656/0 (socket says 172.21.15.170:56656) 2024-04-26T12:30:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.975+0000 7f1806a74640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559f7a1e6040 0x559f7a1e8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36572/0 (socket says 172.21.15.170:36572) 2024-04-26T12:30:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.975+0000 7f1806273640 1 -- 172.21.15.170:0/3113085091 learned_addr learned my addr 172.21.15.170:0/3113085091 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.975+0000 7f1806a74640 1 -- 172.21.15.170:0/3113085091 >> v1:172.21.15.132:6789/0 conn(0x559f7a1e8970 legacy=0x559f7a1ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.975+0000 7f1806a74640 1 -- 172.21.15.170:0/3113085091 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a0a3d40 con 0x559f7a1e6040 2024-04-26T12:30:36.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.977+0000 7f1806a74640 1 --2- 172.21.15.170:0/3113085091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a1e8430 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f17f8005fd0 tx=0x7f17f801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21d4a1059604c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.977+0000 7f1805a72640 1 -- 172.21.15.170:0/3113085091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f8052560 con 0x559f7a1e6040 2024-04-26T12:30:36.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.977+0000 7f1805a72640 1 -- 172.21.15.170:0/3113085091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f8052700 con 0x559f7a1e6040 2024-04-26T12:30:36.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.977+0000 7f1805a72640 1 -- 172.21.15.170:0/3113085091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f8052a60 con 0x559f7a1e6040 2024-04-26T12:30:36.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.978+0000 7f1808f75800 1 -- 172.21.15.170:0/3113085091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 msgr2=0x559f7a1e8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.978+0000 7f1808f75800 1 --2- 172.21.15.170:0/3113085091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a1e8430 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f17f8005fd0 tx=0x7f17f801ccc0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.978+0000 7f1808f75800 1 -- 172.21.15.170:0/3113085091 shutdown_connections 2024-04-26T12:30:36.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.978+0000 7f1808f75800 1 --2- 172.21.15.170:0/3113085091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a1e8430 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.978+0000 7f1808f75800 1 -- 172.21.15.170:0/3113085091 >> 172.21.15.170:0/3113085091 conn(0x559f7a1df9b0 msgr2=0x559f7a1e1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.978+0000 7f1808f75800 1 -- 172.21.15.170:0/3113085091 shutdown_connections 2024-04-26T12:30:36.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.978+0000 7f1808f75800 1 -- 172.21.15.170:0/3113085091 wait complete. 2024-04-26T12:30:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.989+0000 7f1808f75800 1 Processor -- start 2024-04-26T12:30:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.989+0000 7f1808f75800 1 -- start start 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.989+0000 7f1808f75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2d6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.989+0000 7f1808f75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f7a130b70 con 0x559f7a1e6040 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2d6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36578/0 (socket says 172.21.15.170:36578) 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f1806a74640 1 -- 172.21.15.170:0/3638693492 learned_addr learned my addr 172.21.15.170:0/3638693492 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f1806a74640 1 -- 172.21.15.170:0/3638693492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a0a2590 con 0x559f7a1e6040 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f1806a74640 1 --2- 172.21.15.170:0/3638693492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2d6740 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f17f8054040 tx=0x7f17f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67edfe4853ec0ba9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f16f4e09640 1 -- 172.21.15.170:0/3638693492 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f80529e0 con 0x559f7a1e6040 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f16f4e09640 1 -- 172.21.15.170:0/3638693492 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f8052b80 con 0x559f7a1e6040 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.990+0000 7f16f4e09640 1 -- 172.21.15.170:0/3638693492 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f805c430 con 0x559f7a1e6040 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 -- 172.21.15.170:0/3638693492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 msgr2=0x559f7a2d6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 --2- 172.21.15.170:0/3638693492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2d6740 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f17f8054040 tx=0x7f17f804c000 comp rx=0 tx=0).stop 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 -- 172.21.15.170:0/3638693492 shutdown_connections 2024-04-26T12:30:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 --2- 172.21.15.170:0/3638693492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2d6740 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 -- 172.21.15.170:0/3638693492 >> 172.21.15.170:0/3638693492 conn(0x559f7a1df9b0 msgr2=0x559f7a2d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 -- 172.21.15.170:0/3638693492 shutdown_connections 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 -- 172.21.15.170:0/3638693492 wait complete. 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 Processor -- start 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 -- start start 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2ddf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.991+0000 7f1808f75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f7a1ee790 con 0x559f7a1e6040 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2ddf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2ddf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36580/0 (socket says 172.21.15.170:36580) 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f1806a74640 1 -- 172.21.15.170:0/123589247 learned_addr learned my addr 172.21.15.170:0/123589247 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f1806a74640 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a0998f0 con 0x559f7a1e6040 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f1806a74640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2ddf80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f17f8044920 tx=0x7f17f8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f16f3606640 1 -- 172.21.15.170:0/123589247 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f8066540 con 0x559f7a1e6040 2024-04-26T12:30:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f16f3606640 1 -- 172.21.15.170:0/123589247 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f80666e0 con 0x559f7a1e6040 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f7a2de4c0 con 0x559f7a1e6040 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f16f3606640 1 -- 172.21.15.170:0/123589247 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f80669c0 con 0x559f7a1e6040 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.992+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f7a2de9e0 con 0x559f7a1e6040 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.993+0000 7f16f3606640 1 -- 172.21.15.170:0/123589247 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f17f8078020 con 0x559f7a1e6040 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.993+0000 7f16f3606640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16ec036900 0x7f16ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.993+0000 7f16f3606640 1 -- 172.21.15.170:0/123589247 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f17f808eb40 con 0x559f7a1e6040 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.993+0000 7f1806273640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16ec036900 0x7f16ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a1e8970 0x559f7a2e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a2e55f0 con 0x559f7a1e8970 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1807275640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a1e8970 0x559f7a2e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1806273640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16ec036900 0x7f16ec038dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17fc000f60 tx=0x7f17fc0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1807275640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a1e8970 0x559f7a2e4ff0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:36.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1807275640 1 -- 172.21.15.170:0/123589247 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a1e8970 2024-04-26T12:30:36.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a2e25a0 con 0x559f7a1e8970 2024-04-26T12:30:36.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.994+0000 7f1807275640 1 -- 172.21.15.170:0/123589247 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a1e8970 2024-04-26T12:30:36.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.995+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a2e7900 0x559f7a2e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:36.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.995+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a2ea3e0 con 0x559f7a2e7900 2024-04-26T12:30:36.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.995+0000 7f1806a74640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a2e7900 0x559f7a2e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.995+0000 7f1806a74640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a2e7900 0x559f7a2e9cf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1806a74640 1 -- 172.21.15.170:0/123589247 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a2e7900 2024-04-26T12:30:37.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a2e68b0 con 0x559f7a1e8970 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1807275640 1 -- 172.21.15.170:0/123589247 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a1e8970 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f7a2eb840 0x559f7a2edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a2ee440 con 0x559f7a2eb840 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1806273640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f7a2eb840 0x559f7a2edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1806273640 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f7a2eb840 0x559f7a2edcb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.996+0000 7f1806273640 1 -- 172.21.15.170:0/123589247 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a2eb840 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1808f75800 1 Processor -- start 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1808f75800 1 -- start start 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1808f75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a2fc8f0 0x559f7a2fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1808f75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f7a0d6e60 con 0x559f7a2fc8f0 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a2fc8f0 0x559f7a2fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a2fc8f0 0x559f7a2fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36584/0 (socket says 172.21.15.170:36584) 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1806a74640 1 -- 172.21.15.170:0/983825078 learned_addr learned my addr 172.21.15.170:0/983825078 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.997+0000 7f1806a74640 1 -- 172.21.15.170:0/983825078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a2fd250 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.998+0000 7f1806a74640 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a2fc8f0 0x559f7a2fcd10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f17f8066fd0 tx=0x7f17f8051f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.998+0000 7f16f0e01640 1 -- 172.21.15.170:0/983825078 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f8092020 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.998+0000 7f16f0e01640 1 -- 172.21.15.170:0/983825078 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f8070850 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.998+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f7a2fdcc0 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.998+0000 7f16f0e01640 1 -- 172.21.15.170:0/983825078 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f8079580 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.998+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f7a2fe1c0 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f16f0e01640 1 -- 172.21.15.170:0/983825078 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f17f8095020 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f16f0e01640 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16e0036900 0x7f16e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f16f0e01640 1 -- 172.21.15.170:0/983825078 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f17f808a050 con 0x559f7a2fc8f0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1806273640 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16e0036900 0x7f16e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1808f75800 1 Processor -- start 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1808f75800 1 -- start start 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1806273640 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16e0036900 0x7f16e0038dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00bf50 tx=0x7f17fc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1808f75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a309ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1808f75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f7a2d6e00 con 0x559f7a309a80 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a309ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a309ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36594/0 (socket says 172.21.15.170:36594) 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:36.999+0000 7f1806a74640 1 -- 172.21.15.170:0/3247235298 learned_addr learned my addr 172.21.15.170:0/3247235298 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1806a74640 1 -- 172.21.15.170:0/3247235298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a30a470 con 0x559f7a309a80 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1806a74640 1 --2- 172.21.15.170:0/3247235298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a309ea0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f17f8059f50 tx=0x7f17f8096650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b07b654228ff06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f16ea7fc640 1 -- 172.21.15.170:0/3247235298 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f80847e0 con 0x559f7a309a80 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f16ea7fc640 1 -- 172.21.15.170:0/3247235298 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f808e630 con 0x559f7a309a80 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f16ea7fc640 1 -- 172.21.15.170:0/3247235298 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f8084980 con 0x559f7a309a80 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1808f75800 1 -- 172.21.15.170:0/3247235298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 msgr2=0x559f7a309ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1808f75800 1 --2- 172.21.15.170:0/3247235298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a309ea0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f17f8059f50 tx=0x7f17f8096650 comp rx=0 tx=0).stop 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1808f75800 1 -- 172.21.15.170:0/3247235298 shutdown_connections 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1808f75800 1 --2- 172.21.15.170:0/3247235298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a309ea0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1808f75800 1 -- 172.21.15.170:0/3247235298 >> 172.21.15.170:0/3247235298 conn(0x559f7a305d50 msgr2=0x559f7a303db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1808f75800 1 -- 172.21.15.170:0/3247235298 shutdown_connections 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.000+0000 7f1808f75800 1 -- 172.21.15.170:0/3247235298 wait complete. 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.001+0000 7f1808f75800 1 Processor -- start 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.001+0000 7f1808f75800 1 -- start start 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.001+0000 7f1808f75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a310c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.001+0000 7f1808f75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559f7a30a950 con 0x559f7a309a80 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.001+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a310c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.001+0000 7f1806a74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a310c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36604/0 (socket says 172.21.15.170:36604) 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.001+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 learned_addr learned my addr 172.21.15.170:0/546094158 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.002+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a311180 con 0x559f7a309a80 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.002+0000 7f1806a74640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a310c40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f17f8073830 tx=0x7f17f8059ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.002+0000 7f16e8ff9640 1 -- 172.21.15.170:0/546094158 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f80b9020 con 0x559f7a309a80 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.002+0000 7f16e8ff9640 1 -- 172.21.15.170:0/546094158 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f807bb30 con 0x559f7a309a80 2024-04-26T12:30:37.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.002+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f7a311180 con 0x559f7a309a80 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.002+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f7a311180 con 0x559f7a309a80 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.002+0000 7f16e8ff9640 1 -- 172.21.15.170:0/546094158 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f807b5a0 con 0x559f7a309a80 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f16e8ff9640 1 -- 172.21.15.170:0/546094158 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f17f80bc020 con 0x559f7a309a80 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f16e8ff9640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16d0036900 0x7f16d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f16e8ff9640 1 -- 172.21.15.170:0/546094158 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f17f80af050 con 0x559f7a309a80 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f1806273640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16d0036900 0x7f16d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a31c2c0 0x559f7a31e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31eed0 con 0x559f7a31c2c0 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f1806273640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16d0036900 0x7f16d0038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17fc001b60 tx=0x7f17fc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.003+0000 7f1807275640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a31c2c0 0x559f7a31e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1807275640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a31c2c0 0x559f7a31e780 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a31c2c0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 20 realm 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31f2e0 con 0x559f7a31c2c0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a31c2c0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a31c2c0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.004+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31ff50 con 0x559f7a31c2c0 2024-04-26T12:30:37.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.005+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a31c2c0 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.005+0000 7f1808f75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.005+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.005+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a320910 0x559f7a322d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.005+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a323310 con 0x559f7a320910 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.005+0000 7f1806a74640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a320910 0x559f7a322d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.005+0000 7f1806a74640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a320910 0x559f7a322d00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1808f75800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1808f75800 20 searching for the correct realm 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f7a3252c0 0x559f7a327780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a327e50 con 0x559f7a3252c0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1806273640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f7a3252c0 0x559f7a327780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1806273640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f7a3252c0 0x559f7a327780 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1806273640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f17fc037040 0x7f17fc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.006+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a327e50 con 0x7f17fc037040 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.007+0000 7f1807275640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f17fc037040 0x7f17fc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.007+0000 7f1807275640 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f17fc037040 0x7f17fc036410 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.007+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f18000083e0 con 0x7f17fc037040 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.007+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18000083e0 con 0x559f7a31c2c0 2024-04-26T12:30:37.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.008+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x7f17fc037040 2024-04-26T12:30:37.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.009+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x7f17fc037040 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.010+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.011+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.012+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x7f17fc037040 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.013+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.013+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.013+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.013+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.013+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.013+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.013+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.014+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.014+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.014+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x7f17fc037040 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.014+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.014+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a3252c0 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.014+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.014+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a320910 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.015+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.015+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.015+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.015+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559f7a31fbb0 con 0x7f17fc037040 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:37.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a323bd0 con 0x559f7a31c2c0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a323bd0 con 0x559f7a31c2c0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a323bd0 con 0x7f17fc037040 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 zone default found 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 4 Realm: () 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 zonegroup default 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.016+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a324470 con 0x559f7a320910 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a324810 con 0x559f7a3252c0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329df0 con 0x559f7a3252c0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 20 started sync module instance, tier type = 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.017+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329150 con 0x7f17fc037040 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.018+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.018+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143438296656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329150 con 0x7f17fc037040 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.018+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32a930 con 0x559f7a31c2c0 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.019+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94143438296656] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.019+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.019+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143438300192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329150 con 0x559f7a31c2c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.019+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32b3b0 con 0x559f7a3252c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.020+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.020+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94143438302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32bc50 con 0x559f7a3252c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.020+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32c6c0 con 0x7f17fc037040 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.021+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94143438300192] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.021+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94143438302912] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.022+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.022+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94143438305184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a328ca0 con 0x7f17fc037040 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.022+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32cf90 con 0x559f7a31c2c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.023+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.023+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143438310032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32ceb0 con 0x559f7a31c2c0 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.023+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32deb0 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.023+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94143438305184] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.024+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94143438310032] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.024+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.024+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94143438312320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32c190 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.024+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32e750 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.025+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94143438312320] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.025+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.025+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94143438313888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32efa0 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.025+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32f830 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.026+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94143438313888] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94143438318320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32fa10 con 0x559f7a320910 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 20 add_watcher() i=0 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 20 add_watcher() i=1 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 20 add_watcher() i=2 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 20 add_watcher() i=3 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 20 add_watcher() i=4 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 20 add_watcher() i=5 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.027+0000 7f1808f75800 20 add_watcher() i=6 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.028+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94143438318320] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.028+0000 7f1808f75800 20 add_watcher() i=7 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.028+0000 7f1808f75800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.028+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a332de0 con 0x559f7a31c2c0 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.028+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.028+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94143438321920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a3301d0 con 0x559f7a31c2c0 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.029+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94143438321920] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.029+0000 7f16bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.029+0000 7f1808f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:37.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.029+0000 7f1808f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:37.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.029+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33b760 con 0x559f7a31c2c0 2024-04-26T12:30:37.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.031+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.031+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33bdb0 con 0x559f7a320910 2024-04-26T12:30:37.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.032+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.032+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33bdb0 con 0x559f7a3252c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.033+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.033+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33c870 con 0x559f7a31c2c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.034+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.034+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a339490 con 0x7f17fc037040 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.035+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.035+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a339450 con 0x559f7a3252c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.036+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.036+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33da10 con 0x559f7a31c2c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.037+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.037+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33da10 con 0x559f7a320910 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.038+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.038+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33daa0 con 0x7f17fc037040 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.039+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.039+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33daa0 con 0x559f7a3252c0 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.040+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.040+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x7f17fc037040 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.041+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.041+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x559f7a320910 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.042+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.042+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x7f17fc037040 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.043+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.043+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x559f7a320910 2024-04-26T12:30:37.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.045+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.045+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x559f7a31c2c0 2024-04-26T12:30:37.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.046+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.046+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x559f7a3252c0 2024-04-26T12:30:37.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.047+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.047+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x7f17fc037040 2024-04-26T12:30:37.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.048+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.048+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e000 con 0x559f7a3252c0 2024-04-26T12:30:37.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.049+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.049+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e090 con 0x559f7a31c2c0 2024-04-26T12:30:37.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.050+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.050+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e090 con 0x559f7a31c2c0 2024-04-26T12:30:37.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.051+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.051+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e090 con 0x559f7a3252c0 2024-04-26T12:30:37.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.052+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.052+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e120 con 0x7f17fc037040 2024-04-26T12:30:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.053+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.053+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e120 con 0x559f7a3252c0 2024-04-26T12:30:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.054+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.054+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e120 con 0x559f7a3252c0 2024-04-26T12:30:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.055+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.055+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x559f7a3252c0 2024-04-26T12:30:37.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.056+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.056+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x559f7a3252c0 2024-04-26T12:30:37.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.057+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.057+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x559f7a320910 2024-04-26T12:30:37.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.058+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.058+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x559f7a3252c0 2024-04-26T12:30:37.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.059+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.059+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x559f7a320910 2024-04-26T12:30:37.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.060+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.060+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x559f7a3252c0 2024-04-26T12:30:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.061+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.061+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x559f7a320910 2024-04-26T12:30:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.062+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.062+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a33e190 con 0x7f17fc037040 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.063+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.064+0000 7f1637fff640 20 reqs_thread_entry: start 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.064+0000 7f1808f75800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.064+0000 7f1808f75800 20 Filter name: none 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.064+0000 7f1635ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.064+0000 7f1808f75800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.064+0000 7f1808f75800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.064+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a3693d0 con 0x559f7a320910 2024-04-26T12:30:37.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1808f75800 20 rados_obj.operate() r=0 bl.length=419 2024-04-26T12:30:37.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1808f75800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-26T12:30:37.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1808f75800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-26T12:30:37.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1808f75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:37.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a3693c0 con 0x559f7a31c2c0 2024-04-26T12:30:37.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1808f75800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T12:30:37.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.065+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a369dd0 con 0x559f7a320910 2024-04-26T12:30:37.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.066+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.066+0000 7f1808f75800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:30:37.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.066+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94143438563632 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a36c430 con 0x559f7a3252c0 2024-04-26T12:30:37.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== watch-notify(notify (1) cookie 94143438302912 notify 128849018885 ret 0) ==== 212+0+0 (crc 0 0 0) 0x559f7a338ff0 con 0x559f7a3252c0 2024-04-26T12:30:37.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f16ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94143438302912 notifier 4572 bl.length()=170 2024-04-26T12:30:37.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(97 notify.2 [notify cookie 94143438563632 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f16ea7fc640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f16cc003d60 con 0x559f7a3252c0 2024-04-26T12:30:37.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== watch-notify(notify_complete (2) cookie 94143438563632 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f7a33d390 con 0x559f7a3252c0 2024-04-26T12:30:37.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f1808f75800 10 removing email index: 2024-04-26T12:30:37.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f1808f75800 10 removing user buckets index 2024-04-26T12:30:37.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.067+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a36c3b0 con 0x559f7a31c2c0 2024-04-26T12:30:37.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.068+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.068+0000 7f1808f75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-26T12:30:37.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.068+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94143438569056 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a36c3b0 con 0x559f7a31c2c0 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.068+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== watch-notify(notify (1) cookie 94143438310032 notify 128849018898 ret 0) ==== 217+0+0 (crc 0 0 0) 0x559f7a33b880 con 0x559f7a31c2c0 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.068+0000 7f16e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94143438310032 notifier 4572 bl.length()=175 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.068+0000 7f16e9ffb640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f163c0032c0 con 0x559f7a31c2c0 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.068+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(100 notify.4 [notify cookie 94143438569056 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.069+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.069+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== watch-notify(notify_complete (2) cookie 94143438569056 notify 128849018898 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f7a338dd0 con 0x559f7a31c2c0 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.069+0000 7f1808f75800 10 removing user index: testx$tenanteduser 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.069+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a36b940 con 0x559f7a320910 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f1808f75800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f1808f75800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-26T12:30:37.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94143438569056 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559f7a36ad90 con 0x7f17fc037040 2024-04-26T12:30:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== watch-notify(notify (1) cookie 94143438305184 notify 128849018895 ret 0) ==== 209+0+0 (crc 0 0 0) 0x559f7a338dd0 con 0x7f17fc037040 2024-04-26T12:30:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f16ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94143438305184 notifier 4572 bl.length()=167 2024-04-26T12:30:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f16ea7fc640 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f16cc003d60 con 0x7f17fc037040 2024-04-26T12:30:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.070+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(103 notify.3 [notify cookie 94143438569056 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.071+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== watch-notify(notify_complete (2) cookie 94143438569056 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f7a33b360 con 0x7f17fc037040 2024-04-26T12:30:37.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.071+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.071+0000 7f16bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.071+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94143438321920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a36be60 con 0x559f7a31c2c0 2024-04-26T12:30:37.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.072+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94143438321920] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.072+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94143438296656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a36be60 con 0x7f17fc037040 2024-04-26T12:30:37.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.073+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94143438296656] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.073+0000 7f1808f75800 20 remove_watcher() i=0 2024-04-26T12:30:37.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.073+0000 7f1808f75800 2 removed watcher, disabling cache 2024-04-26T12:30:37.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.073+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94143438300192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329650 con 0x559f7a31c2c0 2024-04-26T12:30:37.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.075+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94143438300192] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.075+0000 7f1808f75800 20 remove_watcher() i=1 2024-04-26T12:30:37.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.075+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94143438302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329650 con 0x559f7a3252c0 2024-04-26T12:30:37.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.075+0000 7f1806273640 1 -- 172.21.15.170:0/546094158 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94143438302912] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17fc009050 con 0x559f7a3252c0 2024-04-26T12:30:37.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.076+0000 7f1808f75800 20 remove_watcher() i=2 2024-04-26T12:30:37.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.076+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94143438305184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329650 con 0x7f17fc037040 2024-04-26T12:30:37.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.077+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94143438305184] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x7f17fc037040 2024-04-26T12:30:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.077+0000 7f1808f75800 20 remove_watcher() i=3 2024-04-26T12:30:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.077+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94143438310032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32b7a0 con 0x559f7a31c2c0 2024-04-26T12:30:37.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.078+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94143438310032] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1800026040 con 0x559f7a31c2c0 2024-04-26T12:30:37.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.078+0000 7f1808f75800 20 remove_watcher() i=4 2024-04-26T12:30:37.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.078+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94143438312320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a329650 con 0x559f7a320910 2024-04-26T12:30:37.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.079+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94143438312320] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.079+0000 7f1808f75800 20 remove_watcher() i=5 2024-04-26T12:30:37.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.079+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94143438313888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32ca90 con 0x559f7a320910 2024-04-26T12:30:37.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.080+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94143438313888] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.080+0000 7f1808f75800 20 remove_watcher() i=6 2024-04-26T12:30:37.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.080+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94143438318320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559f7a32b7a0 con 0x559f7a320910 2024-04-26T12:30:37.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1806a74640 1 -- 172.21.15.170:0/546094158 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94143438318320] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f8071910 con 0x559f7a320910 2024-04-26T12:30:37.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 20 remove_watcher() i=7 2024-04-26T12:30:37.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a320910 msgr2=0x559f7a322d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a320910 0x559f7a322d00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a31c2c0 msgr2=0x559f7a31e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a31c2c0 0x559f7a31e780 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f17fc037040 msgr2=0x7f17fc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f17fc037040 0x7f17fc036410 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f7a3252c0 msgr2=0x559f7a327780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559f7a3252c0 0x559f7a327780 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16d0036900 msgr2=0x7f16d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16d0036900 0x7f16d0038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17fc001b60 tx=0x7f17fc010000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 msgr2=0x559f7a310c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 --2- 172.21.15.170:0/546094158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a309a80 0x559f7a310c40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f17f8073830 tx=0x7f17f8059ee0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 reap_dead start 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1807275640 1 -- 172.21.15.170:0/546094158 reap_dead start 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 shutdown_connections 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 >> 172.21.15.170:0/546094158 conn(0x559f7a305d50 msgr2=0x559f7a3033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 shutdown_connections 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.081+0000 7f1808f75800 1 -- 172.21.15.170:0/546094158 wait complete. 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16e0036900 msgr2=0x7f16e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16e0036900 0x7f16e0038dc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00bf50 tx=0x7f17fc00f000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a2fc8f0 msgr2=0x559f7a2fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a2fc8f0 0x559f7a2fcd10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f17f8066fd0 tx=0x7f17f8051f20 comp rx=0 tx=0).stop 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 shutdown_connections 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16e0036900 0x7f16e0038dc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/983825078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a2fc8f0 0x559f7a2fcd10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 >> 172.21.15.170:0/983825078 conn(0x559f7a2f0990 msgr2=0x559f7a2f0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 shutdown_connections 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/983825078 wait complete. 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a2e7900 msgr2=0x559f7a2e9cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559f7a2e7900 0x559f7a2e9cf0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a1e8970 msgr2=0x559f7a2e4ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559f7a1e8970 0x559f7a2e4ff0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f7a2eb840 msgr2=0x559f7a2edcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559f7a2eb840 0x559f7a2edcb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16ec036900 msgr2=0x7f16ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f16ec036900 0x7f16ec038dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f17fc000f60 tx=0x7f17fc0012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 msgr2=0x559f7a2ddf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 --2- 172.21.15.170:0/123589247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559f7a1e6040 0x559f7a2ddf80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f17f8044920 tx=0x7f17f8003330 comp rx=0 tx=0).stop 2024-04-26T12:30:37.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1807275640 1 -- 172.21.15.170:0/123589247 reap_dead start 2024-04-26T12:30:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 shutdown_connections 2024-04-26T12:30:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 >> 172.21.15.170:0/123589247 conn(0x559f7a1df9b0 msgr2=0x559f7a2d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 shutdown_connections 2024-04-26T12:30:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.082+0000 7f1808f75800 1 -- 172.21.15.170:0/123589247 wait complete. 2024-04-26T12:30:37.097 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-26T12:30:37.101 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-26T12:30:37.147 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:37.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-26T12:30:37.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-26T12:30:37.147 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-26T12:30:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.192+0000 7fbddac16800 1 Processor -- start 2024-04-26T12:30:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.192+0000 7fbddac16800 1 -- start start 2024-04-26T12:30:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.192+0000 7fbddac16800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ebeebe0400 0x55ebeebe0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.192+0000 7fbddac16800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ebeea8e0c0 con 0x55ebeebe1660 2024-04-26T12:30:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.192+0000 7fbddac16800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55ebeea724d0 con 0x55ebeebe0400 2024-04-26T12:30:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.193+0000 7fbdd635c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ebeebe0400 0x55ebeebe0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.193+0000 7fbdd635c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ebeebe0400 0x55ebeebe0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36616/0 (socket says 172.21.15.170:36616) 2024-04-26T12:30:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.193+0000 7fbdd635c640 1 -- 172.21.15.170:0/3167288513 learned_addr learned my addr 172.21.15.170:0/3167288513 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.193+0000 7fbdd635c640 1 -- 172.21.15.170:0/3167288513 >> v1:172.21.15.132:6789/0 conn(0x55ebeebe1660 legacy=0x55ebeebe1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.193+0000 7fbdd5b5b640 1 -- 172.21.15.170:0/3167288513 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429716073 0 0) 0x55ebeea8e0c0 con 0x55ebeebe1660 2024-04-26T12:30:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.193+0000 7fbdd635c640 1 -- 172.21.15.170:0/3167288513 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeea9fd40 con 0x55ebeebe0400 2024-04-26T12:30:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.195+0000 7fbdd635c640 1 --2- 172.21.15.170:0/3167288513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeebe0820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800a6b0 tx=0x7fbdc801eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827d4b6a55d15c08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.195+0000 7fbdd5b5b640 1 -- 172.21.15.170:0/3167288513 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc800a200 con 0x55ebeebe0400 2024-04-26T12:30:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.195+0000 7fbdd5b5b640 1 -- 172.21.15.170:0/3167288513 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc800a3a0 con 0x55ebeebe0400 2024-04-26T12:30:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.195+0000 7fbdd5b5b640 1 -- 172.21.15.170:0/3167288513 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80086e0 con 0x55ebeebe0400 2024-04-26T12:30:37.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.196+0000 7fbddac16800 1 -- 172.21.15.170:0/3167288513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 msgr2=0x55ebeebe0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.196+0000 7fbddac16800 1 --2- 172.21.15.170:0/3167288513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeebe0820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800a6b0 tx=0x7fbdc801eed0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.196+0000 7fbddac16800 1 -- 172.21.15.170:0/3167288513 shutdown_connections 2024-04-26T12:30:37.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.196+0000 7fbddac16800 1 --2- 172.21.15.170:0/3167288513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeebe0820 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.196+0000 7fbddac16800 1 -- 172.21.15.170:0/3167288513 >> 172.21.15.170:0/3167288513 conn(0x55ebeebdba00 msgr2=0x55ebeebdde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.196+0000 7fbddac16800 1 -- 172.21.15.170:0/3167288513 shutdown_connections 2024-04-26T12:30:37.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.196+0000 7fbddac16800 1 -- 172.21.15.170:0/3167288513 wait complete. 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.207+0000 7fbddac16800 1 Processor -- start 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.207+0000 7fbddac16800 1 -- start start 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.207+0000 7fbddac16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeecd0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.207+0000 7fbddac16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ebeeb2cb70 con 0x55ebeebe0400 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeecd0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeecd0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36622/0 (socket says 172.21.15.170:36622) 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbdd635c640 1 -- 172.21.15.170:0/1704972027 learned_addr learned my addr 172.21.15.170:0/1704972027 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbdd635c640 1 -- 172.21.15.170:0/1704972027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeea9e590 con 0x55ebeebe0400 2024-04-26T12:30:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbdd635c640 1 --2- 172.21.15.170:0/1704972027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeecd0810 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801eea0 tx=0x7fbdc804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4191ef56a48f1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbcc4608640 1 -- 172.21.15.170:0/1704972027 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc800a200 con 0x55ebeebe0400 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbcc4608640 1 -- 172.21.15.170:0/1704972027 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc8008590 con 0x55ebeebe0400 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.208+0000 7fbcc4608640 1 -- 172.21.15.170:0/1704972027 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80088d0 con 0x55ebeebe0400 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 -- 172.21.15.170:0/1704972027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 msgr2=0x55ebeecd0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 --2- 172.21.15.170:0/1704972027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeecd0810 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801eea0 tx=0x7fbdc804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 -- 172.21.15.170:0/1704972027 shutdown_connections 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 --2- 172.21.15.170:0/1704972027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe0400 0x55ebeecd0810 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 -- 172.21.15.170:0/1704972027 >> 172.21.15.170:0/1704972027 conn(0x55ebeebdba00 msgr2=0x55ebeeccc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 -- 172.21.15.170:0/1704972027 shutdown_connections 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 -- 172.21.15.170:0/1704972027 wait complete. 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.209+0000 7fbddac16800 1 Processor -- start 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbddac16800 1 -- start start 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbddac16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe1660 0x55ebeecdc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbddac16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ebeeb53d70 con 0x55ebeebe1660 2024-04-26T12:30:37.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe1660 0x55ebeecdc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe1660 0x55ebeecdc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36624/0 (socket says 172.21.15.170:36624) 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbdd635c640 1 -- 172.21.15.170:0/3185137754 learned_addr learned my addr 172.21.15.170:0/3185137754 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbdd635c640 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeea958f0 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbdd635c640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe1660 0x55ebeecdc760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801eee0 tx=0x7fbdc8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbcc2e05640 1 -- 172.21.15.170:0/3185137754 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc806d020 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbcc2e05640 1 -- 172.21.15.170:0/3185137754 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc8008b40 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbcc2e05640 1 -- 172.21.15.170:0/3185137754 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc8008e20 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebeecdcca0 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.210+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebeecdd1c0 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.211+0000 7fbcc2e05640 1 -- 172.21.15.170:0/3185137754 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbdc8069480 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.211+0000 7fbcc2e05640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcbc036900 0x7fbcbc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.211+0000 7fbcc2e05640 1 -- 172.21.15.170:0/3185137754 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbdc8065040 con 0x55ebeebe1660 2024-04-26T12:30:37.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.211+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcbc036900 0x7fbcbc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.211+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeece1770 0x55ebeece3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.211+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeece40e0 con 0x55ebeece1770 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbdd6b5d640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeece1770 0x55ebeece3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcbc036900 0x7fbcbc038dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0000f60 tx=0x7fbdc00013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbdd6b5d640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeece1770 0x55ebeece3b60 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/3185137754 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeece1770 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeece0d30 con 0x55ebeece1770 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/3185137754 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeece1770 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeece6410 0x55ebeece8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.212+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeece8ef0 con 0x55ebeece6410 2024-04-26T12:30:37.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.213+0000 7fbdd635c640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeece6410 0x55ebeece8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.213+0000 7fbdd635c640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeece6410 0x55ebeece8800 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.213+0000 7fbdd635c640 1 -- 172.21.15.170:0/3185137754 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeece6410 2024-04-26T12:30:37.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.213+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeece53c0 con 0x55ebeece1770 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.214+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/3185137754 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeece1770 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.214+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ebeecea350 0x55ebeecec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.214+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeececf40 con 0x55ebeecea350 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.214+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ebeecea350 0x55ebeecec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.214+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ebeecea350 0x55ebeecec7e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.214+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/3185137754 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbdc0010590 con 0x55ebeecea350 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbddac16800 1 Processor -- start 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbddac16800 1 -- start start 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbddac16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeecfb3f0 0x55ebeecfb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbddac16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ebeead2e60 con 0x55ebeecfb3f0 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeecfb3f0 0x55ebeecfb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeecfb3f0 0x55ebeecfb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36628/0 (socket says 172.21.15.170:36628) 2024-04-26T12:30:37.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbdd635c640 1 -- 172.21.15.170:0/720531968 learned_addr learned my addr 172.21.15.170:0/720531968 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbdd635c640 1 -- 172.21.15.170:0/720531968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeecfbd50 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbdd635c640 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeecfb3f0 0x55ebeecfb810 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8008ac0 tx=0x7fbdc8054ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbcbbfff640 1 -- 172.21.15.170:0/720531968 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc8072400 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbcbbfff640 1 -- 172.21.15.170:0/720531968 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc80725a0 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbcbbfff640 1 -- 172.21.15.170:0/720531968 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80579e0 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.215+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebeecfc7c0 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.216+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebeecfccc0 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.216+0000 7fbcbbfff640 1 -- 172.21.15.170:0/720531968 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbdc8057b80 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.216+0000 7fbcbbfff640 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcb0036900 0x7fbcb0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.216+0000 7fbcbbfff640 1 -- 172.21.15.170:0/720531968 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbdc8083070 con 0x55ebeecfb3f0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.216+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcb0036900 0x7fbcb0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbddac16800 1 Processor -- start 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbddac16800 1 -- start start 2024-04-26T12:30:37.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcb0036900 0x7fbcb0038dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55ebeece49c0 tx=0x7fbdc0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbddac16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed089c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbddac16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ebeecd0f30 con 0x55ebeed085a0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed089c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36642/0 (socket says 172.21.15.170:36642) 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbdd635c640 1 -- 172.21.15.170:0/3265899208 learned_addr learned my addr 172.21.15.170:0/3265899208 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbdd635c640 1 -- 172.21.15.170:0/3265899208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeed08f90 con 0x55ebeed085a0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbdd635c640 1 --2- 172.21.15.170:0/3265899208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed089c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbdc807bfd0 tx=0x7fbdc8057fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d714dbded88e1892 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbcb9ffb640 1 -- 172.21.15.170:0/3265899208 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80a7070 con 0x55ebeed085a0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbcb9ffb640 1 -- 172.21.15.170:0/3265899208 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc807c480 con 0x55ebeed085a0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.217+0000 7fbcb9ffb640 1 -- 172.21.15.170:0/3265899208 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc807f120 con 0x55ebeed085a0 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 -- 172.21.15.170:0/3265899208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 msgr2=0x55ebeed089c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 --2- 172.21.15.170:0/3265899208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed089c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbdc807bfd0 tx=0x7fbdc8057fa0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 -- 172.21.15.170:0/3265899208 shutdown_connections 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 --2- 172.21.15.170:0/3265899208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed089c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 -- 172.21.15.170:0/3265899208 >> 172.21.15.170:0/3265899208 conn(0x55ebeed04870 msgr2=0x55ebeed028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 -- 172.21.15.170:0/3265899208 shutdown_connections 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 -- 172.21.15.170:0/3265899208 wait complete. 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 Processor -- start 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 -- start start 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed0f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.218+0000 7fbddac16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ebeed09660 con 0x55ebeed085a0 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed0f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbdd635c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed0f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36656/0 (socket says 172.21.15.170:36656) 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 learned_addr learned my addr 172.21.15.170:0/60358429 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeed0fe00 con 0x55ebeed085a0 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbdd635c640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed0f8c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbdc807c9c0 tx=0x7fbdc8001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbca7fff640 1 -- 172.21.15.170:0/60358429 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80b2020 con 0x55ebeed085a0 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbca7fff640 1 -- 172.21.15.170:0/60358429 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc807cc60 con 0x55ebeed085a0 2024-04-26T12:30:37.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebeed0fe00 con 0x55ebeed085a0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbca7fff640 1 -- 172.21.15.170:0/60358429 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc80a7030 con 0x55ebeed085a0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.219+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebeed0fe00 con 0x55ebeed085a0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.220+0000 7fbca7fff640 1 -- 172.21.15.170:0/60358429 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbdc80b5020 con 0x55ebeed085a0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.220+0000 7fbca7fff640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbca0036950 0x7fbca0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.220+0000 7fbca7fff640 1 -- 172.21.15.170:0/60358429 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbdc80a8070 con 0x55ebeed085a0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.220+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbca0036950 0x7fbca0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.220+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbca0036950 0x7fbca0038e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55ebeece5390 tx=0x7fbdc0022040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeed1b110 0x55ebeed1d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1dd20 con 0x55ebeed1b110 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbdd6b5d640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeed1b110 0x55ebeed1d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbdd6b5d640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeed1b110 0x55ebeed1d5d0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 20 realm 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1e130 con 0x55ebeed1b110 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.221+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1ea00 con 0x55ebeed1b110 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbddac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbddac16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeed1fb00 0x55ebeed21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed224b0 con 0x55ebeed1fb00 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbdd635c640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeed1fb00 0x55ebeed21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.222+0000 7fbdd635c640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeed1fb00 0x55ebeed21ef0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbddac16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbddac16800 20 searching for the correct realm 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ebeed24460 0x55ebeed26920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed26ff0 con 0x55ebeed24460 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ebeed24460 0x55ebeed26920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ebeed24460 0x55ebeed26920 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbdcdb5b640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbdc0003a40 0x7fbdc00393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.223+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed26ff0 con 0x7fbdc0003a40 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.224+0000 7fbdd6b5d640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbdc0003a40 0x7fbdc00393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.224+0000 7fbdd6b5d640 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbdc0003a40 0x7fbdc00393c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.224+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.224+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.224+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.224+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x7fbdc0003a40 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.225+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.226+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x7fbdc0003a40 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.227+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.228+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.229+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.229+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.229+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.229+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x7fbdc0003a40 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.229+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.229+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.230+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x7fbdc0003a40 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed24460 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1fb00 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x55ebeed1b110 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.231+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed1eda0 con 0x7fbdc0003a40 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed22d70 con 0x55ebeed1b110 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed22d70 con 0x55ebeed1b110 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed22d70 con 0x7fbdc0003a40 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 zone default found 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 4 Realm: () 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 zonegroup default 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.232+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed23610 con 0x55ebeed1fb00 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed23a00 con 0x55ebeed24460 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed29020 con 0x55ebeed24460 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 20 started sync module instance, tier type = 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.233+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed282f0 con 0x7fbdc0003a40 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.235+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.235+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471812450320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed282f0 con 0x7fbdc0003a40 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.235+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed29aa0 con 0x55ebeed1b110 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.236+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94471812450320] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.236+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.236+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471812454352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed282f0 con 0x55ebeed1b110 2024-04-26T12:30:37.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.236+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2a520 con 0x55ebeed24460 2024-04-26T12:30:37.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.237+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94471812454352] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.237+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.237+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471812447808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed28260 con 0x55ebeed24460 2024-04-26T12:30:37.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.237+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2b410 con 0x7fbdc0003a40 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.238+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94471812447808] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.238+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.238+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471812460384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2b830 con 0x7fbdc0003a40 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.238+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2c1f0 con 0x55ebeed1b110 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.239+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.239+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471812463936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2c610 con 0x55ebeed1b110 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.239+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2d070 con 0x55ebeed1fb00 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.239+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94471812460384] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.240+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.240+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471812461440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2d460 con 0x55ebeed1fb00 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.240+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2de60 con 0x55ebeed1fb00 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.240+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94471812463936] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.241+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94471812461440] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.241+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.241+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471812464992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2d970 con 0x55ebeed1fb00 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.241+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2e700 con 0x55ebeed1fb00 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94471812464992] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471812467536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2e700 con 0x55ebeed1fb00 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 20 add_watcher() i=0 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 20 add_watcher() i=1 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 20 add_watcher() i=2 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 20 add_watcher() i=3 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 20 add_watcher() i=4 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 20 add_watcher() i=5 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.242+0000 7fbddac16800 20 add_watcher() i=6 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.243+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94471812467536] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.243+0000 7fbddac16800 20 add_watcher() i=7 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.243+0000 7fbddac16800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.243+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed31b30 con 0x55ebeed1b110 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.243+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.243+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471812473888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed2eff0 con 0x55ebeed1b110 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.244+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94471812473888] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.245+0000 7fbc8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.245+0000 7fbddac16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.245+0000 7fbddac16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.245+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed31970 con 0x55ebeed1b110 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.246+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.246+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3ac60 con 0x55ebeed1fb00 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.248+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.248+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3ac60 con 0x55ebeed24460 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.249+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.249+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3b740 con 0x55ebeed1b110 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.250+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.250+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3a1f0 con 0x7fbdc0003a40 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.251+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.251+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3a1f0 con 0x55ebeed24460 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.252+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.252+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3c470 con 0x55ebeed1b110 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.253+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.253+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3a170 con 0x55ebeed1fb00 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.254+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.254+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3c920 con 0x7fbdc0003a40 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.255+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.255+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3c920 con 0x55ebeed24460 2024-04-26T12:30:37.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.256+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.256+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x7fbdc0003a40 2024-04-26T12:30:37.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.257+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.257+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x55ebeed1fb00 2024-04-26T12:30:37.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.258+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.258+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x7fbdc0003a40 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.259+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.259+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed39010 con 0x55ebeed1fb00 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.260+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.260+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed39010 con 0x55ebeed1b110 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.261+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.261+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed39010 con 0x55ebeed24460 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.262+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.262+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x7fbdc0003a40 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.263+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.263+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x55ebeed24460 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.264+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.264+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x55ebeed1b110 2024-04-26T12:30:37.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.265+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.265+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x55ebeed1b110 2024-04-26T12:30:37.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.266+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.266+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed391e0 con 0x55ebeed24460 2024-04-26T12:30:37.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.267+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.267+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x7fbdc0003a40 2024-04-26T12:30:37.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.268+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.268+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed24460 2024-04-26T12:30:37.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.269+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.269+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed24460 2024-04-26T12:30:37.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.270+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.270+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed24460 2024-04-26T12:30:37.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.271+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.271+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed24460 2024-04-26T12:30:37.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.272+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.272+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed1fb00 2024-04-26T12:30:37.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.273+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.273+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed24460 2024-04-26T12:30:37.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.274+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.274+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed1fb00 2024-04-26T12:30:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.276+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.276+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed24460 2024-04-26T12:30:37.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.277+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.277+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x55ebeed1fb00 2024-04-26T12:30:37.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.278+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.278+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed3d480 con 0x7fbdc0003a40 2024-04-26T12:30:37.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbc077fe640 20 reqs_thread_entry: start 2024-04-26T12:30:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbddac16800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbddac16800 20 Filter name: none 2024-04-26T12:30:37.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbc057fa640 20 reqs_thread_entry: start 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbddac16800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.279+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed68360 con 0x7fbdc0003a40 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed69e20 con 0x55ebeed1b110 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(95 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:37.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 get_obj_state: octx=0x7fbdd000ab10 obj=myfoo:four state=0x55ebeed6b108 s->prefetch_data=0 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:96 3.24s0 3:26a5a06f:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed6bf30 con 0x55ebeed1fb00 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(96 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 10 manifest: total_size = 4 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.2638023205811387747 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 get_obj_state: octx=0x7fbdd000ab10 obj=myfoo:four state=0x55ebeed6b108 s->prefetch_data=0 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 prepare_atomic_modification: state is not atomic. state=0x55ebeed6b108 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.280+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:97 4.34 4:2ee0f60e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed707e0 con 0x7fbdc0003a40 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.282+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(97 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 [stat,call,call] v30'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.282+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:98 3.24s0 3:26a5a06f:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed707e0 con 0x55ebeed1fb00 2024-04-26T12:30:37.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.283+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(98 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.283+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:99 4.34 4:2ee0f60e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x7fbdc0003a40 2024-04-26T12:30:37.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.284+0000 7fbc8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.284+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471812473888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x55ebeed1b110 2024-04-26T12:30:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.284+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(99 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 [stat,call,call] v30'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.284+0000 7fbcb9ffb640 20 handle_completion(): completion ok for obj=four 2024-04-26T12:30:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.285+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94471812473888] v30'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.285+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471812450320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x7fbdc0003a40 2024-04-26T12:30:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.286+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94471812450320] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.286+0000 7fbddac16800 20 remove_watcher() i=0 2024-04-26T12:30:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.286+0000 7fbddac16800 2 removed watcher, disabling cache 2024-04-26T12:30:37.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.286+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471812454352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x55ebeed1b110 2024-04-26T12:30:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.287+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94471812454352] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.287+0000 7fbddac16800 20 remove_watcher() i=1 2024-04-26T12:30:37.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.287+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471812447808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x55ebeed24460 2024-04-26T12:30:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.288+0000 7fbdcdb5b640 1 -- 172.21.15.170:0/60358429 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94471812447808] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc0036040 con 0x55ebeed24460 2024-04-26T12:30:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.288+0000 7fbddac16800 20 remove_watcher() i=2 2024-04-26T12:30:37.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.288+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471812460384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x7fbdc0003a40 2024-04-26T12:30:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.289+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94471812460384] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x7fbdc0003a40 2024-04-26T12:30:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.289+0000 7fbddac16800 20 remove_watcher() i=3 2024-04-26T12:30:37.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.289+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471812463936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x55ebeed1b110 2024-04-26T12:30:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.290+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94471812463936] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4a0 con 0x55ebeed1b110 2024-04-26T12:30:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.290+0000 7fbddac16800 20 remove_watcher() i=4 2024-04-26T12:30:37.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.290+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471812461440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed71270 con 0x55ebeed1fb00 2024-04-26T12:30:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.291+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94471812461440] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.291+0000 7fbddac16800 20 remove_watcher() i=5 2024-04-26T12:30:37.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.291+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471812464992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed6a040 con 0x55ebeed1fb00 2024-04-26T12:30:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.292+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94471812464992] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.292+0000 7fbddac16800 20 remove_watcher() i=6 2024-04-26T12:30:37.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.292+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471812467536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ebeed6a040 con 0x55ebeed1fb00 2024-04-26T12:30:37.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbdd635c640 1 -- 172.21.15.170:0/60358429 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94471812467536] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc806f020 con 0x55ebeed1fb00 2024-04-26T12:30:37.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 20 remove_watcher() i=7 2024-04-26T12:30:37.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeed1fb00 msgr2=0x55ebeed21ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeed1fb00 0x55ebeed21ef0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeed1b110 msgr2=0x55ebeed1d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeed1b110 0x55ebeed1d5d0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbdc0003a40 msgr2=0x7fbdc00393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbdc0003a40 0x7fbdc00393c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ebeed24460 msgr2=0x55ebeed26920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ebeed24460 0x55ebeed26920 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbca0036950 msgr2=0x7fbca0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbca0036950 0x7fbca0038e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55ebeece5390 tx=0x7fbdc0022040 comp rx=0 tx=0).stop 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 msgr2=0x55ebeed0f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 --2- 172.21.15.170:0/60358429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeed085a0 0x55ebeed0f8c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbdc807c9c0 tx=0x7fbdc8001da0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 reap_dead start 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/60358429 reap_dead start 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 shutdown_connections 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 >> 172.21.15.170:0/60358429 conn(0x55ebeed04870 msgr2=0x55ebeed01ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.293+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 shutdown_connections 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/60358429 wait complete. 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcb0036900 msgr2=0x7fbcb0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcb0036900 0x7fbcb0038dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55ebeece49c0 tx=0x7fbdc0006000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeecfb3f0 msgr2=0x55ebeecfb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeecfb3f0 0x55ebeecfb810 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8008ac0 tx=0x7fbdc8054ea0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 shutdown_connections 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcb0036900 0x7fbcb0038dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/720531968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeecfb3f0 0x55ebeecfb810 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 >> 172.21.15.170:0/720531968 conn(0x55ebeecef490 msgr2=0x55ebeecef890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 shutdown_connections 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/720531968 wait complete. 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeece6410 msgr2=0x55ebeece8800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ebeece6410 0x55ebeece8800 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeece1770 msgr2=0x55ebeece3b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ebeece1770 0x55ebeece3b60 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ebeecea350 msgr2=0x55ebeecec7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ebeecea350 0x55ebeecec7e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcbc036900 msgr2=0x7fbcbc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbcbc036900 0x7fbcbc038dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0000f60 tx=0x7fbdc00013f0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe1660 msgr2=0x55ebeecdc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 --2- 172.21.15.170:0/3185137754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ebeebe1660 0x55ebeecdc760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801eee0 tx=0x7fbdc8002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbdd6b5d640 1 -- 172.21.15.170:0/3185137754 reap_dead start 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 shutdown_connections 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 >> 172.21.15.170:0/3185137754 conn(0x55ebeebdba00 msgr2=0x55ebeeccf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 shutdown_connections 2024-04-26T12:30:37.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.294+0000 7fbddac16800 1 -- 172.21.15.170:0/3185137754 wait complete. 2024-04-26T12:30:37.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:30:37.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-26T12:30:37.304 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-26T12:30:37.346 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:37.346 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8655a91800 1 Processor -- start 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8655a91800 1 -- start start 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8655a91800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d41132e3e0 0x55d41132e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8655a91800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d4111dc0c0 con 0x55d41132f640 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8655a91800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55d4111c04d0 con 0x55d41132e3e0 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8653590640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d41132e3e0 0x55d41132e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8652d8f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55d41132f640 0x55d41132fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:56674/0 (socket says 172.21.15.170:56674) 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.346+0000 7f8652d8f640 1 -- 172.21.15.170:0/1498433029 learned_addr learned my addr 172.21.15.170:0/1498433029 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.347+0000 7f8653590640 1 -- 172.21.15.170:0/1498433029 >> v1:172.21.15.132:6789/0 conn(0x55d41132f640 legacy=0x55d41132fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.347+0000 7f865258e640 1 -- 172.21.15.170:0/1498433029 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435429485 0 0) 0x55d4111dc0c0 con 0x55d41132f640 2024-04-26T12:30:37.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.347+0000 7f8653590640 1 -- 172.21.15.170:0/1498433029 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4111edd40 con 0x55d41132e3e0 2024-04-26T12:30:37.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8653590640 1 --2- 172.21.15.170:0/1498433029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41132e800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f864400a600 tx=0x7f864401ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76efac2f069a26d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f865258e640 1 -- 172.21.15.170:0/1498433029 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864400a200 con 0x55d41132e3e0 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f865258e640 1 -- 172.21.15.170:0/1498433029 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f864400a3a0 con 0x55d41132e3e0 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f865258e640 1 -- 172.21.15.170:0/1498433029 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86440086e0 con 0x55d41132e3e0 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8655a91800 1 -- 172.21.15.170:0/1498433029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 msgr2=0x55d41132e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8655a91800 1 --2- 172.21.15.170:0/1498433029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41132e800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f864400a600 tx=0x7f864401ed70 comp rx=0 tx=0).stop 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8655a91800 1 -- 172.21.15.170:0/1498433029 shutdown_connections 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8655a91800 1 --2- 172.21.15.170:0/1498433029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41132e800 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8655a91800 1 -- 172.21.15.170:0/1498433029 >> 172.21.15.170:0/1498433029 conn(0x55d4113299e0 msgr2=0x55d41132be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8655a91800 1 -- 172.21.15.170:0/1498433029 shutdown_connections 2024-04-26T12:30:37.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.349+0000 7f8655a91800 1 -- 172.21.15.170:0/1498433029 wait complete. 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.361+0000 7f8655a91800 1 Processor -- start 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.361+0000 7f8655a91800 1 -- start start 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.361+0000 7f8655a91800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d411422bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.361+0000 7f8655a91800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d41127ab40 con 0x55d41132e3e0 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.361+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d411422bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.361+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d411422bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36670/0 (socket says 172.21.15.170:36670) 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.361+0000 7f8653590640 1 -- 172.21.15.170:0/807426614 learned_addr learned my addr 172.21.15.170:0/807426614 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.362+0000 7f8653590640 1 -- 172.21.15.170:0/807426614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4111ec590 con 0x55d41132e3e0 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.362+0000 7f8653590640 1 --2- 172.21.15.170:0/807426614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d411422bf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8644056040 tx=0x7f864404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9d312af59c0617 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.362+0000 7f854160a640 1 -- 172.21.15.170:0/807426614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864405d570 con 0x55d41132e3e0 2024-04-26T12:30:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.362+0000 7f854160a640 1 -- 172.21.15.170:0/807426614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8644062070 con 0x55d41132e3e0 2024-04-26T12:30:37.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.362+0000 7f854160a640 1 -- 172.21.15.170:0/807426614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864405d880 con 0x55d41132e3e0 2024-04-26T12:30:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 -- 172.21.15.170:0/807426614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 msgr2=0x55d411422bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 --2- 172.21.15.170:0/807426614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d411422bf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8644056040 tx=0x7f864404e000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 -- 172.21.15.170:0/807426614 shutdown_connections 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 --2- 172.21.15.170:0/807426614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d411422bf0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 -- 172.21.15.170:0/807426614 >> 172.21.15.170:0/807426614 conn(0x55d4113299e0 msgr2=0x55d41141a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 -- 172.21.15.170:0/807426614 shutdown_connections 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 -- 172.21.15.170:0/807426614 wait complete. 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 Processor -- start 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 -- start start 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41142a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8655a91800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4112a1d50 con 0x55d41132e3e0 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41142a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41142a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36672/0 (socket says 172.21.15.170:36672) 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.363+0000 7f8653590640 1 -- 172.21.15.170:0/2714980909 learned_addr learned my addr 172.21.15.170:0/2714980909 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.364+0000 7f8653590640 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4111e38f0 con 0x55d41132e3e0 2024-04-26T12:30:37.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.364+0000 7f8653590640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41142a3f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f864401da60 tx=0x7f8644002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.364+0000 7f853fe07640 1 -- 172.21.15.170:0/2714980909 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864405d780 con 0x55d41132e3e0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.364+0000 7f853fe07640 1 -- 172.21.15.170:0/2714980909 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f864406b070 con 0x55d41132e3e0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.364+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d41142a930 con 0x55d41132e3e0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.364+0000 7f853fe07640 1 -- 172.21.15.170:0/2714980909 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864406f420 con 0x55d41132e3e0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.364+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41142aeb0 con 0x55d41132e3e0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f853fe07640 1 -- 172.21.15.170:0/2714980909 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f864406f5e0 con 0x55d41132e3e0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f853fe07640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8538036900 0x7f8538038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f853fe07640 1 -- 172.21.15.170:0/2714980909 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f864404ce00 con 0x55d41132e3e0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f8652d8f640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8538036900 0x7f8538038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d41132f640 0x55d411431460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114319e0 con 0x55d41132f640 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f8653d91640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d41132f640 0x55d411431460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.365+0000 7f8652d8f640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8538036900 0x7f8538038dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8648000c00 tx=0x7f86480013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.366+0000 7f8653d91640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d41132f640 0x55d411431460 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.366+0000 7f8653d91640 1 -- 172.21.15.170:0/2714980909 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d41132f640 2024-04-26T12:30:37.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.366+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41142ea10 con 0x55d41132f640 2024-04-26T12:30:37.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.366+0000 7f8653d91640 1 -- 172.21.15.170:0/2714980909 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d41132f640 2024-04-26T12:30:37.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.366+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d411433cf0 0x55d4114360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.366+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114367b0 con 0x55d411433cf0 2024-04-26T12:30:37.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.366+0000 7f8653590640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d411433cf0 0x55d4114360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.367+0000 7f8653590640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d411433cf0 0x55d4114360e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.367+0000 7f8653590640 1 -- 172.21.15.170:0/2714980909 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8644054cf0 con 0x55d411433cf0 2024-04-26T12:30:37.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.367+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d411432be0 con 0x55d41132f640 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.367+0000 7f8653d91640 1 -- 172.21.15.170:0/2714980909 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d41132f640 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.367+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d411437bf0 0x55d411439fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.367+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41143a770 con 0x55d411437bf0 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.367+0000 7f8652d8f640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d411437bf0 0x55d411439fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.368+0000 7f8652d8f640 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d411437bf0 0x55d411439fe0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.368+0000 7f8652d8f640 1 -- 172.21.15.170:0/2714980909 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f864800f670 con 0x55d411437bf0 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.368+0000 7f8655a91800 1 Processor -- start 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.368+0000 7f8655a91800 1 -- start start 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.368+0000 7f8655a91800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411448bd0 0x55d411448ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.368+0000 7f8655a91800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d411220e60 con 0x55d411448bd0 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411448bd0 0x55d411448ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411448bd0 0x55d411448ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36674/0 (socket says 172.21.15.170:36674) 2024-04-26T12:30:37.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f8653590640 1 -- 172.21.15.170:0/4115455459 learned_addr learned my addr 172.21.15.170:0/4115455459 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f8653590640 1 -- 172.21.15.170:0/4115455459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d411449530 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f8653590640 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411448bd0 0x55d411448ff0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f864408c550 tx=0x7f8644067840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f853d602640 1 -- 172.21.15.170:0/4115455459 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8644066970 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f853d602640 1 -- 172.21.15.170:0/4115455459 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8644007a70 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d411449fa0 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f853d602640 1 -- 172.21.15.170:0/4115455459 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8644007d50 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.369+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41144a4a0 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f853d602640 1 -- 172.21.15.170:0/4115455459 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f86440783f0 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f853d602640 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f852c036950 0x7f852c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f853d602640 1 -- 172.21.15.170:0/4115455459 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8644082070 con 0x55d411448bd0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f8652d8f640 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f852c036950 0x7f852c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f8655a91800 1 Processor -- start 2024-04-26T12:30:37.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f8655a91800 1 -- start start 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f8652d8f640 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f852c036950 0x7f852c038e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55d411431e90 tx=0x7f8648006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.370+0000 7f8655a91800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d4114561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8655a91800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d4114232b0 con 0x55d411455d80 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d4114561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d4114561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36690/0 (socket says 172.21.15.170:36690) 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8653590640 1 -- 172.21.15.170:0/2264697761 learned_addr learned my addr 172.21.15.170:0/2264697761 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8653590640 1 -- 172.21.15.170:0/2264697761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d411456770 con 0x55d411455d80 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8653590640 1 --2- 172.21.15.170:0/2264697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d4114561a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f864406ffd0 tx=0x7f8644084930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b569fc19ad43e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8536ffd640 1 -- 172.21.15.170:0/2264697761 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8644096070 con 0x55d411455d80 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8536ffd640 1 -- 172.21.15.170:0/2264697761 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8644078810 con 0x55d411455d80 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.371+0000 7f8536ffd640 1 -- 172.21.15.170:0/2264697761 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864408ca30 con 0x55d411455d80 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 -- 172.21.15.170:0/2264697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 msgr2=0x55d4114561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 --2- 172.21.15.170:0/2264697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d4114561a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f864406ffd0 tx=0x7f8644084930 comp rx=0 tx=0).stop 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 -- 172.21.15.170:0/2264697761 shutdown_connections 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 --2- 172.21.15.170:0/2264697761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d4114561a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 -- 172.21.15.170:0/2264697761 >> 172.21.15.170:0/2264697761 conn(0x55d411452050 msgr2=0x55d4114500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 -- 172.21.15.170:0/2264697761 shutdown_connections 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 -- 172.21.15.170:0/2264697761 wait complete. 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 Processor -- start 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 -- start start 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d41145d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8655a91800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d411456dd0 con 0x55d411455d80 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d41145d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8653590640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d41145d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36698/0 (socket says 172.21.15.170:36698) 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.372+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 learned_addr learned my addr 172.21.15.170:0/1710043051 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.373+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d41145d5c0 con 0x55d411455d80 2024-04-26T12:30:37.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.373+0000 7f8653590640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d41145d080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8644056dd0 tx=0x7f8644069f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.373+0000 7f85357fa640 1 -- 172.21.15.170:0/1710043051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86440b4020 con 0x55d411455d80 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.373+0000 7f85357fa640 1 -- 172.21.15.170:0/1710043051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86440903e0 con 0x55d411455d80 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.373+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d41145d5c0 con 0x55d411455d80 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.373+0000 7f85357fa640 1 -- 172.21.15.170:0/1710043051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864407bbc0 con 0x55d411455d80 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.373+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d41145dac0 con 0x55d411455d80 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f85357fa640 1 -- 172.21.15.170:0/1710043051 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8644084b60 con 0x55d411455d80 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f85357fa640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f851c036950 0x7f851c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f85357fa640 1 -- 172.21.15.170:0/1710043051 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f86440a6ca0 con 0x55d411455d80 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f8652d8f640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f851c036950 0x7f851c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d411468810 0x55d41146acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41146b420 con 0x55d411468810 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.374+0000 7f8653d91640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d411468810 0x55d41146acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8652d8f640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f851c036950 0x7f851c038e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f864800ffd0 tx=0x7f8648023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8653d91640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d411468810 0x55d41146acd0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 realm 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41146b830 con 0x55d411468810 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c0d0 con 0x55d411468810 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.375+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d41146d1d0 0x55d41146f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41146fb40 con 0x55d41146d1d0 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8653590640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d41146d1d0 0x55d41146f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8653590640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d41146d1d0 0x55d41146f5c0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8655a91800 20 searching for the correct realm 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d411471b90 0x55d411474050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d411474720 con 0x55d411471b90 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.376+0000 7f8652d8f640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d411471b90 0x55d411474050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.377+0000 7f8652d8f640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d411471b90 0x55d411474050 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.377+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.377+0000 7f8652d8f640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f864802e910 0x7f864803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.377+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d411474720 con 0x7f864802e910 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.377+0000 7f8653d91640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f864802e910 0x7f864803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.377+0000 7f8653d91640 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f864802e910 0x7f864803a3c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.378+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x7f864802e910 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.379+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x7f864802e910 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.380+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.381+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.382+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x7f864802e910 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.383+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x7f864802e910 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411471b90 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.384+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d41146d1d0 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x55d411468810 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d41146c470 con 0x7f864802e910 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d411470490 con 0x55d411468810 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.385+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d411470490 con 0x55d411468810 2024-04-26T12:30:37.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d411470490 con 0x7f864802e910 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 zone default found 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 4 Realm: () 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 zonegroup default 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d411470880 con 0x55d41146d1d0 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d411476580 con 0x55d411471b90 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.386+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d411476920 con 0x55d411471b90 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.387+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.387+0000 7f8655a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.387+0000 7f8655a91800 20 started sync module instance, tier type = 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.387+0000 7f8655a91800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.387+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4114710e0 con 0x7f864802e910 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.388+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.388+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94369311315312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411475f20 con 0x7f864802e910 2024-04-26T12:30:37.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.388+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411477170 con 0x55d411468810 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.389+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94369311315312] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.389+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.389+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94369311317072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411477170 con 0x55d411468810 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.389+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411477b70 con 0x55d411471b90 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.390+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94369311317072] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.390+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.390+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94369311321280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4114770e0 con 0x55d411471b90 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.390+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411478a30 con 0x7f864802e910 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.391+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94369311321280] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.391+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.391+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94369311327616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411478e50 con 0x7f864802e910 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.391+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411479810 con 0x55d411468810 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.392+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94369311327616] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.392+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.392+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94369311329152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411479810 con 0x55d411468810 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.392+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147a1d0 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.393+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.393+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94369311333664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147aa20 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.393+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147b440 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.393+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94369311329152] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.394+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94369311333664] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.394+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.394+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94369311338288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147b830 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.394+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147c080 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94369311338288] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94369311340672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147c150 con 0x55d41146d1d0 2024-04-26T12:30:37.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 20 add_watcher() i=0 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 20 add_watcher() i=1 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 20 add_watcher() i=2 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 20 add_watcher() i=3 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 20 add_watcher() i=4 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 20 add_watcher() i=5 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.395+0000 7f8655a91800 20 add_watcher() i=6 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.396+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94369311340672] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.396+0000 7f8655a91800 20 add_watcher() i=7 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.396+0000 7f8655a91800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.396+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d41147f410 con 0x55d411468810 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.396+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.396+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94369311342096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147c6e0 con 0x55d411468810 2024-04-26T12:30:37.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.397+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94369311342096] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.397+0000 7f8509fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 5 note: GC not initialized 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8508fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 20 Filter name: none 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f84827fc640 20 reqs_thread_entry: start 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b29e0 con 0x7f864802e910 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.398+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b3310 con 0x55d411468810 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(63 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b3350 con 0x7f864802e910 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b4a30 con 0x55d411468810 2024-04-26T12:30:37.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 4.1 4:81b27428:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b4040 con 0x7f864802e910 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 4.1 4:80dfd411:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b95e0 con 0x7f864802e910 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 4.1b 4:d872ae43:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114bbf30 con 0x7f864802e910 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 4.3f 4:fcee3de0:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b95e0 con 0x7f864802e910 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.399+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 4.2f 4:f619a1d9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b95e0 con 0x55d411468810 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 4.1f 4:fb8cf372:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114c3770 con 0x55d411471b90 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 4.34 4:2ee0f60e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114c6470 con 0x7f864802e910 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 4.1d 4:b8cf1840:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114c8f10 con 0x55d411471b90 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 4.f 4:f359a0db:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114cb8e0 con 0x55d411468810 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 4.25 4:a46ce594:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114ce300 con 0x55d411471b90 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 4.11 4:89c8249d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d4114d0d50 con 0x55d41146d1d0 2024-04-26T12:30:37.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(73 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(71 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(70 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(74 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(66 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(76 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(68 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(75 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(69 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(67 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.1 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.400+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(72 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.401+0000 7f8509fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.401+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94369311342096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d4114b49a0 con 0x55d411468810 2024-04-26T12:30:37.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.402+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94369311342096] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.402+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94369311315312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147be10 con 0x7f864802e910 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.403+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94369311315312] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.403+0000 7f8655a91800 20 remove_watcher() i=0 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.403+0000 7f8655a91800 2 removed watcher, disabling cache 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.403+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94369311317072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147be10 con 0x55d411468810 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.404+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94369311317072] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.404+0000 7f8655a91800 20 remove_watcher() i=1 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.404+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94369311321280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411475c50 con 0x55d411471b90 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.405+0000 7f8652d8f640 1 -- 172.21.15.170:0/1710043051 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94369311321280] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8648037040 con 0x55d411471b90 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.405+0000 7f8655a91800 20 remove_watcher() i=2 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.405+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94369311327616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147be10 con 0x7f864802e910 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.406+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94369311327616] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x7f864802e910 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.406+0000 7f8655a91800 20 remove_watcher() i=3 2024-04-26T12:30:37.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.406+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94369311329152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411476cc0 con 0x55d411468810 2024-04-26T12:30:37.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.408+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94369311329152] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f864c00a4a0 con 0x55d411468810 2024-04-26T12:30:37.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.408+0000 7f8655a91800 20 remove_watcher() i=4 2024-04-26T12:30:37.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.408+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94369311333664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411478580 con 0x55d41146d1d0 2024-04-26T12:30:37.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.409+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94369311333664] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.409+0000 7f8655a91800 20 remove_watcher() i=5 2024-04-26T12:30:37.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.409+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94369311338288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d41147be10 con 0x55d41146d1d0 2024-04-26T12:30:37.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.409+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94369311338288] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.410+0000 7f8655a91800 20 remove_watcher() i=6 2024-04-26T12:30:37.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.410+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94369311340672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d411476cc0 con 0x55d41146d1d0 2024-04-26T12:30:37.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.410+0000 7f8653590640 1 -- 172.21.15.170:0/1710043051 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94369311340672] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f86440b6020 con 0x55d41146d1d0 2024-04-26T12:30:37.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.410+0000 7f8655a91800 20 remove_watcher() i=7 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d41146d1d0 msgr2=0x55d41146f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d41146d1d0 0x55d41146f5c0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d411468810 msgr2=0x55d41146acd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d411468810 0x55d41146acd0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f864802e910 msgr2=0x7f864803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f864802e910 0x7f864803a3c0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d411471b90 msgr2=0x55d411474050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d411471b90 0x55d411474050 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f851c036950 msgr2=0x7f851c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f851c036950 0x7f851c038e10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f864800ffd0 tx=0x7f8648023040 comp rx=0 tx=0).stop 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 msgr2=0x55d41145d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/1710043051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411455d80 0x55d41145d080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8644056dd0 tx=0x7f8644069f60 comp rx=0 tx=0).stop 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 reap_dead start 2024-04-26T12:30:37.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8653d91640 1 -- 172.21.15.170:0/1710043051 reap_dead start 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 shutdown_connections 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 >> 172.21.15.170:0/1710043051 conn(0x55d411452050 msgr2=0x55d41144f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 shutdown_connections 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/1710043051 wait complete. 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f852c036950 msgr2=0x7f852c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f852c036950 0x7f852c038e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55d411431e90 tx=0x7f8648006000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411448bd0 msgr2=0x55d411448ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411448bd0 0x55d411448ff0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f864408c550 tx=0x7f8644067840 comp rx=0 tx=0).stop 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 shutdown_connections 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f852c036950 0x7f852c038e10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 --2- 172.21.15.170:0/4115455459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d411448bd0 0x55d411448ff0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 >> 172.21.15.170:0/4115455459 conn(0x55d41143cc70 msgr2=0x55d41143d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 shutdown_connections 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.411+0000 7f8655a91800 1 -- 172.21.15.170:0/4115455459 wait complete. 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d411433cf0 msgr2=0x55d4114360e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d411433cf0 0x55d4114360e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d41132f640 msgr2=0x55d411431460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d41132f640 0x55d411431460 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d411437bf0 msgr2=0x55d411439fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d411437bf0 0x55d411439fe0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8538036900 msgr2=0x7f8538038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8538036900 0x7f8538038dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8648000c00 tx=0x7f86480013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 msgr2=0x55d41142a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 --2- 172.21.15.170:0/2714980909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d41132e3e0 0x55d41142a3f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f864401da60 tx=0x7f8644002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8653d91640 1 -- 172.21.15.170:0/2714980909 reap_dead start 2024-04-26T12:30:37.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 shutdown_connections 2024-04-26T12:30:37.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 >> 172.21.15.170:0/2714980909 conn(0x55d4113299e0 msgr2=0x55d41141d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 shutdown_connections 2024-04-26T12:30:37.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.412+0000 7f8655a91800 1 -- 172.21.15.170:0/2714980909 wait complete. 2024-04-26T12:30:37.429 INFO:teuthology.orchestra.run.smithi170.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"533c183d-6c44-41ed-a056-8506aff12524","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","marker":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-26T12:30:36.858731Z","creation_time":"2024-04-26T12:30:34.022086Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-26T12:30:37.430 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:30:36.858731Z', 'creation_time': '2024-04-26T12:30:34.022086Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:30:37.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-26T12:30:37.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-26T12:30:37.430 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-26T12:30:37.511 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:37.511 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:37.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55aa346800 1 Processor -- start 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55aa346800 1 -- start start 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55aa346800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561429fc1db0 0x56142a056470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55aa346800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561429efa0c0 con 0x561429fc30f0 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55aa346800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x561429ede4d0 con 0x561429fc1db0 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55a7644640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561429fc1db0 0x56142a056470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55a7644640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561429fc1db0 0x56142a056470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36702/0 (socket says 172.21.15.170:36702) 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55a7644640 1 -- 172.21.15.170:0/2056475485 learned_addr learned my addr 172.21.15.170:0/2056475485 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55a7644640 1 -- 172.21.15.170:0/2056475485 >> v1:172.21.15.132:6789/0 conn(0x561429fc30f0 legacy=0x561429fc16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55a7644640 1 -- 172.21.15.170:0/2056475485 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561429f0bd40 con 0x561429fc1db0 2024-04-26T12:30:37.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.511+0000 7f55a6e43640 1 -- 172.21.15.170:0/2056475485 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447425589 0 0) 0x561429efa0c0 con 0x561429fc30f0 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.513+0000 7f55a7644640 1 --2- 172.21.15.170:0/2056475485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a056470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f559800a520 tx=0x7f559801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697151587763817c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.513+0000 7f55a6e43640 1 -- 172.21.15.170:0/2056475485 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5598057070 con 0x561429fc1db0 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.513+0000 7f55a6e43640 1 -- 172.21.15.170:0/2056475485 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598052570 con 0x561429fc1db0 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.513+0000 7f55a6e43640 1 -- 172.21.15.170:0/2056475485 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559804ae60 con 0x561429fc1db0 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.514+0000 7f55aa346800 1 -- 172.21.15.170:0/2056475485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 msgr2=0x56142a056470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.514+0000 7f55aa346800 1 --2- 172.21.15.170:0/2056475485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a056470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f559800a520 tx=0x7f559801d010 comp rx=0 tx=0).stop 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.514+0000 7f55aa346800 1 -- 172.21.15.170:0/2056475485 shutdown_connections 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.514+0000 7f55aa346800 1 --2- 172.21.15.170:0/2056475485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a056470 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.514+0000 7f55aa346800 1 -- 172.21.15.170:0/2056475485 >> 172.21.15.170:0/2056475485 conn(0x56142a048b70 msgr2=0x56142a04af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.514+0000 7f55aa346800 1 -- 172.21.15.170:0/2056475485 shutdown_connections 2024-04-26T12:30:37.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.514+0000 7f55aa346800 1 -- 172.21.15.170:0/2056475485 wait complete. 2024-04-26T12:30:37.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55aa346800 1 Processor -- start 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55aa346800 1 -- start start 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55aa346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55aa346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561429f98b30 con 0x561429fc1db0 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a140ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36714/0 (socket says 172.21.15.170:36714) 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55a7e45640 1 -- 172.21.15.170:0/4071586669 learned_addr learned my addr 172.21.15.170:0/4071586669 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55a7e45640 1 -- 172.21.15.170:0/4071586669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561429f0a590 con 0x561429fc1db0 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.526+0000 7f55a7e45640 1 --2- 172.21.15.170:0/4071586669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a140ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f559c001d50 tx=0x7f559c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d648c965b01cd5c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f5495e0b640 1 -- 172.21.15.170:0/4071586669 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c00f400 con 0x561429fc1db0 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f5495e0b640 1 -- 172.21.15.170:0/4071586669 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c00f5c0 con 0x561429fc1db0 2024-04-26T12:30:37.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f5495e0b640 1 -- 172.21.15.170:0/4071586669 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c00f7f0 con 0x561429fc1db0 2024-04-26T12:30:37.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f55aa346800 1 -- 172.21.15.170:0/4071586669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 msgr2=0x56142a140ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f55aa346800 1 --2- 172.21.15.170:0/4071586669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a140ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f559c001d50 tx=0x7f559c00b5b0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f55aa346800 1 -- 172.21.15.170:0/4071586669 shutdown_connections 2024-04-26T12:30:37.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f55aa346800 1 --2- 172.21.15.170:0/4071586669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a140ab0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f55aa346800 1 -- 172.21.15.170:0/4071586669 >> 172.21.15.170:0/4071586669 conn(0x56142a048b70 msgr2=0x56142a13c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f55aa346800 1 -- 172.21.15.170:0/4071586669 shutdown_connections 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.527+0000 7f55aa346800 1 -- 172.21.15.170:0/4071586669 wait complete. 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55aa346800 1 Processor -- start 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55aa346800 1 -- start start 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55aa346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55aa346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56142a058cc0 con 0x561429fc1db0 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a1484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36730/0 (socket says 172.21.15.170:36730) 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55a7e45640 1 -- 172.21.15.170:0/3404856478 learned_addr learned my addr 172.21.15.170:0/3404856478 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.528+0000 7f55a7e45640 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561429f018f0 con 0x561429fc1db0 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.529+0000 7f55a7e45640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a1484a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f559c002000 tx=0x7f559c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.529+0000 7f548ffff640 1 -- 172.21.15.170:0/3404856478 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c0197b0 con 0x561429fc1db0 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.529+0000 7f548ffff640 1 -- 172.21.15.170:0/3404856478 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c019950 con 0x561429fc1db0 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.529+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56142a1489e0 con 0x561429fc1db0 2024-04-26T12:30:37.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.529+0000 7f548ffff640 1 -- 172.21.15.170:0/3404856478 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c019c30 con 0x561429fc1db0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.529+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56142a148f00 con 0x561429fc1db0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.529+0000 7f548ffff640 1 -- 172.21.15.170:0/3404856478 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f559c00e070 con 0x561429fc1db0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f548ffff640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5490036950 0x7f5490038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f548ffff640 1 -- 172.21.15.170:0/3404856478 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f559c020030 con 0x561429fc1db0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f55a7644640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5490036950 0x7f5490038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561429fc30f0 0x56142a14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a14fa50 con 0x561429fc30f0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f55a8646640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561429fc30f0 0x56142a14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f55a7644640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5490036950 0x7f5490038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f559800a520 tx=0x7f559804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f55a8646640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561429fc30f0 0x56142a14f510 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.530+0000 7f55a8646640 1 -- 172.21.15.170:0/3404856478 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x561429fc30f0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.531+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a14ca90 con 0x561429fc30f0 2024-04-26T12:30:37.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.531+0000 7f55a8646640 1 -- 172.21.15.170:0/3404856478 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55a000a4a0 con 0x561429fc30f0 2024-04-26T12:30:37.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.531+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a151d50 0x56142a154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.531+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a154830 con 0x56142a151d50 2024-04-26T12:30:37.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.531+0000 7f55a7e45640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a151d50 0x56142a154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55a7e45640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a151d50 0x56142a154140 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55a7e45640 1 -- 172.21.15.170:0/3404856478 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f559c015020 con 0x56142a151d50 2024-04-26T12:30:37.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a150d00 con 0x561429fc30f0 2024-04-26T12:30:37.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55a8646640 1 -- 172.21.15.170:0/3404856478 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55a000a4a0 con 0x561429fc30f0 2024-04-26T12:30:37.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56142a155ce0 0x56142a158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a158890 con 0x56142a155ce0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55a7644640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56142a155ce0 0x56142a158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.532+0000 7f55a7644640 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56142a155ce0 0x56142a158130 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55a7644640 1 -- 172.21.15.170:0/3404856478 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f559805a040 con 0x56142a155ce0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55aa346800 1 Processor -- start 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55aa346800 1 -- start start 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55aa346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a166cd0 0x56142a1670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55aa346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561429f3ee60 con 0x56142a166cd0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a166cd0 0x56142a1670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a166cd0 0x56142a1670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36742/0 (socket says 172.21.15.170:36742) 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.533+0000 7f55a7e45640 1 -- 172.21.15.170:0/1236575680 learned_addr learned my addr 172.21.15.170:0/1236575680 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.534+0000 7f55a7e45640 1 -- 172.21.15.170:0/1236575680 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56142a167630 con 0x56142a166cd0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.534+0000 7f55a7e45640 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a166cd0 0x56142a1670f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f559c04c010 tx=0x7f559c025f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.534+0000 7f548d7fa640 1 -- 172.21.15.170:0/1236575680 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c03d070 con 0x56142a166cd0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.534+0000 7f548d7fa640 1 -- 172.21.15.170:0/1236575680 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c00a1d0 con 0x56142a166cd0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.534+0000 7f548d7fa640 1 -- 172.21.15.170:0/1236575680 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c00a4b0 con 0x56142a166cd0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.534+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56142a1680a0 con 0x56142a166cd0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.534+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56142a1685a0 con 0x56142a166cd0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f548d7fa640 1 -- 172.21.15.170:0/1236575680 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f559c037070 con 0x56142a166cd0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f548d7fa640 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5480036950 0x7f5480038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f548d7fa640 1 -- 172.21.15.170:0/1236575680 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f559c01b040 con 0x56142a166cd0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f55a7644640 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5480036950 0x7f5480038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f55aa346800 1 Processor -- start 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f55a7644640 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5480036950 0x7f5480038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x56142a14ce50 tx=0x7f5598005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f55aa346800 1 -- start start 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f55aa346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a1741f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.535+0000 7f55aa346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56142a141230 con 0x56142a173dd0 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a1741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a1741f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36756/0 (socket says 172.21.15.170:36756) 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f55a7e45640 1 -- 172.21.15.170:0/1178730346 learned_addr learned my addr 172.21.15.170:0/1178730346 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f55a7e45640 1 -- 172.21.15.170:0/1178730346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56142a1747c0 con 0x56142a173dd0 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f55a7e45640 1 --2- 172.21.15.170:0/1178730346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a1741f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f559c04c4a0 tx=0x7f559c049c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8177e449c7a6ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f5486ffd640 1 -- 172.21.15.170:0/1178730346 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c016a80 con 0x56142a173dd0 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f5486ffd640 1 -- 172.21.15.170:0/1178730346 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c025430 con 0x56142a173dd0 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.536+0000 7f5486ffd640 1 -- 172.21.15.170:0/1178730346 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c0179f0 con 0x56142a173dd0 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 -- 172.21.15.170:0/1178730346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 msgr2=0x56142a1741f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 --2- 172.21.15.170:0/1178730346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a1741f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f559c04c4a0 tx=0x7f559c049c60 comp rx=0 tx=0).stop 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 -- 172.21.15.170:0/1178730346 shutdown_connections 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 --2- 172.21.15.170:0/1178730346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a1741f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 -- 172.21.15.170:0/1178730346 >> 172.21.15.170:0/1178730346 conn(0x56142a1700a0 msgr2=0x56142a16e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 -- 172.21.15.170:0/1178730346 shutdown_connections 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 -- 172.21.15.170:0/1178730346 wait complete. 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 Processor -- start 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 -- start start 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a17b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55aa346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56142a174e90 con 0x56142a173dd0 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a17b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55a7e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a17b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36772/0 (socket says 172.21.15.170:36772) 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.537+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 learned_addr learned my addr 172.21.15.170:0/3299207399 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.538+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56142a17b660 con 0x56142a173dd0 2024-04-26T12:30:37.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.538+0000 7f55a7e45640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a17b120 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f559c04c4a0 tx=0x7f559c030f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.538+0000 7f54857fa640 1 -- 172.21.15.170:0/3299207399 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c06e020 con 0x56142a173dd0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.538+0000 7f54857fa640 1 -- 172.21.15.170:0/3299207399 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c023c10 con 0x56142a173dd0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.538+0000 7f54857fa640 1 -- 172.21.15.170:0/3299207399 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f559c00a890 con 0x56142a173dd0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.538+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56142a17b660 con 0x56142a173dd0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.538+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56142a17b660 con 0x56142a173dd0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f54857fa640 1 -- 172.21.15.170:0/3299207399 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f559c071020 con 0x56142a173dd0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f54857fa640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5470036950 0x7f5470038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f54857fa640 1 -- 172.21.15.170:0/3299207399 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f559c064050 con 0x56142a173dd0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f55a7644640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5470036950 0x7f5470038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56142a1868c0 0x56142a188d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a1894d0 con 0x56142a1868c0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f55a8646640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56142a1868c0 0x56142a188d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f55a7644640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5470036950 0x7f5470038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55980058d0 tx=0x7f559804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.539+0000 7f55a8646640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56142a1868c0 0x56142a188d80 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 realm 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a1898e0 con 0x56142a1868c0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a1b0 con 0x56142a1868c0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a18b040 0x56142a18d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.540+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18db90 con 0x56142a18b040 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.541+0000 7f55a7e45640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a18b040 0x56142a18d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.541+0000 7f55a7e45640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a18b040 0x56142a18d430 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.541+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.541+0000 7f55aa346800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.541+0000 7f55aa346800 20 searching for the correct realm 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.541+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56142a18fc40 0x56142a192100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.541+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a1927d0 con 0x56142a18fc40 2024-04-26T12:30:37.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.542+0000 7f55a7644640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56142a18fc40 0x56142a192100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.542+0000 7f55a7644640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56142a18fc40 0x56142a192100 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.542+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.542+0000 7f55a7644640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5598082040 0x7f559805d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.542+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a1927d0 con 0x7f5598082040 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.542+0000 7f55a8646640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5598082040 0x7f559805d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.543+0000 7f55a8646640 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5598082040 0x7f559805d440 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.543+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.543+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.543+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.543+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.543+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.543+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.544+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.545+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.546+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.547+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.548+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.549+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:37.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.550+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18e540 con 0x56142a1868c0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18e540 con 0x56142a1868c0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18e510 con 0x7f5598082040 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:37.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 zone default found 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 4 Realm: () 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 zonegroup default 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.551+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18e930 con 0x56142a18b040 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a194630 con 0x56142a18fc40 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a18e540 con 0x56142a18fc40 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 20 started sync module instance, tier type = 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.552+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a193ad0 con 0x7f5598082040 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.553+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.553+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644605632496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a193ad0 con 0x7f5598082040 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.553+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a195030 con 0x56142a1868c0 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.554+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644605632496] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.555+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.555+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644605635392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a193ad0 con 0x56142a1868c0 2024-04-26T12:30:37.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.555+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a195aa0 con 0x56142a18fc40 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.556+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644605635392] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.556+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.556+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644605629984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a193a40 con 0x56142a18fc40 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.556+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a196990 con 0x7f5598082040 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.557+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.557+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644605629984] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.557+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644605642432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a197110 con 0x7f5598082040 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.557+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a195ee0 con 0x56142a1868c0 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.558+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.558+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644605646592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a195ee0 con 0x56142a1868c0 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.558+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a198630 con 0x56142a18b040 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.558+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644605642432] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.559+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644605646592] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.560+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.560+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644605647648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a198140 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.560+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a198f00 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.560+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644605647648] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.561+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.561+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644605643616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a199750 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.561+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a19a000 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644605643616] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644605653664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a19a1e0 con 0x56142a18b040 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=0 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=1 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=2 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=3 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=4 2024-04-26T12:30:37.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=5 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=6 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644605653664] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 20 add_watcher() i=7 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.562+0000 7f55aa346800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.563+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56142a19d5b0 con 0x56142a1868c0 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.563+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.563+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644605657296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a19a9a0 con 0x56142a1868c0 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644605657296] v30'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f545dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f55aa346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f55aa346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f55aa346800 5 note: GC not initialized 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f545cfe1640 20 reqs_thread_entry: start 2024-04-26T12:30:37.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f55aa346800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.564+0000 7f55aa346800 20 Filter name: none 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.565+0000 7f53d67fc640 20 reqs_thread_entry: start 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.565+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a1cffc0 con 0x56142a18b040 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.565+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.565+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a198f00 con 0x56142a18b040 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.565+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.566+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a198f00 con 0x56142a18fc40 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.566+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.566+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a198f00 con 0x56142a18b040 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.566+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.566+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a198f00 con 0x56142a1868c0 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.566+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.566+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.567+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.567+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.567+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.567+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.567+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.567+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f55a000a4a0 con 0x7f5598082040 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.568+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.569+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.569+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.569+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'18 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.569+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.569+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f55a000a4a0 con 0x56142a1868c0 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.569+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.570+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.570+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.570+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'15 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f55a004d110 con 0x56142a1868c0 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.570+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.570+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.570+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.570+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.571+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.571+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f55a004d110 con 0x56142a1868c0 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.571+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.571+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f55a004d110 con 0x7f5598082040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.571+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.571+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f55a004d110 con 0x7f5598082040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.571+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.572+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f55a004d110 con 0x56142a1868c0 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.572+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.572+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.572+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.572+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f55a004d110 con 0x7f5598082040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.572+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18fc40 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.573+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a1868c0 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.574+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f55a004d110 con 0x56142a1868c0 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.574+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x7f5598082040 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.574+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f55a004d110 con 0x7f5598082040 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.574+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56142a18a550 con 0x56142a18b040 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.574+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.586 INFO:teuthology.orchestra.run.smithi170.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-26T12:30:37.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.576+0000 7f545dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.576+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644605657296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a1cec80 con 0x56142a1868c0 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.577+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94644605657296] v30'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55a004d110 con 0x56142a1868c0 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.577+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644605632496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a1ce490 con 0x7f5598082040 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.578+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94644605632496] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a004d110 con 0x7f5598082040 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.578+0000 7f55aa346800 20 remove_watcher() i=0 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.578+0000 7f55aa346800 2 removed watcher, disabling cache 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.578+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644605635392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a1ce490 con 0x56142a1868c0 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.579+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94644605635392] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a004d110 con 0x56142a1868c0 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.579+0000 7f55aa346800 20 remove_watcher() i=1 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.579+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644605629984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a1ce490 con 0x56142a18fc40 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.580+0000 7f55a7644640 1 -- 172.21.15.170:0/3299207399 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94644605629984] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559807f070 con 0x56142a18fc40 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.580+0000 7f55aa346800 20 remove_watcher() i=2 2024-04-26T12:30:37.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.580+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644605642432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a194b40 con 0x7f5598082040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.581+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94644605642432] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a004d110 con 0x7f5598082040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.581+0000 7f55aa346800 20 remove_watcher() i=3 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.581+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644605646592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a193620 con 0x56142a1868c0 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.582+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94644605646592] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a004d110 con 0x56142a1868c0 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.582+0000 7f55aa346800 20 remove_watcher() i=4 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.582+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644605647648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a1966c0 con 0x56142a18b040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.584+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94644605647648] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.584+0000 7f55aa346800 20 remove_watcher() i=5 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.584+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644605643616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a194b40 con 0x56142a18b040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.584+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94644605643616] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.584+0000 7f55aa346800 20 remove_watcher() i=6 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.584+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644605653664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56142a193620 con 0x56142a18b040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.585+0000 7f55a7e45640 1 -- 172.21.15.170:0/3299207399 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94644605653664] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f559c015020 con 0x56142a18b040 2024-04-26T12:30:37.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.585+0000 7f55aa346800 20 remove_watcher() i=7 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a18b040 msgr2=0x56142a18d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a18b040 0x56142a18d430 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56142a1868c0 msgr2=0x56142a188d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x56142a1868c0 0x56142a188d80 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5598082040 msgr2=0x7f559805d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5598082040 0x7f559805d440 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56142a18fc40 msgr2=0x56142a192100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x56142a18fc40 0x56142a192100 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5470036950 msgr2=0x7f5470038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5470036950 0x7f5470038e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f55980058d0 tx=0x7f559804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 msgr2=0x56142a17b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55a8646640 1 -- 172.21.15.170:0/3299207399 reap_dead start 2024-04-26T12:30:37.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a17b120 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f559c04c4a0 tx=0x7f559c030f60 comp rx=0 tx=0).stop 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 shutdown_connections 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/3299207399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a173dd0 0x56142a17b120 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 >> 172.21.15.170:0/3299207399 conn(0x56142a1700a0 msgr2=0x56142a16d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 shutdown_connections 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/3299207399 wait complete. 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5480036950 msgr2=0x7f5480038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5480036950 0x7f5480038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x56142a14ce50 tx=0x7f5598005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a166cd0 msgr2=0x56142a1670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a166cd0 0x56142a1670f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f559c04c010 tx=0x7f559c025f20 comp rx=0 tx=0).stop 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 shutdown_connections 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5480036950 0x7f5480038e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 --2- 172.21.15.170:0/1236575680 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56142a166cd0 0x56142a1670f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 >> 172.21.15.170:0/1236575680 conn(0x56142a15ad70 msgr2=0x56142a15b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 shutdown_connections 2024-04-26T12:30:37.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.586+0000 7f55aa346800 1 -- 172.21.15.170:0/1236575680 wait complete. 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a151d50 msgr2=0x56142a154140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x56142a151d50 0x56142a154140 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561429fc30f0 msgr2=0x56142a14f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561429fc30f0 0x56142a14f510 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56142a155ce0 msgr2=0x56142a158130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x56142a155ce0 0x56142a158130 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5490036950 msgr2=0x7f5490038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5490036950 0x7f5490038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f559800a520 tx=0x7f559804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 msgr2=0x56142a1484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 --2- 172.21.15.170:0/3404856478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561429fc1db0 0x56142a1484a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f559c002000 tx=0x7f559c000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55a8646640 1 -- 172.21.15.170:0/3404856478 reap_dead start 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 shutdown_connections 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 >> 172.21.15.170:0/3404856478 conn(0x56142a048b70 msgr2=0x56142a13f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 shutdown_connections 2024-04-26T12:30:37.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.587+0000 7f55aa346800 1 -- 172.21.15.170:0/3404856478 wait complete. 2024-04-26T12:30:37.597 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-26T12:30:37.598 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-26T12:30:37.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-26T12:30:37.598 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-26T12:30:37.680 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:37.681 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:37.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.680+0000 7f3ee8298800 1 Processor -- start 2024-04-26T12:30:37.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.680+0000 7f3ee8298800 1 -- start start 2024-04-26T12:30:37.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.680+0000 7f3ee8298800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5604c695b8d0 0x5604c695dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.680+0000 7f3ee8298800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604c68050c0 con 0x5604c6957920 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.680+0000 7f3ee8298800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5604c67e94d0 con 0x5604c695b8d0 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.681+0000 7f3ee5596640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5604c695b8d0 0x5604c695dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.681+0000 7f3ee5d97640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5604c6957920 0x5604c6957d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:56696/0 (socket says 172.21.15.170:56696) 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.681+0000 7f3ee5d97640 1 -- 172.21.15.170:0/2857684198 learned_addr learned my addr 172.21.15.170:0/2857684198 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.681+0000 7f3ee5596640 1 -- 172.21.15.170:0/2857684198 >> v1:172.21.15.132:6789/0 conn(0x5604c6957920 legacy=0x5604c6957d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.681+0000 7f3ee4d95640 1 -- 172.21.15.170:0/2857684198 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771938786 0 0) 0x5604c68050c0 con 0x5604c6957920 2024-04-26T12:30:37.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.681+0000 7f3ee5596640 1 -- 172.21.15.170:0/2857684198 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c6816d40 con 0x5604c695b8d0 2024-04-26T12:30:37.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.683+0000 7f3ee5596640 1 --2- 172.21.15.170:0/2857684198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c695b8d0 0x5604c695dcc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00a470 tx=0x7f3edc01cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fca16cb9a22715 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.683+0000 7f3ee4d95640 1 -- 172.21.15.170:0/2857684198 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc057070 con 0x5604c695b8d0 2024-04-26T12:30:37.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.683+0000 7f3ee4d95640 1 -- 172.21.15.170:0/2857684198 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc052570 con 0x5604c695b8d0 2024-04-26T12:30:37.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.683+0000 7f3ee4d95640 1 -- 172.21.15.170:0/2857684198 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3edc052870 con 0x5604c695b8d0 2024-04-26T12:30:37.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.684+0000 7f3ee8298800 1 -- 172.21.15.170:0/2857684198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c695b8d0 msgr2=0x5604c695dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.684+0000 7f3ee8298800 1 --2- 172.21.15.170:0/2857684198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c695b8d0 0x5604c695dcc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00a470 tx=0x7f3edc01cf20 comp rx=0 tx=0).stop 2024-04-26T12:30:37.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.684+0000 7f3ee8298800 1 -- 172.21.15.170:0/2857684198 shutdown_connections 2024-04-26T12:30:37.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.684+0000 7f3ee8298800 1 --2- 172.21.15.170:0/2857684198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c695b8d0 0x5604c695dcc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.684+0000 7f3ee8298800 1 -- 172.21.15.170:0/2857684198 >> 172.21.15.170:0/2857684198 conn(0x5604c6952160 msgr2=0x5604c6954580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.684+0000 7f3ee8298800 1 -- 172.21.15.170:0/2857684198 shutdown_connections 2024-04-26T12:30:37.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.684+0000 7f3ee8298800 1 -- 172.21.15.170:0/2857684198 wait complete. 2024-04-26T12:30:37.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.695+0000 7f3ee8298800 1 Processor -- start 2024-04-26T12:30:37.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.695+0000 7f3ee8298800 1 -- start start 2024-04-26T12:30:37.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3ee8298800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6957020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3ee8298800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5604c68a3b40 con 0x5604c6957920 2024-04-26T12:30:37.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6957020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6957020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36776/0 (socket says 172.21.15.170:36776) 2024-04-26T12:30:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3ee5d97640 1 -- 172.21.15.170:0/4068685150 learned_addr learned my addr 172.21.15.170:0/4068685150 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3ee5d97640 1 -- 172.21.15.170:0/4068685150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c6815590 con 0x5604c6957920 2024-04-26T12:30:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/4068685150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6957020 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800b240 tx=0x7f3ed800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2def7c7053e83c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3dd3e07640 1 -- 172.21.15.170:0/4068685150 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed8008070 con 0x5604c6957920 2024-04-26T12:30:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3dd3e07640 1 -- 172.21.15.170:0/4068685150 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed800d500 con 0x5604c6957920 2024-04-26T12:30:37.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.696+0000 7f3dd3e07640 1 -- 172.21.15.170:0/4068685150 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed800d860 con 0x5604c6957920 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 -- 172.21.15.170:0/4068685150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 msgr2=0x5604c6957020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 --2- 172.21.15.170:0/4068685150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6957020 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800b240 tx=0x7f3ed800b700 comp rx=0 tx=0).stop 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 -- 172.21.15.170:0/4068685150 shutdown_connections 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 --2- 172.21.15.170:0/4068685150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6957020 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 -- 172.21.15.170:0/4068685150 >> 172.21.15.170:0/4068685150 conn(0x5604c6952160 msgr2=0x5604c6a43cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 -- 172.21.15.170:0/4068685150 shutdown_connections 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 -- 172.21.15.170:0/4068685150 wait complete. 2024-04-26T12:30:37.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.697+0000 7f3ee8298800 1 Processor -- start 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee8298800 1 -- start start 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee8298800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6a50ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee8298800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5604c695e500 con 0x5604c6957920 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6a50ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6a50ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36780/0 (socket says 172.21.15.170:36780) 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee5d97640 1 -- 172.21.15.170:0/177883006 learned_addr learned my addr 172.21.15.170:0/177883006 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee5d97640 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c680c8f0 con 0x5604c6957920 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6a50ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x5604c6956650 tx=0x7f3ed8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3dd2604640 1 -- 172.21.15.170:0/177883006 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed8019870 con 0x5604c6957920 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3dd2604640 1 -- 172.21.15.170:0/177883006 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed8019a10 con 0x5604c6957920 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604c6a51430 con 0x5604c6957920 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3dd2604640 1 -- 172.21.15.170:0/177883006 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed8019d30 con 0x5604c6957920 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.698+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c6a51950 con 0x5604c6957920 2024-04-26T12:30:37.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.699+0000 7f3dd2604640 1 -- 172.21.15.170:0/177883006 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ed8017040 con 0x5604c6957920 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.699+0000 7f3dd2604640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dcc036900 0x7f3dcc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.699+0000 7f3dd2604640 1 -- 172.21.15.170:0/177883006 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3ed8015020 con 0x5604c6957920 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.699+0000 7f3ee5596640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dcc036900 0x7f3dcc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c695b8d0 0x5604c6a57f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a584a0 con 0x5604c695b8d0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee6598640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c695b8d0 0x5604c6a57f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee5596640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dcc036900 0x7f3dcc038dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3edc054000 tx=0x7f3edc04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee6598640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c695b8d0 0x5604c6a57f60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee6598640 1 -- 172.21.15.170:0/177883006 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c695b8d0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a55530 con 0x5604c695b8d0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.700+0000 7f3ee6598640 1 -- 172.21.15.170:0/177883006 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c695b8d0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.701+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a5a7b0 0x5604c6a5cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.701+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a5d290 con 0x5604c6a5a7b0 2024-04-26T12:30:37.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.701+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a5a7b0 0x5604c6a5cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.701+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a5a7b0 0x5604c6a5cba0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.701+0000 7f3ee5d97640 1 -- 172.21.15.170:0/177883006 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ed802d070 con 0x5604c6a5a7b0 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.701+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a59760 con 0x5604c695b8d0 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.702+0000 7f3ee6598640 1 -- 172.21.15.170:0/177883006 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c695b8d0 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.702+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5604c6a5e740 0x5604c6a60b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.702+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a612f0 con 0x5604c6a5e740 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.702+0000 7f3ee5596640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5604c6a5e740 0x5604c6a60b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.702+0000 7f3ee5596640 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5604c6a5e740 0x5604c6a60b90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.702+0000 7f3ee5596640 1 -- 172.21.15.170:0/177883006 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3edc0528e0 con 0x5604c6a5e740 2024-04-26T12:30:37.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee8298800 1 Processor -- start 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee8298800 1 -- start start 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee8298800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a6f730 0x5604c6a6fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee8298800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5604c6849e60 con 0x5604c6a6f730 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a6f730 0x5604c6a6fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a6f730 0x5604c6a6fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36796/0 (socket says 172.21.15.170:36796) 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee5d97640 1 -- 172.21.15.170:0/1085763028 learned_addr learned my addr 172.21.15.170:0/1085763028 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee5d97640 1 -- 172.21.15.170:0/1085763028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c6a70090 con 0x5604c6a6f730 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.703+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a6f730 0x5604c6a6fb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ffd0 tx=0x7f3ed800f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3dcb7fe640 1 -- 172.21.15.170:0/1085763028 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed800edf0 con 0x5604c6a6f730 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3dcb7fe640 1 -- 172.21.15.170:0/1085763028 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed801a3c0 con 0x5604c6a6f730 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604c6a70b00 con 0x5604c6a6f730 2024-04-26T12:30:37.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3dcb7fe640 1 -- 172.21.15.170:0/1085763028 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed801a6c0 con 0x5604c6a6f730 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c6a71000 con 0x5604c6a6f730 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3dcb7fe640 1 -- 172.21.15.170:0/1085763028 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ed803f250 con 0x5604c6a6f730 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3dcb7fe640 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dc0036950 0x7f3dc0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.704+0000 7f3dcb7fe640 1 -- 172.21.15.170:0/1085763028 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3ed803ac90 con 0x5604c6a6f730 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee5596640 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dc0036950 0x7f3dc0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee8298800 1 Processor -- start 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee8298800 1 -- start start 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee5596640 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dc0036950 0x7f3dc0038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5604c6a58d60 tx=0x7f3edc005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee8298800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a47fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee8298800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5604c6a4c340 con 0x5604c6a498b0 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a47fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a47fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36810/0 (socket says 172.21.15.170:36810) 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee5d97640 1 -- 172.21.15.170:0/1535941115 learned_addr learned my addr 172.21.15.170:0/1535941115 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.705+0000 7f3ee5d97640 1 -- 172.21.15.170:0/1535941115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c6a49d60 con 0x5604c6a498b0 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/1535941115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a47fa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8001610 tx=0x7f3ed8026b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7459818cef2c5959 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3dc97fa640 1 -- 172.21.15.170:0/1535941115 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed802bde0 con 0x5604c6a498b0 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3dc97fa640 1 -- 172.21.15.170:0/1535941115 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed801ca10 con 0x5604c6a498b0 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3dc97fa640 1 -- 172.21.15.170:0/1535941115 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed8044a80 con 0x5604c6a498b0 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 -- 172.21.15.170:0/1535941115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 msgr2=0x5604c6a47fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 --2- 172.21.15.170:0/1535941115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a47fa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8001610 tx=0x7f3ed8026b20 comp rx=0 tx=0).stop 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 -- 172.21.15.170:0/1535941115 shutdown_connections 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 --2- 172.21.15.170:0/1535941115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a47fa0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 -- 172.21.15.170:0/1535941115 >> 172.21.15.170:0/1535941115 conn(0x5604c6a78dd0 msgr2=0x5604c6a76e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 -- 172.21.15.170:0/1535941115 shutdown_connections 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 -- 172.21.15.170:0/1535941115 wait complete. 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.706+0000 7f3ee8298800 1 Processor -- start 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee8298800 1 -- start start 2024-04-26T12:30:37.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee8298800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a86040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee8298800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5604c6a484e0 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a86040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee5d97640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a86040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36820/0 (socket says 172.21.15.170:36820) 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 learned_addr learned my addr 172.21.15.170:0/3255843685 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c6a86580 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a86040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ff30 tx=0x7f3ed8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3db77fe640 1 -- 172.21.15.170:0/3255843685 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed806a020 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3db77fe640 1 -- 172.21.15.170:0/3255843685 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed8044bb0 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604c6a86580 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.707+0000 7f3db77fe640 1 -- 172.21.15.170:0/3255843685 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed803f670 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.708+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c6a86580 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.708+0000 7f3db77fe640 1 -- 172.21.15.170:0/3255843685 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ed806d020 con 0x5604c6a498b0 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.708+0000 7f3db77fe640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3db0036900 0x7f3db0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.708+0000 7f3db77fe640 1 -- 172.21.15.170:0/3255843685 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3ed8062070 con 0x5604c6a498b0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.708+0000 7f3ee5596640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3db0036900 0x7f3db0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.709+0000 7f3ee5596640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3db0036900 0x7f3db0038dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3edc052fd0 tx=0x7f3edc04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.709+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.709+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c6a91670 0x5604c6a93b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.709+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a94280 con 0x5604c6a91670 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.709+0000 7f3ee6598640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c6a91670 0x5604c6a93b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.709+0000 7f3ee6598640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c6a91670 0x5604c6a93b30 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 realm 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a94690 con 0x5604c6a91670 2024-04-26T12:30:37.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a94f60 con 0x5604c6a91670 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a91670 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a96060 0x5604c6a98450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a98a60 con 0x5604c6a96060 2024-04-26T12:30:37.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.710+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a96060 0x5604c6a98450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.711+0000 7f3ee5d97640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a96060 0x5604c6a98450 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.711+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.711+0000 7f3ee8298800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.711+0000 7f3ee8298800 20 searching for the correct realm 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.711+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5604c6a9a9f0 0x5604c6a9ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.711+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9d580 con 0x5604c6a9a9f0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.711+0000 7f3ee5596640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5604c6a9a9f0 0x5604c6a9ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.712+0000 7f3ee5596640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5604c6a9a9f0 0x5604c6a9ceb0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.712+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.712+0000 7f3ee5596640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3edc076040 0x7f3edc05e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.712+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9d580 con 0x7f3edc076040 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.712+0000 7f3ee6598640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3edc076040 0x7f3edc05e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.713+0000 7f3ee6598640 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3edc076040 0x7f3edc05e480 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.713+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.713+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a96060 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.713+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.713+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a91670 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.713+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.713+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a91670 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a96060 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a96060 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x7f3edc076040 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.714+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a9a9f0 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a91670 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a96060 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a91670 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x7f3edc076040 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.715+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a95300 con 0x5604c6a9a9f0 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.716+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.716+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a9a9f0 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.716+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.716+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a96060 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.716+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.716+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a9a9f0 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a9a9f0 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a91670 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a91670 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.717+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a96060 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a9a9f0 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x7f3edc076040 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a91670 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.718+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a96060 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a9a9f0 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a96060 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x7f3edc076040 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a9a9f0 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.719+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a96060 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x5604c6a91670 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3edc090040 con 0x7f3edc076040 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:37.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.720+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a99320 con 0x5604c6a91670 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a99320 con 0x5604c6a91670 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a99320 con 0x7f3edc076040 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:37.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 zone default found 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 4 Realm: () 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 zonegroup default 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a99bc0 con 0x5604c6a96060 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.721+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9f3e0 con 0x5604c6a9a9f0 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee8298800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9f780 con 0x5604c6a9a9f0 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee8298800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee8298800 20 started sync module instance, tier type = 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee8298800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.722+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e880 con 0x7f3edc076040 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.723+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.723+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94578512883072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e880 con 0x7f3edc076040 2024-04-26T12:30:37.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.723+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa0140 con 0x5604c6a91670 2024-04-26T12:30:37.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.724+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94578512883072] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.725+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.725+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94578512887408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e880 con 0x5604c6a91670 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.725+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa0b90 con 0x5604c6a9a9f0 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.726+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94578512887408] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.726+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.726+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94578512880592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e7f0 con 0x5604c6a9a9f0 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.726+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa1920 con 0x7f3edc076040 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.727+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94578512880592] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.727+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.727+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94578512891776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa1d10 con 0x7f3edc076040 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.727+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa2710 con 0x5604c6a91670 2024-04-26T12:30:37.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.728+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94578512891776] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.728+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.728+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94578512892832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa26d0 con 0x5604c6a91670 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.728+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa3120 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.729+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.729+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94578512892832] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.729+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94578512899184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa39c0 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.729+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa2220 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.730+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94578512899184] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.730+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.730+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94578512903936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa47d0 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.730+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa5020 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94578512903936] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94578512907120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa5440 con 0x5604c6a96060 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 20 add_watcher() i=0 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 20 add_watcher() i=1 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 20 add_watcher() i=2 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 20 add_watcher() i=3 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 20 add_watcher() i=4 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 20 add_watcher() i=5 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.731+0000 7f3ee8298800 20 add_watcher() i=6 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.732+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94578512907120] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.732+0000 7f3ee8298800 20 add_watcher() i=7 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.732+0000 7f3ee8298800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.732+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa87a0 con 0x5604c6a91670 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.732+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.732+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94578512920992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa55b0 con 0x5604c6a91670 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.733+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94578512920992] v30'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.733+0000 7f3d977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.733+0000 7f3ee8298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.733+0000 7f3ee8298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 5 note: GC not initialized 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3d967fc640 20 reqs_thread_entry: start 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 20 Filter name: none 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3d07fff640 20 reqs_thread_entry: start 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6adbf20 con 0x5604c6a91670 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:37.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.734+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6ade9b0 con 0x7f3edc076040 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 20 disabling bucket name=myfoo 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6adc990 con 0x7f3edc076040 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-26T12:30:37.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6adf1e0 con 0x5604c6a91670 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.735+0000 7f3ee8298800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.736+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6ae6e30 con 0x5604c6a91670 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:37.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94578513148064 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6ae24e0 con 0x5604c6a91670 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify (1) cookie 94578512892832 notify 128849018899 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5604c6adf5d0 con 0x5604c6a91670 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3dc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94578512892832 notifier 4600 bl.length()=752 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(67 notify.4 [notify cookie 94578513148064 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3dc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3dc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3dc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3dc97fa640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3da8003ea0 con 0x5604c6a91670 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== watch-notify(notify_complete (2) cookie 94578513148064 notify 128849018899 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5604c6ade6f0 con 0x5604c6a91670 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_sources= new_sources= 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential sources added=[] removed=[] 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_dests= new_dests= 2024-04-26T12:30:37.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential dests added=[] removed=[] 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.737+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6ae1ff0 con 0x5604c6a91670 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee8298800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee8298800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee8298800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94578513166944 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5604c6ae1ff0 con 0x5604c6a91670 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== watch-notify(notify (1) cookie 94578512892832 notify 128849018900 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5604c6ade6f0 con 0x5604c6a91670 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3dc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94578512892832 notifier 4600 bl.length()=567 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3dc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3dc97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3dc97fa640 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3da8003ea0 con 0x5604c6a91670 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(70 notify.4 [notify cookie 94578513166944 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== watch-notify(notify_complete (2) cookie 94578513166944 notify 128849018900 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3ee0045700 con 0x5604c6a91670 2024-04-26T12:30:37.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.739+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.756 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:37.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.740+0000 7f3d977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.740+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94578512920992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6adde00 con 0x5604c6a91670 2024-04-26T12:30:37.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.741+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94578512920992] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.741+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94578512883072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa81a0 con 0x7f3edc076040 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.742+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94578512883072] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.742+0000 7f3ee8298800 20 remove_watcher() i=0 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.742+0000 7f3ee8298800 2 removed watcher, disabling cache 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.742+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94578512887408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9ed60 con 0x5604c6a91670 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.743+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94578512887408] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.743+0000 7f3ee8298800 20 remove_watcher() i=1 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.743+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94578512880592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9fe70 con 0x5604c6a9a9f0 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.744+0000 7f3ee5596640 1 -- 172.21.15.170:0/3255843685 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94578512880592] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc081070 con 0x5604c6a9a9f0 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.744+0000 7f3ee8298800 20 remove_watcher() i=2 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.744+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94578512891776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e3d0 con 0x7f3edc076040 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.745+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94578512891776] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x7f3edc076040 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.745+0000 7f3ee8298800 20 remove_watcher() i=3 2024-04-26T12:30:37.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.745+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94578512892832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e3d0 con 0x5604c6a91670 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.746+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94578512892832] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ee000a4a0 con 0x5604c6a91670 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.746+0000 7f3ee8298800 20 remove_watcher() i=4 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.746+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94578512899184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e3d0 con 0x5604c6a96060 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.747+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94578512899184] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.747+0000 7f3ee8298800 20 remove_watcher() i=5 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.747+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94578512903936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6a9e3d0 con 0x5604c6a96060 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.748+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94578512903936] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.748+0000 7f3ee8298800 20 remove_watcher() i=6 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.748+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94578512907120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5604c6aa3f00 con 0x5604c6a96060 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee5d97640 1 -- 172.21.15.170:0/3255843685 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94578512907120] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed8048050 con 0x5604c6a96060 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 20 remove_watcher() i=7 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a96060 msgr2=0x5604c6a98450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a96060 0x5604c6a98450 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c6a91670 msgr2=0x5604c6a93b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c6a91670 0x5604c6a93b30 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3edc076040 msgr2=0x7f3edc05e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3edc076040 0x7f3edc05e480 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5604c6a9a9f0 msgr2=0x5604c6a9ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5604c6a9a9f0 0x5604c6a9ceb0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3db0036900 msgr2=0x7f3db0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3db0036900 0x7f3db0038dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3edc052fd0 tx=0x7f3edc04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 msgr2=0x5604c6a86040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a86040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ff30 tx=0x7f3ed8011f10 comp rx=0 tx=0).stop 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee6598640 1 -- 172.21.15.170:0/3255843685 reap_dead start 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 shutdown_connections 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 --2- 172.21.15.170:0/3255843685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a498b0 0x5604c6a86040 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 >> 172.21.15.170:0/3255843685 conn(0x5604c6a78dd0 msgr2=0x5604c6a76430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 shutdown_connections 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.749+0000 7f3ee8298800 1 -- 172.21.15.170:0/3255843685 wait complete. 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dc0036950 msgr2=0x7f3dc0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dc0036950 0x7f3dc0038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5604c6a58d60 tx=0x7f3edc005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a6f730 msgr2=0x5604c6a6fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a6f730 0x5604c6a6fb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ffd0 tx=0x7f3ed800f840 comp rx=0 tx=0).stop 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 shutdown_connections 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dc0036950 0x7f3dc0038e10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/1085763028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6a6f730 0x5604c6a6fb50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 >> 172.21.15.170:0/1085763028 conn(0x5604c6a637d0 msgr2=0x5604c6a63bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 shutdown_connections 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/1085763028 wait complete. 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a5a7b0 msgr2=0x5604c6a5cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5604c6a5a7b0 0x5604c6a5cba0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c695b8d0 msgr2=0x5604c6a57f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5604c695b8d0 0x5604c6a57f60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5604c6a5e740 msgr2=0x5604c6a60b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5604c6a5e740 0x5604c6a60b90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dcc036900 msgr2=0x7f3dcc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3dcc036900 0x7f3dcc038dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3edc054000 tx=0x7f3edc04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 msgr2=0x5604c6a50ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 --2- 172.21.15.170:0/177883006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5604c6957920 0x5604c6a50ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x5604c6956650 tx=0x7f3ed8000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee6598640 1 -- 172.21.15.170:0/177883006 reap_dead start 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 shutdown_connections 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 >> 172.21.15.170:0/177883006 conn(0x5604c6952160 msgr2=0x5604c6a424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 shutdown_connections 2024-04-26T12:30:37.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.750+0000 7f3ee8298800 1 -- 172.21.15.170:0/177883006 wait complete. 2024-04-26T12:30:37.766 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:37.768 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-26T12:30:37.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-26T12:30:37.769 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-26T12:30:37.844 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:37.845 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.844+0000 7f4063346800 1 Processor -- start 2024-04-26T12:30:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.844+0000 7f4063346800 1 -- start start 2024-04-26T12:30:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4063346800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562498cc4100 0x562498cc26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4063346800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562498bfb0c0 con 0x562498cc2bf0 2024-04-26T12:30:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4063346800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x562498bdf4d0 con 0x562498cc4100 2024-04-26T12:30:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4060e45640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562498cc4100 0x562498cc26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4060644640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x562498cc2bf0 0x562498d56470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:56698/0 (socket says 172.21.15.170:56698) 2024-04-26T12:30:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4060e45640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562498cc4100 0x562498cc26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36826/0 (socket says 172.21.15.170:36826) 2024-04-26T12:30:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4060644640 1 -- 172.21.15.170:0/2629122408 learned_addr learned my addr 172.21.15.170:0/2629122408 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4060e45640 1 -- 172.21.15.170:0/2629122408 >> v1:172.21.15.132:6789/0 conn(0x562498cc2bf0 legacy=0x562498d56470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.845+0000 7f4060e45640 1 -- 172.21.15.170:0/2629122408 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498c0cd40 con 0x562498cc4100 2024-04-26T12:30:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.847+0000 7f4060e45640 1 --2- 172.21.15.170:0/2629122408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc4100 0x562498cc26b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f405000a470 tx=0x7f405001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c187ccc56f0d56f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.847+0000 7f405fe43640 1 -- 172.21.15.170:0/2629122408 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050057070 con 0x562498cc4100 2024-04-26T12:30:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.847+0000 7f405fe43640 1 -- 172.21.15.170:0/2629122408 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4050052570 con 0x562498cc4100 2024-04-26T12:30:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.847+0000 7f405fe43640 1 -- 172.21.15.170:0/2629122408 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050052870 con 0x562498cc4100 2024-04-26T12:30:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.848+0000 7f4063346800 1 -- 172.21.15.170:0/2629122408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc4100 msgr2=0x562498cc26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.848+0000 7f4063346800 1 --2- 172.21.15.170:0/2629122408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc4100 0x562498cc26b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f405000a470 tx=0x7f405001ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.848+0000 7f4063346800 1 -- 172.21.15.170:0/2629122408 shutdown_connections 2024-04-26T12:30:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.848+0000 7f4063346800 1 --2- 172.21.15.170:0/2629122408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc4100 0x562498cc26b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.848+0000 7f4063346800 1 -- 172.21.15.170:0/2629122408 >> 172.21.15.170:0/2629122408 conn(0x562498d49b80 msgr2=0x562498d4bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.848+0000 7f4063346800 1 -- 172.21.15.170:0/2629122408 shutdown_connections 2024-04-26T12:30:37.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.848+0000 7f4063346800 1 -- 172.21.15.170:0/2629122408 wait complete. 2024-04-26T12:30:37.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.859+0000 7f4063346800 1 Processor -- start 2024-04-26T12:30:37.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.859+0000 7f4063346800 1 -- start start 2024-04-26T12:30:37.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.859+0000 7f4063346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e41e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.859+0000 7f4063346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562498c99b40 con 0x562498cc2bf0 2024-04-26T12:30:37.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e41e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36838/0 (socket says 172.21.15.170:36838) 2024-04-26T12:30:37.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f4060e45640 1 -- 172.21.15.170:0/1927977222 learned_addr learned my addr 172.21.15.170:0/1927977222 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f4060e45640 1 -- 172.21.15.170:0/1927977222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498c0b590 con 0x562498cc2bf0 2024-04-26T12:30:37.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f4060e45640 1 --2- 172.21.15.170:0/1927977222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e41e60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4050000c00 tx=0x7f405004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59813beb012e79d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f3f4ee0d640 1 -- 172.21.15.170:0/1927977222 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050057070 con 0x562498cc2bf0 2024-04-26T12:30:37.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f3f4ee0d640 1 -- 172.21.15.170:0/1927977222 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4050063070 con 0x562498cc2bf0 2024-04-26T12:30:37.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.860+0000 7f3f4ee0d640 1 -- 172.21.15.170:0/1927977222 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050052720 con 0x562498cc2bf0 2024-04-26T12:30:37.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 -- 172.21.15.170:0/1927977222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 msgr2=0x562498e41e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 --2- 172.21.15.170:0/1927977222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e41e60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4050000c00 tx=0x7f405004c000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 -- 172.21.15.170:0/1927977222 shutdown_connections 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 --2- 172.21.15.170:0/1927977222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e41e60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 -- 172.21.15.170:0/1927977222 >> 172.21.15.170:0/1927977222 conn(0x562498d49b80 msgr2=0x562498e3d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 -- 172.21.15.170:0/1927977222 shutdown_connections 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 -- 172.21.15.170:0/1927977222 wait complete. 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 Processor -- start 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 -- start start 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e49740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.861+0000 7f4063346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562498d59e40 con 0x562498cc2bf0 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e49740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e49740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36850/0 (socket says 172.21.15.170:36850) 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f4060e45640 1 -- 172.21.15.170:0/3607590583 learned_addr learned my addr 172.21.15.170:0/3607590583 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f4060e45640 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498c028f0 con 0x562498cc2bf0 2024-04-26T12:30:37.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f4060e45640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e49740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4050000c00 tx=0x7f4050002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f3f4d60a640 1 -- 172.21.15.170:0/3607590583 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050052c70 con 0x562498cc2bf0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f3f4d60a640 1 -- 172.21.15.170:0/3607590583 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405006c070 con 0x562498cc2bf0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562498e49c80 con 0x562498cc2bf0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f3f4d60a640 1 -- 172.21.15.170:0/3607590583 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405005e480 con 0x562498cc2bf0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.862+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562498e4a140 con 0x562498cc2bf0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.863+0000 7f3f4d60a640 1 -- 172.21.15.170:0/3607590583 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f405006e030 con 0x562498cc2bf0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.863+0000 7f3f4d60a640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f48036950 0x7f3f48038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.863+0000 7f3f4d60a640 1 -- 172.21.15.170:0/3607590583 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f405008e1f0 con 0x562498cc2bf0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.863+0000 7f4060644640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f48036950 0x7f3f48038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.863+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498cc4100 0x562498e507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.863+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e50cf0 con 0x562498cc4100 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.863+0000 7f4061646640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498cc4100 0x562498e507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4060644640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f48036950 0x7f3f48038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4054000f60 tx=0x7f40540012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4061646640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498cc4100 0x562498e507b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4061646640 1 -- 172.21.15.170:0/3607590583 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498cc4100 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e4dd80 con 0x562498cc4100 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4061646640 1 -- 172.21.15.170:0/3607590583 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f405800a4a0 con 0x562498cc4100 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e53040 0x562498e55430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e55b20 con 0x562498e53040 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.864+0000 7f4060e45640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e53040 0x562498e55430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.865+0000 7f4060e45640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e53040 0x562498e55430 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.865+0000 7f4060e45640 1 -- 172.21.15.170:0/3607590583 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4050070410 con 0x562498e53040 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.865+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e51ff0 con 0x562498cc4100 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.865+0000 7f4061646640 1 -- 172.21.15.170:0/3607590583 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f405800a4a0 con 0x562498cc4100 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.865+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562498e56f80 0x562498e59410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.865+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e59b70 con 0x562498e56f80 2024-04-26T12:30:37.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.865+0000 7f4060644640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562498e56f80 0x562498e59410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.866+0000 7f4060644640 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562498e56f80 0x562498e59410 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.866+0000 7f4060644640 1 -- 172.21.15.170:0/3607590583 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4054009050 con 0x562498e56f80 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.866+0000 7f4063346800 1 Processor -- start 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.866+0000 7f4063346800 1 -- start start 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.866+0000 7f4063346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e68020 0x562498e68440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.866+0000 7f4063346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562498c3fe60 con 0x562498e68020 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e68020 0x562498e68440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e68020 0x562498e68440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36864/0 (socket says 172.21.15.170:36864) 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f4060e45640 1 -- 172.21.15.170:0/1081954266 learned_addr learned my addr 172.21.15.170:0/1081954266 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f4060e45640 1 -- 172.21.15.170:0/1081954266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498e68980 con 0x562498e68020 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f4060e45640 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e68020 0x562498e68440 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f405008c680 tx=0x7f4050009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f3f467fc640 1 -- 172.21.15.170:0/1081954266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050084040 con 0x562498e68020 2024-04-26T12:30:37.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f3f467fc640 1 -- 172.21.15.170:0/1081954266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4050058040 con 0x562498e68020 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562498e693f0 con 0x562498e68020 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f3f467fc640 1 -- 172.21.15.170:0/1081954266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050009af0 con 0x562498e68020 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.867+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562498e698f0 con 0x562498e68020 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f3f467fc640 1 -- 172.21.15.170:0/1081954266 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4050009c90 con 0x562498e68020 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f3f467fc640 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f38036950 0x7f3f38038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f3f467fc640 1 -- 172.21.15.170:0/1081954266 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f405009ca00 con 0x562498e68020 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f4060644640 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f38036950 0x7f3f38038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f4063346800 1 Processor -- start 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f4063346800 1 -- start start 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f4060644640 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f38036950 0x7f3f38038e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f405400bf50 tx=0x7f405400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f4063346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e755f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.868+0000 7f4063346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562498e42520 con 0x562498e751d0 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e755f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36878/0 (socket says 172.21.15.170:36878) 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f4060e45640 1 -- 172.21.15.170:0/2684376133 learned_addr learned my addr 172.21.15.170:0/2684376133 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f4060e45640 1 -- 172.21.15.170:0/2684376133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498e75bc0 con 0x562498e751d0 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f4060e45640 1 --2- 172.21.15.170:0/2684376133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e755f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4050079030 tx=0x7f405005e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5949244c3d83de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f3f37fff640 1 -- 172.21.15.170:0/2684376133 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405004f900 con 0x562498e751d0 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f3f37fff640 1 -- 172.21.15.170:0/2684376133 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40500ac070 con 0x562498e751d0 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.869+0000 7f3f37fff640 1 -- 172.21.15.170:0/2684376133 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050068770 con 0x562498e751d0 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 -- 172.21.15.170:0/2684376133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 msgr2=0x562498e755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 --2- 172.21.15.170:0/2684376133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e755f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4050079030 tx=0x7f405005e750 comp rx=0 tx=0).stop 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 -- 172.21.15.170:0/2684376133 shutdown_connections 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 --2- 172.21.15.170:0/2684376133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e755f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 -- 172.21.15.170:0/2684376133 >> 172.21.15.170:0/2684376133 conn(0x562498e71530 msgr2=0x562498e6f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 -- 172.21.15.170:0/2684376133 shutdown_connections 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 -- 172.21.15.170:0/2684376133 wait complete. 2024-04-26T12:30:37.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 Processor -- start 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 -- start start 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e7c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4063346800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562498e76270 con 0x562498e751d0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.870+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e7c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f4060e45640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e7c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36880/0 (socket says 172.21.15.170:36880) 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 learned_addr learned my addr 172.21.15.170:0/622014042 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562498e7cae0 con 0x562498e751d0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f4060e45640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e7c5a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4050044810 tx=0x7f405006af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f3f367fc640 1 -- 172.21.15.170:0/622014042 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4050091ad0 con 0x562498e751d0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f3f367fc640 1 -- 172.21.15.170:0/622014042 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4050091c70 con 0x562498e751d0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562498e7cae0 con 0x562498e751d0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f3f367fc640 1 -- 172.21.15.170:0/622014042 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f405004f3f0 con 0x562498e751d0 2024-04-26T12:30:37.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.871+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562498e7cae0 con 0x562498e751d0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.872+0000 7f3f367fc640 1 -- 172.21.15.170:0/622014042 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f40500a5040 con 0x562498e751d0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.872+0000 7f3f367fc640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f2c036950 0x7f3f2c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.872+0000 7f3f367fc640 1 -- 172.21.15.170:0/622014042 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f40500a2040 con 0x562498e751d0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.872+0000 7f4060644640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f2c036950 0x7f3f2c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.872+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.872+0000 7f4060644640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f2c036950 0x7f3f2c038e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4054001b60 tx=0x7f4054010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.872+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498e87b70 0x562498e8a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8a780 con 0x562498e87b70 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4061646640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498e87b70 0x562498e8a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4061646640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498e87b70 0x562498e8a030 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 20 realm 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8ab90 con 0x562498e87b70 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b460 con 0x562498e87b70 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.873+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4063346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4063346800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e8c560 0x562498e8e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8ef10 con 0x562498e8c560 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4060e45640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e8c560 0x562498e8e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4060e45640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e8c560 0x562498e8e950 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.874+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4063346800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4063346800 20 searching for the correct realm 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562498e90ec0 0x562498e93380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e93a50 con 0x562498e90ec0 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4060644640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562498e90ec0 0x562498e93380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4060644640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562498e90ec0 0x562498e93380 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4060644640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4054037040 0x7f4054036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e93a50 con 0x7f4054037040 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.875+0000 7f4061646640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4054037040 0x7f4054036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:37.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.876+0000 7f4061646640 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4054037040 0x7f4054036410 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.876+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.876+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.876+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.876+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.877+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x7f4054037040 2024-04-26T12:30:37.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.878+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x7f4054037040 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.879+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.879+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.879+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.879+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.879+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.879+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.880+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x7f4054037040 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.881+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.882+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x7f4054037040 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e90ec0 2024-04-26T12:30:37.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e8c560 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x562498e87b70 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.883+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562498e8b800 con 0x7f4054037040 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8f7d0 con 0x562498e87b70 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8f7d0 con 0x562498e87b70 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e8f7d0 con 0x7f4054037040 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.884+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 zone default found 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 4 Realm: () 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:37.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 zonegroup default 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e90070 con 0x562498e8c560 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e958b0 con 0x562498e90ec0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e95c50 con 0x562498e90ec0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:37.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 started sync module instance, tier type = 2024-04-26T12:30:37.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:37.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.885+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e94d50 con 0x7f4054037040 2024-04-26T12:30:37.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.886+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.886+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94715184238912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e94d50 con 0x7f4054037040 2024-04-26T12:30:37.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.886+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e96500 con 0x562498e87b70 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.887+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94715184238912] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.888+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.888+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94715184242672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e94d50 con 0x562498e87b70 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.888+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e96f50 con 0x562498e90ec0 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.889+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94715184242672] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.889+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.889+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94715184236704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e94cc0 con 0x562498e90ec0 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.889+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e97e10 con 0x7f4054037040 2024-04-26T12:30:37.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.890+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94715184236704] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.890+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.890+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94715184249184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e98230 con 0x7f4054037040 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.890+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e98b00 con 0x562498e87b70 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.891+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94715184249184] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.891+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.891+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94715184250240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e98650 con 0x562498e87b70 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.891+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e99510 con 0x562498e8c560 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.892+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.892+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94715184255072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e99db0 con 0x562498e8c560 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.892+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9a7f0 con 0x562498e8c560 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.892+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94715184250240] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.893+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94715184255072] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.893+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.893+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94715184259776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9abe0 con 0x562498e8c560 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.893+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9b430 con 0x562498e8c560 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94715184259776] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94715184263040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9b850 con 0x562498e8c560 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 20 add_watcher() i=0 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 20 add_watcher() i=1 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 20 add_watcher() i=2 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 20 add_watcher() i=3 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 20 add_watcher() i=4 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 20 add_watcher() i=5 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.894+0000 7f4063346800 20 add_watcher() i=6 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.895+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94715184263040] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.895+0000 7f4063346800 20 add_watcher() i=7 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.895+0000 7f4063346800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.895+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498e9eb50 con 0x562498e87b70 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.895+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.895+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94715184264464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9bde0 con 0x562498e87b70 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.896+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94715184264464] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f3f177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 5 note: GC not initialized 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f3f167e4640 20 reqs_thread_entry: start 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 20 Filter name: none 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f3f0ffff640 20 reqs_thread_entry: start 2024-04-26T12:30:37.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.897+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498ed21c0 con 0x562498e87b70 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498ed1ca0 con 0x7f4054037040 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 20 enabling bucket name=myfoo 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498ed2c30 con 0x7f4054037040 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 : miss 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 20 rados->read ofs=0 len=0 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.898+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498ed54a0 con 0x562498e87b70 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4063346800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4063346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4063346800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4063346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4063346800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4063346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.899+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.19 8:9d34c571:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498edd040 con 0x562498e87b70 2024-04-26T12:30:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4063346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4063346800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4063346800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4063346800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1, ofs0, ns] 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94715184503584 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498ed86a0 con 0x562498e87b70 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify (1) cookie 94715184250240 notify 128849018901 ret 0) ==== 794+0+0 (crc 0 0 0) 0x562498ed5890 con 0x562498e87b70 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f3f37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018901 cookie 94715184250240 notifier 4607 bl.length()=752 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f3f37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 info.flags=0x17 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f3f37fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1 to cache LRU end 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f3f37fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(67 notify.4 [notify cookie 94715184503584 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f3f37fff640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3f24003ea0 con 0x562498e87b70 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== watch-notify(notify_complete (2) cookie 94715184503584 notify 128849018901 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562498ed48f0 con 0x562498e87b70 2024-04-26T12:30:37.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.900+0000 7f4063346800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_sources= new_sources= 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.901+0000 7f4063346800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential sources added=[] removed=[] 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.901+0000 7f4063346800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): orig_dests= new_dests= 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.901+0000 7f4063346800 20 handle_bi_update(): bucket=:myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1]): potential dests added=[] removed=[] 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.901+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498ed81b0 con 0x562498e87b70 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4063346800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4063346800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4063346800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94715184522272 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562498ed81b0 con 0x562498e87b70 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== watch-notify(notify (1) cookie 94715184250240 notify 128849018902 ret 0) ==== 609+0+0 (crc 0 0 0) 0x562498ed48f0 con 0x562498e87b70 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f3f37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018902 cookie 94715184250240 notifier 4607 bl.length()=567 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f3f37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f3f37fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f3f37fff640 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3f24003ea0 con 0x562498e87b70 2024-04-26T12:30:37.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(70 notify.4 [notify cookie 94715184522272 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.902+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== watch-notify(notify_complete (2) cookie 94715184522272 notify 128849018902 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40580458a0 con 0x562498e87b70 2024-04-26T12:30:37.918 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.903+0000 7f3f177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.903+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94715184264464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498ed3b50 con 0x562498e87b70 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.904+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94715184264464] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.904+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94715184238912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9b510 con 0x7f4054037040 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.905+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94715184238912] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.905+0000 7f4063346800 20 remove_watcher() i=0 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.905+0000 7f4063346800 2 removed watcher, disabling cache 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.905+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94715184242672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9b510 con 0x562498e87b70 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.906+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94715184242672] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.906+0000 7f4063346800 20 remove_watcher() i=1 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.906+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94715184236704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e95ff0 con 0x562498e90ec0 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.907+0000 7f4060644640 1 -- 172.21.15.170:0/622014042 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94715184236704] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4054009050 con 0x562498e90ec0 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.907+0000 7f4063346800 20 remove_watcher() i=2 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.907+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94715184249184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9b510 con 0x7f4054037040 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.908+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94715184249184] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x7f4054037040 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.908+0000 7f4063346800 20 remove_watcher() i=3 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.908+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94715184250240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e948a0 con 0x562498e87b70 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.909+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94715184250240] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f405800a4a0 con 0x562498e87b70 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.909+0000 7f4063346800 20 remove_watcher() i=4 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.909+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94715184255072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e9b510 con 0x562498e8c560 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.910+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94715184255072] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.910+0000 7f4063346800 20 remove_watcher() i=5 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.910+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94715184259776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e948a0 con 0x562498e8c560 2024-04-26T12:30:37.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.911+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94715184259776] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.911+0000 7f4063346800 20 remove_watcher() i=6 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.911+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94715184263040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562498e99060 con 0x562498e8c560 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4060e45640 1 -- 172.21.15.170:0/622014042 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94715184263040] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40500ce040 con 0x562498e8c560 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 20 remove_watcher() i=7 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e8c560 msgr2=0x562498e8e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e8c560 0x562498e8e950 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498e87b70 msgr2=0x562498e8a030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498e87b70 0x562498e8a030 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4054037040 msgr2=0x7f4054036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4054037040 0x7f4054036410 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562498e90ec0 msgr2=0x562498e93380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562498e90ec0 0x562498e93380 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f2c036950 msgr2=0x7f3f2c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f2c036950 0x7f3f2c038e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4054001b60 tx=0x7f4054010000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4061646640 1 -- 172.21.15.170:0/622014042 reap_dead start 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 msgr2=0x562498e7c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e7c5a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4050044810 tx=0x7f405006af10 comp rx=0 tx=0).stop 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 shutdown_connections 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 --2- 172.21.15.170:0/622014042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e751d0 0x562498e7c5a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 >> 172.21.15.170:0/622014042 conn(0x562498e71530 msgr2=0x562498e6eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 shutdown_connections 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.912+0000 7f4063346800 1 -- 172.21.15.170:0/622014042 wait complete. 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f38036950 msgr2=0x7f3f38038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f38036950 0x7f3f38038e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f405400bf50 tx=0x7f405400f000 comp rx=0 tx=0).stop 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e68020 msgr2=0x562498e68440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e68020 0x562498e68440 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f405008c680 tx=0x7f4050009770 comp rx=0 tx=0).stop 2024-04-26T12:30:37.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 shutdown_connections 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f38036950 0x7f3f38038e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/1081954266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498e68020 0x562498e68440 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 >> 172.21.15.170:0/1081954266 conn(0x562498e5c0c0 msgr2=0x562498e5c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 shutdown_connections 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/1081954266 wait complete. 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e53040 msgr2=0x562498e55430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562498e53040 0x562498e55430 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498cc4100 msgr2=0x562498e507b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562498cc4100 0x562498e507b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562498e56f80 msgr2=0x562498e59410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562498e56f80 0x562498e59410 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f48036950 msgr2=0x7f3f48038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3f48036950 0x7f3f48038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4054000f60 tx=0x7f40540012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 msgr2=0x562498e49740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:37.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 --2- 172.21.15.170:0/3607590583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562498cc2bf0 0x562498e49740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4050000c00 tx=0x7f4050002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:37.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4061646640 1 -- 172.21.15.170:0/3607590583 reap_dead start 2024-04-26T12:30:37.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 shutdown_connections 2024-04-26T12:30:37.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 >> 172.21.15.170:0/3607590583 conn(0x562498d49b80 msgr2=0x562498e40850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:37.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 shutdown_connections 2024-04-26T12:30:37.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:37.913+0000 7f4063346800 1 -- 172.21.15.170:0/3607590583 wait complete. 2024-04-26T12:30:37.929 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:37.936 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:30:38.177 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-26T12:30:38.183 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:53.184 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-26T12:30:53.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-26T12:30:53.184 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:53.233 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.233+0000 7f74db938800 1 Processor -- start 2024-04-26T12:30:53.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.233+0000 7f74db938800 1 -- start start 2024-04-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.233+0000 7f74db938800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5570bf3e7ab0 0x5570bf3e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.233+0000 7f74db938800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5570bf2900c0 con 0x5570bf3e4b20 2024-04-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.233+0000 7f74db938800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5570bf2744d0 con 0x5570bf3e7ab0 2024-04-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.234+0000 7f74d6e95640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5570bf3e7ab0 0x5570bf3e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.234+0000 7f74d7696640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5570bf3e4b20 0x5570bf3e4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43962/0 (socket says 172.21.15.170:43962) 2024-04-26T12:30:53.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.234+0000 7f74d7696640 1 -- 172.21.15.170:0/565832615 learned_addr learned my addr 172.21.15.170:0/565832615 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:53.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.234+0000 7f74d6e95640 1 -- 172.21.15.170:0/565832615 >> v1:172.21.15.132:6789/0 conn(0x5570bf3e4b20 legacy=0x5570bf3e4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.234+0000 7f74d6e95640 1 -- 172.21.15.170:0/565832615 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bf2a1d40 con 0x5570bf3e7ab0 2024-04-26T12:30:53.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.236+0000 7f74d6e95640 1 --2- 172.21.15.170:0/565832615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e7ab0 0x5570bf3e9ea0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a470 tx=0x7f74cc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24682c48d4c68f19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.236+0000 7f74d6694640 1 -- 172.21.15.170:0/565832615 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc057070 con 0x5570bf3e7ab0 2024-04-26T12:30:53.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.236+0000 7f74d6694640 1 -- 172.21.15.170:0/565832615 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc052570 con 0x5570bf3e7ab0 2024-04-26T12:30:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.236+0000 7f74d6694640 1 -- 172.21.15.170:0/565832615 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74cc052870 con 0x5570bf3e7ab0 2024-04-26T12:30:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.237+0000 7f74db938800 1 -- 172.21.15.170:0/565832615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e7ab0 msgr2=0x5570bf3e9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.237+0000 7f74db938800 1 --2- 172.21.15.170:0/565832615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e7ab0 0x5570bf3e9ea0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a470 tx=0x7f74cc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.237+0000 7f74db938800 1 -- 172.21.15.170:0/565832615 shutdown_connections 2024-04-26T12:30:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.237+0000 7f74db938800 1 --2- 172.21.15.170:0/565832615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e7ab0 0x5570bf3e9ea0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.237+0000 7f74db938800 1 -- 172.21.15.170:0/565832615 >> 172.21.15.170:0/565832615 conn(0x5570bf3dd160 msgr2=0x5570bf3df580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.237+0000 7f74db938800 1 -- 172.21.15.170:0/565832615 shutdown_connections 2024-04-26T12:30:53.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.237+0000 7f74db938800 1 -- 172.21.15.170:0/565832615 wait complete. 2024-04-26T12:30:53.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74db938800 1 Processor -- start 2024-04-26T12:30:53.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74db938800 1 -- start start 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74db938800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf3e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74db938800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5570bf32eb40 con 0x5570bf3e4b20 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf3e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf3e41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49210/0 (socket says 172.21.15.170:49210) 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74d7696640 1 -- 172.21.15.170:0/1725677426 learned_addr learned my addr 172.21.15.170:0/1725677426 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.251+0000 7f74d7696640 1 -- 172.21.15.170:0/1725677426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bf2a0590 con 0x5570bf3e4b20 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.252+0000 7f74d7696640 1 --2- 172.21.15.170:0/1725677426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf3e41c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f74c80017a0 tx=0x7f74c8001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce5d39ab5b9442a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.252+0000 7f73c560a640 1 -- 172.21.15.170:0/1725677426 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8016070 con 0x5570bf3e4b20 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.252+0000 7f73c560a640 1 -- 172.21.15.170:0/1725677426 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c8004520 con 0x5570bf3e4b20 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.252+0000 7f73c560a640 1 -- 172.21.15.170:0/1725677426 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8004820 con 0x5570bf3e4b20 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 -- 172.21.15.170:0/1725677426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 msgr2=0x5570bf3e41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 --2- 172.21.15.170:0/1725677426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf3e41c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f74c80017a0 tx=0x7f74c8001c60 comp rx=0 tx=0).stop 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 -- 172.21.15.170:0/1725677426 shutdown_connections 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 --2- 172.21.15.170:0/1725677426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf3e41c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 -- 172.21.15.170:0/1725677426 >> 172.21.15.170:0/1725677426 conn(0x5570bf3dd160 msgr2=0x5570bf4cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 -- 172.21.15.170:0/1725677426 shutdown_connections 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 -- 172.21.15.170:0/1725677426 wait complete. 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 Processor -- start 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 -- start start 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf4de200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74db938800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5570bf3ea6e0 con 0x5570bf3e4b20 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf4de200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf4de200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49220/0 (socket says 172.21.15.170:49220) 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.253+0000 7f74d7696640 1 -- 172.21.15.170:0/2545181342 learned_addr learned my addr 172.21.15.170:0/2545181342 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.254+0000 7f74d7696640 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bf2978f0 con 0x5570bf3e4b20 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.254+0000 7f74d7696640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf4de200 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f74c8014040 tx=0x7f74c8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.254+0000 7f73c3e07640 1 -- 172.21.15.170:0/2545181342 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8020070 con 0x5570bf3e4b20 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.254+0000 7f73c3e07640 1 -- 172.21.15.170:0/2545181342 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c8011550 con 0x5570bf3e4b20 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.254+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570bf4de740 con 0x5570bf3e4b20 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.254+0000 7f73c3e07640 1 -- 172.21.15.170:0/2545181342 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8016040 con 0x5570bf3e4b20 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.254+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570bf4decc0 con 0x5570bf3e4b20 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.255+0000 7f73c3e07640 1 -- 172.21.15.170:0/2545181342 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f74c8023070 con 0x5570bf3e4b20 2024-04-26T12:30:53.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.255+0000 7f73c3e07640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73bc0369a0 0x7f73bc038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.255+0000 7f73c3e07640 1 -- 172.21.15.170:0/2545181342 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f74c804bd20 con 0x5570bf3e4b20 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.255+0000 7f74d6e95640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73bc0369a0 0x7f73bc038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.255+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf3e7ab0 0x5570bf4e5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.256+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf4e57b0 con 0x5570bf3e7ab0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.256+0000 7f74d7e97640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf3e7ab0 0x5570bf4e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.256+0000 7f74d6e95640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73bc0369a0 0x7f73bc038e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74cc054000 tx=0x7f74cc04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.256+0000 7f74d7e97640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf3e7ab0 0x5570bf4e5270 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.256+0000 7f74d7e97640 1 -- 172.21.15.170:0/2545181342 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf3e7ab0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.256+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf4e2820 con 0x5570bf3e7ab0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.257+0000 7f74d7e97640 1 -- 172.21.15.170:0/2545181342 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf3e7ab0 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.257+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf4e7a80 0x5570bf4e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.257+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf4ea560 con 0x5570bf4e7a80 2024-04-26T12:30:53.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.257+0000 7f74d7696640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf4e7a80 0x5570bf4e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.257+0000 7f74d7696640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf4e7a80 0x5570bf4e9e70 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.258+0000 7f74d7696640 1 -- 172.21.15.170:0/2545181342 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f74c802c070 con 0x5570bf4e7a80 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.258+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf4e6a30 con 0x5570bf3e7ab0 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.258+0000 7f74d7e97640 1 -- 172.21.15.170:0/2545181342 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf3e7ab0 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.258+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5570bf4eba10 0x5570bf4ede40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.258+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf4ee5d0 con 0x5570bf4eba10 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.258+0000 7f74d6e95640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5570bf4eba10 0x5570bf4ede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.258+0000 7f74d6e95640 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5570bf4eba10 0x5570bf4ede40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74d6e95640 1 -- 172.21.15.170:0/2545181342 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f74cc052940 con 0x5570bf4eba10 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74db938800 1 Processor -- start 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74db938800 1 -- start start 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74db938800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf4fca30 0x5570bf4fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74db938800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5570bf2d4e60 con 0x5570bf4fca30 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf4fca30 0x5570bf4fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf4fca30 0x5570bf4fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49224/0 (socket says 172.21.15.170:49224) 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.259+0000 7f74d7696640 1 -- 172.21.15.170:0/978149631 learned_addr learned my addr 172.21.15.170:0/978149631 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.260+0000 7f74d7696640 1 -- 172.21.15.170:0/978149631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bf4fd390 con 0x5570bf4fca30 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.260+0000 7f74d7696640 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf4fca30 0x5570bf4fce50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000f80 tx=0x7f74c8043490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.260+0000 7f73c1602640 1 -- 172.21.15.170:0/978149631 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8023360 con 0x5570bf4fca30 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.260+0000 7f73c1602640 1 -- 172.21.15.170:0/978149631 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c8023500 con 0x5570bf4fca30 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.260+0000 7f73c1602640 1 -- 172.21.15.170:0/978149631 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8023db0 con 0x5570bf4fca30 2024-04-26T12:30:53.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.260+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570bf4fde00 con 0x5570bf4fca30 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.260+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570bf4fe300 con 0x5570bf4fca30 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.261+0000 7f73c1602640 1 -- 172.21.15.170:0/978149631 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f74c801ba30 con 0x5570bf4fca30 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.261+0000 7f73c1602640 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73b0036950 0x7f73b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.261+0000 7f73c1602640 1 -- 172.21.15.170:0/978149631 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f74c8038d00 con 0x5570bf4fca30 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.261+0000 7f74d6e95640 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73b0036950 0x7f73b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.261+0000 7f74db938800 1 Processor -- start 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.261+0000 7f74db938800 1 -- start start 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74d6e95640 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73b0036950 0x7f73b0038e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5570bf4e5c20 tx=0x7f74cc005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74db938800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf509fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74db938800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5570bf3e2840 con 0x5570bf509bb0 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf509fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf509fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49226/0 (socket says 172.21.15.170:49226) 2024-04-26T12:30:53.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74d7696640 1 -- 172.21.15.170:0/1626995100 learned_addr learned my addr 172.21.15.170:0/1626995100 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74d7696640 1 -- 172.21.15.170:0/1626995100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bf50a5c0 con 0x5570bf509bb0 2024-04-26T12:30:53.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f74d7696640 1 --2- 172.21.15.170:0/1626995100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf509fd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f74c804bc70 tx=0x7f74c8025e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fe2ee9ad7c0853 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f73baffd640 1 -- 172.21.15.170:0/1626995100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c805b070 con 0x5570bf509bb0 2024-04-26T12:30:53.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f73baffd640 1 -- 172.21.15.170:0/1626995100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c804b150 con 0x5570bf509bb0 2024-04-26T12:30:53.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.262+0000 7f73baffd640 1 -- 172.21.15.170:0/1626995100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8043910 con 0x5570bf509bb0 2024-04-26T12:30:53.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 -- 172.21.15.170:0/1626995100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 msgr2=0x5570bf509fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 --2- 172.21.15.170:0/1626995100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf509fd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f74c804bc70 tx=0x7f74c8025e00 comp rx=0 tx=0).stop 2024-04-26T12:30:53.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 -- 172.21.15.170:0/1626995100 shutdown_connections 2024-04-26T12:30:53.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 --2- 172.21.15.170:0/1626995100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf509fd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 -- 172.21.15.170:0/1626995100 >> 172.21.15.170:0/1626995100 conn(0x5570bf505ef0 msgr2=0x5570bf503f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 -- 172.21.15.170:0/1626995100 shutdown_connections 2024-04-26T12:30:53.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 -- 172.21.15.170:0/1626995100 wait complete. 2024-04-26T12:30:53.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 Processor -- start 2024-04-26T12:30:53.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 -- start start 2024-04-26T12:30:53.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf510fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.263+0000 7f74db938800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5570bf50ace0 con 0x5570bf509bb0 2024-04-26T12:30:53.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf510fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f74d7696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf510fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49232/0 (socket says 172.21.15.170:49232) 2024-04-26T12:30:53.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 learned_addr learned my addr 172.21.15.170:0/1027408457 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bf5114f0 con 0x5570bf509bb0 2024-04-26T12:30:53.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f74d7696640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf510fb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f74c8038f70 tx=0x7f74c8021ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f73b97fa640 1 -- 172.21.15.170:0/1027408457 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c8063070 con 0x5570bf509bb0 2024-04-26T12:30:53.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f73b97fa640 1 -- 172.21.15.170:0/1027408457 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c8043630 con 0x5570bf509bb0 2024-04-26T12:30:53.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570bf5114f0 con 0x5570bf509bb0 2024-04-26T12:30:53.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f73b97fa640 1 -- 172.21.15.170:0/1027408457 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74c805b040 con 0x5570bf509bb0 2024-04-26T12:30:53.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.264+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570bf5114f0 con 0x5570bf509bb0 2024-04-26T12:30:53.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.265+0000 7f73b97fa640 1 -- 172.21.15.170:0/1027408457 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f74c8066070 con 0x5570bf509bb0 2024-04-26T12:30:53.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.265+0000 7f73b97fa640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73a00368b0 0x7f73a0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.265+0000 7f73b97fa640 1 -- 172.21.15.170:0/1027408457 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f74c8069d60 con 0x5570bf509bb0 2024-04-26T12:30:53.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.265+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.265+0000 7f74d6e95640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73a00368b0 0x7f73a0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf51c710 0x5570bf51ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51f300 con 0x5570bf51c710 2024-04-26T12:30:53.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74d7e97640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf51c710 0x5570bf51ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74d6e95640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73a00368b0 0x7f73a0038d70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f74cc052fd0 tx=0x7f74cc04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74d7e97640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf51c710 0x5570bf51ebb0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf51c710 2024-04-26T12:30:53.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 20 realm 2024-04-26T12:30:53.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51f710 con 0x5570bf51c710 2024-04-26T12:30:53.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf51c710 2024-04-26T12:30:53.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:53.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.266+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf51c710 2024-04-26T12:30:53.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf51c710 2024-04-26T12:30:53.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74db938800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf520350 con 0x5570bf51c710 2024-04-26T12:30:53.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf51c710 2024-04-26T12:30:53.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74db938800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf520d10 0x5570bf523100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf523680 con 0x5570bf520d10 2024-04-26T12:30:53.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.267+0000 7f74d7696640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf520d10 0x5570bf523100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.268+0000 7f74d7696640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf520d10 0x5570bf523100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.268+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.268+0000 7f74db938800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.268+0000 7f74db938800 20 searching for the correct realm 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.268+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5570bf525760 0x5570bf527c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.268+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5282f0 con 0x5570bf525760 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.268+0000 7f74d6e95640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5570bf525760 0x5570bf527c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.269+0000 7f74d6e95640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5570bf525760 0x5570bf527c20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.269+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.269+0000 7f74d6e95640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f74cc076040 0x7f74cc083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.269+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5282f0 con 0x7f74cc076040 2024-04-26T12:30:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.269+0000 7f74d7e97640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f74cc076040 0x7f74cc083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.269+0000 7f74d7e97640 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f74cc076040 0x7f74cc083410 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.270+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74d00083e0 con 0x7f74cc076040 2024-04-26T12:30:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.270+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf520d10 2024-04-26T12:30:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.270+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.270+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf51c710 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.270+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d00083e0 con 0x5570bf51c710 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.270+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf51c710 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf520d10 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf520d10 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x7f74cc076040 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.271+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf525760 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf51c710 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x7f74cc076040 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf51c710 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.272+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x7f74cc076040 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.273+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.273+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5570bf51ffb0 con 0x5570bf525760 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.273+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.273+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf525760 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.273+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.273+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf520d10 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf525760 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf525760 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf51c710 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.274+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf51c710 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.275+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.275+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf520d10 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.275+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.275+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf525760 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.275+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.275+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x7f74cc076040 2024-04-26T12:30:53.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf51c710 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf520d10 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf525760 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.276+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf520d10 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.277+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.277+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x7f74cc076040 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.277+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.277+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf525760 2024-04-26T12:30:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.277+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.277+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf520d10 2024-04-26T12:30:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x5570bf51c710 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f74cc090040 con 0x7f74cc076040 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.278+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf524020 con 0x5570bf51c710 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf524020 con 0x5570bf51c710 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf524020 con 0x7f74cc076040 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:53.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 zone default found 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 4 Realm: () 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 zonegroup default 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.279+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf524440 con 0x5570bf520d10 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf523fa0 con 0x5570bf525760 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52a150 con 0x5570bf525760 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 20 started sync module instance, tier type = 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.280+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5295f0 con 0x7f74cc076040 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.281+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.281+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93942734560016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5295f0 con 0x7f74cc076040 2024-04-26T12:30:53.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.281+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52ab10 con 0x5570bf51c710 2024-04-26T12:30:53.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.282+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93942734560016] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.283+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.283+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93942734563392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5295f0 con 0x5570bf51c710 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.283+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52b560 con 0x5570bf525760 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.284+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.284+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93942734565488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52be00 con 0x5570bf525760 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.284+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52c8a0 con 0x7f74cc076040 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.285+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93942734563392] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.285+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93942734565488] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.285+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.285+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93942734567760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf529140 con 0x7f74cc076040 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.285+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52d180 con 0x5570bf51c710 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.287+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93942734567760] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.287+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.287+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93942734570352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52d0c0 con 0x5570bf51c710 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.287+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52db90 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.288+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.288+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93942734575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52e3e0 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.288+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52eed0 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.288+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93942734570352] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.289+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.289+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93942734572560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52f720 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.289+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5300e0 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.289+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93942734575328] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93942734572560] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93942734577456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5300e0 con 0x5570bf520d10 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 20 add_watcher() i=0 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 20 add_watcher() i=1 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 20 add_watcher() i=2 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 20 add_watcher() i=3 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 20 add_watcher() i=4 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 20 add_watcher() i=5 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.290+0000 7f74db938800 20 add_watcher() i=6 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.291+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93942734577456] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.291+0000 7f74db938800 20 add_watcher() i=7 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.291+0000 7f74db938800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.291+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5332a0 con 0x5570bf51c710 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.292+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.292+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93942734584880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf530500 con 0x5570bf51c710 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.293+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93942734584880] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.293+0000 7f738dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.293+0000 7f74db938800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.293+0000 7f74db938800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.293+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53ba30 con 0x5570bf51c710 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.294+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.294+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53c040 con 0x5570bf520d10 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.296+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.296+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53c040 con 0x5570bf525760 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.297+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.297+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53ca60 con 0x5570bf51c710 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.298+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.298+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5399b0 con 0x7f74cc076040 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.299+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.299+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf5399b0 con 0x5570bf525760 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.299+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.300+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53d790 con 0x5570bf51c710 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.301+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.301+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53d790 con 0x5570bf520d10 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.302+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.302+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53d820 con 0x7f74cc076040 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.303+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.303+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53d820 con 0x5570bf525760 2024-04-26T12:30:53.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.304+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.304+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53dcd0 con 0x7f74cc076040 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.305+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'46 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.305+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53dcd0 con 0x5570bf520d10 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.306+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.306+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53dcd0 con 0x7f74cc076040 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.307+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.307+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53dcd0 con 0x5570bf520d10 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.309+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.309+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53dcd0 con 0x5570bf51c710 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.309+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.310+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53dcd0 con 0x5570bf525760 2024-04-26T12:30:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.311+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.311+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53ded0 con 0x7f74cc076040 2024-04-26T12:30:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.312+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'47 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.312+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf525760 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.313+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.313+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf51c710 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.314+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.314+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf51c710 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.315+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.315+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf525760 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.316+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.316+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x7f74cc076040 2024-04-26T12:30:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.317+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.317+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e470 con 0x5570bf525760 2024-04-26T12:30:53.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.318+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.318+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e470 con 0x5570bf525760 2024-04-26T12:30:53.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.319+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.319+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf525760 2024-04-26T12:30:53.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.320+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.320+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf525760 2024-04-26T12:30:53.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.321+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.321+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf520d10 2024-04-26T12:30:53.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.322+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.322+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf525760 2024-04-26T12:30:53.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.323+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.323+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e2a0 con 0x5570bf520d10 2024-04-26T12:30:53.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.324+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.324+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e470 con 0x5570bf525760 2024-04-26T12:30:53.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.325+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.326+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e470 con 0x5570bf520d10 2024-04-26T12:30:53.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.327+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.327+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf53e470 con 0x7f74cc076040 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.328+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.328+0000 7f738cfe1640 20 reqs_thread_entry: start 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.328+0000 7f74db938800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.328+0000 7f74db938800 20 Filter name: none 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.328+0000 7f73067fc640 20 reqs_thread_entry: start 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.329+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.329+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.329+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf51c710 2024-04-26T12:30:53.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.329+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.329+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.329+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.330+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.330+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.330+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf520d10 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.330+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.330+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf525760 2024-04-26T12:30:53.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.331+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf51c710 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.332+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x7f74cc076040 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.333+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.333+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.333+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.333+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.333+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.333+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf525760 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf51c710 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.334+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.335+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.335+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.335+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.335+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf520d10 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.335+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.335+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.336+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.336+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.336+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.336+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x7f74cc076040 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.336+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.336+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf525760 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.337+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.338+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.338+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x7f74cc076040 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.338+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.338+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.338+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.338+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.339+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.339+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf520d10 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.339+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.339+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.339+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.339+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.340+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.340+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x7f74cc076040 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.340+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.340+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.340+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.340+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.341+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.341+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf520d10 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.341+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.341+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf520d10 2024-04-26T12:30:53.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.342+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.342+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.342+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.342+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf51c710 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf51c710 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x5570bf525760 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.343+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x5570bf525760 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf568e20 con 0x7f74cc076040 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569e30 con 0x7f74cc076040 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 34 ==== osd_op_reply(144 gc.16 [call out=1702b] v0'0 uv44 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.344+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf51c710 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.345+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf51c710 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf51c710 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf51c710 2024-04-26T12:30:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf51c710 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.346+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf51c710 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.347+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x7f74cc076040 2024-04-26T12:30:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x7f74cc076040 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x7f74cc076040 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.348+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.349+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.350+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.351+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.351+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.351+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.351+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.351+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.351+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf520d10 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.352+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.352+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf520d10 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.352+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.352+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf520d10 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.352+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.352+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.353+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.353+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.353+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.353+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.353+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.353+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf520d10 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.354+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.354+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf520d10 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.354+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.354+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf520d10 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.354+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.354+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf525760 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf525760 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf520d10 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.355+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x5570bf520d10 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.356+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.356+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x5570bf520d10 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.356+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.356+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x7f74cc076040 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.356+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.356+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf569680 con 0x7f74cc076040 2024-04-26T12:30:53.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.357+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.357+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5570bf56a690 con 0x7f74cc076040 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.357+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.358+0000 7f738dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.358+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93942734584880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf567e10 con 0x5570bf51c710 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.359+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93942734584880] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.359+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93942734560016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52fc30 con 0x7f74cc076040 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.360+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93942734560016] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.360+0000 7f74db938800 20 remove_watcher() i=0 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.360+0000 7f74db938800 2 removed watcher, disabling cache 2024-04-26T12:30:53.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.360+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93942734563392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52fc30 con 0x5570bf51c710 2024-04-26T12:30:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.361+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93942734563392] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.361+0000 7f74db938800 20 remove_watcher() i=1 2024-04-26T12:30:53.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.361+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93942734565488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52a840 con 0x5570bf525760 2024-04-26T12:30:53.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.362+0000 7f74d6e95640 1 -- 172.21.15.170:0/1027408457 <== osd.3 v2:172.21.15.170:6816/2349137764 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93942734565488] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74cc081070 con 0x5570bf525760 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.362+0000 7f74db938800 20 remove_watcher() i=2 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.362+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93942734567760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52fc30 con 0x7f74cc076040 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.363+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.2 v2:172.21.15.170:6800/1189813177 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93942734567760] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x7f74cc076040 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.363+0000 7f74db938800 20 remove_watcher() i=3 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.363+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93942734570352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52b950 con 0x5570bf51c710 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.364+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93942734570352] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74d0026040 con 0x5570bf51c710 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.364+0000 7f74db938800 20 remove_watcher() i=4 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.364+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93942734575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52fc30 con 0x5570bf520d10 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.365+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93942734575328] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.365+0000 7f74db938800 20 remove_watcher() i=5 2024-04-26T12:30:53.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.365+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93942734572560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52b950 con 0x5570bf520d10 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.366+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93942734572560] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.366+0000 7f74db938800 20 remove_watcher() i=6 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.366+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93942734577456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5570bf52fc30 con 0x5570bf520d10 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.367+0000 7f74d7696640 1 -- 172.21.15.170:0/1027408457 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93942734577456] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74c8065030 con 0x5570bf520d10 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 20 remove_watcher() i=7 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf520d10 msgr2=0x5570bf523100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf520d10 0x5570bf523100 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf51c710 msgr2=0x5570bf51ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf51c710 0x5570bf51ebb0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f74cc076040 msgr2=0x7f74cc083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f74cc076040 0x7f74cc083410 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5570bf525760 msgr2=0x5570bf527c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5570bf525760 0x5570bf527c20 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73a00368b0 msgr2=0x7f73a0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73a00368b0 0x7f73a0038d70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f74cc052fd0 tx=0x7f74cc04f000 comp rx=0 tx=0).stop 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 msgr2=0x5570bf510fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74d7e97640 1 -- 172.21.15.170:0/1027408457 reap_dead start 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf510fb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f74c8038f70 tx=0x7f74c8021ea0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 shutdown_connections 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/1027408457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf509bb0 0x5570bf510fb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 >> 172.21.15.170:0/1027408457 conn(0x5570bf505ef0 msgr2=0x5570bf503550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 shutdown_connections 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/1027408457 wait complete. 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73b0036950 msgr2=0x7f73b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73b0036950 0x7f73b0038e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5570bf4e5c20 tx=0x7f74cc005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf4fca30 msgr2=0x5570bf4fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf4fca30 0x5570bf4fce50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000f80 tx=0x7f74c8043490 comp rx=0 tx=0).stop 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 shutdown_connections 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73b0036950 0x7f73b0038e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 --2- 172.21.15.170:0/978149631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf4fca30 0x5570bf4fce50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 >> 172.21.15.170:0/978149631 conn(0x5570bf4f0ad0 msgr2=0x5570bf4f0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 shutdown_connections 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.368+0000 7f74db938800 1 -- 172.21.15.170:0/978149631 wait complete. 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf4e7a80 msgr2=0x5570bf4e9e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5570bf4e7a80 0x5570bf4e9e70 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf3e7ab0 msgr2=0x5570bf4e5270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5570bf3e7ab0 0x5570bf4e5270 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5570bf4eba10 msgr2=0x5570bf4ede40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5570bf4eba10 0x5570bf4ede40 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73bc0369a0 msgr2=0x7f73bc038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f73bc0369a0 0x7f73bc038e60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f74cc054000 tx=0x7f74cc04e000 comp rx=0 tx=0).stop 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 msgr2=0x5570bf4de200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 --2- 172.21.15.170:0/2545181342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570bf3e4b20 0x5570bf4de200 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f74c8014040 tx=0x7f74c8001250 comp rx=0 tx=0).stop 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74d7e97640 1 -- 172.21.15.170:0/2545181342 reap_dead start 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 shutdown_connections 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 >> 172.21.15.170:0/2545181342 conn(0x5570bf3dd160 msgr2=0x5570bf4cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 shutdown_connections 2024-04-26T12:30:53.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.369+0000 7f74db938800 1 -- 172.21.15.170:0/2545181342 wait complete. 2024-04-26T12:30:53.383 INFO:teuthology.orchestra.run.smithi170.stdout:[{"tag":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.17386773605926641383\u0000","time":"2024-04-26T12:30:53.182209+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_7","key":"","instance":""}]}] 2024-04-26T12:30:53.383 DEBUG:tasks.util.rgw: json result: [{'tag': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.17386773605926641383\x00', 'time': '2024-04-26T12:30:53.182209+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_7', 'key': '', 'instance': ''}]}] 2024-04-26T12:30:53.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-26T12:30:53.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-26T12:30:53.384 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-26T12:30:53.425 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:53.425 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:53.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.424+0000 7fb9baa34800 1 Processor -- start 2024-04-26T12:30:53.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9baa34800 1 -- start start 2024-04-26T12:30:53.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9baa34800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5643c07f13d0 0x5643c07f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9baa34800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643c069f0c0 con 0x5643c07f2630 2024-04-26T12:30:53.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9baa34800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5643c06834d0 con 0x5643c07f13d0 2024-04-26T12:30:53.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9b8533640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5643c07f13d0 0x5643c07f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9b8533640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5643c07f13d0 0x5643c07f17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49242/0 (socket says 172.21.15.170:49242) 2024-04-26T12:30:53.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9b8533640 1 -- 172.21.15.170:0/315541548 learned_addr learned my addr 172.21.15.170:0/315541548 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9b8533640 1 -- 172.21.15.170:0/315541548 >> v1:172.21.15.132:6789/0 conn(0x5643c07f2630 legacy=0x5643c07f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.425+0000 7fb9b8533640 1 -- 172.21.15.170:0/315541548 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c06b0d40 con 0x5643c07f13d0 2024-04-26T12:30:53.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.427+0000 7fb9b8533640 1 --2- 172.21.15.170:0/315541548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c07f17f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800a520 tx=0x7fb9a801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d25138e65d106a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.427+0000 7fb9b7531640 1 -- 172.21.15.170:0/315541548 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8057070 con 0x5643c07f13d0 2024-04-26T12:30:53.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.427+0000 7fb9b7531640 1 -- 172.21.15.170:0/315541548 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a8052570 con 0x5643c07f13d0 2024-04-26T12:30:53.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.427+0000 7fb9b7531640 1 -- 172.21.15.170:0/315541548 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a804ae60 con 0x5643c07f13d0 2024-04-26T12:30:53.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.428+0000 7fb9baa34800 1 -- 172.21.15.170:0/315541548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 msgr2=0x5643c07f17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.428+0000 7fb9baa34800 1 --2- 172.21.15.170:0/315541548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c07f17f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800a520 tx=0x7fb9a801d010 comp rx=0 tx=0).stop 2024-04-26T12:30:53.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.428+0000 7fb9baa34800 1 -- 172.21.15.170:0/315541548 shutdown_connections 2024-04-26T12:30:53.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.428+0000 7fb9baa34800 1 --2- 172.21.15.170:0/315541548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c07f17f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.428+0000 7fb9baa34800 1 -- 172.21.15.170:0/315541548 >> 172.21.15.170:0/315541548 conn(0x5643c07ec9d0 msgr2=0x5643c07eedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.428+0000 7fb9baa34800 1 -- 172.21.15.170:0/315541548 shutdown_connections 2024-04-26T12:30:53.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.428+0000 7fb9baa34800 1 -- 172.21.15.170:0/315541548 wait complete. 2024-04-26T12:30:53.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9baa34800 1 Processor -- start 2024-04-26T12:30:53.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9baa34800 1 -- start start 2024-04-26T12:30:53.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9baa34800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9baa34800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5643c073db30 con 0x5643c07f13d0 2024-04-26T12:30:53.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08e5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49250/0 (socket says 172.21.15.170:49250) 2024-04-26T12:30:53.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9b8533640 1 -- 172.21.15.170:0/996400282 learned_addr learned my addr 172.21.15.170:0/996400282 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9b8533640 1 -- 172.21.15.170:0/996400282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c06af590 con 0x5643c07f13d0 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.440+0000 7fb9b8533640 1 --2- 172.21.15.170:0/996400282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08e5d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8055040 tx=0x7fb9a804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f648f2e48564f250 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb8a660c640 1 -- 172.21.15.170:0/996400282 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8057040 con 0x5643c07f13d0 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb8a660c640 1 -- 172.21.15.170:0/996400282 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a8052720 con 0x5643c07f13d0 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb8a660c640 1 -- 172.21.15.170:0/996400282 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8052a40 con 0x5643c07f13d0 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb9baa34800 1 -- 172.21.15.170:0/996400282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 msgr2=0x5643c08e5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb9baa34800 1 --2- 172.21.15.170:0/996400282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08e5d90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8055040 tx=0x7fb9a804c000 comp rx=0 tx=0).stop 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb9baa34800 1 -- 172.21.15.170:0/996400282 shutdown_connections 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb9baa34800 1 --2- 172.21.15.170:0/996400282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08e5d90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb9baa34800 1 -- 172.21.15.170:0/996400282 >> 172.21.15.170:0/996400282 conn(0x5643c07ec9d0 msgr2=0x5643c08dd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb9baa34800 1 -- 172.21.15.170:0/996400282 shutdown_connections 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.441+0000 7fb9baa34800 1 -- 172.21.15.170:0/996400282 wait complete. 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9baa34800 1 Processor -- start 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9baa34800 1 -- start start 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9baa34800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9baa34800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5643c0764d40 con 0x5643c07f13d0 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08ed650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49256/0 (socket says 172.21.15.170:49256) 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9b8533640 1 -- 172.21.15.170:0/3301449999 learned_addr learned my addr 172.21.15.170:0/3301449999 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9b8533640 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c06a68f0 con 0x5643c07f13d0 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.442+0000 7fb9b8533640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08ed650 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8052540 tx=0x7fb9a8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.443+0000 7fb8a4e09640 1 -- 172.21.15.170:0/3301449999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8073070 con 0x5643c07f13d0 2024-04-26T12:30:53.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.443+0000 7fb8a4e09640 1 -- 172.21.15.170:0/3301449999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a8052c90 con 0x5643c07f13d0 2024-04-26T12:30:53.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.443+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643c08edb90 con 0x5643c07f13d0 2024-04-26T12:30:53.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.443+0000 7fb8a4e09640 1 -- 172.21.15.170:0/3301449999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8057070 con 0x5643c07f13d0 2024-04-26T12:30:53.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.443+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c08ee0b0 con 0x5643c07f13d0 2024-04-26T12:30:53.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.443+0000 7fb8a4e09640 1 -- 172.21.15.170:0/3301449999 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9a8076070 con 0x5643c07f13d0 2024-04-26T12:30:53.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb8a4e09640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8a0036900 0x7fb8a0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb8a4e09640 1 -- 172.21.15.170:0/3301449999 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb9a808dad0 con 0x5643c07f13d0 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8a0036900 0x7fb8a0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c07f2630 0x5643c08f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c08f4c00 con 0x5643c07f2630 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9b8d34640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c07f2630 0x5643c08f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8a0036900 0x7fb8a0038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac001e10 tx=0x7fb9ac001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9b8d34640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c07f2630 0x5643c08f46c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9b8d34640 1 -- 172.21.15.170:0/3301449999 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c07f2630 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.444+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c08f54c0 con 0x5643c07f2630 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.445+0000 7fb9b8d34640 1 -- 172.21.15.170:0/3301449999 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c07f2630 2024-04-26T12:30:53.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.445+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c08f6e10 0x5643c08f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.445+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c08f9a30 con 0x5643c08f6e10 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.445+0000 7fb9b8533640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c08f6e10 0x5643c08f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.445+0000 7fb9b8533640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c08f6e10 0x5643c08f92a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.446+0000 7fb9b8533640 1 -- 172.21.15.170:0/3301449999 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9a8075030 con 0x5643c08f6e10 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.446+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c08f5d40 con 0x5643c07f2630 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.446+0000 7fb9b8d34640 1 -- 172.21.15.170:0/3301449999 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c07f2630 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.446+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5643c08faee0 0x5643c08fd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.446+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c08fdab0 con 0x5643c08faee0 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.446+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5643c08faee0 0x5643c08fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5643c08faee0 0x5643c08fd350 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9b7d32640 1 -- 172.21.15.170:0/3301449999 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb9ac0106a0 con 0x5643c08faee0 2024-04-26T12:30:53.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9baa34800 1 Processor -- start 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9baa34800 1 -- start start 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9baa34800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c090bf10 0x5643c090c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9baa34800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5643c06e3e60 con 0x5643c090bf10 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c090bf10 0x5643c090c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c090bf10 0x5643c090c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49268/0 (socket says 172.21.15.170:49268) 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.447+0000 7fb9b8533640 1 -- 172.21.15.170:0/1768103011 learned_addr learned my addr 172.21.15.170:0/1768103011 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.448+0000 7fb9b8533640 1 -- 172.21.15.170:0/1768103011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c090c870 con 0x5643c090bf10 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.448+0000 7fb9b8533640 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c090bf10 0x5643c090c330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8052a30 tx=0x7fb9a8077860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.448+0000 7fb89dffb640 1 -- 172.21.15.170:0/1768103011 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8083040 con 0x5643c090bf10 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.448+0000 7fb89dffb640 1 -- 172.21.15.170:0/1768103011 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a805d780 con 0x5643c090bf10 2024-04-26T12:30:53.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.448+0000 7fb89dffb640 1 -- 172.21.15.170:0/1768103011 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8076950 con 0x5643c090bf10 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.448+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643c090d2e0 con 0x5643c090bf10 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.448+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c090d2e0 con 0x5643c090bf10 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.449+0000 7fb89dffb640 1 -- 172.21.15.170:0/1768103011 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9a8076b10 con 0x5643c090bf10 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.449+0000 7fb89dffb640 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8900368b0 0x7fb890038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.449+0000 7fb89dffb640 1 -- 172.21.15.170:0/1768103011 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb9a8060110 con 0x5643c090bf10 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.449+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8900368b0 0x7fb890038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.449+0000 7fb9baa34800 1 Processor -- start 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.449+0000 7fb9baa34800 1 -- start start 2024-04-26T12:30:53.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.449+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8900368b0 0x7fb890038d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5643c08f1cd0 tx=0x7fb9ac006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb9baa34800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c09192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb9baa34800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5643c08e6450 con 0x5643c0918e80 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c09192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c09192a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49282/0 (socket says 172.21.15.170:49282) 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb9b8533640 1 -- 172.21.15.170:0/3842820495 learned_addr learned my addr 172.21.15.170:0/3842820495 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb9b8533640 1 -- 172.21.15.170:0/3842820495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c0919870 con 0x5643c0918e80 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb9b8533640 1 --2- 172.21.15.170:0/3842820495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c09192a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb9a805c7d0 tx=0x7fb9a806af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f705cca55f73668 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb88f7fe640 1 -- 172.21.15.170:0/3842820495 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8078440 con 0x5643c0918e80 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb88f7fe640 1 -- 172.21.15.170:0/3842820495 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a8076e00 con 0x5643c0918e80 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.450+0000 7fb88f7fe640 1 -- 172.21.15.170:0/3842820495 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8078600 con 0x5643c0918e80 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 -- 172.21.15.170:0/3842820495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 msgr2=0x5643c09192a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3842820495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c09192a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb9a805c7d0 tx=0x7fb9a806af40 comp rx=0 tx=0).stop 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 -- 172.21.15.170:0/3842820495 shutdown_connections 2024-04-26T12:30:53.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3842820495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c09192a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 -- 172.21.15.170:0/3842820495 >> 172.21.15.170:0/3842820495 conn(0x5643c09151e0 msgr2=0x5643c0913240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 -- 172.21.15.170:0/3842820495 shutdown_connections 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 -- 172.21.15.170:0/3842820495 wait complete. 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 Processor -- start 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 -- start start 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c0920290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9baa34800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5643c0919f20 con 0x5643c0918e80 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c0920290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9b8533640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c0920290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49286/0 (socket says 172.21.15.170:49286) 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.451+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 learned_addr learned my addr 172.21.15.170:0/2566002889 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.452+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c09207d0 con 0x5643c0918e80 2024-04-26T12:30:53.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.452+0000 7fb9b8533640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c0920290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb9a805c7d0 tx=0x7fb9a8073ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.452+0000 7fb88dffb640 1 -- 172.21.15.170:0/2566002889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a80b9070 con 0x5643c0918e80 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.452+0000 7fb88dffb640 1 -- 172.21.15.170:0/2566002889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a80975c0 con 0x5643c0918e80 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.452+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643c09207d0 con 0x5643c0918e80 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.452+0000 7fb88dffb640 1 -- 172.21.15.170:0/2566002889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a8078440 con 0x5643c0918e80 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.452+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c0920c70 con 0x5643c0918e80 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.453+0000 7fb88dffb640 1 -- 172.21.15.170:0/2566002889 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9a80c1060 con 0x5643c0918e80 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.453+0000 7fb88dffb640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb880036900 0x7fb880038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.453+0000 7fb88dffb640 1 -- 172.21.15.170:0/2566002889 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb9a80a9070 con 0x5643c0918e80 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.453+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb880036900 0x7fb880038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.453+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb880036900 0x7fb880038dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5643c08fdeb0 tx=0x7fb9ac011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.453+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.453+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c092b8e0 0x5643c092dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c092e4f0 con 0x5643c092b8e0 2024-04-26T12:30:53.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9b8d34640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c092b8e0 0x5643c092dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9b8d34640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c092b8e0 0x5643c092dda0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 20 realm 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c092e900 con 0x5643c092b8e0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f1d0 con 0x5643c092b8e0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.454+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9baa34800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c09302d0 0x5643c09326c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0932cd0 con 0x5643c09302d0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9b8533640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c09302d0 0x5643c09326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.455+0000 7fb9b8533640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c09302d0 0x5643c09326c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9baa34800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9baa34800 20 searching for the correct realm 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5643c0934c80 0x5643c0937140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c0937810 con 0x5643c0934c80 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5643c0934c80 0x5643c0937140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5643c0934c80 0x5643c0937140 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9b7d32640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb9ac0393c0 0x7fb9ac039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.456+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c0937810 con 0x7fb9ac0393c0 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.457+0000 7fb9b8d34640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb9ac0393c0 0x7fb9ac039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.457+0000 7fb9b8d34640 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb9ac0393c0 0x7fb9ac039810 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.457+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb9b000a4a0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.457+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.458+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.458+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.458+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.458+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.458+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.458+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x7fb9ac0393c0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000a4a0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.459+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x7fb9ac0393c0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000a4a0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b000a4a0 con 0x5643c092b8e0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x7fb9ac0393c0 2024-04-26T12:30:53.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.460+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.461+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.462+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x7fb9ac0393c0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.463+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.464+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.464+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x7fb9ac0393c0 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.464+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.464+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c0934c80 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.464+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.464+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c09302d0 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x5643c092b8e0 2024-04-26T12:30:53.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643c092f570 con 0x7fb9ac0393c0 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.465+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0933590 con 0x5643c092b8e0 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0933590 con 0x5643c092b8e0 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0933590 con 0x7fb9ac0393c0 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 zone default found 2024-04-26T12:30:53.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 4 Realm: () 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 zonegroup default 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.466+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0933e30 con 0x5643c09302d0 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0939670 con 0x5643c0934c80 2024-04-26T12:30:53.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0939a10 con 0x5643c0934c80 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 20 started sync module instance, tier type = 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.467+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0938b10 con 0x7fb9ac0393c0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.468+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.468+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94848993693792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0938b10 con 0x7fb9ac0393c0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.468+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093a3d0 con 0x5643c092b8e0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.469+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94848993693792] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.469+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.469+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94848993698048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0938b10 con 0x5643c092b8e0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.469+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093ae20 con 0x5643c0934c80 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.470+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94848993698048] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.470+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.470+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94848993691232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0938a80 con 0x5643c0934c80 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.471+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093bce0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.471+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.471+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94848993691232] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.471+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94848993704464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093b2d0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.471+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093c9f0 con 0x5643c092b8e0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.473+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.473+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94848993707264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093c920 con 0x5643c092b8e0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.473+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093d910 con 0x5643c09302d0 2024-04-26T12:30:53.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.473+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94848993704464] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.474+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94848993707264] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.474+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.474+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94848993709536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093be30 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.474+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093e1b0 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.475+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94848993709536] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.475+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.475+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94848993713328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093e0d0 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.475+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093ef40 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94848993713328] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94848993715536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093ee20 con 0x5643c09302d0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 20 add_watcher() i=0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 20 add_watcher() i=1 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 20 add_watcher() i=2 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 20 add_watcher() i=3 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 20 add_watcher() i=4 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 20 add_watcher() i=5 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.476+0000 7fb9baa34800 20 add_watcher() i=6 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.477+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94848993715536] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.477+0000 7fb9baa34800 20 add_watcher() i=7 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.477+0000 7fb9baa34800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.477+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0942360 con 0x5643c092b8e0 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.477+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.477+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94848993717056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093f820 con 0x5643c092b8e0 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.478+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94848993717056] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.478+0000 7fb86e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:53.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.478+0000 7fb9baa34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.478+0000 7fb9baa34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.479+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c09421c0 con 0x5643c092b8e0 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.480+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.480+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094b530 con 0x5643c09302d0 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.481+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.481+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094b530 con 0x5643c0934c80 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.481+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.482+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094bfd0 con 0x5643c092b8e0 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.482+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.482+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094ab00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.483+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.483+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094ab00 con 0x5643c0934c80 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.484+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.484+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094cd00 con 0x5643c092b8e0 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.485+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.485+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094cd90 con 0x5643c09302d0 2024-04-26T12:30:53.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.487+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.487+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094ce20 con 0x7fb9ac0393c0 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.488+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.488+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094ceb0 con 0x5643c0934c80 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.489+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.489+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d420 con 0x7fb9ac0393c0 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.490+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'49 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.490+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d420 con 0x5643c09302d0 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.491+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.491+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d420 con 0x7fb9ac0393c0 2024-04-26T12:30:53.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.492+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.492+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d4b0 con 0x5643c09302d0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.493+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.493+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d4b0 con 0x5643c092b8e0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.494+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.494+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d4b0 con 0x5643c0934c80 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.495+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.495+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094dae0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.496+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'50 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.496+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d9f0 con 0x5643c0934c80 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.497+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.497+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d9f0 con 0x5643c092b8e0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.498+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.498+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d9f0 con 0x5643c092b8e0 2024-04-26T12:30:53.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.499+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.499+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d9f0 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.500+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.500+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094d9f0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.501+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.501+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.502+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.502+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.503+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.503+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.504+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.504+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.505+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.505+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c09302d0 2024-04-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.506+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.506+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c0934c80 2024-04-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.507+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.507+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c09302d0 2024-04-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.508+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.509+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c0934c80 2024-04-26T12:30:53.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.510+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.510+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x5643c09302d0 2024-04-26T12:30:53.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.511+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.511+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c094a590 con 0x7fb9ac0393c0 2024-04-26T12:30:53.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.512+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.512+0000 7fb86d7e2640 20 reqs_thread_entry: start 2024-04-26T12:30:53.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.512+0000 7fb9baa34800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:53.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.512+0000 7fb9baa34800 20 Filter name: none 2024-04-26T12:30:53.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.512+0000 7fb7deffd640 20 reqs_thread_entry: start 2024-04-26T12:30:53.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.513+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-26T12:30:53.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.513+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:94 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(94 gc.22 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:95 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(95 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:96 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(96 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(97 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.514+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.515+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(98 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.515+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.515+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.516+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(99 gc.22 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.516+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.516+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:100 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(100 gc.23 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:101 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(101 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== osd_op_reply(102 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 35 ==== osd_op_reply(103 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 36 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.517+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:105 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.518+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 37 ==== osd_op_reply(105 gc.23 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.518+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-26T12:30:53.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.518+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.519+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 38 ==== osd_op_reply(106 gc.24 [call] v32'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.519+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.519+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 39 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.519+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.519+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:108 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 40 ==== osd_op_reply(108 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:109 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 41 ==== osd_op_reply(109 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac036040 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:110 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 42 ==== osd_op_reply(110 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.520+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:111 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.521+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 43 ==== osd_op_reply(111 gc.24 [call] v32'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.521+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.521+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:112 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.522+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 44 ==== osd_op_reply(112 gc.25 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.522+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:113 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.522+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 45 ==== osd_op_reply(113 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.522+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.522+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:114 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.522+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 46 ==== osd_op_reply(114 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.522+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:115 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.523+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 47 ==== osd_op_reply(115 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.523+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.523+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:116 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.523+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 48 ==== osd_op_reply(116 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.523+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.523+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:117 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.524+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 49 ==== osd_op_reply(117 gc.25 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.524+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.524+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:118 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.525+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(118 gc.26 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.525+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:119 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.525+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(119 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.525+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.525+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:120 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(120 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:121 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(121 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:122 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(122 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.526+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:123 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.527+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(123 gc.26 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.527+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-26T12:30:53.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.527+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:124 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.528+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 50 ==== osd_op_reply(124 gc.27 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.528+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:125 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 51 ==== osd_op_reply(125 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:126 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 52 ==== osd_op_reply(126 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:127 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 53 ==== osd_op_reply(127 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:128 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 54 ==== osd_op_reply(128 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.529+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:129 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.530+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 55 ==== osd_op_reply(129 gc.27 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.530+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.530+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:130 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.531+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(130 gc.28 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.531+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:131 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(131 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:132 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c09302d0 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(132 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:133 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(133 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:134 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(134 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.532+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:135 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.534+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== osd_op_reply(135 gc.28 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.534+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-26T12:30:53.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.534+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:136 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 56 ==== osd_op_reply(136 gc.29 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:137 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 57 ==== osd_op_reply(137 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:138 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 58 ==== osd_op_reply(138 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:139 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 59 ==== osd_op_reply(139 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.535+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:140 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.536+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 60 ==== osd_op_reply(140 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.536+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.536+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:141 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.536+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 61 ==== osd_op_reply(141 gc.29 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.536+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-26T12:30:53.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.536+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:142 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.537+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(142 gc.30 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:143 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(143 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:144 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(144 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:145 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(145 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.538+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:146 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.539+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(146 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.539+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.539+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:147 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.540+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(147 gc.30 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.540+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-26T12:30:53.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.540+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:148 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.541+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(148 gc.31 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.541+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:149 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(149 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:150 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x7fb9ac0393c0 2024-04-26T12:30:53.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(150 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:151 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(151 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:152 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(152 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.542+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:153 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.543+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(153 gc.31 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.543+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-26T12:30:53.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.543+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:154 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.544+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(154 gc.0 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.544+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:155 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(155 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:156 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c092b8e0 2024-04-26T12:30:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(156 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:157 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(157 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:158 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(158 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.545+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:159 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.546+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(159 gc.0 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.546+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.546+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:160 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.548+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== osd_op_reply(160 gc.1 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.548+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:161 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.548+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(161 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.548+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.548+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:162 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.548+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== osd_op_reply(162 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.548+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:163 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.549+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== osd_op_reply(163 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.549+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.549+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:164 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.549+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(164 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.549+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.549+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:165 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.550+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== osd_op_reply(165 gc.1 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.550+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.550+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:166 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.551+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 62 ==== osd_op_reply(166 gc.2 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.551+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:167 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.551+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 63 ==== osd_op_reply(167 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.551+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.551+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:168 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 64 ==== osd_op_reply(168 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:169 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 65 ==== osd_op_reply(169 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:170 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 66 ==== osd_op_reply(170 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.552+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:171 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.553+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 67 ==== osd_op_reply(171 gc.2 [call] v32'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.553+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.553+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:172 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.554+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(172 gc.3 [call] v32'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.554+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:173 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.554+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(173 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.554+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.554+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:174 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.554+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(174 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.554+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:175 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.555+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(175 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.555+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.555+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:176 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.555+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(176 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.555+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.555+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:177 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.556+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(177 gc.3 [call] v32'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.556+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-26T12:30:53.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.556+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:178 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(178 gc.4 [call] v32'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:179 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(179 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:180 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x7fb9ac0393c0 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== osd_op_reply(180 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:181 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(181 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.557+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:182 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.558+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(182 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.558+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.558+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:183 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.559+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== osd_op_reply(183 gc.4 [call] v32'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.559+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.559+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:184 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 68 ==== osd_op_reply(184 gc.5 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:185 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 69 ==== osd_op_reply(185 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:186 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 70 ==== osd_op_reply(186 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:187 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 71 ==== osd_op_reply(187 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:188 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 72 ==== osd_op_reply(188 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.560+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:189 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.561+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 73 ==== osd_op_reply(189 gc.5 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.561+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.561+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:190 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(190 gc.6 [call] v32'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:191 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(191 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:192 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== osd_op_reply(192 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:193 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(193 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.563+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:194 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.564+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== osd_op_reply(194 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.564+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.564+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:195 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.565+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(195 gc.6 [call] v32'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.565+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.565+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:196 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.566+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 48 ==== osd_op_reply(196 gc.7 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.566+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:197 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.566+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 49 ==== osd_op_reply(197 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.566+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.566+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:198 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.566+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 50 ==== osd_op_reply(198 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.566+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:199 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.567+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 51 ==== osd_op_reply(199 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.567+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.567+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:200 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.567+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 52 ==== osd_op_reply(200 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.567+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.567+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:201 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.568+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 53 ==== osd_op_reply(201 gc.7 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.568+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.568+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:202 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.569+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(202 gc.8 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.569+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:203 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.569+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== osd_op_reply(203 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.569+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.569+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:204 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x7fb9ac0393c0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 34 ==== osd_op_reply(204 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:205 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 35 ==== osd_op_reply(205 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:206 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 36 ==== osd_op_reply(206 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.570+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:207 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.571+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 37 ==== osd_op_reply(207 gc.8 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.571+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.571+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:208 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.572+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 74 ==== osd_op_reply(208 gc.9 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.572+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:209 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.572+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 75 ==== osd_op_reply(209 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.572+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.572+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:210 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.572+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 76 ==== osd_op_reply(210 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.572+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:211 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.573+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 77 ==== osd_op_reply(211 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.573+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.573+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:212 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.573+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 78 ==== osd_op_reply(212 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.573+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.573+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:213 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.574+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 79 ==== osd_op_reply(213 gc.9 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.574+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.574+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:214 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 38 ==== osd_op_reply(214 gc.10 [call] v32'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:215 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 39 ==== osd_op_reply(215 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:216 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 40 ==== osd_op_reply(216 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:217 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 41 ==== osd_op_reply(217 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.575+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:218 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.576+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 42 ==== osd_op_reply(218 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.576+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.576+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:219 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.576+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 43 ==== osd_op_reply(219 gc.10 [call] v32'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.576+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-26T12:30:53.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.576+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:220 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 54 ==== osd_op_reply(220 gc.11 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:221 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 55 ==== osd_op_reply(221 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:222 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 56 ==== osd_op_reply(222 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:223 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 57 ==== osd_op_reply(223 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.578+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:224 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.579+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 58 ==== osd_op_reply(224 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.579+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.579+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:225 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.580+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 59 ==== osd_op_reply(225 gc.11 [call] v32'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.580+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-26T12:30:53.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.580+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:226 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.581+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 44 ==== osd_op_reply(226 gc.12 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.581+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:227 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.581+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 45 ==== osd_op_reply(227 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:228 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 46 ==== osd_op_reply(228 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:229 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 47 ==== osd_op_reply(229 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:230 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 48 ==== osd_op_reply(230 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.582+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:231 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.583+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 49 ==== osd_op_reply(231 gc.12 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.583+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.583+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:232 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.584+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 60 ==== osd_op_reply(232 gc.13 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.584+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:233 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 61 ==== osd_op_reply(233 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:234 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 62 ==== osd_op_reply(234 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:235 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 63 ==== osd_op_reply(235 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.585+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:236 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.586+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 64 ==== osd_op_reply(236 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.586+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.586+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:237 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c09302d0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.586+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 65 ==== osd_op_reply(237 gc.13 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.586+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.586+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:238 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.587+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== osd_op_reply(238 gc.14 [call] v32'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.587+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:239 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.587+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(239 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.587+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.587+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:240 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c092b8e0 2024-04-26T12:30:53.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.587+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(240 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.587+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:241 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.588+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 48 ==== osd_op_reply(241 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.588+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.588+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:242 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.588+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 49 ==== osd_op_reply(242 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.588+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.588+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:243 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c092b8e0 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.589+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 50 ==== osd_op_reply(243 gc.14 [call] v32'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.589+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-26T12:30:53.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.589+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:244 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.590+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 80 ==== osd_op_reply(244 gc.15 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.590+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:245 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.590+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 81 ==== osd_op_reply(245 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.590+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.590+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:246 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x5643c0934c80 2024-04-26T12:30:53.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 82 ==== osd_op_reply(246 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:247 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 83 ==== osd_op_reply(247 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:248 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 84 ==== osd_op_reply(248 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.591+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:249 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x5643c0934c80 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.592+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 85 ==== osd_op_reply(249 gc.15 [call] v32'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.592+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.592+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:250 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.593+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 50 ==== osd_op_reply(250 gc.16 [call] v32'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.593+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:251 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.593+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 51 ==== osd_op_reply(251 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.593+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.593+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:252 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978d50 con 0x7fb9ac0393c0 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 52 ==== osd_op_reply(252 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:253 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 53 ==== osd_op_reply(253 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:254 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0979d60 con 0x7fb9ac0393c0 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 54 ==== osd_op_reply(254 gc.16 [call out=1702b] v0'0 uv55 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 20 garbage collection: RGWGC::process iterating over entry tag='1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.17386773605926641383', time=2024-04-26T12:30:53.182209+0000, chain.objs.size()=7 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_1 2024-04-26T12:30:53.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:255 3.3es0 3:7f692cb5:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0978010 con 0x5643c09302d0 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_2 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:256 3.29s0 3:9737d1c5:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c097cf30 con 0x5643c09302d0 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_3 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:257 3.22s0 3:464d9e87:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c097f7a0 con 0x5643c0934c80 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_4 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:258 3.3s0 3:c02dec94:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0982010 con 0x7fb9ac0393c0 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_5 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:259 3.15s0 3:abc7d2cf:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0984880 con 0x7fb9ac0393c0 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_6 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:260 3.33s0 3:ceee532c:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0982010 con 0x5643c09302d0 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_7 2024-04-26T12:30:53.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.594+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:261 3.2bs0 3:d489dde6:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0989640 con 0x5643c092b8e0 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.597+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 51 ==== osd_op_reply(261 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_7 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.597+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 66 ==== osd_op_reply(256 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_2 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.597+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 67 ==== osd_op_reply(255 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.597+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 68 ==== osd_op_reply(260 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_6 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.597+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 86 ==== osd_op_reply(257 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_3 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.598+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 55 ==== osd_op_reply(259 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_5 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.599+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 56 ==== osd_op_reply(258 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1__shadow_.yPcw61Eto7yqUkkfwqblk4Q1xssDA9m_4 [call] v32'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.599+0000 7fb9baa34800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-26T12:30:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.599+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:262 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.601+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 57 ==== osd_op_reply(262 gc.16 [call] v32'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.601+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:263 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.601+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 58 ==== osd_op_reply(263 gc.16 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.601+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.601+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:264 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.602+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 87 ==== osd_op_reply(264 gc.17 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.602+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:265 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 88 ==== osd_op_reply(265 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:266 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 89 ==== osd_op_reply(266 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:267 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 90 ==== osd_op_reply(267 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:268 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 91 ==== osd_op_reply(268 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.607 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.603+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:269 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.604+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 92 ==== osd_op_reply(269 gc.17 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.604+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-26T12:30:53.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.604+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:270 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.605+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 52 ==== osd_op_reply(270 gc.18 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.605+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:271 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.605+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 53 ==== osd_op_reply(271 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:272 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c097e2c0 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 54 ==== osd_op_reply(272 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:273 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 55 ==== osd_op_reply(273 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:274 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 56 ==== osd_op_reply(274 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.606+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:275 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.607+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 57 ==== osd_op_reply(275 gc.18 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.607+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-26T12:30:53.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.607+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:276 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.608+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 58 ==== osd_op_reply(276 gc.19 [call] v32'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.608+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:277 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.608+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 59 ==== osd_op_reply(277 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.608+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.608+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:278 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c097e2c0 con 0x5643c092b8e0 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.608+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 60 ==== osd_op_reply(278 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.609+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:279 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.609+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 61 ==== osd_op_reply(279 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.609+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.609+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:280 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.609+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 62 ==== osd_op_reply(280 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.609+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.609+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:281 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c092b8e0 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.610+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 63 ==== osd_op_reply(281 gc.19 [call] v32'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.610+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.610+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:282 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.611+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 93 ==== osd_op_reply(282 gc.20 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.611+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:283 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.611+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 94 ==== osd_op_reply(283 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.611+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.611+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:284 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.611+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 95 ==== osd_op_reply(284 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.611+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:285 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.612+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 96 ==== osd_op_reply(285 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.612+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.612+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:286 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.612+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 97 ==== osd_op_reply(286 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.612+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.612+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:287 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x5643c0934c80 2024-04-26T12:30:53.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.613+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 98 ==== osd_op_reply(287 gc.20 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.613+0000 7fb9baa34800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-26T12:30:53.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.613+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:288 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.614+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 59 ==== osd_op_reply(288 gc.21 [call] v32'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.614+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:289 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.614+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 60 ==== osd_op_reply(289 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.614+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.614+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:290 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.614+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 61 ==== osd_op_reply(290 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.614+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:291 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.615+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 62 ==== osd_op_reply(291 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.615+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.615+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:292 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.615+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 63 ==== osd_op_reply(292 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.615+0000 7fb9baa34800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.615+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:293 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0977a00 con 0x7fb9ac0393c0 2024-04-26T12:30:53.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.616+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 64 ==== osd_op_reply(293 gc.21 [call] v32'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.616+0000 7fb86e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:53.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.616+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94848993717056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0946ce0 con 0x5643c092b8e0 2024-04-26T12:30:53.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.617+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94848993717056] v32'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.617+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94848993693792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0946ce0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.618+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94848993693792] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.618+0000 7fb9baa34800 20 remove_watcher() i=0 2024-04-26T12:30:53.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.618+0000 7fb9baa34800 2 removed watcher, disabling cache 2024-04-26T12:30:53.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.618+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94848993698048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0946ce0 con 0x5643c092b8e0 2024-04-26T12:30:53.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.619+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94848993698048] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.620+0000 7fb9baa34800 20 remove_watcher() i=1 2024-04-26T12:30:53.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.620+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94848993691232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093a100 con 0x5643c0934c80 2024-04-26T12:30:53.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.621+0000 7fb9b7d32640 1 -- 172.21.15.170:0/2566002889 <== osd.3 v2:172.21.15.170:6816/2349137764 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94848993691232] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9ac052020 con 0x5643c0934c80 2024-04-26T12:30:53.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.621+0000 7fb9baa34800 20 remove_watcher() i=2 2024-04-26T12:30:53.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.621+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94848993704464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0946ce0 con 0x7fb9ac0393c0 2024-04-26T12:30:53.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.621+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.2 v2:172.21.15.170:6800/1189813177 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94848993704464] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x7fb9ac0393c0 2024-04-26T12:30:53.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.621+0000 7fb9baa34800 20 remove_watcher() i=3 2024-04-26T12:30:53.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.622+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94848993707264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0938660 con 0x5643c092b8e0 2024-04-26T12:30:53.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.622+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 <== osd.1 v2:172.21.15.170:6808/2372702203 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94848993707264] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9b0033040 con 0x5643c092b8e0 2024-04-26T12:30:53.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.622+0000 7fb9baa34800 20 remove_watcher() i=4 2024-04-26T12:30:53.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.622+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94848993709536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093a100 con 0x5643c09302d0 2024-04-26T12:30:53.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.623+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94848993709536] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.623+0000 7fb9baa34800 20 remove_watcher() i=5 2024-04-26T12:30:53.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.623+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94848993713328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c093ba10 con 0x5643c09302d0 2024-04-26T12:30:53.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.624+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94848993713328] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.624+0000 7fb9baa34800 20 remove_watcher() i=6 2024-04-26T12:30:53.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.624+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94848993715536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643c0946ce0 con 0x5643c09302d0 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9b8533640 1 -- 172.21.15.170:0/2566002889 <== osd.0 v2:172.21.15.132:6800/965566727 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94848993715536] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9a809e070 con 0x5643c09302d0 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 20 remove_watcher() i=7 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c09302d0 msgr2=0x5643c09326c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c09302d0 0x5643c09326c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c092b8e0 msgr2=0x5643c092dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c092b8e0 0x5643c092dda0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb9ac0393c0 msgr2=0x7fb9ac039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb9ac0393c0 0x7fb9ac039810 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5643c0934c80 msgr2=0x5643c0937140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5643c0934c80 0x5643c0937140 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb880036900 msgr2=0x7fb880038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb880036900 0x7fb880038dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5643c08fdeb0 tx=0x7fb9ac011000 comp rx=0 tx=0).stop 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 msgr2=0x5643c0920290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9b8d34640 1 -- 172.21.15.170:0/2566002889 reap_dead start 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.625+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c0920290 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb9a805c7d0 tx=0x7fb9a8073ef0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 shutdown_connections 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/2566002889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c0918e80 0x5643c0920290 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 >> 172.21.15.170:0/2566002889 conn(0x5643c09151e0 msgr2=0x5643c0912840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 shutdown_connections 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/2566002889 wait complete. 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8900368b0 msgr2=0x7fb890038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8900368b0 0x7fb890038d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5643c08f1cd0 tx=0x7fb9ac006000 comp rx=0 tx=0).stop 2024-04-26T12:30:53.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c090bf10 msgr2=0x5643c090c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c090bf10 0x5643c090c330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8052a30 tx=0x7fb9a8077860 comp rx=0 tx=0).stop 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 shutdown_connections 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8900368b0 0x7fb890038d70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/1768103011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c090bf10 0x5643c090c330 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 >> 172.21.15.170:0/1768103011 conn(0x5643c08fffb0 msgr2=0x5643c09003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 shutdown_connections 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/1768103011 wait complete. 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c08f6e10 msgr2=0x5643c08f92a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5643c08f6e10 0x5643c08f92a0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c07f2630 msgr2=0x5643c08f46c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5643c07f2630 0x5643c08f46c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5643c08faee0 msgr2=0x5643c08fd350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5643c08faee0 0x5643c08fd350 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8a0036900 msgr2=0x7fb8a0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb8a0036900 0x7fb8a0038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac001e10 tx=0x7fb9ac001390 comp rx=0 tx=0).stop 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 msgr2=0x5643c08ed650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 --2- 172.21.15.170:0/3301449999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5643c07f13d0 0x5643c08ed650 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8052540 tx=0x7fb9a8003020 comp rx=0 tx=0).stop 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9b8d34640 1 -- 172.21.15.170:0/3301449999 reap_dead start 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.626+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 shutdown_connections 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.627+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 >> 172.21.15.170:0/3301449999 conn(0x5643c07ec9d0 msgr2=0x5643c08e0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.627+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 shutdown_connections 2024-04-26T12:30:53.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.627+0000 7fb9baa34800 1 -- 172.21.15.170:0/3301449999 wait complete. 2024-04-26T12:30:53.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-26T12:30:53.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-26T12:30:53.636 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-26T12:30:53.719 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:53.719 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:53.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.717+0000 7f72cf933800 1 Processor -- start 2024-04-26T12:30:53.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72cf933800 1 -- start start 2024-04-26T12:30:53.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72cf933800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556b90c68870 0x556b90c6ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72cf933800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b90b120c0 con 0x556b90c643e0 2024-04-26T12:30:53.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72cf933800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x556b90af64d0 con 0x556b90c68870 2024-04-26T12:30:53.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72c2df4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556b90c68870 0x556b90c6ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72cb5f5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x556b90c643e0 0x556b90c64800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43986/0 (socket says 172.21.15.170:43986) 2024-04-26T12:30:53.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72cb5f5640 1 -- 172.21.15.170:0/637254791 learned_addr learned my addr 172.21.15.170:0/637254791 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:53.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72c2df4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556b90c68870 0x556b90c6ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49292/0 (socket says 172.21.15.170:49292) 2024-04-26T12:30:53.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72c2df4640 1 -- 172.21.15.170:0/637254791 >> v1:172.21.15.132:6789/0 conn(0x556b90c643e0 legacy=0x556b90c64800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72cadf4640 1 -- 172.21.15.170:0/637254791 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190680925 0 0) 0x556b90b120c0 con 0x556b90c643e0 2024-04-26T12:30:53.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.718+0000 7f72c2df4640 1 -- 172.21.15.170:0/637254791 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b90b23d40 con 0x556b90c68870 2024-04-26T12:30:53.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.720+0000 7f72c2df4640 1 --2- 172.21.15.170:0/637254791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c68870 0x556b90c6ac60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f72b400a470 tx=0x7f72b401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e93ebb3885f9f0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cadf4640 1 -- 172.21.15.170:0/637254791 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b4057070 con 0x556b90c68870 2024-04-26T12:30:53.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cadf4640 1 -- 172.21.15.170:0/637254791 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4052570 con 0x556b90c68870 2024-04-26T12:30:53.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cadf4640 1 -- 172.21.15.170:0/637254791 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72b4052870 con 0x556b90c68870 2024-04-26T12:30:53.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cf933800 1 -- 172.21.15.170:0/637254791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c68870 msgr2=0x556b90c6ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cf933800 1 --2- 172.21.15.170:0/637254791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c68870 0x556b90c6ac60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f72b400a470 tx=0x7f72b401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:53.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cf933800 1 -- 172.21.15.170:0/637254791 shutdown_connections 2024-04-26T12:30:53.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cf933800 1 --2- 172.21.15.170:0/637254791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c68870 0x556b90c6ac60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cf933800 1 -- 172.21.15.170:0/637254791 >> 172.21.15.170:0/637254791 conn(0x556b90c5f9e0 msgr2=0x556b90c61e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cf933800 1 -- 172.21.15.170:0/637254791 shutdown_connections 2024-04-26T12:30:53.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.721+0000 7f72cf933800 1 -- 172.21.15.170:0/637254791 wait complete. 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cf933800 1 Processor -- start 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cf933800 1 -- start start 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cf933800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90bd8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cf933800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556b90bb0b40 con 0x556b90c643e0 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90bd8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90bd8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49304/0 (socket says 172.21.15.170:49304) 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cb5f5640 1 -- 172.21.15.170:0/1971987503 learned_addr learned my addr 172.21.15.170:0/1971987503 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.733+0000 7f72cb5f5640 1 -- 172.21.15.170:0/1971987503 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b90b22590 con 0x556b90c643e0 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.734+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/1971987503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90bd8650 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00b240 tx=0x7f72bc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d5f26c3ee6a780 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.734+0000 7f71b960a640 1 -- 172.21.15.170:0/1971987503 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc008070 con 0x556b90c643e0 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.734+0000 7f71b960a640 1 -- 172.21.15.170:0/1971987503 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc00d500 con 0x556b90c643e0 2024-04-26T12:30:53.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.734+0000 7f71b960a640 1 -- 172.21.15.170:0/1971987503 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc00d860 con 0x556b90c643e0 2024-04-26T12:30:53.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.734+0000 7f72cf933800 1 -- 172.21.15.170:0/1971987503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 msgr2=0x556b90bd8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.734+0000 7f72cf933800 1 --2- 172.21.15.170:0/1971987503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90bd8650 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00b240 tx=0x7f72bc00b700 comp rx=0 tx=0).stop 2024-04-26T12:30:53.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 -- 172.21.15.170:0/1971987503 shutdown_connections 2024-04-26T12:30:53.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 --2- 172.21.15.170:0/1971987503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90bd8650 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 -- 172.21.15.170:0/1971987503 >> 172.21.15.170:0/1971987503 conn(0x556b90c5f9e0 msgr2=0x556b90d50ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 -- 172.21.15.170:0/1971987503 shutdown_connections 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 -- 172.21.15.170:0/1971987503 wait complete. 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 Processor -- start 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 -- start start 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90d5ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cf933800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556b90c6b530 con 0x556b90c643e0 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90d5ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90d5ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49308/0 (socket says 172.21.15.170:49308) 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cb5f5640 1 -- 172.21.15.170:0/2796191412 learned_addr learned my addr 172.21.15.170:0/2796191412 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.735+0000 7f72cb5f5640 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b90b198f0 con 0x556b90c643e0 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.736+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90d5ded0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f72bc000f60 tx=0x7f72bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.736+0000 7f71b7e07640 1 -- 172.21.15.170:0/2796191412 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc019870 con 0x556b90c643e0 2024-04-26T12:30:53.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.736+0000 7f71b7e07640 1 -- 172.21.15.170:0/2796191412 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc019a10 con 0x556b90c643e0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.736+0000 7f71b7e07640 1 -- 172.21.15.170:0/2796191412 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc019d10 con 0x556b90c643e0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.736+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b90d5e410 con 0x556b90c643e0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.736+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b90d5e930 con 0x556b90c643e0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f71b7e07640 1 -- 172.21.15.170:0/2796191412 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72bc017040 con 0x556b90c643e0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f71b7e07640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71b0036950 0x7f71b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f71b7e07640 1 -- 172.21.15.170:0/2796191412 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f72bc015020 con 0x556b90c643e0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f72c2df4640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71b0036950 0x7f71b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90c68870 0x556b90d64f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90d65480 con 0x556b90c68870 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f72cbdf6640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90c68870 0x556b90d64f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f72c2df4640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71b0036950 0x7f71b0038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f72b4054000 tx=0x7f72b404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.737+0000 7f72cbdf6640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90c68870 0x556b90d64f40 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.738+0000 7f72cbdf6640 1 -- 172.21.15.170:0/2796191412 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90c68870 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.738+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90d62510 con 0x556b90c68870 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.738+0000 7f72cbdf6640 1 -- 172.21.15.170:0/2796191412 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90c68870 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.738+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90d67770 0x556b90d69b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.738+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90d6a250 con 0x556b90d67770 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.738+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90d67770 0x556b90d69b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90d67770 0x556b90d69b60 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72cb5f5640 1 -- 172.21.15.170:0/2796191412 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72bc02d070 con 0x556b90d67770 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90d66720 con 0x556b90c68870 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72cbdf6640 1 -- 172.21.15.170:0/2796191412 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90c68870 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556b90d6b6b0 0x556b90d6db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90d6e2a0 con 0x556b90d6b6b0 2024-04-26T12:30:53.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72c2df4640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556b90d6b6b0 0x556b90d6db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.739+0000 7f72c2df4640 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556b90d6b6b0 0x556b90d6db40 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72c2df4640 1 -- 172.21.15.170:0/2796191412 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72b40528e0 con 0x556b90d6b6b0 2024-04-26T12:30:53.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72cf933800 1 Processor -- start 2024-04-26T12:30:53.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72cf933800 1 -- start start 2024-04-26T12:30:53.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72cf933800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d7c6e0 0x556b90d7cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72cf933800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556b90b56e60 con 0x556b90d7c6e0 2024-04-26T12:30:53.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d7c6e0 0x556b90d7cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d7c6e0 0x556b90d7cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49324/0 (socket says 172.21.15.170:49324) 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.740+0000 7f72cb5f5640 1 -- 172.21.15.170:0/964574649 learned_addr learned my addr 172.21.15.170:0/964574649 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.741+0000 7f72cb5f5640 1 -- 172.21.15.170:0/964574649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b90d7d040 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.741+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d7c6e0 0x556b90d7cb00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f72bc04b450 tx=0x7f72bc01aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.741+0000 7f71b5602640 1 -- 172.21.15.170:0/964574649 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc01acb0 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.741+0000 7f71b5602640 1 -- 172.21.15.170:0/964574649 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc01ae50 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.741+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b90d7dab0 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.741+0000 7f71b5602640 1 -- 172.21.15.170:0/964574649 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc00f5a0 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.741+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b90d7dfb0 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f71b5602640 1 -- 172.21.15.170:0/964574649 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72bc00f740 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f71b5602640 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71a40369c0 0x7f71a4038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f71b5602640 1 -- 172.21.15.170:0/964574649 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f72bc03ad60 con 0x556b90d7c6e0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f72c2df4640 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71a40369c0 0x7f71a4038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f72cf933800 1 Processor -- start 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f72cf933800 1 -- start start 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f72c2df4640 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71a40369c0 0x7f71a4038e80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x556b90d666f0 tx=0x7f72b4005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f72cf933800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d54f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.742+0000 7f72cf933800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556b90d59330 con 0x556b90d568a0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d54f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d54f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49328/0 (socket says 172.21.15.170:49328) 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f72cb5f5640 1 -- 172.21.15.170:0/224897919 learned_addr learned my addr 172.21.15.170:0/224897919 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f72cb5f5640 1 -- 172.21.15.170:0/224897919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b90d56d50 con 0x556b90d568a0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/224897919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d54f90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001540 tx=0x7f72bc030bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed73509ea59a2f04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f71aeffd640 1 -- 172.21.15.170:0/224897919 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc03e040 con 0x556b90d568a0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f71aeffd640 1 -- 172.21.15.170:0/224897919 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc040900 con 0x556b90d568a0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.743+0000 7f71aeffd640 1 -- 172.21.15.170:0/224897919 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc030480 con 0x556b90d568a0 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 -- 172.21.15.170:0/224897919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 msgr2=0x556b90d54f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 --2- 172.21.15.170:0/224897919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d54f90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001540 tx=0x7f72bc030bd0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 -- 172.21.15.170:0/224897919 shutdown_connections 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 --2- 172.21.15.170:0/224897919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d54f90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 -- 172.21.15.170:0/224897919 >> 172.21.15.170:0/224897919 conn(0x556b90d85d40 msgr2=0x556b90d83da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 -- 172.21.15.170:0/224897919 shutdown_connections 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 -- 172.21.15.170:0/224897919 wait complete. 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 Processor -- start 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 -- start start 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d92fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cf933800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556b90d554d0 con 0x556b90d568a0 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d92fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cb5f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d92fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49330/0 (socket says 172.21.15.170:49330) 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.744+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 learned_addr learned my addr 172.21.15.170:0/28680843 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.745+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b90d93510 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.745+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d92fd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f72bc041540 tx=0x7f72bc041570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.745+0000 7f71ad7fa640 1 -- 172.21.15.170:0/28680843 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc03e040 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.745+0000 7f71ad7fa640 1 -- 172.21.15.170:0/28680843 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc010df0 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.745+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b90d93510 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.745+0000 7f71ad7fa640 1 -- 172.21.15.170:0/28680843 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72bc041be0 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.745+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b90d93510 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f71ad7fa640 1 -- 172.21.15.170:0/28680843 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72bc024740 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f71ad7fa640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7194036950 0x7f7194038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f71ad7fa640 1 -- 172.21.15.170:0/28680843 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f72bc065070 con 0x556b90d568a0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f72c2df4640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7194036950 0x7f7194038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90d9e540 0x556b90da09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da1110 con 0x556b90d9e540 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f72cbdf6640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90d9e540 0x556b90da09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f72c2df4640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7194036950 0x7f7194038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f72b4052fd0 tx=0x7f72b404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.746+0000 7f72cbdf6640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90d9e540 0x556b90da09c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 realm 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da1520 con 0x556b90d9e540 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da1dc0 con 0x556b90d9e540 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90d9e540 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90da2ec0 0x556b90da52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da5830 con 0x556b90da2ec0 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.747+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90da2ec0 0x556b90da52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72cb5f5640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90da2ec0 0x556b90da52b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72cf933800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72cf933800 20 searching for the correct realm 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556b90da7880 0x556b90da9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90daa410 con 0x556b90da7880 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72c2df4640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556b90da7880 0x556b90da9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.748+0000 7f72c2df4640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556b90da7880 0x556b90da9d40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.749+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.749+0000 7f72c2df4640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f72b4076040 0x7f72b405e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.749+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90daa410 con 0x7f72b4076040 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.749+0000 7f72cbdf6640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f72b4076040 0x7f72b405e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.749+0000 7f72cbdf6640 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f72b4076040 0x7f72b405e480 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.749+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72c400a4a0 con 0x7f72b4076040 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.749+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90da2ec0 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.750+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.750+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90d9e540 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.750+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.750+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90d9e540 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.750+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.750+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90da2ec0 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.750+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90da2ec0 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x7f72b4076040 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c400a4a0 con 0x7f72b4076040 2024-04-26T12:30:53.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90da7880 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90d9e540 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.751+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x7f72b4076040 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c400a4a0 con 0x7f72b4076040 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90d9e540 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c400a4a0 con 0x556b90d9e540 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x7f72b4076040 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b90da2160 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.752+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da2ec0 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90d9e540 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.753+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90d9e540 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.754+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.754+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da2ec0 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.754+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.754+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da7880 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.754+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.754+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x7f72b4076040 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90d9e540 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da2ec0 2024-04-26T12:30:53.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da7880 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.755+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da2ec0 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x7f72b4076040 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da7880 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90da2ec0 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.756+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x556b90d9e540 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72b4090040 con 0x7f72b4076040 2024-04-26T12:30:53.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da6180 con 0x556b90d9e540 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da6180 con 0x556b90d9e540 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.757+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da6180 con 0x7f72b4076040 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 zone default found 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 4 Realm: () 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 zonegroup default 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90da6570 con 0x556b90da2ec0 2024-04-26T12:30:53.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dac270 con 0x556b90da7880 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.758+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dac610 con 0x556b90da7880 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.759+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.759+0000 7f72cf933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.759+0000 7f72cf933800 20 started sync module instance, tier type = 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.759+0000 7f72cf933800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.759+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90da6dd0 con 0x7f72b4076040 2024-04-26T12:30:53.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.760+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.760+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920480113248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dabb30 con 0x7f72b4076040 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.760+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dace60 con 0x556b90d9e540 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.761+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920480113248] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.761+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.761+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920480114576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dace60 con 0x556b90d9e540 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.761+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dad820 con 0x556b90da7880 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.762+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920480114576] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.762+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.762+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920480119216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dacdd0 con 0x556b90da7880 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.762+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dae560 con 0x7f72b4076040 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.763+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.763+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920480119216] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.763+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920480125040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90daee30 con 0x7f72b4076040 2024-04-26T12:30:53.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.763+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dadbe0 con 0x556b90d9e540 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.764+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.764+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920480130032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dadbe0 con 0x556b90d9e540 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.764+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db0320 con 0x556b90da2ec0 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.764+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920480125040] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.765+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.765+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920480127360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db0710 con 0x556b90da2ec0 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.765+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920480130032] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.765+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db0c20 con 0x556b90da2ec0 2024-04-26T12:30:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.766+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920480127360] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.766+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.766+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920480132656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db1470 con 0x556b90da2ec0 2024-04-26T12:30:53.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.766+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db1d20 con 0x556b90da2ec0 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920480132656] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920480137152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db2190 con 0x556b90da2ec0 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 20 add_watcher() i=0 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 20 add_watcher() i=1 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 20 add_watcher() i=2 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 20 add_watcher() i=3 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 20 add_watcher() i=4 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 20 add_watcher() i=5 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.767+0000 7f72cf933800 20 add_watcher() i=6 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.768+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920480137152] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.768+0000 7f72cf933800 20 add_watcher() i=7 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.768+0000 7f72cf933800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:53.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.768+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90db5510 con 0x556b90d9e540 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.768+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.768+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920480140880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db2720 con 0x556b90d9e540 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.769+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920480140880] v32'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.769+0000 7f7181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.769+0000 7f72cf933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.769+0000 7f72cf933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.770+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbdd00 con 0x556b90d9e540 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.770+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.771+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbe270 con 0x556b90da2ec0 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.771+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.771+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbe270 con 0x556b90da7880 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.772+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.772+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbecf0 con 0x556b90d9e540 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.773+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.773+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db9b90 con 0x7f72b4076040 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.774+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'58 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.774+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90db9b60 con 0x556b90da7880 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.775+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.775+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbfa20 con 0x556b90d9e540 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.776+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.777+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbfe00 con 0x556b90da2ec0 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.777+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.778+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbfe00 con 0x7f72b4076040 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.778+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.778+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbfe00 con 0x556b90da7880 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.779+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.779+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x7f72b4076040 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.780+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'59 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.780+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da2ec0 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.781+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.781+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x7f72b4076040 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.782+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.782+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da2ec0 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.783+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.783+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90d9e540 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.784+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.784+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.785+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.785+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x7f72b4076040 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.786+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'60 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.786+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.787+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.787+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90d9e540 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.788+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.788+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90d9e540 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.789+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.789+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.790+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.790+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x7f72b4076040 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.791+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.791+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.792+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.792+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.793+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.793+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.794+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.794+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.795+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.795+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da2ec0 2024-04-26T12:30:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.796+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.796+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.797+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.797+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da2ec0 2024-04-26T12:30:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.798+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.798+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da7880 2024-04-26T12:30:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.799+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.799+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x556b90da2ec0 2024-04-26T12:30:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.800+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.800+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dc02b0 con 0x7f72b4076040 2024-04-26T12:30:53.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.801+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.801+0000 7f7180fe1640 20 reqs_thread_entry: start 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.801+0000 7f72cf933800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.801+0000 7f72cf933800 20 Filter name: none 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.801+0000 7f70fa7fc640 20 reqs_thread_entry: start 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.801+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.802+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.802+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90d9e540 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.802+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.802+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.802+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.802+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.803+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.803+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da2ec0 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.803+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.803+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.803+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.803+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.804+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90d9e540 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x7f72b4076040 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.805+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.806+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.806+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.806+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.806+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.806+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.806+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90d9e540 2024-04-26T12:30:53.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.807+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da2ec0 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.808+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x7f72b4076040 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.809+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.809+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.809+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.809+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.809+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.809+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x7f72b4076040 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.810+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da2ec0 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.811+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.812+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.812+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x7f72b4076040 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.812+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.812+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.812+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.812+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da2ec0 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.813+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90d9e540 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.814+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x7f72b4076040 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.815+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.816+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.816+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.816+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.816+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.816+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.816+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.816+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90d9e540 2024-04-26T12:30:53.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.817+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90d9e540 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.818+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.819+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.819+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x7f72b4076040 2024-04-26T12:30:53.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.819+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.819+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.819+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.819+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.819+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.820+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.820+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.820+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.820+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.820+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.820+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.820+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.837 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.821+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.822+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.822+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.822+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.822+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.822+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.822+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.822+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da2ec0 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.823+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.824+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.824+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.824+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.824+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.824+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.824+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da2ec0 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.825+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.825+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.825+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.825+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da7880 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da7880 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.826+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x556b90da2ec0 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x556b90da2ec0 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90deb010 con 0x7f72b4076040 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.827+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b90dec020 con 0x7f72b4076040 2024-04-26T12:30:53.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.828+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.828+0000 7f7181fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.828+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920480140880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbe840 con 0x556b90d9e540 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.829+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93920480140880] v32'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.829+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920480113248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dbe840 con 0x7f72b4076040 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.830+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93920480113248] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.830+0000 7f72cf933800 20 remove_watcher() i=0 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.830+0000 7f72cf933800 2 removed watcher, disabling cache 2024-04-26T12:30:53.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.830+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920480114576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dab260 con 0x556b90d9e540 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.831+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93920480114576] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.832+0000 7f72cf933800 20 remove_watcher() i=1 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.832+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920480119216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dab260 con 0x556b90da7880 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.833+0000 7f72c2df4640 1 -- 172.21.15.170:0/28680843 <== osd.3 v2:172.21.15.170:6816/2349137764 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93920480119216] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72b4081070 con 0x556b90da7880 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.833+0000 7f72cf933800 20 remove_watcher() i=2 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.833+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920480125040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dac9b0 con 0x7f72b4076040 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.834+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.2 v2:172.21.15.170:6800/1189813177 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93920480125040] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x7f72b4076040 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.834+0000 7f72cf933800 20 remove_watcher() i=3 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.834+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920480130032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dab260 con 0x556b90d9e540 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.835+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93920480130032] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72c4033040 con 0x556b90d9e540 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.835+0000 7f72cf933800 20 remove_watcher() i=4 2024-04-26T12:30:53.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.835+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920480127360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dac9b0 con 0x556b90da2ec0 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.836+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93920480127360] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.836+0000 7f72cf933800 20 remove_watcher() i=5 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.836+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920480132656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90daf3f0 con 0x556b90da2ec0 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.837+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93920480132656] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.837+0000 7f72cf933800 20 remove_watcher() i=6 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.837+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920480137152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b90dab260 con 0x556b90da2ec0 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cb5f5640 1 -- 172.21.15.170:0/28680843 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93920480137152] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72bc06e020 con 0x556b90da2ec0 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 20 remove_watcher() i=7 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90da2ec0 msgr2=0x556b90da52b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90da2ec0 0x556b90da52b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90d9e540 msgr2=0x556b90da09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90d9e540 0x556b90da09c0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f72b4076040 msgr2=0x7f72b405e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f72b4076040 0x7f72b405e480 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556b90da7880 msgr2=0x556b90da9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556b90da7880 0x556b90da9d40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7194036950 msgr2=0x7f7194038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7194036950 0x7f7194038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f72b4052fd0 tx=0x7f72b404f000 comp rx=0 tx=0).stop 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 msgr2=0x556b90d92fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d92fd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f72bc041540 tx=0x7f72bc041570 comp rx=0 tx=0).stop 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cbdf6640 1 -- 172.21.15.170:0/28680843 reap_dead start 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 shutdown_connections 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/28680843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d568a0 0x556b90d92fd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 >> 172.21.15.170:0/28680843 conn(0x556b90d85d40 msgr2=0x556b90d833a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 shutdown_connections 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/28680843 wait complete. 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71a40369c0 msgr2=0x7f71a4038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71a40369c0 0x7f71a4038e80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x556b90d666f0 tx=0x7f72b4005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d7c6e0 msgr2=0x556b90d7cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.838+0000 7f72cf933800 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d7c6e0 0x556b90d7cb00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f72bc04b450 tx=0x7f72bc01aaf0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 shutdown_connections 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71a40369c0 0x7f71a4038e80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 --2- 172.21.15.170:0/964574649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90d7c6e0 0x556b90d7cb00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 >> 172.21.15.170:0/964574649 conn(0x556b90d70780 msgr2=0x556b90d70b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 shutdown_connections 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/964574649 wait complete. 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90d67770 msgr2=0x556b90d69b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556b90d67770 0x556b90d69b60 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90c68870 msgr2=0x556b90d64f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556b90c68870 0x556b90d64f40 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556b90d6b6b0 msgr2=0x556b90d6db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556b90d6b6b0 0x556b90d6db40 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71b0036950 msgr2=0x7f71b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f71b0036950 0x7f71b0038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f72b4054000 tx=0x7f72b404e000 comp rx=0 tx=0).stop 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 msgr2=0x556b90d5ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 --2- 172.21.15.170:0/2796191412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556b90c643e0 0x556b90d5ded0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f72bc000f60 tx=0x7f72bc000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cbdf6640 1 -- 172.21.15.170:0/2796191412 reap_dead start 2024-04-26T12:30:53.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 shutdown_connections 2024-04-26T12:30:53.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 >> 172.21.15.170:0/2796191412 conn(0x556b90c5f9e0 msgr2=0x556b90d4f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 shutdown_connections 2024-04-26T12:30:53.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.839+0000 7f72cf933800 1 -- 172.21.15.170:0/2796191412 wait complete. 2024-04-26T12:30:53.856 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-04-26T12:30:53.856 DEBUG:tasks.util.rgw: json result: [] 2024-04-26T12:30:53.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T12:30:53.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T12:30:53.856 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T12:30:53.938 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:53.939 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.937+0000 7f582b575800 1 Processor -- start 2024-04-26T12:30:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.937+0000 7f582b575800 1 -- start start 2024-04-26T12:30:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.937+0000 7f582b575800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a762d64960 0x55a762d66d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.937+0000 7f582b575800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a762c0d0c0 con 0x55a762d605c0 2024-04-26T12:30:53.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.937+0000 7f582b575800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55a762bf14d0 con 0x55a762d64960 2024-04-26T12:30:53.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.938+0000 7f5828873640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a762d64960 0x55a762d66d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.938+0000 7f5828873640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a762d64960 0x55a762d66d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49340/0 (socket says 172.21.15.170:49340) 2024-04-26T12:30:53.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.938+0000 7f5828873640 1 -- 172.21.15.170:0/3527266676 learned_addr learned my addr 172.21.15.170:0/3527266676 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.938+0000 7f5828873640 1 -- 172.21.15.170:0/3527266676 >> v1:172.21.15.132:6789/0 conn(0x55a762d605c0 legacy=0x55a762d609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.938+0000 7f5828873640 1 -- 172.21.15.170:0/3527266676 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a762c1ed40 con 0x55a762d64960 2024-04-26T12:30:53.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.940+0000 7f5828873640 1 --2- 172.21.15.170:0/3527266676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d64960 0x55a762d66d50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f582000a520 tx=0x7f582001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e44980899a2575e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.940+0000 7f581bfff640 1 -- 172.21.15.170:0/3527266676 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820057070 con 0x55a762d64960 2024-04-26T12:30:53.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.940+0000 7f581bfff640 1 -- 172.21.15.170:0/3527266676 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820052570 con 0x55a762d64960 2024-04-26T12:30:53.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.940+0000 7f581bfff640 1 -- 172.21.15.170:0/3527266676 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582004ae60 con 0x55a762d64960 2024-04-26T12:30:53.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.940+0000 7f582b575800 1 -- 172.21.15.170:0/3527266676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d64960 msgr2=0x55a762d66d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.940+0000 7f582b575800 1 --2- 172.21.15.170:0/3527266676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d64960 0x55a762d66d50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f582000a520 tx=0x7f582001d010 comp rx=0 tx=0).stop 2024-04-26T12:30:53.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.941+0000 7f582b575800 1 -- 172.21.15.170:0/3527266676 shutdown_connections 2024-04-26T12:30:53.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.941+0000 7f582b575800 1 --2- 172.21.15.170:0/3527266676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d64960 0x55a762d66d50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.941+0000 7f582b575800 1 -- 172.21.15.170:0/3527266676 >> 172.21.15.170:0/3527266676 conn(0x55a762d5bb80 msgr2=0x55a762d5dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.941+0000 7f582b575800 1 -- 172.21.15.170:0/3527266676 shutdown_connections 2024-04-26T12:30:53.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.941+0000 7f582b575800 1 -- 172.21.15.170:0/3527266676 wait complete. 2024-04-26T12:30:53.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.952+0000 7f582b575800 1 Processor -- start 2024-04-26T12:30:53.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.952+0000 7f582b575800 1 -- start start 2024-04-26T12:30:53.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.952+0000 7f582b575800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e51730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.952+0000 7f582b575800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a762cabb40 con 0x55a762d605c0 2024-04-26T12:30:53.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e51730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e51730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49346/0 (socket says 172.21.15.170:49346) 2024-04-26T12:30:53.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5829074640 1 -- 172.21.15.170:0/304816628 learned_addr learned my addr 172.21.15.170:0/304816628 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5829074640 1 -- 172.21.15.170:0/304816628 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a762c1d590 con 0x55a762d605c0 2024-04-26T12:30:53.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5829074640 1 --2- 172.21.15.170:0/304816628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e51730 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f581c001d50 tx=0x7f581c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7682f7b4469eb97c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5717606640 1 -- 172.21.15.170:0/304816628 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c00f400 con 0x55a762d605c0 2024-04-26T12:30:53.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5717606640 1 -- 172.21.15.170:0/304816628 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c00f5a0 con 0x55a762d605c0 2024-04-26T12:30:53.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.953+0000 7f5717606640 1 -- 172.21.15.170:0/304816628 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c00f7d0 con 0x55a762d605c0 2024-04-26T12:30:53.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 -- 172.21.15.170:0/304816628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 msgr2=0x55a762e51730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 --2- 172.21.15.170:0/304816628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e51730 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f581c001d50 tx=0x7f581c00b5b0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 -- 172.21.15.170:0/304816628 shutdown_connections 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 --2- 172.21.15.170:0/304816628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e51730 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 -- 172.21.15.170:0/304816628 >> 172.21.15.170:0/304816628 conn(0x55a762d5bb80 msgr2=0x55a762e4d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 -- 172.21.15.170:0/304816628 shutdown_connections 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 -- 172.21.15.170:0/304816628 wait complete. 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 Processor -- start 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 -- start start 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e59180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.954+0000 7f582b575800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a762d67620 con 0x55a762d605c0 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e59180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49356/0 (socket says 172.21.15.170:49356) 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5829074640 1 -- 172.21.15.170:0/3583020162 learned_addr learned my addr 172.21.15.170:0/3583020162 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5829074640 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a762c148f0 con 0x55a762d605c0 2024-04-26T12:30:53.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5829074640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e59180 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f581c00b5f0 tx=0x7f581c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5715e03640 1 -- 172.21.15.170:0/3583020162 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c01a7c0 con 0x55a762d605c0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5715e03640 1 -- 172.21.15.170:0/3583020162 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c01a960 con 0x55a762d605c0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a762e596c0 con 0x55a762d605c0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f5715e03640 1 -- 172.21.15.170:0/3583020162 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c01ac40 con 0x55a762d605c0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.955+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a762e59c40 con 0x55a762d605c0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.956+0000 7f5715e03640 1 -- 172.21.15.170:0/3583020162 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f581c017070 con 0x55a762d605c0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.956+0000 7f5715e03640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5710036950 0x7f5710038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.956+0000 7f5715e03640 1 -- 172.21.15.170:0/3583020162 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f581c015020 con 0x55a762d605c0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.956+0000 7f5828873640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5710036950 0x7f5710038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.956+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762d64960 0x55a762e60150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.956+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e60690 con 0x55a762d64960 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f5829875640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762d64960 0x55a762e60150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f5828873640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5710036950 0x7f5710038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5820054000 tx=0x7f582004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f5829875640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762d64960 0x55a762e60150 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f5829875640 1 -- 172.21.15.170:0/3583020162 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762d64960 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e5d720 con 0x55a762d64960 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f5829875640 1 -- 172.21.15.170:0/3583020162 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762d64960 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e629a0 0x55a762e64d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.957+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e65430 con 0x55a762e629a0 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.958+0000 7f5829074640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e629a0 0x55a762e64d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.958+0000 7f5829074640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e629a0 0x55a762e64d90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.958+0000 7f5829074640 1 -- 172.21.15.170:0/3583020162 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f581c02e070 con 0x55a762e629a0 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.958+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e61950 con 0x55a762d64960 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.958+0000 7f5829875640 1 -- 172.21.15.170:0/3583020162 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762d64960 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.958+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a762e668e0 0x55a762e68d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.958+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e69490 con 0x55a762e668e0 2024-04-26T12:30:53.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.959+0000 7f5828873640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a762e668e0 0x55a762e68d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.959+0000 7f5828873640 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a762e668e0 0x55a762e68d30 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.959+0000 7f5828873640 1 -- 172.21.15.170:0/3583020162 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f582005a040 con 0x55a762e668e0 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.959+0000 7f582b575800 1 Processor -- start 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.959+0000 7f582b575800 1 -- start start 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f582b575800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762cd6280 0x55a762cd46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f582b575800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a762c51e60 con 0x55a762cd6280 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762cd6280 0x55a762cd46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762cd6280 0x55a762cd46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49358/0 (socket says 172.21.15.170:49358) 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f5829074640 1 -- 172.21.15.170:0/1299722213 learned_addr learned my addr 172.21.15.170:0/1299722213 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f5829074640 1 -- 172.21.15.170:0/1299722213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a762cd4c30 con 0x55a762cd6280 2024-04-26T12:30:53.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f5829074640 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762cd6280 0x55a762cd46f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f581c01beb0 tx=0x7f581c044500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f570effd640 1 -- 172.21.15.170:0/1299722213 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c04c040 con 0x55a762cd6280 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f570effd640 1 -- 172.21.15.170:0/1299722213 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c017490 con 0x55a762cd6280 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a762cd4e60 con 0x55a762cd6280 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f570effd640 1 -- 172.21.15.170:0/1299722213 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c01dda0 con 0x55a762cd6280 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.960+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a762cd4e60 con 0x55a762cd6280 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.961+0000 7f570effd640 1 -- 172.21.15.170:0/1299722213 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f581c039030 con 0x55a762cd6280 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.961+0000 7f570effd640 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5700036950 0x7f5700038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.961+0000 7f570effd640 1 -- 172.21.15.170:0/1299722213 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f581c037070 con 0x55a762cd6280 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.961+0000 7f5828873640 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5700036950 0x7f5700038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.961+0000 7f582b575800 1 Processor -- start 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.961+0000 7f582b575800 1 -- start start 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.961+0000 7f5828873640 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5700036950 0x7f5700038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55a762e5d640 tx=0x7f5820005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f582b575800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e86c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f582b575800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a762e51eb0 con 0x55a762e86820 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e86c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e86c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49372/0 (socket says 172.21.15.170:49372) 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f5829074640 1 -- 172.21.15.170:0/4261197422 learned_addr learned my addr 172.21.15.170:0/4261197422 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f5829074640 1 -- 172.21.15.170:0/4261197422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a762e87210 con 0x55a762e86820 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f5829074640 1 --2- 172.21.15.170:0/4261197422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e86c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f581c01c740 tx=0x7f581c031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bdb2348709263c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f570cff9640 1 -- 172.21.15.170:0/4261197422 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c05c020 con 0x55a762e86820 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f570cff9640 1 -- 172.21.15.170:0/4261197422 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c04ce50 con 0x55a762e86820 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.962+0000 7f570cff9640 1 -- 172.21.15.170:0/4261197422 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c03cdc0 con 0x55a762e86820 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 -- 172.21.15.170:0/4261197422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 msgr2=0x55a762e86c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 --2- 172.21.15.170:0/4261197422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e86c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f581c01c740 tx=0x7f581c031a30 comp rx=0 tx=0).stop 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 -- 172.21.15.170:0/4261197422 shutdown_connections 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 --2- 172.21.15.170:0/4261197422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e86c40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 -- 172.21.15.170:0/4261197422 >> 172.21.15.170:0/4261197422 conn(0x55a762e82b80 msgr2=0x55a762e80be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 -- 172.21.15.170:0/4261197422 shutdown_connections 2024-04-26T12:30:53.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 -- 172.21.15.170:0/4261197422 wait complete. 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 Processor -- start 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 -- start start 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e8dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f582b575800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a762e878c0 con 0x55a762e86820 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e8dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f5829074640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e8dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49384/0 (socket says 172.21.15.170:49384) 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.963+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 learned_addr learned my addr 172.21.15.170:0/1926872255 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.964+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a762e8e150 con 0x55a762e86820 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.964+0000 7f5829074640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e8dc10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f581c031ef0 tx=0x7f581c04d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.964+0000 7f56feffd640 1 -- 172.21.15.170:0/1926872255 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c070070 con 0x55a762e86820 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.964+0000 7f56feffd640 1 -- 172.21.15.170:0/1926872255 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581c03f170 con 0x55a762e86820 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.964+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a762e8e150 con 0x55a762e86820 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.964+0000 7f56feffd640 1 -- 172.21.15.170:0/1926872255 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f581c00ea70 con 0x55a762e86820 2024-04-26T12:30:53.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.964+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a762e8e150 con 0x55a762e86820 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.965+0000 7f56feffd640 1 -- 172.21.15.170:0/1926872255 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f581c073070 con 0x55a762e86820 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.965+0000 7f56feffd640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f56f4036950 0x7f56f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.965+0000 7f56feffd640 1 -- 172.21.15.170:0/1926872255 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f581c068070 con 0x55a762e86820 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.965+0000 7f5828873640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f56f4036950 0x7f56f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.965+0000 7f5828873640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f56f4036950 0x7f56f4038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5820000c00 tx=0x7f582004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.965+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762e99280 0x55a762e9b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9be90 con 0x55a762e99280 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f5829875640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762e99280 0x55a762e9b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f5829875640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762e99280 0x55a762e9b740 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 20 realm 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9c2a0 con 0x55a762e99280 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.966+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cb70 con 0x55a762e99280 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f582b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e99280 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f582b575800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e9dc70 0x55a762ea0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea0670 con 0x55a762e9dc70 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f5829074640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e9dc70 0x55a762ea0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.967+0000 7f5829074640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e9dc70 0x55a762ea0060 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f582b575800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f582b575800 20 searching for the correct realm 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a762ea2600 0x55a762ea4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea5190 con 0x55a762ea2600 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f5828873640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a762ea2600 0x55a762ea4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f5828873640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a762ea2600 0x55a762ea4ac0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f5828873640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5820074040 0x7f5820081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:53.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.968+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea5190 con 0x7f5820074040 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.969+0000 7f5829875640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5820074040 0x7f5820081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.969+0000 7f5829875640 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5820074040 0x7f5820081410 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.969+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f582400a4a0 con 0x7f5820074040 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.969+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e9dc70 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.969+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.969+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e99280 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e99280 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e9dc70 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e9dc70 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x7f5820074040 2024-04-26T12:30:53.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400a4a0 con 0x7f5820074040 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.970+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762ea2600 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e99280 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x7f5820074040 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400a4a0 con 0x7f5820074040 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762e99280 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582400a4a0 con 0x55a762e99280 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.971+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x7f5820074040 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:53.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a762e9cf10 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e9dc70 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.972+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e99280 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e99280 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:53.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.973+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e9dc70 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762ea2600 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x7f5820074040 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e99280 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.974+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e9dc70 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.975+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.975+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762ea2600 2024-04-26T12:30:53.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.975+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.975+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e9dc70 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.975+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.975+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x7f5820074040 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762ea2600 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e9dc70 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x55a762e99280 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.976+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f582008e040 con 0x7f5820074040 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:53.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea0f30 con 0x55a762e99280 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea0f30 con 0x55a762e99280 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:53.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea0f30 con 0x7f5820074040 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 zone default found 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 4 Realm: () 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 zonegroup default 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.977+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea17d0 con 0x55a762e9dc70 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:53.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6ff0 con 0x55a762ea2600 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea7390 con 0x55a762ea2600 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 20 started sync module instance, tier type = 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.978+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6490 con 0x7f5820074040 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.979+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.979+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94177407429008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6490 con 0x7f5820074040 2024-04-26T12:30:53.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.979+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea7be0 con 0x55a762e99280 2024-04-26T12:30:53.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.980+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94177407429008] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.981+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.981+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94177407432976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6490 con 0x55a762e99280 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.981+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea8650 con 0x55a762ea2600 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.982+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.982+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94177407432976] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.982+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94177407426528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea8a70 con 0x55a762ea2600 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.982+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea9470 con 0x7f5820074040 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.983+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.983+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94177407438720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea9d40 con 0x7f5820074040 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.983+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eaa7b0 con 0x55a762e99280 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.983+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94177407426528] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.984+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94177407438720] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.984+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.984+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94177407443584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea9810 con 0x55a762e99280 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.984+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eab050 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.985+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94177407443584] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.985+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.985+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94177407445920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea97c0 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.985+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eaba50 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.986+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94177407445920] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.986+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.986+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94177407435072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eac2a0 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.986+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eacb50 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94177407435072] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94177407450608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eac6c0 con 0x55a762e9dc70 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 20 add_watcher() i=0 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 20 add_watcher() i=1 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 20 add_watcher() i=2 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 20 add_watcher() i=3 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 20 add_watcher() i=4 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 20 add_watcher() i=5 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.987+0000 7f582b575800 20 add_watcher() i=6 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.988+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94177407450608] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.988+0000 7f582b575800 20 add_watcher() i=7 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.988+0000 7f582b575800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.988+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762eb0030 con 0x55a762e99280 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.988+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.988+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94177407452128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ead550 con 0x55a762e99280 2024-04-26T12:30:54.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.989+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94177407452128] v32'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.989+0000 7f56df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.989+0000 7f582b575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.989+0000 7f582b575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.989+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eafea0 con 0x55a762e99280 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.990+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.991+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eb9200 con 0x55a762e9dc70 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.992+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.992+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eb9200 con 0x55a762ea2600 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.993+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.993+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eb9d20 con 0x55a762e99280 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.993+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.994+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eba290 con 0x7f5820074040 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.994+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'61 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.994+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eba740 con 0x55a762ea2600 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.995+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.995+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebacb0 con 0x55a762e99280 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.996+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.996+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebacb0 con 0x55a762e9dc70 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.997+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.997+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebacb0 con 0x7f5820074040 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.998+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.998+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebad40 con 0x55a762ea2600 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.999+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:53.999+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb2d0 con 0x7f5820074040 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.000+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.000+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb2b0 con 0x55a762e9dc70 2024-04-26T12:30:54.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.001+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.001+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb280 con 0x7f5820074040 2024-04-26T12:30:54.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.002+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.002+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb280 con 0x55a762e9dc70 2024-04-26T12:30:54.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.003+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.003+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb1f0 con 0x55a762e99280 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.004+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.004+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb1f0 con 0x55a762ea2600 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.005+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.005+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb1f0 con 0x7f5820074040 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.006+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'63 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.006+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.007+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.007+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762e99280 2024-04-26T12:30:54.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.008+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.008+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762e99280 2024-04-26T12:30:54.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.009+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.009+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.010+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.010+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x7f5820074040 2024-04-26T12:30:54.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.011+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.011+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.012+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.012+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.013+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.013+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.014+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.014+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.015+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.015+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762e9dc70 2024-04-26T12:30:54.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.016+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.016+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.017+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.017+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762e9dc70 2024-04-26T12:30:54.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.018+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.018+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762ea2600 2024-04-26T12:30:54.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.019+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.019+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x55a762e9dc70 2024-04-26T12:30:54.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.020+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.020+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ebb160 con 0x7f5820074040 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.021+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.021+0000 7f56de7e4640 20 reqs_thread_entry: start 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.021+0000 7f582b575800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.021+0000 7f582b575800 20 Filter name: none 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f564ffff640 20 reqs_thread_entry: start 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ee6340 con 0x55a762e99280 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a762ee6290 con 0x7f5820074040 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.022+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.025 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T12:30:54.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.023+0000 7f56df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.023+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94177407452128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ee62f0 con 0x55a762e99280 2024-04-26T12:30:54.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.024+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94177407452128] v32'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.024+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94177407429008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eac3b0 con 0x7f5820074040 2024-04-26T12:30:54.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.025+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94177407429008] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.025+0000 7f582b575800 20 remove_watcher() i=0 2024-04-26T12:30:54.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.025+0000 7f582b575800 2 removed watcher, disabling cache 2024-04-26T12:30:54.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.025+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94177407432976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6990 con 0x55a762e99280 2024-04-26T12:30:54.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.026+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94177407432976] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.026+0000 7f582b575800 20 remove_watcher() i=1 2024-04-26T12:30:54.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.026+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94177407426528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6990 con 0x55a762ea2600 2024-04-26T12:30:54.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.027+0000 7f5828873640 1 -- 172.21.15.170:0/1926872255 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94177407426528] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582007f070 con 0x55a762ea2600 2024-04-26T12:30:54.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.028+0000 7f582b575800 20 remove_watcher() i=2 2024-04-26T12:30:54.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.028+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94177407438720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea5fe0 con 0x7f5820074040 2024-04-26T12:30:54.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.028+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94177407438720] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x7f5820074040 2024-04-26T12:30:54.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.028+0000 7f582b575800 20 remove_watcher() i=3 2024-04-26T12:30:54.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.028+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94177407443584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6990 con 0x55a762e99280 2024-04-26T12:30:54.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.029+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94177407443584] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5824033040 con 0x55a762e99280 2024-04-26T12:30:54.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.029+0000 7f582b575800 20 remove_watcher() i=4 2024-04-26T12:30:54.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.029+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94177407445920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea5fe0 con 0x55a762e9dc70 2024-04-26T12:30:54.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.030+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94177407445920] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.030+0000 7f582b575800 20 remove_watcher() i=5 2024-04-26T12:30:54.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.030+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94177407435072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762eaa280 con 0x55a762e9dc70 2024-04-26T12:30:54.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.032+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94177407435072] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.032+0000 7f582b575800 20 remove_watcher() i=6 2024-04-26T12:30:54.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.032+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94177407450608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a762ea6990 con 0x55a762e9dc70 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f5829074640 1 -- 172.21.15.170:0/1926872255 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94177407450608] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581c072030 con 0x55a762e9dc70 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 20 remove_watcher() i=7 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e9dc70 msgr2=0x55a762ea0060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e9dc70 0x55a762ea0060 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762e99280 msgr2=0x55a762e9b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762e99280 0x55a762e9b740 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5820074040 msgr2=0x7f5820081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5820074040 0x7f5820081410 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a762ea2600 msgr2=0x55a762ea4ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a762ea2600 0x55a762ea4ac0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f56f4036950 msgr2=0x7f56f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f56f4036950 0x7f56f4038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5820000c00 tx=0x7f582004f000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 msgr2=0x55a762e8dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f5829875640 1 -- 172.21.15.170:0/1926872255 reap_dead start 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e8dc10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f581c031ef0 tx=0x7f581c04d4e0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 shutdown_connections 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1926872255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762e86820 0x55a762e8dc10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 >> 172.21.15.170:0/1926872255 conn(0x55a762e82b80 msgr2=0x55a762e801e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 shutdown_connections 2024-04-26T12:30:54.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1926872255 wait complete. 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5700036950 msgr2=0x7f5700038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5700036950 0x7f5700038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55a762e5d640 tx=0x7f5820005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762cd6280 msgr2=0x55a762cd46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762cd6280 0x55a762cd46f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f581c01beb0 tx=0x7f581c044500 comp rx=0 tx=0).stop 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 shutdown_connections 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5700036950 0x7f5700038e10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 --2- 172.21.15.170:0/1299722213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762cd6280 0x55a762cd46f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 >> 172.21.15.170:0/1299722213 conn(0x55a762e6b990 msgr2=0x55a762e6bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 shutdown_connections 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.033+0000 7f582b575800 1 -- 172.21.15.170:0/1299722213 wait complete. 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e629a0 msgr2=0x55a762e64d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a762e629a0 0x55a762e64d90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762d64960 msgr2=0x55a762e60150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a762d64960 0x55a762e60150 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a762e668e0 msgr2=0x55a762e68d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a762e668e0 0x55a762e68d30 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5710036950 msgr2=0x7f5710038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5710036950 0x7f5710038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5820054000 tx=0x7f582004e000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 msgr2=0x55a762e59180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 --2- 172.21.15.170:0/3583020162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a762d605c0 0x55a762e59180 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f581c00b5f0 tx=0x7f581c000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f5829875640 1 -- 172.21.15.170:0/3583020162 reap_dead start 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 shutdown_connections 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 >> 172.21.15.170:0/3583020162 conn(0x55a762d5bb80 msgr2=0x55a762e50120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 shutdown_connections 2024-04-26T12:30:54.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.034+0000 7f582b575800 1 -- 172.21.15.170:0/3583020162 wait complete. 2024-04-26T12:30:54.043 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:30:54.054 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-26T12:30:54.059 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:54.085 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:54.094 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:54.139 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-26T12:30:54.144 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:54.144 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:30:54.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:30:54.144 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:30:54.188 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:54.188 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2edb29800 1 Processor -- start 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2edb29800 1 -- start start 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2edb29800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5579f6a95980 0x5579f6a9e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2edb29800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579f69420c0 con 0x5579f6a93e40 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2edb29800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5579f69264d0 con 0x5579f6a95980 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2e8fa6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5579f6a95980 0x5579f6a9e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2e97a7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5579f6a93e40 0x5579f6a94260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:43998/0 (socket says 172.21.15.170:43998) 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.187+0000 7fa2e97a7640 1 -- 172.21.15.170:0/3640519324 learned_addr learned my addr 172.21.15.170:0/3640519324 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.188+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/3640519324 >> v1:172.21.15.132:6789/0 conn(0x5579f6a93e40 legacy=0x5579f6a94260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.188+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/3640519324 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f6953d40 con 0x5579f6a95980 2024-04-26T12:30:54.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/3640519324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a95980 0x5579f6a9e480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400a470 tx=0x7fa2d401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc80cde306af996 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2e3fff640 1 -- 172.21.15.170:0/3640519324 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2d4057070 con 0x5579f6a95980 2024-04-26T12:30:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2e3fff640 1 -- 172.21.15.170:0/3640519324 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d4052440 con 0x5579f6a95980 2024-04-26T12:30:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2e3fff640 1 -- 172.21.15.170:0/3640519324 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2d4052740 con 0x5579f6a95980 2024-04-26T12:30:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2edb29800 1 -- 172.21.15.170:0/3640519324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a95980 msgr2=0x5579f6a9e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3640519324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a95980 0x5579f6a9e480 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400a470 tx=0x7fa2d401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2edb29800 1 -- 172.21.15.170:0/3640519324 shutdown_connections 2024-04-26T12:30:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3640519324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a95980 0x5579f6a9e480 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2edb29800 1 -- 172.21.15.170:0/3640519324 >> 172.21.15.170:0/3640519324 conn(0x5579f6a8fa00 msgr2=0x5579f6a91e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2edb29800 1 -- 172.21.15.170:0/3640519324 shutdown_connections 2024-04-26T12:30:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.190+0000 7fa2edb29800 1 -- 172.21.15.170:0/3640519324 wait complete. 2024-04-26T12:30:54.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2edb29800 1 Processor -- start 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2edb29800 1 -- start start 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2edb29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b88bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2edb29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5579f69e0b70 con 0x5579f6a93e40 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b88bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b88bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49402/0 (socket says 172.21.15.170:49402) 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2e97a7640 1 -- 172.21.15.170:0/980553967 learned_addr learned my addr 172.21.15.170:0/980553967 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.202+0000 7fa2e97a7640 1 -- 172.21.15.170:0/980553967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f6952590 con 0x5579f6a93e40 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.203+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/980553967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b88bd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40017a0 tx=0x7fa2e4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31c178f862ff27b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.203+0000 7fa1d7606640 1 -- 172.21.15.170:0/980553967 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e4004520 con 0x5579f6a93e40 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.203+0000 7fa1d7606640 1 -- 172.21.15.170:0/980553967 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e40046c0 con 0x5579f6a93e40 2024-04-26T12:30:54.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.203+0000 7fa1d7606640 1 -- 172.21.15.170:0/980553967 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e4004a00 con 0x5579f6a93e40 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 -- 172.21.15.170:0/980553967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 msgr2=0x5579f6b88bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 --2- 172.21.15.170:0/980553967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b88bd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40017a0 tx=0x7fa2e4001c60 comp rx=0 tx=0).stop 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 -- 172.21.15.170:0/980553967 shutdown_connections 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 --2- 172.21.15.170:0/980553967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b88bd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 -- 172.21.15.170:0/980553967 >> 172.21.15.170:0/980553967 conn(0x5579f6a8fa00 msgr2=0x5579f6b844f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 -- 172.21.15.170:0/980553967 shutdown_connections 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 -- 172.21.15.170:0/980553967 wait complete. 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 Processor -- start 2024-04-26T12:30:54.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 -- start start 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b90530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2edb29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5579f6aa0ca0 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b90530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b90530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49414/0 (socket says 172.21.15.170:49414) 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.204+0000 7fa2e97a7640 1 -- 172.21.15.170:0/3406292324 learned_addr learned my addr 172.21.15.170:0/3406292324 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.205+0000 7fa2e97a7640 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f69498f0 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.205+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b90530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4000f80 tx=0x7fa2e4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.205+0000 7fa1d5e03640 1 -- 172.21.15.170:0/3406292324 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e4022020 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.205+0000 7fa1d5e03640 1 -- 172.21.15.170:0/3406292324 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e4014870 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.205+0000 7fa1d5e03640 1 -- 172.21.15.170:0/3406292324 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e4014bb0 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.205+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579f6b90a70 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.205+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f6b90f90 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.206+0000 7fa1d5e03640 1 -- 172.21.15.170:0/3406292324 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa2e4025020 con 0x5579f6a93e40 2024-04-26T12:30:54.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.206+0000 7fa1d5e03640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1d0036950 0x7fa1d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.206+0000 7fa1d5e03640 1 -- 172.21.15.170:0/3406292324 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fa2e4018030 con 0x5579f6a93e40 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.206+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1d0036950 0x7fa1d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.206+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6a95980 0x5579f6b975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.206+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6b97ae0 con 0x5579f6a95980 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.206+0000 7fa2e9fa8640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6a95980 0x5579f6b975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1d0036950 0x7fa1d0038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4054000 tx=0x7fa2d404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2e9fa8640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6a95980 0x5579f6b975a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/3406292324 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6a95980 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6b94b50 con 0x5579f6a95980 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/3406292324 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6a95980 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6b99df0 0x5579f6b9c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6b9c8d0 con 0x5579f6b99df0 2024-04-26T12:30:54.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.207+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6b99df0 0x5579f6b9c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.208+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6b99df0 0x5579f6b9c1e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.208+0000 7fa2e97a7640 1 -- 172.21.15.170:0/3406292324 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6b99df0 2024-04-26T12:30:54.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.208+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6b98da0 con 0x5579f6a95980 2024-04-26T12:30:54.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.208+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/3406292324 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6a95980 2024-04-26T12:30:54.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.208+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5579f6b9dd30 0x5579f6ba01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.208+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6ba0900 con 0x5579f6b9dd30 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.208+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5579f6b9dd30 0x5579f6ba01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.209+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5579f6b9dd30 0x5579f6ba01a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.209+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/3406292324 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa2d4052910 con 0x5579f6b9dd30 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.209+0000 7fa2edb29800 1 Processor -- start 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.209+0000 7fa2edb29800 1 -- start start 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.209+0000 7fa2edb29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6baed60 0x5579f6baf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.209+0000 7fa2edb29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5579f6986e60 con 0x5579f6baed60 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6baed60 0x5579f6baf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6baed60 0x5579f6baf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49430/0 (socket says 172.21.15.170:49430) 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa2e97a7640 1 -- 172.21.15.170:0/3650019002 learned_addr learned my addr 172.21.15.170:0/3650019002 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa2e97a7640 1 -- 172.21.15.170:0/3650019002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f6baf6c0 con 0x5579f6baed60 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6baed60 0x5579f6baf180 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4006690 tx=0x7fa2e40108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa1ceffd640 1 -- 172.21.15.170:0/3650019002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e4044d70 con 0x5579f6baed60 2024-04-26T12:30:54.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa1ceffd640 1 -- 172.21.15.170:0/3650019002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e401d950 con 0x5579f6baed60 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa1ceffd640 1 -- 172.21.15.170:0/3650019002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e401dc30 con 0x5579f6baed60 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579f6bb0130 con 0x5579f6baed60 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.210+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f6bb0630 con 0x5579f6baed60 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.211+0000 7fa1ceffd640 1 -- 172.21.15.170:0/3650019002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa2e4010070 con 0x5579f6baed60 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.211+0000 7fa1ceffd640 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1c4036a10 0x7fa1c4038ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.211+0000 7fa1ceffd640 1 -- 172.21.15.170:0/3650019002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fa2e4028d70 con 0x5579f6baed60 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.211+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1c4036a10 0x7fa1c4038ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.211+0000 7fa2edb29800 1 Processor -- start 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.211+0000 7fa2edb29800 1 -- start start 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1c4036a10 0x7fa1c4038ed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5579f6b983a0 tx=0x7fa2d4005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2edb29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bbc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2edb29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5579f6b89350 con 0x5579f6bbbe80 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bbc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bbc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49432/0 (socket says 172.21.15.170:49432) 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2e97a7640 1 -- 172.21.15.170:0/2151311196 learned_addr learned my addr 172.21.15.170:0/2151311196 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2e97a7640 1 -- 172.21.15.170:0/2151311196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f6bbc870 con 0x5579f6bbbe80 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/2151311196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bbc2a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4032010 tx=0x7fa2e401def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505323a1c347991 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa1ccff9640 1 -- 172.21.15.170:0/2151311196 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e4007000 con 0x5579f6bbbe80 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa1ccff9640 1 -- 172.21.15.170:0/2151311196 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e40442d0 con 0x5579f6bbbe80 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.212+0000 7fa1ccff9640 1 -- 172.21.15.170:0/2151311196 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e401e6d0 con 0x5579f6bbbe80 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 -- 172.21.15.170:0/2151311196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 msgr2=0x5579f6bbc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 --2- 172.21.15.170:0/2151311196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bbc2a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4032010 tx=0x7fa2e401def0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 -- 172.21.15.170:0/2151311196 shutdown_connections 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 --2- 172.21.15.170:0/2151311196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bbc2a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 -- 172.21.15.170:0/2151311196 >> 172.21.15.170:0/2151311196 conn(0x5579f6bb81e0 msgr2=0x5579f6bb6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 -- 172.21.15.170:0/2151311196 shutdown_connections 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 -- 172.21.15.170:0/2151311196 wait complete. 2024-04-26T12:30:54.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 Processor -- start 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 -- start start 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bc3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2edb29800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5579f6bbcf20 con 0x5579f6bbbe80 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bc3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2e97a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bc3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49444/0 (socket says 172.21.15.170:49444) 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.213+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 learned_addr learned my addr 172.21.15.170:0/1898701179 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.214+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f6bc37d0 con 0x5579f6bbbe80 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.214+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bc3290 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40104d0 tx=0x7fa2e40072e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.214+0000 7fa1baffd640 1 -- 172.21.15.170:0/1898701179 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e401e4c0 con 0x5579f6bbbe80 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.214+0000 7fa1baffd640 1 -- 172.21.15.170:0/1898701179 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e4068070 con 0x5579f6bbbe80 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.214+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579f6bc37d0 con 0x5579f6bbbe80 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.214+0000 7fa1baffd640 1 -- 172.21.15.170:0/1898701179 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2e404cb90 con 0x5579f6bbbe80 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.214+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f6bc37d0 con 0x5579f6bbbe80 2024-04-26T12:30:54.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.215+0000 7fa1baffd640 1 -- 172.21.15.170:0/1898701179 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa2e4056040 con 0x5579f6bbbe80 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.215+0000 7fa1baffd640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1b4036950 0x7fa1b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.215+0000 7fa1baffd640 1 -- 172.21.15.170:0/1898701179 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fa2e4053040 con 0x5579f6bbbe80 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.215+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1b4036950 0x7fa1b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.215+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.215+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1b4036950 0x7fa1b4038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa2d401ced0 tx=0x7fa2d404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.215+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6bce7f0 0x5579f6bd0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd1400 con 0x5579f6bce7f0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2e9fa8640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6bce7f0 0x5579f6bd0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2e9fa8640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6bce7f0 0x5579f6bd0cb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6bce7f0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 20 realm 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd1830 con 0x5579f6bce7f0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6bce7f0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bce7f0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6bce7f0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.216+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd24a0 con 0x5579f6bce7f0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.217+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6bce7f0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.217+0000 7fa2edb29800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.217+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.217+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6bd2e60 0x5579f6bd5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.217+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd5860 con 0x5579f6bd2e60 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.217+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6bd2e60 0x5579f6bd5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.217+0000 7fa2e97a7640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6bd2e60 0x5579f6bd5250 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2edb29800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2edb29800 20 searching for the correct realm 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5579f6bd77d0 0x5579f6bd9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bda360 con 0x5579f6bd77d0 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5579f6bd77d0 0x5579f6bd9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5579f6bd77d0 0x5579f6bd9c90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2e8fa6640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fa2d4076040 0x7fa2d4083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bda360 con 0x7fa2d4076040 2024-04-26T12:30:54.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.218+0000 7fa2e9fa8640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fa2d4076040 0x7fa2d4083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.219+0000 7fa2e9fa8640 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fa2d4076040 0x7fa2d4083410 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.219+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa2dc0083e0 con 0x7fa2d4076040 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.219+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bd2e60 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.219+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.219+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bce7f0 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc0083e0 con 0x5579f6bce7f0 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bce7f0 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bd2e60 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bd2e60 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x7fa2d4076040 2024-04-26T12:30:54.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.220+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bd77d0 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bce7f0 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x7fa2d4076040 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bce7f0 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.221+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x7fa2d4076040 2024-04-26T12:30:54.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.222+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.222+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd2100 con 0x5579f6bd77d0 2024-04-26T12:30:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.222+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.222+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd77d0 2024-04-26T12:30:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.222+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.222+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd2e60 2024-04-26T12:30:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.222+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd77d0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd77d0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bce7f0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bce7f0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.223+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd2e60 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd77d0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x7fa2d4076040 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bce7f0 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.224+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd2e60 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.225+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.225+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd77d0 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.225+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.225+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd2e60 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.225+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.225+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x7fa2d4076040 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.226+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.226+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd77d0 2024-04-26T12:30:54.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.226+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.226+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bd2e60 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.226+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.226+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x5579f6bce7f0 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.226+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2d4090040 con 0x7fa2d4076040 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd5c00 con 0x5579f6bce7f0 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd5c00 con 0x5579f6bce7f0 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.227+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd5c00 con 0x7fa2d4076040 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 20 zone default found 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 4 Realm: () 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:54.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 20 zonegroup default 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bd6640 con 0x5579f6bd2e60 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdc1c0 con 0x5579f6bd77d0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.228+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2edb29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdc560 con 0x5579f6bd77d0 2024-04-26T12:30:54.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2edb29800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2edb29800 20 started sync module instance, tier type = 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2edb29800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.229+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdb660 con 0x7fa2d4076040 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.230+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.230+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93982319032912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdb660 con 0x7fa2d4076040 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.230+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdcdb0 con 0x5579f6bce7f0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.231+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93982319032912] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.231+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.231+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93982319037152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdb660 con 0x5579f6bce7f0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.231+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdd840 con 0x5579f6bd77d0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.232+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93982319037152] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.232+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.232+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93982319030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdb5d0 con 0x5579f6bd77d0 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.232+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bde700 con 0x7fa2d4076040 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.233+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93982319030704] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.233+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.233+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93982319043152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bde670 con 0x7fa2d4076040 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.233+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdf5c0 con 0x5579f6bce7f0 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.234+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93982319043152] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.234+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.234+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93982319045280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdf5c0 con 0x5579f6bce7f0 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.234+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdff80 con 0x5579f6bd2e60 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.235+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93982319045280] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.235+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.235+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93982319046928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6bdf530 con 0x5579f6bd2e60 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.235+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6be0e40 con 0x5579f6bd2e60 2024-04-26T12:30:54.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.237+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93982319046928] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.237+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.237+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93982319053200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6be1260 con 0x5579f6bd2e60 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.237+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6be1af0 con 0x5579f6bd2e60 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93982319053200] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93982319054256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6be1cd0 con 0x5579f6bd2e60 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 20 add_watcher() i=0 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 20 add_watcher() i=1 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 20 add_watcher() i=2 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 20 add_watcher() i=3 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 20 add_watcher() i=4 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 20 add_watcher() i=5 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.238+0000 7fa2edb29800 20 add_watcher() i=6 2024-04-26T12:30:54.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.240+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93982319054256] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.240+0000 7fa2edb29800 20 add_watcher() i=7 2024-04-26T12:30:54.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.240+0000 7fa2edb29800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:54.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.240+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6be50a0 con 0x5579f6bce7f0 2024-04-26T12:30:54.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.240+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.240+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93982319057856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6be2490 con 0x5579f6bce7f0 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.241+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93982319057856] v32'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.241+0000 7fa19f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.241+0000 7fa2edb29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.241+0000 7fa2edb29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.241+0000 7fa2edb29800 5 note: GC not initialized 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa19e7e4640 20 reqs_thread_entry: start 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 20 Filter name: none 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa10ffff640 20 reqs_thread_entry: start 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c18a90 con 0x7fa2d4076040 2024-04-26T12:30:54.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 : miss 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.242+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:63 8.15 8:af1fdfee:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1a650 con 0x5579f6bd77d0 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(63 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 info.flags=0x17 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 to cache LRU end 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 2024-04-26T12:30:54.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 20 get_obj_state: octx=0x7fa2dc008ce0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5579f6c1d0a8 s->prefetch_data=0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 3.ds0 3:b217b38e:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bd77d0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(64 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 10 manifest: total_size = 5 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.243+0000 7fa2edb29800 20 get_obj_state: setting s->obj_tag to _DlJHp46FbPrNvT6QZqlgrsx0_rGWwo2 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.244+0000 7fa19f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.244+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93982319057856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bce7f0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.245+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93982319057856] v32'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.245+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93982319032912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x7fa2d4076040 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.246+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93982319032912] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.246+0000 7fa2edb29800 20 remove_watcher() i=0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.246+0000 7fa2edb29800 2 removed watcher, disabling cache 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.246+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93982319037152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bce7f0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.247+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93982319037152] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.247+0000 7fa2edb29800 20 remove_watcher() i=1 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.247+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93982319030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bd77d0 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.248+0000 7fa2e8fa6640 1 -- 172.21.15.170:0/1898701179 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93982319030704] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2d4081070 con 0x5579f6bd77d0 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.248+0000 7fa2edb29800 20 remove_watcher() i=2 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.248+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93982319043152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x7fa2d4076040 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.249+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93982319043152] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x7fa2d4076040 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.249+0000 7fa2edb29800 20 remove_watcher() i=3 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.249+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93982319045280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bce7f0 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.251+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93982319045280] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2dc026040 con 0x5579f6bce7f0 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.251+0000 7fa2edb29800 20 remove_watcher() i=4 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.251+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93982319046928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bd2e60 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.252+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93982319046928] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.252+0000 7fa2edb29800 20 remove_watcher() i=5 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.252+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93982319053200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bd2e60 2024-04-26T12:30:54.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.253+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93982319053200] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.253+0000 7fa2edb29800 20 remove_watcher() i=6 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.253+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93982319054256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5579f6c1e2a0 con 0x5579f6bd2e60 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.253+0000 7fa2e97a7640 1 -- 172.21.15.170:0/1898701179 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93982319054256] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2e401b070 con 0x5579f6bd2e60 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 20 remove_watcher() i=7 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6bd2e60 msgr2=0x5579f6bd5250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6bd2e60 0x5579f6bd5250 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6bce7f0 msgr2=0x5579f6bd0cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6bce7f0 0x5579f6bd0cb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fa2d4076040 msgr2=0x7fa2d4083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fa2d4076040 0x7fa2d4083410 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5579f6bd77d0 msgr2=0x5579f6bd9c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5579f6bd77d0 0x5579f6bd9c90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1b4036950 msgr2=0x7fa1b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1b4036950 0x7fa1b4038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa2d401ced0 tx=0x7fa2d404f000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 msgr2=0x5579f6bc3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/1898701179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6bbbe80 0x5579f6bc3290 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40104d0 tx=0x7fa2e40072e0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 reap_dead start 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/1898701179 reap_dead start 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 shutdown_connections 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 >> 172.21.15.170:0/1898701179 conn(0x5579f6bb81e0 msgr2=0x5579f6bb5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 shutdown_connections 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/1898701179 wait complete. 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1c4036a10 msgr2=0x7fa1c4038ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1c4036a10 0x7fa1c4038ed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5579f6b983a0 tx=0x7fa2d4005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6baed60 msgr2=0x5579f6baf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6baed60 0x5579f6baf180 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4006690 tx=0x7fa2e40108f0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 shutdown_connections 2024-04-26T12:30:54.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1c4036a10 0x7fa1c4038ed0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3650019002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6baed60 0x5579f6baf180 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 >> 172.21.15.170:0/3650019002 conn(0x5579f6ba2e00 msgr2=0x5579f6ba3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 shutdown_connections 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.254+0000 7fa2edb29800 1 -- 172.21.15.170:0/3650019002 wait complete. 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6b99df0 msgr2=0x5579f6b9c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5579f6b99df0 0x5579f6b9c1e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6a95980 msgr2=0x5579f6b975a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5579f6a95980 0x5579f6b975a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5579f6b9dd30 msgr2=0x5579f6ba01a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5579f6b9dd30 0x5579f6ba01a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1d0036950 msgr2=0x7fa1d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fa1d0036950 0x7fa1d0038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4054000 tx=0x7fa2d404e000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 msgr2=0x5579f6b90530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 --2- 172.21.15.170:0/3406292324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5579f6a93e40 0x5579f6b90530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4000f80 tx=0x7fa2e4001250 comp rx=0 tx=0).stop 2024-04-26T12:30:54.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2e9fa8640 1 -- 172.21.15.170:0/3406292324 reap_dead start 2024-04-26T12:30:54.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 shutdown_connections 2024-04-26T12:30:54.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 >> 172.21.15.170:0/3406292324 conn(0x5579f6a8fa00 msgr2=0x5579f6b875c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 shutdown_connections 2024-04-26T12:30:54.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.255+0000 7fa2edb29800 1 -- 172.21.15.170:0/3406292324 wait complete. 2024-04-26T12:30:54.321 INFO:teuthology.orchestra.run.smithi170.stdout:fooFoofooFooFULL_CONTROL 2024-04-26T12:30:54.321 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-26T12:30:54.323 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-26T12:30:54.328 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:54.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:30:54.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-26T12:30:54.328 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:54.372 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.370+0000 7f5007016800 1 Processor -- start 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.370+0000 7f5007016800 1 -- start start 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.370+0000 7f5007016800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559a5e768de0 0x559a5e7fd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.370+0000 7f5007016800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559a5e6a10c0 con 0x559a5e76a120 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.370+0000 7f5007016800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x559a5e6854d0 con 0x559a5e768de0 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.371+0000 7f5001f5b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559a5e768de0 0x559a5e7fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.371+0000 7f500275c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559a5e76a120 0x559a5e7686d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:44014/0 (socket says 172.21.15.170:44014) 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.371+0000 7f5001f5b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559a5e768de0 0x559a5e7fd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49454/0 (socket says 172.21.15.170:49454) 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.371+0000 7f500275c640 1 -- 172.21.15.170:0/498070330 learned_addr learned my addr 172.21.15.170:0/498070330 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.371+0000 7f5001f5b640 1 -- 172.21.15.170:0/498070330 >> v1:172.21.15.132:6789/0 conn(0x559a5e76a120 legacy=0x559a5e7686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.371+0000 7f500175a640 1 -- 172.21.15.170:0/498070330 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944261055 0 0) 0x559a5e6a10c0 con 0x559a5e76a120 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.371+0000 7f5001f5b640 1 -- 172.21.15.170:0/498070330 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5e6b2d40 con 0x559a5e768de0 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.373+0000 7f5001f5b640 1 --2- 172.21.15.170:0/498070330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e7fd4a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800a470 tx=0x7f4ff801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec23469a4f56fade server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.373+0000 7f500175a640 1 -- 172.21.15.170:0/498070330 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8057070 con 0x559a5e768de0 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.373+0000 7f500175a640 1 -- 172.21.15.170:0/498070330 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8052570 con 0x559a5e768de0 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.373+0000 7f500175a640 1 -- 172.21.15.170:0/498070330 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff8052870 con 0x559a5e768de0 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.373+0000 7f5007016800 1 -- 172.21.15.170:0/498070330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 msgr2=0x559a5e7fd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.373+0000 7f5007016800 1 --2- 172.21.15.170:0/498070330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e7fd4a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800a470 tx=0x7f4ff801ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.374+0000 7f5007016800 1 -- 172.21.15.170:0/498070330 shutdown_connections 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.374+0000 7f5007016800 1 --2- 172.21.15.170:0/498070330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e7fd4a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.374+0000 7f5007016800 1 -- 172.21.15.170:0/498070330 >> 172.21.15.170:0/498070330 conn(0x559a5e7efba0 msgr2=0x559a5e7f1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.374+0000 7f5007016800 1 -- 172.21.15.170:0/498070330 shutdown_connections 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.374+0000 7f5007016800 1 -- 172.21.15.170:0/498070330 wait complete. 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.385+0000 7f5007016800 1 Processor -- start 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.385+0000 7f5007016800 1 -- start start 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.385+0000 7f5007016800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.385+0000 7f5007016800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559a5e73fb70 con 0x559a5e768de0 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8e7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49466/0 (socket says 172.21.15.170:49466) 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f500275c640 1 -- 172.21.15.170:0/1330115514 learned_addr learned my addr 172.21.15.170:0/1330115514 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f500275c640 1 -- 172.21.15.170:0/1330115514 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5e6b1590 con 0x559a5e768de0 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f500275c640 1 --2- 172.21.15.170:0/1330115514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8e7b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4001e00 tx=0x7f4ff400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4160a4f35a81d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f4ef0608640 1 -- 172.21.15.170:0/1330115514 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff4012020 con 0x559a5e768de0 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f4ef0608640 1 -- 172.21.15.170:0/1330115514 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff400e5c0 con 0x559a5e768de0 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.386+0000 7f4ef0608640 1 -- 172.21.15.170:0/1330115514 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff400e8e0 con 0x559a5e768de0 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 -- 172.21.15.170:0/1330115514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 msgr2=0x559a5e8e7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 --2- 172.21.15.170:0/1330115514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8e7b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4001e00 tx=0x7f4ff400b780 comp rx=0 tx=0).stop 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 -- 172.21.15.170:0/1330115514 shutdown_connections 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 --2- 172.21.15.170:0/1330115514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8e7b60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 -- 172.21.15.170:0/1330115514 >> 172.21.15.170:0/1330115514 conn(0x559a5e7efba0 msgr2=0x559a5e8e3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 -- 172.21.15.170:0/1330115514 shutdown_connections 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 -- 172.21.15.170:0/1330115514 wait complete. 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 Processor -- start 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.387+0000 7f5007016800 1 -- start start 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f5007016800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f5007016800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559a5e7ffcf0 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8ef520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49474/0 (socket says 172.21.15.170:49474) 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f500275c640 1 -- 172.21.15.170:0/2945458 learned_addr learned my addr 172.21.15.170:0/2945458 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f500275c640 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5e6a88f0 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f500275c640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8ef520 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x559a5e8e88f0 tx=0x7f4ff4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f4eeee05640 1 -- 172.21.15.170:0/2945458 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff4012030 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f4eeee05640 1 -- 172.21.15.170:0/2945458 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff401a700 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f4eeee05640 1 -- 172.21.15.170:0/2945458 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff401a9e0 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a5e8efa60 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.388+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5e8eff80 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.389+0000 7f4eeee05640 1 -- 172.21.15.170:0/2945458 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ff4015020 con 0x559a5e768de0 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.389+0000 7f4eeee05640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ee8036950 0x7f4ee8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.389+0000 7f4eeee05640 1 -- 172.21.15.170:0/2945458 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f4ff4020030 con 0x559a5e768de0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.389+0000 7f5001f5b640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ee8036950 0x7f4ee8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.389+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e76a120 0x559a5e8f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.389+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e8f6ad0 con 0x559a5e76a120 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5002f5d640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e76a120 0x559a5e8f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5001f5b640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ee8036950 0x7f4ee8038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800a470 tx=0x7f4ff804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5002f5d640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e76a120 0x559a5e8f6590 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5002f5d640 1 -- 172.21.15.170:0/2945458 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e76a120 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e8f3b60 con 0x559a5e76a120 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5002f5d640 1 -- 172.21.15.170:0/2945458 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e76a120 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e8f8dc0 0x559a5e8fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.390+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e8fb850 con 0x559a5e8f8dc0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.391+0000 7f500275c640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e8f8dc0 0x559a5e8fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.391+0000 7f500275c640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e8f8dc0 0x559a5e8fb1b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.391+0000 7f500275c640 1 -- 172.21.15.170:0/2945458 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ff400dcd0 con 0x559a5e8f8dc0 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.391+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e8f7d70 con 0x559a5e76a120 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.392+0000 7f5002f5d640 1 -- 172.21.15.170:0/2945458 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e76a120 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.392+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559a5e8fcd00 0x559a5e8ff150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.392+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e8ff8b0 con 0x559a5e8fcd00 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.392+0000 7f5001f5b640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559a5e8fcd00 0x559a5e8ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.392+0000 7f5001f5b640 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559a5e8fcd00 0x559a5e8ff150 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.392+0000 7f5001f5b640 1 -- 172.21.15.170:0/2945458 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ff805a040 con 0x559a5e8fcd00 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.392+0000 7f5007016800 1 Processor -- start 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f5007016800 1 -- start start 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f5007016800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e90dd10 0x559a5e90e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f5007016800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559a5e6e5e60 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e90dd10 0x559a5e90e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e90dd10 0x559a5e90e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49484/0 (socket says 172.21.15.170:49484) 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f500275c640 1 -- 172.21.15.170:0/493687795 learned_addr learned my addr 172.21.15.170:0/493687795 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f500275c640 1 -- 172.21.15.170:0/493687795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5e90e670 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f500275c640 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e90dd10 0x559a5e90e130 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400bd20 tx=0x7f4ff402dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f4ee7fff640 1 -- 172.21.15.170:0/493687795 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff403b070 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f4ee7fff640 1 -- 172.21.15.170:0/493687795 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff4016530 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f4ee7fff640 1 -- 172.21.15.170:0/493687795 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff4040040 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.393+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a5e90f0e0 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.394+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5e90f5e0 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.394+0000 7f4ee7fff640 1 -- 172.21.15.170:0/493687795 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ff403e070 con 0x559a5e90dd10 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.394+0000 7f4ee7fff640 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.394+0000 7f4ee7fff640 1 -- 172.21.15.170:0/493687795 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f4ff4037020 con 0x559a5e90dd10 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.394+0000 7f5001f5b640 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f5007016800 1 Processor -- start 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f5007016800 1 -- start start 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f5001f5b640 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x559a5e8f3a80 tx=0x7f4ff8005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f5007016800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e91b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f5007016800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559a5e8e82e0 con 0x559a5e91afb0 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e91b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e91b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49500/0 (socket says 172.21.15.170:49500) 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f500275c640 1 -- 172.21.15.170:0/3541469392 learned_addr learned my addr 172.21.15.170:0/3541469392 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f500275c640 1 -- 172.21.15.170:0/3541469392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5e91b9a0 con 0x559a5e91afb0 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f500275c640 1 --2- 172.21.15.170:0/3541469392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e91b3d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4018740 tx=0x7f4ff4027ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212b8192d9e2112b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f4ee5ffb640 1 -- 172.21.15.170:0/3541469392 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff4027120 con 0x559a5e91afb0 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f4ee5ffb640 1 -- 172.21.15.170:0/3541469392 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff404c790 con 0x559a5e91afb0 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.395+0000 7f4ee5ffb640 1 -- 172.21.15.170:0/3541469392 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff40490c0 con 0x559a5e91afb0 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 -- 172.21.15.170:0/3541469392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 msgr2=0x559a5e91b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 --2- 172.21.15.170:0/3541469392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e91b3d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4018740 tx=0x7f4ff4027ae0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 -- 172.21.15.170:0/3541469392 shutdown_connections 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 --2- 172.21.15.170:0/3541469392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e91b3d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 -- 172.21.15.170:0/3541469392 >> 172.21.15.170:0/3541469392 conn(0x559a5e917310 msgr2=0x559a5e915370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 -- 172.21.15.170:0/3541469392 shutdown_connections 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 -- 172.21.15.170:0/3541469392 wait complete. 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 Processor -- start 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 -- start start 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e9223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.396+0000 7f5007016800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559a5e91c050 con 0x559a5e91afb0 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e9223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f500275c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e9223d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49508/0 (socket says 172.21.15.170:49508) 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 learned_addr learned my addr 172.21.15.170:0/3595639011 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5e922910 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f500275c640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e9223d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400dfd0 tx=0x7f4ff404ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f4ed3fff640 1 -- 172.21.15.170:0/3595639011 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff4070070 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f4ed3fff640 1 -- 172.21.15.170:0/3595639011 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff404c0f0 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f4ed3fff640 1 -- 172.21.15.170:0/3595639011 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ff404c3d0 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a5e922910 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.397+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5e922910 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.398+0000 7f4ed3fff640 1 -- 172.21.15.170:0/3595639011 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ff4073070 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.398+0000 7f4ed3fff640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ecc036950 0x7f4ecc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.398+0000 7f4ed3fff640 1 -- 172.21.15.170:0/3595639011 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f4ff4076d70 con 0x559a5e91afb0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.398+0000 7f5001f5b640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ecc036950 0x7f4ecc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5001f5b640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ecc036950 0x7f4ecc038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x559a5e8ffcb0 tx=0x7f4ff804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e92dae0 0x559a5e92ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e9306f0 con 0x559a5e92dae0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5002f5d640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e92dae0 0x559a5e92ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5002f5d640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e92dae0 0x559a5e92ffa0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 20 realm 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e930b00 con 0x559a5e92dae0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.399+0000 7f5007016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e9313d0 con 0x559a5e92dae0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e9324d0 0x559a5e9348c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e934ed0 con 0x559a5e9324d0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f500275c640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e9324d0 0x559a5e9348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.400+0000 7f500275c640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e9324d0 0x559a5e9348c0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.401+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.401+0000 7f5007016800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.401+0000 7f5007016800 20 searching for the correct realm 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.401+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559a5e936e80 0x559a5e939340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.401+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e939a10 con 0x559a5e936e80 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.401+0000 7f5001f5b640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559a5e936e80 0x559a5e939340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.401+0000 7f5001f5b640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559a5e936e80 0x559a5e939340 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.402+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.402+0000 7f5001f5b640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4ff8083040 0x7f4ff8075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.402+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e939a10 con 0x7f4ff8083040 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.402+0000 7f5002f5d640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4ff8083040 0x7f4ff8075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.402+0000 7f5002f5d640 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4ff8083040 0x7f4ff8075430 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.402+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x7f4ff8083040 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.402+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.403+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x7f4ff8083040 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x7f4ff8083040 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x7f4ff8083040 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x7f4ff8083040 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.404+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc00a4a0 con 0x559a5e92dae0 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x7f4ff8083040 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.405+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.406+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.407+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.407+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.407+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.407+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.407+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.407+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x7f4ff8083040 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.407+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.408+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.408+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.408+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.408+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.408+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.408+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.408+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x7f4ff8083040 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e936e80 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e9324d0 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.409+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x559a5e92dae0 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a5e931770 con 0x7f4ff8083040 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e935790 con 0x559a5e92dae0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e935790 con 0x559a5e92dae0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.410+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e935790 con 0x7f4ff8083040 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 zone default found 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 4 Realm: () 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 zonegroup default 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e936030 con 0x559a5e9324d0 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93b870 con 0x559a5e936e80 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.411+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93bc10 con 0x559a5e936e80 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.412+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.412+0000 7f5007016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.412+0000 7f5007016800 20 started sync module instance, tier type = 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.412+0000 7f5007016800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.412+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93ad10 con 0x7f4ff8083040 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.413+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.413+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94121500062000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93ad10 con 0x7f4ff8083040 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.413+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93c460 con 0x559a5e92dae0 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.414+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94121500062000] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.414+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.414+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94121500066192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93ad10 con 0x559a5e92dae0 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.414+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93cf00 con 0x559a5e936e80 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.415+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.415+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94121500068336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93d7a0 con 0x559a5e936e80 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.415+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93e290 con 0x7f4ff8083040 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.415+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94121500066192] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.416+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94121500068336] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.416+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.416+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94121500070640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93a860 con 0x7f4ff8083040 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.416+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93eb70 con 0x559a5e92dae0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.417+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94121500070640] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.417+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.417+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94121500073312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93eae0 con 0x559a5e92dae0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.417+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93f580 con 0x559a5e9324d0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.418+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.418+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94121500078288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93fe20 con 0x559a5e9324d0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.418+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e940850 con 0x559a5e9324d0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.418+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94121500073312] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.419+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94121500078288] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.419+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.419+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94121500083040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e940c70 con 0x559a5e9324d0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.419+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e9414c0 con 0x559a5e9324d0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94121500083040] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94121500085840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e941860 con 0x559a5e9324d0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 20 add_watcher() i=0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 20 add_watcher() i=1 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 20 add_watcher() i=2 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 20 add_watcher() i=3 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 20 add_watcher() i=4 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 20 add_watcher() i=5 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.420+0000 7f5007016800 20 add_watcher() i=6 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.421+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94121500085840] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.421+0000 7f5007016800 20 add_watcher() i=7 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.421+0000 7f5007016800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.421+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e93e720 con 0x559a5e92dae0 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.422+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.422+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94121500087024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e942130 con 0x559a5e92dae0 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94121500087024] v32'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f4eb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 5 note: GC not initialized 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f4e337fe640 20 reqs_thread_entry: start 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 20 Filter name: none 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f4e317fa640 20 reqs_thread_entry: start 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.423+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e9783f0 con 0x7f4ff8083040 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 : miss 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:63 8.15 8:af1fdfee:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e979fb0 con 0x559a5e936e80 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(63 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 info.flags=0x17 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 to cache LRU end 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 20 get_obj_state: octx=0x7f4ffc00aaf0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x559a5e97ca48 s->prefetch_data=0 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 3.ds0 3:b217b38e:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a5e97dc20 con 0x559a5e936e80 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(64 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 10 manifest: total_size = 5 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.424+0000 7f5007016800 20 get_obj_state: setting s->obj_tag to _jA_k8hNm4wQleJygEBFuwmsZa2_9Xll 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.425+0000 7f4eb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.425+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94121500087024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x559a5e92dae0 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.426+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94121500087024] v32'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.426+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94121500062000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x7f4ff8083040 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.427+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94121500062000] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.427+0000 7f5007016800 20 remove_watcher() i=0 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.427+0000 7f5007016800 2 removed watcher, disabling cache 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.427+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94121500066192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x559a5e92dae0 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.428+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94121500066192] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.428+0000 7f5007016800 20 remove_watcher() i=1 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.428+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94121500068336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x559a5e936e80 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.429+0000 7f5001f5b640 1 -- 172.21.15.170:0/3595639011 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94121500068336] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff8070030 con 0x559a5e936e80 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.429+0000 7f5007016800 20 remove_watcher() i=2 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.429+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94121500070640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x7f4ff8083040 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.430+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94121500070640] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x7f4ff8083040 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.430+0000 7f5007016800 20 remove_watcher() i=3 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.430+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94121500073312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x559a5e92dae0 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.431+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94121500073312] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc033040 con 0x559a5e92dae0 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.431+0000 7f5007016800 20 remove_watcher() i=4 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.431+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94121500078288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x559a5e9324d0 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.432+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94121500078288] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.432+0000 7f5007016800 20 remove_watcher() i=5 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.432+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94121500083040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x559a5e9324d0 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.433+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94121500083040] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.433+0000 7f5007016800 20 remove_watcher() i=6 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.433+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94121500085840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a5e975d40 con 0x559a5e9324d0 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f500275c640 1 -- 172.21.15.170:0/3595639011 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94121500085840] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ff4072030 con 0x559a5e9324d0 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 20 remove_watcher() i=7 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e9324d0 msgr2=0x559a5e9348c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e9324d0 0x559a5e9348c0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e92dae0 msgr2=0x559a5e92ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e92dae0 0x559a5e92ffa0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4ff8083040 msgr2=0x7f4ff8075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f4ff8083040 0x7f4ff8075430 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559a5e936e80 msgr2=0x559a5e939340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.434+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559a5e936e80 0x559a5e939340 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ecc036950 msgr2=0x7f4ecc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ecc036950 0x7f4ecc038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x559a5e8ffcb0 tx=0x7f4ff804f000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 msgr2=0x559a5e9223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/3595639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e91afb0 0x559a5e9223d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400dfd0 tx=0x7f4ff404ffa0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 reap_dead start 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5002f5d640 1 -- 172.21.15.170:0/3595639011 reap_dead start 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 shutdown_connections 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 >> 172.21.15.170:0/3595639011 conn(0x559a5e917310 msgr2=0x559a5e914970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 shutdown_connections 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/3595639011 wait complete. 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 msgr2=0x7f4edc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x559a5e8f3a80 tx=0x7f4ff8005a00 comp rx=0 tx=0).stop 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e90dd10 msgr2=0x559a5e90e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e90dd10 0x559a5e90e130 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400bd20 tx=0x7f4ff402dd80 comp rx=0 tx=0).stop 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 shutdown_connections 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/493687795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e90dd10 0x559a5e90e130 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 >> 172.21.15.170:0/493687795 conn(0x559a5e901db0 msgr2=0x559a5e9021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 shutdown_connections 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/493687795 wait complete. 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e8f8dc0 msgr2=0x559a5e8fb1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559a5e8f8dc0 0x559a5e8fb1b0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e76a120 msgr2=0x559a5e8f6590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559a5e76a120 0x559a5e8f6590 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559a5e8fcd00 msgr2=0x559a5e8ff150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559a5e8fcd00 0x559a5e8ff150 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ee8036950 msgr2=0x7f4ee8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ee8036950 0x7f4ee8038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800a470 tx=0x7f4ff804e000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 msgr2=0x559a5e8ef520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.435+0000 7f5007016800 1 --2- 172.21.15.170:0/2945458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a5e768de0 0x559a5e8ef520 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x559a5e8e88f0 tx=0x7f4ff4000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.436+0000 7f5002f5d640 1 -- 172.21.15.170:0/2945458 reap_dead start 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.436+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 shutdown_connections 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.436+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 >> 172.21.15.170:0/2945458 conn(0x559a5e7efba0 msgr2=0x559a5e8e6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.436+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 shutdown_connections 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.436+0000 7f5007016800 1 -- 172.21.15.170:0/2945458 wait complete. 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi170.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-26T12:30:54.458 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-26T12:30:54.461 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-26T12:30:54.473 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:54.579 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-26T12:30:54.579 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-26T12:30:54.579 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-26T12:30:54.579 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-26T12:30:54.579 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-26T12:30:54.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-26T12:30:54.580 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-26T12:30:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.622+0000 7f974c63f800 1 Processor -- start 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.622+0000 7f974c63f800 1 -- start start 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.622+0000 7f974c63f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fed43bbf90 0x55fed43be380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.622+0000 7f974c63f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fed42680c0 con 0x55fed43be8c0 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.622+0000 7f974c63f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55fed424c4d0 con 0x55fed43bbf90 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.623+0000 7f974a13e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fed43bbf90 0x55fed43be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.623+0000 7f974993d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55fed43be8c0 0x55fed43c0cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:44022/0 (socket says 172.21.15.170:44022) 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.623+0000 7f974a13e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fed43bbf90 0x55fed43be380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49520/0 (socket says 172.21.15.170:49520) 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.623+0000 7f974993d640 1 -- 172.21.15.170:0/3787832589 learned_addr learned my addr 172.21.15.170:0/3787832589 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.623+0000 7f974a13e640 1 -- 172.21.15.170:0/3787832589 >> v1:172.21.15.132:6789/0 conn(0x55fed43be8c0 legacy=0x55fed43c0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.623+0000 7f974a13e640 1 -- 172.21.15.170:0/3787832589 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4279d40 con 0x55fed43bbf90 2024-04-26T12:30:54.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974a13e640 1 --2- 172.21.15.170:0/3787832589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed43be380 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f973c005fd0 tx=0x7f973c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843fff27fa138cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974913c640 1 -- 172.21.15.170:0/3787832589 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c052560 con 0x55fed43bbf90 2024-04-26T12:30:54.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974913c640 1 -- 172.21.15.170:0/3787832589 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c052700 con 0x55fed43bbf90 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974913c640 1 -- 172.21.15.170:0/3787832589 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c052a60 con 0x55fed43bbf90 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974c63f800 1 -- 172.21.15.170:0/3787832589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 msgr2=0x55fed43be380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974c63f800 1 --2- 172.21.15.170:0/3787832589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed43be380 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f973c005fd0 tx=0x7f973c01ccc0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974c63f800 1 -- 172.21.15.170:0/3787832589 shutdown_connections 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974c63f800 1 --2- 172.21.15.170:0/3787832589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed43be380 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974c63f800 1 -- 172.21.15.170:0/3787832589 >> 172.21.15.170:0/3787832589 conn(0x55fed43b5a00 msgr2=0x55fed43b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974c63f800 1 -- 172.21.15.170:0/3787832589 shutdown_connections 2024-04-26T12:30:54.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.625+0000 7f974c63f800 1 -- 172.21.15.170:0/3787832589 wait complete. 2024-04-26T12:30:54.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.637+0000 7f974c63f800 1 Processor -- start 2024-04-26T12:30:54.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.637+0000 7f974c63f800 1 -- start start 2024-04-26T12:30:54.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.637+0000 7f974c63f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed44ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.637+0000 7f974c63f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fed4306b70 con 0x55fed43bbf90 2024-04-26T12:30:54.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed44ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed44ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49528/0 (socket says 172.21.15.170:49528) 2024-04-26T12:30:54.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f974a13e640 1 -- 172.21.15.170:0/3785097293 learned_addr learned my addr 172.21.15.170:0/3785097293 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f974a13e640 1 -- 172.21.15.170:0/3785097293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed4278590 con 0x55fed43bbf90 2024-04-26T12:30:54.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f974a13e640 1 --2- 172.21.15.170:0/3785097293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed44ac700 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f973c054040 tx=0x7f973c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4479d60c257022 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f9638608640 1 -- 172.21.15.170:0/3785097293 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c0529e0 con 0x55fed43bbf90 2024-04-26T12:30:54.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f9638608640 1 -- 172.21.15.170:0/3785097293 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c052b80 con 0x55fed43bbf90 2024-04-26T12:30:54.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.638+0000 7f9638608640 1 -- 172.21.15.170:0/3785097293 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c05c430 con 0x55fed43bbf90 2024-04-26T12:30:54.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 -- 172.21.15.170:0/3785097293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 msgr2=0x55fed44ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 --2- 172.21.15.170:0/3785097293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed44ac700 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f973c054040 tx=0x7f973c04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 -- 172.21.15.170:0/3785097293 shutdown_connections 2024-04-26T12:30:54.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 --2- 172.21.15.170:0/3785097293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbf90 0x55fed44ac700 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 -- 172.21.15.170:0/3785097293 >> 172.21.15.170:0/3785097293 conn(0x55fed43b5a00 msgr2=0x55fed44a8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 -- 172.21.15.170:0/3785097293 shutdown_connections 2024-04-26T12:30:54.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 -- 172.21.15.170:0/3785097293 wait complete. 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 Processor -- start 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 -- start start 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43be8c0 0x55fed44b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.639+0000 7f974c63f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fed43c2670 con 0x55fed43be8c0 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.640+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43be8c0 0x55fed44b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.640+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43be8c0 0x55fed44b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49534/0 (socket says 172.21.15.170:49534) 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.640+0000 7f974a13e640 1 -- 172.21.15.170:0/3375780977 learned_addr learned my addr 172.21.15.170:0/3375780977 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.640+0000 7f974a13e640 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed426f8f0 con 0x55fed43be8c0 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.640+0000 7f974a13e640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43be8c0 0x55fed44b4230 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f973c044920 tx=0x7f973c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.640+0000 7f9636e05640 1 -- 172.21.15.170:0/3375780977 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c05ce50 con 0x55fed43be8c0 2024-04-26T12:30:54.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.641+0000 7f9636e05640 1 -- 172.21.15.170:0/3375780977 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c072480 con 0x55fed43be8c0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.641+0000 7f9636e05640 1 -- 172.21.15.170:0/3375780977 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c0727a0 con 0x55fed43be8c0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.641+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed44b4770 con 0x55fed43be8c0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.641+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed44b4cf0 con 0x55fed43be8c0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.641+0000 7f9636e05640 1 -- 172.21.15.170:0/3375780977 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f973c072940 con 0x55fed43be8c0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.641+0000 7f9636e05640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9630036af0 0x7f9630038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.641+0000 7f9636e05640 1 -- 172.21.15.170:0/3375780977 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f973c08f460 con 0x55fed43be8c0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974993d640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9630036af0 0x7f9630038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44b9290 0x55fed44bb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44bbc30 con 0x55fed44b9290 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974a93f640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44b9290 0x55fed44bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974993d640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9630036af0 0x7f9630038fb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9734000f60 tx=0x7f97340012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974a93f640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44b9290 0x55fed44bb680 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974a93f640 1 -- 172.21.15.170:0/3375780977 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44b9290 2024-04-26T12:30:54.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.642+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44b8850 con 0x55fed44b9290 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.643+0000 7f974a93f640 1 -- 172.21.15.170:0/3375780977 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44b9290 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.643+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44bdf40 0x55fed44c0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.643+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44c0a20 con 0x55fed44bdf40 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.643+0000 7f974a13e640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44bdf40 0x55fed44c0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.643+0000 7f974a13e640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44bdf40 0x55fed44c0330 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.643+0000 7f974a13e640 1 -- 172.21.15.170:0/3375780977 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f973c066940 con 0x55fed44bdf40 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.643+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44bcef0 con 0x55fed44b9290 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.644+0000 7f974a93f640 1 -- 172.21.15.170:0/3375780977 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44b9290 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.644+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fed44c1ed0 0x55fed44c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.644+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44c4a90 con 0x55fed44c1ed0 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.644+0000 7f974993d640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fed44c1ed0 0x55fed44c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.644+0000 7f974993d640 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fed44c1ed0 0x55fed44c4300 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.644+0000 7f974993d640 1 -- 172.21.15.170:0/3375780977 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9734009050 con 0x55fed44c1ed0 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974c63f800 1 Processor -- start 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974c63f800 1 -- start start 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974c63f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbb30 0x55fed43b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974c63f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fed42ace60 con 0x55fed43bbb30 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbb30 0x55fed43b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbb30 0x55fed43b9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49544/0 (socket says 172.21.15.170:49544) 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974a13e640 1 -- 172.21.15.170:0/1495215339 learned_addr learned my addr 172.21.15.170:0/1495215339 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974a13e640 1 -- 172.21.15.170:0/1495215339 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed43ba4e0 con 0x55fed43bbb30 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f974a13e640 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbb30 0x55fed43b9fa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f973c08d840 tx=0x7f973c08f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f962ffff640 1 -- 172.21.15.170:0/1495215339 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c07ad70 con 0x55fed43bbb30 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.645+0000 7f962ffff640 1 -- 172.21.15.170:0/1495215339 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c08c1c0 con 0x55fed43bbb30 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.646+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed43ba770 con 0x55fed43bbb30 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.646+0000 7f962ffff640 1 -- 172.21.15.170:0/1495215339 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c0653a0 con 0x55fed43bbb30 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.646+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed43bac70 con 0x55fed43bbb30 2024-04-26T12:30:54.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.646+0000 7f962ffff640 1 -- 172.21.15.170:0/1495215339 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f973c065540 con 0x55fed43bbb30 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.646+0000 7f962ffff640 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9624036950 0x7f9624038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.646+0000 7f962ffff640 1 -- 172.21.15.170:0/1495215339 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f973c085040 con 0x55fed43bbb30 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.646+0000 7f974993d640 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9624036950 0x7f9624038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974c63f800 1 Processor -- start 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974c63f800 1 -- start start 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974993d640 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9624036950 0x7f9624038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f973400bf50 tx=0x7f973400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974c63f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e2290 0x55fed44e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974c63f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fed44acdc0 con 0x55fed44e2290 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e2290 0x55fed44e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e2290 0x55fed44e26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49548/0 (socket says 172.21.15.170:49548) 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974a13e640 1 -- 172.21.15.170:0/950087363 learned_addr learned my addr 172.21.15.170:0/950087363 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.647+0000 7f974a13e640 1 -- 172.21.15.170:0/950087363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed44e2c80 con 0x55fed44e2290 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974a13e640 1 --2- 172.21.15.170:0/950087363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e2290 0x55fed44e26b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f973c07aff0 tx=0x7f973c089130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69628fe2e62074f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f962dffb640 1 -- 172.21.15.170:0/950087363 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c07ce70 con 0x55fed44e2290 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f962dffb640 1 -- 172.21.15.170:0/950087363 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c0a7070 con 0x55fed44e2290 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f962dffb640 1 -- 172.21.15.170:0/950087363 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c088d20 con 0x55fed44e2290 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 -- 172.21.15.170:0/950087363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e2290 msgr2=0x55fed44e26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 --2- 172.21.15.170:0/950087363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e2290 0x55fed44e26b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f973c07aff0 tx=0x7f973c089130 comp rx=0 tx=0).stop 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 -- 172.21.15.170:0/950087363 shutdown_connections 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 --2- 172.21.15.170:0/950087363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e2290 0x55fed44e26b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 -- 172.21.15.170:0/950087363 >> 172.21.15.170:0/950087363 conn(0x55fed44de5f0 msgr2=0x55fed44dc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 -- 172.21.15.170:0/950087363 shutdown_connections 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 -- 172.21.15.170:0/950087363 wait complete. 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.648+0000 7f974c63f800 1 Processor -- start 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974c63f800 1 -- start start 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974c63f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e9890 0x55fed44e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974c63f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fed44e3330 con 0x55fed44e9890 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e9890 0x55fed44e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974a13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e9890 0x55fed44e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49554/0 (socket says 172.21.15.170:49554) 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 learned_addr learned my addr 172.21.15.170:0/3648498830 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fed44ea1f0 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974a13e640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e9890 0x55fed44e9cb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f973c089320 tx=0x7f973c054f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f961bfff640 1 -- 172.21.15.170:0/3648498830 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c08ddf0 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f961bfff640 1 -- 172.21.15.170:0/3648498830 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c07fd90 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fed44ea1f0 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f961bfff640 1 -- 172.21.15.170:0/3648498830 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f973c0577e0 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.649+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fed44ea1f0 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.650+0000 7f961bfff640 1 -- 172.21.15.170:0/3648498830 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f973c057980 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.650+0000 7f961bfff640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9614036950 0x7f9614038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.650+0000 7f961bfff640 1 -- 172.21.15.170:0/3648498830 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f973c09e040 con 0x55fed44e9890 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.650+0000 7f974993d640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9614036950 0x7f9614038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.651+0000 7f974993d640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9614036950 0x7f9614038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9734001b60 tx=0x7f9734010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.651+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.651+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44f52a0 0x55fed44f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.651+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f7eb0 con 0x55fed44f52a0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.651+0000 7f974a93f640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44f52a0 0x55fed44f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.651+0000 7f974a93f640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44f52a0 0x55fed44f7760 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44f52a0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 realm 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f82c0 con 0x55fed44f52a0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44f52a0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44f52a0 2024-04-26T12:30:54.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8f30 con 0x55fed44f52a0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44f52a0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44f98f0 0x55fed44fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44fc330 con 0x55fed44f98f0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.652+0000 7f974a13e640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44f98f0 0x55fed44fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974a13e640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44f98f0 0x55fed44fbce0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974c63f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974c63f800 20 searching for the correct realm 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fed44fe2c0 0x55fed4500780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed4500e50 con 0x55fed44fe2c0 2024-04-26T12:30:54.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974993d640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fed44fe2c0 0x55fed4500780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.653+0000 7f974993d640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fed44fe2c0 0x55fed4500780 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.654+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.654+0000 7f974993d640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9734038040 0x7f973401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.654+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed4500e50 con 0x7f9734038040 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.654+0000 7f974a93f640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9734038040 0x7f973401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.654+0000 7f974a93f640 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9734038040 0x7f973401bab0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.654+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f97440083e0 con 0x7f9734038040 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.654+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440083e0 con 0x55fed44f52a0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.655+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x7f9734038040 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.656+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x7f9734038040 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x7f9734038040 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.657+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.658+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.659+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.659+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.659+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.659+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.659+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.659+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x7f9734038040 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.659+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.660+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.660+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.660+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.660+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.660+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.660+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.660+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x7f9734038040 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44fe2c0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f98f0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.661+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x55fed44f52a0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fed44f8b90 con 0x7f9734038040 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:54.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44fc6d0 con 0x55fed44f52a0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44fc6d0 con 0x55fed44f52a0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.662+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44fc6d0 con 0x7f9734038040 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 zone default found 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 4 Realm: () 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 zonegroup default 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed44fcf70 con 0x55fed44f98f0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4502cb0 con 0x55fed44fe2c0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.663+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4503050 con 0x55fed44fe2c0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.664+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.664+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.664+0000 7f974c63f800 20 started sync module instance, tier type = 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.664+0000 7f974c63f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.664+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4502150 con 0x7f9734038040 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.665+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.665+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94552972076704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4502150 con 0x7f9734038040 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.665+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4503a10 con 0x55fed44f52a0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.666+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94552972076704] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.666+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.666+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94552972074624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4503a10 con 0x55fed44f52a0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.666+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45043d0 con 0x55fed44fe2c0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.667+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94552972074624] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.667+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.667+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94552972080480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4503980 con 0x55fed44fe2c0 2024-04-26T12:30:54.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.667+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45051c0 con 0x7f9734038040 2024-04-26T12:30:54.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.668+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94552972080480] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.668+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.668+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94552972085232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45055b0 con 0x7f9734038040 2024-04-26T12:30:54.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.668+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4505fb0 con 0x55fed44f52a0 2024-04-26T12:30:54.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.669+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94552972085232] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.669+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.669+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94552972086288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4505f70 con 0x55fed44f52a0 2024-04-26T12:30:54.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.669+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45069c0 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.670+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94552972086288] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.670+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.670+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94552972090048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4505ee0 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.670+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4507880 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.671+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.671+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94552972098592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45084f0 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.671+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4508eb0 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.671+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94552972090048] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94552972098592] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94552972094896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4508eb0 con 0x55fed44f98f0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 20 add_watcher() i=0 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 20 add_watcher() i=1 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 20 add_watcher() i=2 2024-04-26T12:30:54.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 20 add_watcher() i=3 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 20 add_watcher() i=4 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 20 add_watcher() i=5 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.674+0000 7f974c63f800 20 add_watcher() i=6 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.675+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94552972094896] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.675+0000 7f974c63f800 20 add_watcher() i=7 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.675+0000 7f974c63f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.675+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed450c0a0 con 0x55fed44f52a0 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.675+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.676+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94552972102144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45092d0 con 0x55fed44f52a0 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.676+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94552972102144] v32'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.676+0000 7f9600fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.677+0000 7f974c63f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.677+0000 7f974c63f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.677+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed450b9a0 con 0x55fed44f52a0 2024-04-26T12:30:54.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.678+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.678+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4515240 con 0x55fed44f98f0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.679+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.679+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4515240 con 0x55fed44fe2c0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.680+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.680+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4515c60 con 0x55fed44f52a0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.681+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.681+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45147d0 con 0x7f9734038040 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.682+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'64 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.682+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45147d0 con 0x55fed44fe2c0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.683+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.683+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4516e40 con 0x55fed44f52a0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.684+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.684+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4516e40 con 0x55fed44f98f0 2024-04-26T12:30:54.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.685+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.685+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4516e40 con 0x7f9734038040 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.686+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.686+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4516e40 con 0x55fed44fe2c0 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.687+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.687+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45173b0 con 0x7f9734038040 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.688+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'65 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.688+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45173b0 con 0x55fed44f98f0 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.689+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.689+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45173b0 con 0x7f9734038040 2024-04-26T12:30:54.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.690+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.690+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44f98f0 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.691+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.691+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44f52a0 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.692+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.692+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.693+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.693+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x7f9734038040 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.694+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'66 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.694+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.695+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.695+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44f52a0 2024-04-26T12:30:54.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.696+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.697+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44f52a0 2024-04-26T12:30:54.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.698+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.698+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.699+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.699+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x7f9734038040 2024-04-26T12:30:54.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.699+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.700+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.700+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.700+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.701+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.701+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.702+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.702+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.703+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.703+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44f98f0 2024-04-26T12:30:54.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.704+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.704+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.705+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.705+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44f98f0 2024-04-26T12:30:54.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.707+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.707+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44fe2c0 2024-04-26T12:30:54.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.707+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.707+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x55fed44f98f0 2024-04-26T12:30:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.708+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.708+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4517790 con 0x7f9734038040 2024-04-26T12:30:54.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.709+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f957b7fe640 20 reqs_thread_entry: start 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 20 Filter name: none 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f95797fa640 20 reqs_thread_entry: start 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45429e0 con 0x7f9734038040 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:30:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 : miss 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.710+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:95 8.15 8:af1fdfee:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45443d0 con 0x55fed44fe2c0 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(95 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 info.flags=0x17 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 to cache LRU end 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:96 4.37 4:efe55c73:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c1be0 con 0x55fed44f98f0 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(96 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.711+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:97 4.1a 4:5bede6b5:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c1be0 con 0x7f9734038040 2024-04-26T12:30:54.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.712+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(97 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.712+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:98 4.7 4:e065555c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c1be0 con 0x55fed44f98f0 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.712+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(98 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2 [call out=426b] v0'0 uv14 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.712+0000 7f974c63f800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.712+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 4.2c 4:35e220cb:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x55fed44f52a0 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.713+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(99 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.713+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:100 4.13 4:c89bcd64:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x7f9734038040 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.713+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(100 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744026040 con 0x7f9734038040 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.713+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:101 4.3b 4:dd4c47fa:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x55fed44fe2c0 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.713+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(101 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.713+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:102 4.15 4:a89db787:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x55fed44fe2c0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(102 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974c63f800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 4.27 4:e47e30a9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x55fed44f52a0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(103 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:104 4.c 4:30159bb7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x55fed44f52a0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(104 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974c63f800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.714+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:105 4.2d 4:b4b35ece:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x55fed44f98f0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(105 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:106 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45c2080 con 0x55fed44f98f0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(106 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [call out=697b] v0'0 uv12 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974c63f800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974c63f800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:107 3.14s0 3:29262431:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45bf910 con 0x55fed44fe2c0 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.715+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(107 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.716+0000 7f974c63f800 10 manifest: total_size = 6 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.716+0000 7f974c63f800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.12643855454023647743 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.716+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.716+0000 7f974c63f800 20 prepare_atomic_modification: state is not atomic. state=0x55fed4545188 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.716+0000 7f974c63f800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.716+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:108 4.7 4:e065555c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4549b40 con 0x55fed44f98f0 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.717+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(108 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2 [stat,call,call] v32'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.717+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:109 3.14s0 3:29262431:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4547b20 con 0x55fed44fe2c0 2024-04-26T12:30:54.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.718+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(109 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_9c8454ddf7aa50116496bac348d7550d [call] v32'5 uv5 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.718+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:110 4.7 4:e065555c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4549b40 con 0x55fed44f98f0 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.718+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.718+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:111 3.14s0 3:2b3fbf4d:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4549b40 con 0x55fed44fe2c0 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(111 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974c63f800 10 manifest: total_size = 3 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974c63f800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9147597743213704806 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974c63f800 20 prepare_atomic_modification: state is not atomic. state=0x55fed4545188 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974c63f800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:112 4.15 4:a89db787:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed454ef70 con 0x55fed44fe2c0 2024-04-26T12:30:54.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.719+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(110 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2 [stat,call,call] v32'16 uv16 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.720+0000 7f962dffb640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.720+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(112 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.720+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:113 3.14s0 3:2b3fbf4d:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4547b20 con 0x55fed44fe2c0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.721+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(113 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.721+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:114 4.15 4:a89db787:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed454af30 con 0x55fed44fe2c0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.721+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.721+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:115 3.as0 3:51e6b7f1:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed454af30 con 0x55fed44fe2c0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.721+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== osd_op_reply(115 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f974c63f800 10 manifest: total_size = 4 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f974c63f800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10570094971649068994 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f974c63f800 20 prepare_atomic_modification: state is not atomic. state=0x55fed4545188 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f974c63f800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8 2024-04-26T12:30:54.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:116 4.c 4:30159bb7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed454ebe0 con 0x55fed44f52a0 2024-04-26T12:30:54.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 35 ==== osd_op_reply(114 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.722+0000 7f962d7fa640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.723+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(116 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9744026040 con 0x55fed44f52a0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.723+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:117 3.as0 3:51e6b7f1:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed454d720 con 0x55fed44fe2c0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.724+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 36 ==== osd_op_reply(117 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.724+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:118 4.c 4:30159bb7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed454ebe0 con 0x55fed44f52a0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.724+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.724+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:119 3.11s0 3:8ba80d1a:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed454ebe0 con 0x55fed44fe2c0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 37 ==== osd_op_reply(119 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974c63f800 10 manifest: total_size = 5 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974c63f800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9367222891583051656 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974c63f800 20 prepare_atomic_modification: state is not atomic. state=0x55fed4545188 2024-04-26T12:30:54.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974c63f800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 2024-04-26T12:30:54.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:120 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45509d0 con 0x55fed44f98f0 2024-04-26T12:30:54.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(118 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.725+0000 7f962dffb640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-26T12:30:54.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.726+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(120 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [stat,call,call] v32'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.726+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:121 3.11s0 3:8ba80d1a:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45509d0 con 0x55fed44fe2c0 2024-04-26T12:30:54.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.727+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 38 ==== osd_op_reply(121 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.727+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:122 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45509d0 con 0x55fed44f98f0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.727+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.727+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:123 3.ds0 3:b217b38e:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45509d0 con 0x55fed44fe2c0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.728+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 39 ==== osd_op_reply(123 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.728+0000 7f974c63f800 10 manifest: total_size = 5 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.728+0000 7f974c63f800 20 get_obj_state: setting s->obj_tag to _jA_k8hNm4wQleJygEBFuwmsZa2_9Xll 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.728+0000 7f974c63f800 20 get_obj_state: octx=0x7f9744008ce0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55fed4545188 s->prefetch_data=0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.728+0000 7f974c63f800 20 prepare_atomic_modification: state is not atomic. state=0x55fed4545188 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.728+0000 7f974c63f800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.728+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:124 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45492e0 con 0x55fed44f98f0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.729+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(122 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [stat,call,call] v32'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.729+0000 7f962d7fa640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.729+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(124 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [stat,call,call] v32'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.729+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:125 3.ds0 3:b217b38e:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4550b30 con 0x55fed44fe2c0 2024-04-26T12:30:54.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 40 ==== osd_op_reply(125 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:126 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4545e00 con 0x55fed44f98f0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974c63f800 20 list_objects_ordered: starting attempt 1 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974c63f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:127 4.37 4:efe55c73:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4545ce0 con 0x55fed44f98f0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:128 4.1a 4:5bede6b5:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45494c0 con 0x7f9734038040 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:129 4.7 4:e065555c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45494c0 con 0x55fed44f98f0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.730+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:130 4.2c 4:35e220cb:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4556450 con 0x55fed44f52a0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(127 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:131 4.13 4:c89bcd64:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4556450 con 0x7f9734038040 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(129 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2 [call out=124b] v0'0 uv16 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(128 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(130 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:132 4.3b 4:dd4c47fa:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4545ce0 con 0x55fed44fe2c0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:133 4.15 4:a89db787:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45bfbd0 con 0x55fed44fe2c0 2024-04-26T12:30:54.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:134 4.27 4:e47e30a9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4554ce0 con 0x55fed44f52a0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:135 4.c 4:30159bb7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4545ce0 con 0x55fed44f52a0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:136 4.2d 4:b4b35ece:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed455c9f0 con 0x55fed44f98f0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:137 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x55fed44f98f0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(131 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== osd_op_reply(126 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [stat,call,call] v32'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f962dffb640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 41 ==== osd_op_reply(132 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(134 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.731+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 42 ==== osd_op_reply(133 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(136 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(137 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [call out=124b] v0'0 uv20 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(135 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:30:54.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5])"; uploads.size()=0; is_truncated=0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:138 4.37 4:efe55c73:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x55fed44f98f0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:139 4.1a 4:5bede6b5:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45504c0 con 0x7f9734038040 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:140 4.7 4:e065555c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x55fed44f98f0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:141 4.2c 4:35e220cb:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4550f50 con 0x55fed44f52a0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:142 4.13 4:c89bcd64:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x7f9734038040 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:143 4.3b 4:dd4c47fa:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45504c0 con 0x55fed44fe2c0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:144 4.15 4:a89db787:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x55fed44fe2c0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:145 4.27 4:e47e30a9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45541a0 con 0x55fed44f52a0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:146 4.c 4:30159bb7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4550f50 con 0x55fed44f52a0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:147 4.2d 4:b4b35ece:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4562120 con 0x55fed44f98f0 2024-04-26T12:30:54.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(138 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:148 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4550f50 con 0x55fed44f98f0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(140 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2 [call out=124b] v0'0 uv16 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(139 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(142 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(147 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(141 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(148 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [call out=124b] v0'0 uv20 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(145 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 43 ==== osd_op_reply(143 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.732+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 44 ==== osd_op_reply(144 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.733+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(146 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.733+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45504c0 con 0x7f9734038040 2024-04-26T12:30:54.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.734+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.734+0000 7f974c63f800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.734+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45504c0 con 0x7f9734038040 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974c63f800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974c63f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94552972456928 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4544fa0 con 0x55fed44f98f0 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== watch-notify(notify (1) cookie 94552972098592 notify 137438953490 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55fed45173b0 con 0x55fed44f98f0 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f962dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94552972098592 notifier 4656 bl.length()=149 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f962dffb640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9610003d60 con 0x55fed44f98f0 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(151 notify.6 [notify cookie 94552972456928 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== watch-notify(notify_complete (2) cookie 94552972456928 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fed43ba4e0 con 0x55fed44f98f0 2024-04-26T12:30:54.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.735+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:153 8.15 8:af1fdfee:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45504c0 con 0x55fed44fe2c0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.736+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 45 ==== osd_op_reply(153 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.736+0000 7f974c63f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 from cache 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.736+0000 7f974c63f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5, ofs0, ns] 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.736+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify cookie 94552972456928 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed45bfa80 con 0x55fed44f52a0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.736+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== watch-notify(notify (1) cookie 94552972086288 notify 137438953499 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55fed450b960 con 0x55fed44f52a0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.736+0000 7f962d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94552972086288 notifier 4656 bl.length()=206 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f962d7fa640 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:155 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9580003320 con 0x55fed44f52a0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(154 notify.4 [notify cookie 94552972456928 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(155 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== watch-notify(notify_complete (2) cookie 94552972456928 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fed4514150 con 0x55fed44f52a0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:156 4.37 4:efe55c73:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x55fed44f98f0 2024-04-26T12:30:54.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:157 4.1a 4:5bede6b5:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4544a70 con 0x7f9734038040 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:158 4.7 4:e065555c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45544b0 con 0x55fed44f98f0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:159 4.2c 4:35e220cb:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x55fed44f52a0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:160 4.13 4:c89bcd64:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45544b0 con 0x7f9734038040 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:161 4.3b 4:dd4c47fa:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4544a70 con 0x55fed44fe2c0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:162 4.15 4:a89db787:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed455f3e0 con 0x55fed44fe2c0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:163 4.27 4:e47e30a9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4555680 con 0x55fed44f52a0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:164 4.c 4:30159bb7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4542e00 con 0x55fed44f52a0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:165 4.2d 4:b4b35ece:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed45544b0 con 0x55fed44f98f0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.737+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:166 4.7 4:e29b1db3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4544a70 con 0x55fed44f98f0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.738+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(157 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.738+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(165 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.9 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.738+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== osd_op_reply(158 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.2 [delete] v32'21 uv21 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.739+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 46 ==== osd_op_reply(161 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.739+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 48 ==== osd_op_reply(156 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.0 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.739+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 49 ==== osd_op_reply(166 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.10 [delete] v32'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.739+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(160 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.4 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.739+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(164 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.8 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.739+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== osd_op_reply(163 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(159 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 47 ==== osd_op_reply(162 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5.6 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974c63f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 : miss 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974c63f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:167 6.6 6:624f6fe5:::pubsub..bucket.myfoo%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fed4545ce0 con 0x55fed44fe2c0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 48 ==== osd_op_reply(167 pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974c63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974c63f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 info.flags=0x0 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974c63f800 10 adding default.rgw.log++pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 to cache LRU end 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.740+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:168 6.6 6:624f6fe5:::pubsub..bucket.myfoo%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4545ce0 con 0x55fed44fe2c0 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.741+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 49 ==== osd_op_reply(168 pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.5 [delete] v32'13 uv12 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.741+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4545ce0 con 0x7f9734038040 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.742+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.743+0000 7f9600fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.743+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94552972102144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x55fed44f52a0 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.744+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94552972102144] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.744+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94552972076704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x7f9734038040 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.745+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94552972076704] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.745+0000 7f974c63f800 20 remove_watcher() i=0 2024-04-26T12:30:54.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.745+0000 7f974c63f800 2 removed watcher, disabling cache 2024-04-26T12:30:54.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.745+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94552972074624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x55fed44f52a0 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.746+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94552972074624] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.746+0000 7f974c63f800 20 remove_watcher() i=1 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.746+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94552972080480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x55fed44fe2c0 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.747+0000 7f974993d640 1 -- 172.21.15.170:0/3648498830 <== osd.3 v2:172.21.15.170:6816/2349137764 50 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94552972080480] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9734009050 con 0x55fed44fe2c0 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.747+0000 7f974c63f800 20 remove_watcher() i=2 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.747+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94552972085232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x7f9734038040 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.748+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94552972085232] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744046040 con 0x7f9734038040 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.748+0000 7f974c63f800 20 remove_watcher() i=3 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.748+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94552972086288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x55fed44f52a0 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.749+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94552972086288] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9744046040 con 0x55fed44f52a0 2024-04-26T12:30:54.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.749+0000 7f974c63f800 20 remove_watcher() i=4 2024-04-26T12:30:54.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.749+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94552972090048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x55fed44f98f0 2024-04-26T12:30:54.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.750+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 50 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94552972090048] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.750+0000 7f974c63f800 20 remove_watcher() i=5 2024-04-26T12:30:54.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.750+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94552972098592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x55fed44f98f0 2024-04-26T12:30:54.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.751+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 51 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94552972098592] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.751+0000 7f974c63f800 20 remove_watcher() i=6 2024-04-26T12:30:54.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.751+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94552972094896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fed4510ad0 con 0x55fed44f98f0 2024-04-26T12:30:54.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.751+0000 7f974a13e640 1 -- 172.21.15.170:0/3648498830 <== osd.0 v2:172.21.15.132:6800/965566727 52 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94552972094896] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f973c095020 con 0x55fed44f98f0 2024-04-26T12:30:54.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 20 remove_watcher() i=7 2024-04-26T12:30:54.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44f98f0 msgr2=0x55fed44fbce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44f98f0 0x55fed44fbce0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44f52a0 msgr2=0x55fed44f7760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44f52a0 0x55fed44f7760 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9734038040 msgr2=0x7f973401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9734038040 0x7f973401bab0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fed44fe2c0 msgr2=0x55fed4500780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fed44fe2c0 0x55fed4500780 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9614036950 msgr2=0x7f9614038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9614036950 0x7f9614038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9734001b60 tx=0x7f9734010000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974a93f640 1 -- 172.21.15.170:0/3648498830 reap_dead start 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e9890 msgr2=0x55fed44e9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e9890 0x55fed44e9cb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f973c089320 tx=0x7f973c054f40 comp rx=0 tx=0).stop 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 shutdown_connections 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/3648498830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed44e9890 0x55fed44e9cb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 >> 172.21.15.170:0/3648498830 conn(0x55fed44de5f0 msgr2=0x55fed44dbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 shutdown_connections 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/3648498830 wait complete. 2024-04-26T12:30:54.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9624036950 msgr2=0x7f9624038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9624036950 0x7f9624038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f973400bf50 tx=0x7f973400f000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbb30 msgr2=0x55fed43b9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbb30 0x55fed43b9fa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f973c08d840 tx=0x7f973c08f3a0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 shutdown_connections 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9624036950 0x7f9624038e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 --2- 172.21.15.170:0/1495215339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43bbb30 0x55fed43b9fa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 >> 172.21.15.170:0/1495215339 conn(0x55fed44c6f90 msgr2=0x55fed44c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 shutdown_connections 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.752+0000 7f974c63f800 1 -- 172.21.15.170:0/1495215339 wait complete. 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44bdf40 msgr2=0x55fed44c0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fed44bdf40 0x55fed44c0330 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44b9290 msgr2=0x55fed44bb680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fed44b9290 0x55fed44bb680 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fed44c1ed0 msgr2=0x55fed44c4300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fed44c1ed0 0x55fed44c4300 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9630036af0 msgr2=0x7f9630038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9630036af0 0x7f9630038fb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9734000f60 tx=0x7f97340012b0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43be8c0 msgr2=0x55fed44b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 --2- 172.21.15.170:0/3375780977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fed43be8c0 0x55fed44b4230 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f973c044920 tx=0x7f973c003330 comp rx=0 tx=0).stop 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974a93f640 1 -- 172.21.15.170:0/3375780977 reap_dead start 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 shutdown_connections 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 >> 172.21.15.170:0/3375780977 conn(0x55fed43b5a00 msgr2=0x55fed44ab0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 shutdown_connections 2024-04-26T12:30:54.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.753+0000 7f974c63f800 1 -- 172.21.15.170:0/3375780977 wait complete. 2024-04-26T12:30:54.764 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:30:54.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:30:54.764 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-26T12:30:54.810 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:54.810 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:54.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f501652d800 1 Processor -- start 2024-04-26T12:30:54.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f501652d800 1 -- start start 2024-04-26T12:30:54.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f501652d800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562c8c696050 0x562c8c698440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f501652d800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c8c5420c0 con 0x562c8c698980 2024-04-26T12:30:54.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f501652d800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x562c8c5264d0 con 0x562c8c696050 2024-04-26T12:30:54.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f5012178640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562c8c696050 0x562c8c698440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f5011977640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x562c8c698980 0x562c8c69ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:44038/0 (socket says 172.21.15.170:44038) 2024-04-26T12:30:54.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.808+0000 7f5011977640 1 -- 172.21.15.170:0/2361330642 learned_addr learned my addr 172.21.15.170:0/2361330642 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:54.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.809+0000 7f5012178640 1 -- 172.21.15.170:0/2361330642 >> v1:172.21.15.132:6789/0 conn(0x562c8c698980 legacy=0x562c8c69ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.809+0000 7f5012178640 1 -- 172.21.15.170:0/2361330642 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8c553d40 con 0x562c8c696050 2024-04-26T12:30:54.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.809+0000 7f5011176640 1 -- 172.21.15.170:0/2361330642 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318331156 0 0) 0x562c8c5420c0 con 0x562c8c698980 2024-04-26T12:30:54.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f5012178640 1 --2- 172.21.15.170:0/2361330642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c698440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00a470 tx=0x7f4ffc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d8fd520e5be278 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f5011176640 1 -- 172.21.15.170:0/2361330642 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc057070 con 0x562c8c696050 2024-04-26T12:30:54.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f5011176640 1 -- 172.21.15.170:0/2361330642 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc052570 con 0x562c8c696050 2024-04-26T12:30:54.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f5011176640 1 -- 172.21.15.170:0/2361330642 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc052870 con 0x562c8c696050 2024-04-26T12:30:54.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f501652d800 1 -- 172.21.15.170:0/2361330642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 msgr2=0x562c8c698440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f501652d800 1 --2- 172.21.15.170:0/2361330642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c698440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00a470 tx=0x7f4ffc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:54.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f501652d800 1 -- 172.21.15.170:0/2361330642 shutdown_connections 2024-04-26T12:30:54.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f501652d800 1 --2- 172.21.15.170:0/2361330642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c698440 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f501652d800 1 -- 172.21.15.170:0/2361330642 >> 172.21.15.170:0/2361330642 conn(0x562c8c68fa00 msgr2=0x562c8c691e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f501652d800 1 -- 172.21.15.170:0/2361330642 shutdown_connections 2024-04-26T12:30:54.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.811+0000 7f501652d800 1 -- 172.21.15.170:0/2361330642 wait complete. 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.823+0000 7f501652d800 1 Processor -- start 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.823+0000 7f501652d800 1 -- start start 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.823+0000 7f501652d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c786580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.823+0000 7f501652d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562c8c5e0b70 con 0x562c8c696050 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.823+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c786580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.823+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c786580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49576/0 (socket says 172.21.15.170:49576) 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.823+0000 7f5012178640 1 -- 172.21.15.170:0/2202616658 learned_addr learned my addr 172.21.15.170:0/2202616658 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.824+0000 7f5012178640 1 -- 172.21.15.170:0/2202616658 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8c552590 con 0x562c8c696050 2024-04-26T12:30:54.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.824+0000 7f5012178640 1 --2- 172.21.15.170:0/2202616658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c786580 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc055040 tx=0x7f4ffc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0496ed588f512d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.824+0000 7f4f00608640 1 -- 172.21.15.170:0/2202616658 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc057070 con 0x562c8c696050 2024-04-26T12:30:54.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.824+0000 7f4f00608640 1 -- 172.21.15.170:0/2202616658 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc063070 con 0x562c8c696050 2024-04-26T12:30:54.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.824+0000 7f4f00608640 1 -- 172.21.15.170:0/2202616658 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc052720 con 0x562c8c696050 2024-04-26T12:30:54.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 -- 172.21.15.170:0/2202616658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 msgr2=0x562c8c786580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 --2- 172.21.15.170:0/2202616658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c786580 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc055040 tx=0x7f4ffc04c000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 -- 172.21.15.170:0/2202616658 shutdown_connections 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 --2- 172.21.15.170:0/2202616658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c786580 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 -- 172.21.15.170:0/2202616658 >> 172.21.15.170:0/2202616658 conn(0x562c8c68fa00 msgr2=0x562c8c781ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 -- 172.21.15.170:0/2202616658 shutdown_connections 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 -- 172.21.15.170:0/2202616658 wait complete. 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 Processor -- start 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 -- start start 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c78de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f501652d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562c8c69e7a0 con 0x562c8c696050 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c78de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c78de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49590/0 (socket says 172.21.15.170:49590) 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.825+0000 7f5012178640 1 -- 172.21.15.170:0/2065369892 learned_addr learned my addr 172.21.15.170:0/2065369892 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.826+0000 7f5012178640 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8c5498f0 con 0x562c8c696050 2024-04-26T12:30:54.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.826+0000 7f5012178640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c78de10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc060040 tx=0x7f4ffc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.826+0000 7f4efee05640 1 -- 172.21.15.170:0/2065369892 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc052e30 con 0x562c8c696050 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.826+0000 7f4efee05640 1 -- 172.21.15.170:0/2065369892 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc06c070 con 0x562c8c696050 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.826+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c8c78e350 con 0x562c8c696050 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.826+0000 7f4efee05640 1 -- 172.21.15.170:0/2065369892 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc05e5f0 con 0x562c8c696050 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.826+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c8c78e8d0 con 0x562c8c696050 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f4efee05640 1 -- 172.21.15.170:0/2065369892 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ffc05e790 con 0x562c8c696050 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f4efee05640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ef8036950 0x7f4ef8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f4efee05640 1 -- 172.21.15.170:0/2065369892 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f4ffc08e9b0 con 0x562c8c696050 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f5011977640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ef8036950 0x7f4ef8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c698980 0x562c8c794e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7953c0 con 0x562c8c698980 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f5012979640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c698980 0x562c8c794e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.827+0000 7f5011977640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ef8036950 0x7f4ef8038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5004000c00 tx=0x7f50040013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.828+0000 7f5012979640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c698980 0x562c8c794e80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.828+0000 7f5012979640 1 -- 172.21.15.170:0/2065369892 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c698980 2024-04-26T12:30:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.828+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c792430 con 0x562c8c698980 2024-04-26T12:30:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.828+0000 7f5012979640 1 -- 172.21.15.170:0/2065369892 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c698980 2024-04-26T12:30:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.828+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7976b0 0x562c8c799aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.828+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c79a170 con 0x562c8c7976b0 2024-04-26T12:30:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.829+0000 7f5012178640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7976b0 0x562c8c799aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.829+0000 7f5012178640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7976b0 0x562c8c799aa0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.829+0000 7f5012178640 1 -- 172.21.15.170:0/2065369892 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7976b0 2024-04-26T12:30:54.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.829+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c796660 con 0x562c8c698980 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.829+0000 7f5012979640 1 -- 172.21.15.170:0/2065369892 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c698980 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.829+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562c8c79b5b0 0x562c8c79da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.829+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c79e200 con 0x562c8c79b5b0 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.830+0000 7f5011977640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562c8c79b5b0 0x562c8c79da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.830+0000 7f5011977640 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562c8c79b5b0 0x562c8c79da70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.830+0000 7f5011977640 1 -- 172.21.15.170:0/2065369892 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f500400f670 con 0x562c8c79b5b0 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.830+0000 7f501652d800 1 Processor -- start 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.830+0000 7f501652d800 1 -- start start 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f501652d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c7ac6b0 0x562c8c7acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f501652d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562c8c586e60 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c7ac6b0 0x562c8c7acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c7ac6b0 0x562c8c7acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49602/0 (socket says 172.21.15.170:49602) 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f5012178640 1 -- 172.21.15.170:0/349930417 learned_addr learned my addr 172.21.15.170:0/349930417 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f5012178640 1 -- 172.21.15.170:0/349930417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8c7ad010 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f5012178640 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c7ac6b0 0x562c8c7acad0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc08cd50 tx=0x7f4ffc068e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f4ef7fff640 1 -- 172.21.15.170:0/349930417 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc092020 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f4ef7fff640 1 -- 172.21.15.170:0/349930417 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc058040 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c8c7ada80 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f4ef7fff640 1 -- 172.21.15.170:0/349930417 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc002a70 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.831+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c8c7ada80 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.832+0000 7f4ef7fff640 1 -- 172.21.15.170:0/349930417 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ffc095020 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.832+0000 7f4ef7fff640 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4eec036950 0x7f4eec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.832+0000 7f4ef7fff640 1 -- 172.21.15.170:0/349930417 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f4ffc098d10 con 0x562c8c7ac6b0 2024-04-26T12:30:54.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.832+0000 7f5011977640 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4eec036950 0x7f4eec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.832+0000 7f501652d800 1 Processor -- start 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f501652d800 1 -- start start 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f5011977640 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4eec036950 0x7f4eec038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x562c8c795850 tx=0x7f5004006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f501652d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c695a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f501652d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562c8c786c40 con 0x562c8c695640 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c695a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c695a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49606/0 (socket says 172.21.15.170:49606) 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f5012178640 1 -- 172.21.15.170:0/1906411837 learned_addr learned my addr 172.21.15.170:0/1906411837 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f5012178640 1 -- 172.21.15.170:0/1906411837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8c693e40 con 0x562c8c695640 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f5012178640 1 --2- 172.21.15.170:0/1906411837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c695a60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0021c0 tx=0x7f4ffc067e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634038430d5c3a6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f4ef5ffb640 1 -- 172.21.15.170:0/1906411837 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc09ae70 con 0x562c8c695640 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f4ef5ffb640 1 -- 172.21.15.170:0/1906411837 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc067640 con 0x562c8c695640 2024-04-26T12:30:54.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.833+0000 7f4ef5ffb640 1 -- 172.21.15.170:0/1906411837 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc002d40 con 0x562c8c695640 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 -- 172.21.15.170:0/1906411837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 msgr2=0x562c8c695a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 --2- 172.21.15.170:0/1906411837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c695a60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0021c0 tx=0x7f4ffc067e70 comp rx=0 tx=0).stop 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 -- 172.21.15.170:0/1906411837 shutdown_connections 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 --2- 172.21.15.170:0/1906411837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c695a60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 -- 172.21.15.170:0/1906411837 >> 172.21.15.170:0/1906411837 conn(0x562c8c7b5920 msgr2=0x562c8c7b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 -- 172.21.15.170:0/1906411837 shutdown_connections 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 -- 172.21.15.170:0/1906411837 wait complete. 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 Processor -- start 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 -- start start 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c7c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f501652d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562c8c694250 con 0x562c8c695640 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c7c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f5012178640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c7c2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49614/0 (socket says 172.21.15.170:49614) 2024-04-26T12:30:54.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.834+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 learned_addr learned my addr 172.21.15.170:0/2289205115 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.835+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8c7c30e0 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.835+0000 7f5012178640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c7c2ba0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc098f80 tx=0x7f4ffc070f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.835+0000 7f4ee3fff640 1 -- 172.21.15.170:0/2289205115 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc002230 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.835+0000 7f4ee3fff640 1 -- 172.21.15.170:0/2289205115 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0bb070 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.835+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c8c7c30e0 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.835+0000 7f4ee3fff640 1 -- 172.21.15.170:0/2289205115 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc002500 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.835+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c8c7c30e0 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.836+0000 7f4ee3fff640 1 -- 172.21.15.170:0/2289205115 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4ffc08e0b0 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.836+0000 7f4ee3fff640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.836+0000 7f4ee3fff640 1 -- 172.21.15.170:0/2289205115 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f4ffc081760 con 0x562c8c695640 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.836+0000 7f5011977640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.836+0000 7f5011977640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x562c8c79e600 tx=0x7f5004023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c7ce320 0x562c8c7d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d0f30 con 0x562c8c7ce320 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f5012979640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c7ce320 0x562c8c7d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f5012979640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c7ce320 0x562c8c7d07e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 20 realm 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1340 con 0x562c8c7ce320 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.837+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1c10 con 0x562c8c7ce320 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f501652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f501652d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7d2d10 0x562c8c7d5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d5710 con 0x562c8c7d2d10 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.838+0000 7f5012178640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7d2d10 0x562c8c7d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f5012178640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7d2d10 0x562c8c7d5100 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f501652d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f501652d800 20 searching for the correct realm 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562c8c7d76c0 0x562c8c7d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7da250 con 0x562c8c7d76c0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f5011977640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562c8c7d76c0 0x562c8c7d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.839+0000 7f5011977640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562c8c7d76c0 0x562c8c7d9b80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.840+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.840+0000 7f5011977640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f500403a3c0 0x7f500403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.840+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7da250 con 0x7f500403a3c0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.840+0000 7f5012979640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f500403a3c0 0x7f500403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.840+0000 7f5012979640 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f500403a3c0 0x7f500403a810 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.840+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f500c00a4a0 con 0x7f500403a3c0 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.840+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.841+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.841+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.841+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.841+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.841+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.841+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x7f500403a3c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c00a4a0 con 0x7f500403a3c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.842+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x7f500403a3c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c00a4a0 con 0x7f500403a3c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c00a4a0 con 0x562c8c7ce320 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x7f500403a3c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.843+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.844+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.845+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x7f500403a3c0 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.846+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.846+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.846+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.846+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.846+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.846+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.847+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.847+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.847+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.847+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x7f500403a3c0 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.847+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.847+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d76c0 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7d2d10 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x562c8c7ce320 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d1fb0 con 0x7f500403a3c0 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:54.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.848+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d5fd0 con 0x562c8c7ce320 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d5fd0 con 0x562c8c7ce320 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d5fd0 con 0x7f500403a3c0 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 zone default found 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 4 Realm: () 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 zonegroup default 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.849+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7d6870 con 0x562c8c7d2d10 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dc0b0 con 0x562c8c7d76c0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dc450 con 0x562c8c7d76c0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 20 started sync module instance, tier type = 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.850+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7db550 con 0x7f500403a3c0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.851+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.851+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94749335599696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7db550 con 0x7f500403a3c0 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.851+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dce50 con 0x562c8c7ce320 2024-04-26T12:30:54.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.852+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94749335599696] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.852+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.852+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94749335603552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7db550 con 0x562c8c7ce320 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.852+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dd860 con 0x562c8c7d76c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.853+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94749335603552] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.854+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.854+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94749335597216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7db4c0 con 0x562c8c7d76c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.854+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7de720 con 0x7f500403a3c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.855+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94749335597216] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.855+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.855+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94749335609968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7deb40 con 0x7f500403a3c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.855+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7df500 con 0x562c8c7ce320 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.856+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94749335609968] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.856+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.856+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94749335611536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7df500 con 0x562c8c7ce320 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.856+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dfec0 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.857+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.857+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94749335616016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7e0710 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.857+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7e1190 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.857+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94749335611536] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.858+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94749335616016] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.858+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.858+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94749335618144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7df050 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.858+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7e1a30 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.859+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94749335618144] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94749335620736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7e1a30 con 0x562c8c7d2d10 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 20 add_watcher() i=0 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 20 add_watcher() i=1 2024-04-26T12:30:54.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 20 add_watcher() i=2 2024-04-26T12:30:54.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 20 add_watcher() i=3 2024-04-26T12:30:54.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 20 add_watcher() i=4 2024-04-26T12:30:54.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 20 add_watcher() i=5 2024-04-26T12:30:54.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.860+0000 7f501652d800 20 add_watcher() i=6 2024-04-26T12:30:54.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.861+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94749335620736] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.861+0000 7f501652d800 20 add_watcher() i=7 2024-04-26T12:30:54.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.861+0000 7f501652d800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:54.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.861+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7e4df0 con 0x562c8c7ce320 2024-04-26T12:30:54.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.861+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.861+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94749335623408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7e1fc0 con 0x562c8c7ce320 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94749335623408] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f4ec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f501652d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f501652d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f501652d800 5 note: GC not initialized 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f4e437fe640 20 reqs_thread_entry: start 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f501652d800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.862+0000 7f501652d800 20 Filter name: none 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f4e417fa640 20 reqs_thread_entry: start 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c818430 con 0x562c8c7ce320 2024-04-26T12:30:54.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.863+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c81e5d0 con 0x562c8c7ce320 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f501652d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f501652d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f501652d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94749335871584 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c8c819eb0 con 0x562c8c7ce320 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 94749335611536 notify 137438953500 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f500c018d00 con 0x562c8c7ce320 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f4ef5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94749335611536 notifier 4663 bl.length()=579 2024-04-26T12:30:54.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f4ef5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:54.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f4ef5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:54.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f4ef5ffb640 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4ed8003ea0 con 0x562c8c7ce320 2024-04-26T12:30:54.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.864+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(64 notify.4 [notify cookie 94749335871584 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.865+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.865+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 94749335871584 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f500c005040 con 0x562c8c7ce320 2024-04-26T12:30:54.879 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:54.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.866+0000 7f4ec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.866+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94749335623408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c81d460 con 0x562c8c7ce320 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.867+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94749335623408] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.867+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94749335599696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c81d460 con 0x7f500403a3c0 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.868+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94749335599696] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.868+0000 7f501652d800 20 remove_watcher() i=0 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.868+0000 7f501652d800 2 removed watcher, disabling cache 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.868+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94749335603552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dba50 con 0x562c8c7ce320 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.869+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94749335603552] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.869+0000 7f501652d800 20 remove_watcher() i=1 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.869+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94749335597216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dba50 con 0x562c8c7d76c0 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.870+0000 7f5011977640 1 -- 172.21.15.170:0/2289205115 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94749335597216] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5004037040 con 0x562c8c7d76c0 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.870+0000 7f501652d800 20 remove_watcher() i=2 2024-04-26T12:30:54.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.870+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94749335609968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7db0a0 con 0x7f500403a3c0 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.871+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94749335609968] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x7f500403a3c0 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.871+0000 7f501652d800 20 remove_watcher() i=3 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.871+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94749335611536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7de270 con 0x562c8c7ce320 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.872+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94749335611536] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f500c033040 con 0x562c8c7ce320 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.872+0000 7f501652d800 20 remove_watcher() i=4 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.872+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94749335616016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7db0a0 con 0x562c8c7d2d10 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.873+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94749335616016] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.873+0000 7f501652d800 20 remove_watcher() i=5 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.873+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94749335618144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7de270 con 0x562c8c7d2d10 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.874+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94749335618144] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.874+0000 7f501652d800 20 remove_watcher() i=6 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.874+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94749335620736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c8c7dfa10 con 0x562c8c7d2d10 2024-04-26T12:30:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.874+0000 7f5012178640 1 -- 172.21.15.170:0/2289205115 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94749335620736] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ffc071990 con 0x562c8c7d2d10 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.874+0000 7f501652d800 20 remove_watcher() i=7 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7d2d10 msgr2=0x562c8c7d5100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7d2d10 0x562c8c7d5100 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c7ce320 msgr2=0x562c8c7d07e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c7ce320 0x562c8c7d07e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f500403a3c0 msgr2=0x7f500403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f500403a3c0 0x7f500403a810 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562c8c7d76c0 msgr2=0x562c8c7d9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562c8c7d76c0 0x562c8c7d9b80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 msgr2=0x7f4edc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4edc036950 0x7f4edc038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x562c8c79e600 tx=0x7f5004023040 comp rx=0 tx=0).stop 2024-04-26T12:30:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 msgr2=0x562c8c7c2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/2289205115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c695640 0x562c8c7c2ba0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc098f80 tx=0x7f4ffc070f50 comp rx=0 tx=0).stop 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 reap_dead start 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f5012979640 1 -- 172.21.15.170:0/2289205115 reap_dead start 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 shutdown_connections 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 >> 172.21.15.170:0/2289205115 conn(0x562c8c7b5920 msgr2=0x562c8c7b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 shutdown_connections 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/2289205115 wait complete. 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4eec036950 msgr2=0x7f4eec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4eec036950 0x7f4eec038e10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x562c8c795850 tx=0x7f5004006000 comp rx=0 tx=0).stop 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c7ac6b0 msgr2=0x562c8c7acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c7ac6b0 0x562c8c7acad0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc08cd50 tx=0x7f4ffc068e30 comp rx=0 tx=0).stop 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 shutdown_connections 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4eec036950 0x7f4eec038e10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 --2- 172.21.15.170:0/349930417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c7ac6b0 0x562c8c7acad0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 >> 172.21.15.170:0/349930417 conn(0x562c8c7a0750 msgr2=0x562c8c7a0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 shutdown_connections 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.875+0000 7f501652d800 1 -- 172.21.15.170:0/349930417 wait complete. 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7976b0 msgr2=0x562c8c799aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562c8c7976b0 0x562c8c799aa0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c698980 msgr2=0x562c8c794e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562c8c698980 0x562c8c794e80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562c8c79b5b0 msgr2=0x562c8c79da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562c8c79b5b0 0x562c8c79da70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ef8036950 msgr2=0x7f4ef8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4ef8036950 0x7f4ef8038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5004000c00 tx=0x7f50040013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 msgr2=0x562c8c78de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 --2- 172.21.15.170:0/2065369892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562c8c696050 0x562c8c78de10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc060040 tx=0x7f4ffc002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f5012979640 1 -- 172.21.15.170:0/2065369892 reap_dead start 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 shutdown_connections 2024-04-26T12:30:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 >> 172.21.15.170:0/2065369892 conn(0x562c8c68fa00 msgr2=0x562c8c784f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 shutdown_connections 2024-04-26T12:30:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.876+0000 7f501652d800 1 -- 172.21.15.170:0/2065369892 wait complete. 2024-04-26T12:30:54.890 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:54.891 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:30:54.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-26T12:30:54.891 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.934+0000 7f3ebeb3f800 1 Processor -- start 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.934+0000 7f3ebeb3f800 1 -- start start 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3ebeb3f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556f5fe0ede0 0x556f5fea34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3ebeb3f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f5fd470c0 con 0x556f5fe10120 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3ebeb3f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x556f5fd2b4d0 con 0x556f5fe0ede0 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3eba09a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556f5fe0ede0 0x556f5fea34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3eba09a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556f5fe0ede0 0x556f5fea34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49622/0 (socket says 172.21.15.170:49622) 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3eba89b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x556f5fe10120 0x556f5fe0e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:44050/0 (socket says 172.21.15.170:44050) 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3eba09a640 1 -- 172.21.15.170:0/1197940074 learned_addr learned my addr 172.21.15.170:0/1197940074 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3eba09a640 1 -- 172.21.15.170:0/1197940074 >> v1:172.21.15.132:6789/0 conn(0x556f5fe10120 legacy=0x556f5fe0e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3eb9899640 1 -- 172.21.15.170:0/1197940074 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1594038488 0 0) 0x556f5fd470c0 con 0x556f5fe10120 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.935+0000 7f3eba09a640 1 -- 172.21.15.170:0/1197940074 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5fd58d40 con 0x556f5fe0ede0 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.937+0000 7f3eba09a640 1 --2- 172.21.15.170:0/1197940074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5fea34a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000a520 tx=0x7f3eb001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6d5127fe219d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.937+0000 7f3eb9899640 1 -- 172.21.15.170:0/1197940074 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb0057070 con 0x556f5fe0ede0 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.937+0000 7f3eb9899640 1 -- 172.21.15.170:0/1197940074 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0052570 con 0x556f5fe0ede0 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.937+0000 7f3eb9899640 1 -- 172.21.15.170:0/1197940074 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eb004ae60 con 0x556f5fe0ede0 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.938+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1197940074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 msgr2=0x556f5fea34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.938+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1197940074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5fea34a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000a520 tx=0x7f3eb001d010 comp rx=0 tx=0).stop 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.938+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1197940074 shutdown_connections 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.938+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1197940074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5fea34a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.938+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1197940074 >> 172.21.15.170:0/1197940074 conn(0x556f5fe95ba0 msgr2=0x556f5fe97fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.938+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1197940074 shutdown_connections 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.938+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1197940074 wait complete. 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.949+0000 7f3ebeb3f800 1 Processor -- start 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.949+0000 7f3ebeb3f800 1 -- start start 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3ebeb3f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff8db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3ebeb3f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556f5fde5b70 con 0x556f5fe0ede0 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff8db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff8db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49636/0 (socket says 172.21.15.170:49636) 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3eba89b640 1 -- 172.21.15.170:0/62403138 learned_addr learned my addr 172.21.15.170:0/62403138 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3eba89b640 1 -- 172.21.15.170:0/62403138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5fd57590 con 0x556f5fe0ede0 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3eba89b640 1 --2- 172.21.15.170:0/62403138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff8db00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b230 tx=0x7f3eac00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2720b7878d600f1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3da8e09640 1 -- 172.21.15.170:0/62403138 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac00e5c0 con 0x556f5fe0ede0 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3da8e09640 1 -- 172.21.15.170:0/62403138 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac014070 con 0x556f5fe0ede0 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.950+0000 7f3da8e09640 1 -- 172.21.15.170:0/62403138 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac00e910 con 0x556f5fe0ede0 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.951+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/62403138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 msgr2=0x556f5ff8db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.951+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/62403138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff8db00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b230 tx=0x7f3eac00b6f0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.951+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/62403138 shutdown_connections 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.951+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/62403138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff8db00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.951+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/62403138 >> 172.21.15.170:0/62403138 conn(0x556f5fe95ba0 msgr2=0x556f5ff89420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.951+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/62403138 shutdown_connections 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.951+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/62403138 wait complete. 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3ebeb3f800 1 Processor -- start 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3ebeb3f800 1 -- start start 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3ebeb3f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3ebeb3f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556f5fea5cf0 con 0x556f5fe0ede0 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff954c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49638/0 (socket says 172.21.15.170:49638) 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3eba89b640 1 -- 172.21.15.170:0/1467290706 learned_addr learned my addr 172.21.15.170:0/1467290706 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3eba89b640 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5fd4e8f0 con 0x556f5fe0ede0 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3eba89b640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff954c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3eac000c00 tx=0x7f3eac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3da7606640 1 -- 172.21.15.170:0/1467290706 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac00f9b0 con 0x556f5fe0ede0 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3da7606640 1 -- 172.21.15.170:0/1467290706 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac006070 con 0x556f5fe0ede0 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3da7606640 1 -- 172.21.15.170:0/1467290706 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac00fcc0 con 0x556f5fe0ede0 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.952+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f5ff95a00 con 0x556f5fe0ede0 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.953+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5ff95f80 con 0x556f5fe0ede0 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.953+0000 7f3da7606640 1 -- 172.21.15.170:0/1467290706 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3eac019430 con 0x556f5fe0ede0 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.953+0000 7f3da7606640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3da0036950 0x7f3da0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3da7606640 1 -- 172.21.15.170:0/1467290706 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f3eac04c9c0 con 0x556f5fe0ede0 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5fe10120 0x556f5ff9c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3eba09a640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3da0036950 0x7f3da0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ff9cb00 con 0x556f5fe10120 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3ebb09c640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5fe10120 0x556f5ff9c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3ebb09c640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5fe10120 0x556f5ff9c530 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3eba09a640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3da0036950 0x7f3da0038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000a520 tx=0x7f3eb004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3ebb09c640 1 -- 172.21.15.170:0/1467290706 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5fe10120 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.954+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ff99ab0 con 0x556f5fe10120 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.955+0000 7f3ebb09c640 1 -- 172.21.15.170:0/1467290706 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5fe10120 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.955+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ff9ee00 0x556f5ffa11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.955+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffa1890 con 0x556f5ff9ee00 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.955+0000 7f3eba89b640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ff9ee00 0x556f5ffa11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.955+0000 7f3eba89b640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ff9ee00 0x556f5ffa11f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.956+0000 7f3eba89b640 1 -- 172.21.15.170:0/1467290706 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3eac02d070 con 0x556f5ff9ee00 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.956+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ff9ddb0 con 0x556f5fe10120 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.956+0000 7f3ebb09c640 1 -- 172.21.15.170:0/1467290706 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5fe10120 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.956+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556f5ffa2cd0 0x556f5ffa5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.956+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffa58d0 con 0x556f5ffa2cd0 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.956+0000 7f3eba09a640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556f5ffa2cd0 0x556f5ffa5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.956+0000 7f3eba09a640 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556f5ffa2cd0 0x556f5ffa5140 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3eba09a640 1 -- 172.21.15.170:0/1467290706 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3eb005a040 con 0x556f5ffa2cd0 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3ebeb3f800 1 Processor -- start 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3ebeb3f800 1 -- start start 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3ebeb3f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffb3d10 0x556f5ffb4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3ebeb3f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556f5fd8be60 con 0x556f5ffb3d10 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffb3d10 0x556f5ffb4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffb3d10 0x556f5ffb4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49646/0 (socket says 172.21.15.170:49646) 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3eba89b640 1 -- 172.21.15.170:0/4043456510 learned_addr learned my addr 172.21.15.170:0/4043456510 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.957+0000 7f3eba89b640 1 -- 172.21.15.170:0/4043456510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5ffb4670 con 0x556f5ffb3d10 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.958+0000 7f3eba89b640 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffb3d10 0x556f5ffb4130 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3eac04aca0 tx=0x7f3eac025e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.958+0000 7f3da4e01640 1 -- 172.21.15.170:0/4043456510 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac019930 con 0x556f5ffb3d10 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.958+0000 7f3da4e01640 1 -- 172.21.15.170:0/4043456510 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac019ad0 con 0x556f5ffb3d10 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.958+0000 7f3da4e01640 1 -- 172.21.15.170:0/4043456510 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac0442d0 con 0x556f5ffb3d10 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.958+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f5ffb50e0 con 0x556f5ffb3d10 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.958+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5ffb55e0 con 0x556f5ffb3d10 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.958+0000 7f3da4e01640 1 -- 172.21.15.170:0/4043456510 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3eac044470 con 0x556f5ffb3d10 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3da4e01640 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d94036950 0x7f3d94038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3da4e01640 1 -- 172.21.15.170:0/4043456510 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f3eac010030 con 0x556f5ffb3d10 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3eba09a640 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d94036950 0x7f3d94038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3ebeb3f800 1 Processor -- start 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3ebeb3f800 1 -- start start 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3ebeb3f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3ebeb3f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556f5ff8e280 con 0x556f5ffc1040 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3eba09a640 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d94036950 0x7f3d94038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x556f5ff99a20 tx=0x7f3eb0005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49652/0 (socket says 172.21.15.170:49652) 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3eba89b640 1 -- 172.21.15.170:0/1083914496 learned_addr learned my addr 172.21.15.170:0/1083914496 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.959+0000 7f3eba89b640 1 -- 172.21.15.170:0/1083914496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5ffc1a30 con 0x556f5ffc1040 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3eba89b640 1 --2- 172.21.15.170:0/1083914496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc1460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00ff40 tx=0x7f3eac026b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280995b77a62d9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3d9e7fc640 1 -- 172.21.15.170:0/1083914496 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac057040 con 0x556f5ffc1040 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3d9e7fc640 1 -- 172.21.15.170:0/1083914496 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac0496f0 con 0x556f5ffc1040 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3d9e7fc640 1 -- 172.21.15.170:0/1083914496 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac03dd30 con 0x556f5ffc1040 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1083914496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 msgr2=0x556f5ffc1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1083914496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc1460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00ff40 tx=0x7f3eac026b50 comp rx=0 tx=0).stop 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1083914496 shutdown_connections 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1083914496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc1460 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1083914496 >> 172.21.15.170:0/1083914496 conn(0x556f5ffbd310 msgr2=0x556f5ffbb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1083914496 shutdown_connections 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1083914496 wait complete. 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.960+0000 7f3ebeb3f800 1 Processor -- start 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3ebeb3f800 1 -- start start 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3ebeb3f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3ebeb3f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556f5ffc2100 con 0x556f5ffc1040 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3eba89b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49660/0 (socket says 172.21.15.170:49660) 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 learned_addr learned my addr 172.21.15.170:0/2585399467 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f5ffc8960 con 0x556f5ffc1040 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3eba89b640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc8420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3eac03f040 tx=0x7f3eac025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3d9cff9640 1 -- 172.21.15.170:0/2585399467 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac06b070 con 0x556f5ffc1040 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.961+0000 7f3d9cff9640 1 -- 172.21.15.170:0/2585399467 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac026400 con 0x556f5ffc1040 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.962+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f5ffc8960 con 0x556f5ffc1040 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.962+0000 7f3d9cff9640 1 -- 172.21.15.170:0/2585399467 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eac017c40 con 0x556f5ffc1040 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.962+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f5ffc8960 con 0x556f5ffc1040 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.962+0000 7f3d9cff9640 1 -- 172.21.15.170:0/2585399467 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3eac06e070 con 0x556f5ffc1040 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.962+0000 7f3d9cff9640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d84036950 0x7f3d84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.963+0000 7f3d9cff9640 1 -- 172.21.15.170:0/2585399467 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f3eac060020 con 0x556f5ffc1040 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.963+0000 7f3eba09a640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d84036950 0x7f3d84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.963+0000 7f3eba09a640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d84036950 0x7f3d84038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00058d0 tx=0x7f3eb004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.963+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.963+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5ffd3a50 0x556f5ffd5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.963+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd6660 con 0x556f5ffd3a50 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.963+0000 7f3ebb09c640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5ffd3a50 0x556f5ffd5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebb09c640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5ffd3a50 0x556f5ffd5f10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 realm 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd6a70 con 0x556f5ffd3a50 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd7340 con 0x556f5ffd3a50 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ffd8440 0x556f5ffda830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.964+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffdae40 con 0x556f5ffd8440 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3eba89b640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ffd8440 0x556f5ffda830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3eba89b640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ffd8440 0x556f5ffda830 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3ebeb3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3ebeb3f800 20 searching for the correct realm 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556f5ffdcd80 0x556f5ffdf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffdf8c0 con 0x556f5ffdcd80 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.965+0000 7f3eba09a640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556f5ffdcd80 0x556f5ffdf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.966+0000 7f3eba09a640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556f5ffdcd80 0x556f5ffdf240 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.966+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.966+0000 7f3eba09a640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3eb0082040 0x7f3eb005d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.966+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffdf8c0 con 0x7f3eb0082040 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.966+0000 7f3ebb09c640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3eb0082040 0x7f3eb005d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.966+0000 7f3ebb09c640 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3eb0082040 0x7f3eb005d440 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.967+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3eb400a4a0 con 0x7f3eb0082040 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.967+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.967+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.967+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.967+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.967+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x7f3eb0082040 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb400a4a0 con 0x7f3eb0082040 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.968+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x7f3eb0082040 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb400a4a0 con 0x7f3eb0082040 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb400a4a0 con 0x556f5ffd3a50 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.969+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x7f3eb0082040 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.970+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.970+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.970+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.970+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.970+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.970+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.971+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.972+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.972+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.972+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.972+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.972+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x7f3eb0082040 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.972+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.972+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.973+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.973+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.973+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.973+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.973+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.973+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x7f3eb0082040 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffdcd80 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd8440 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.974+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x556f5ffd3a50 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffd76e0 con 0x7f3eb0082040 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffdb690 con 0x556f5ffd3a50 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffdb690 con 0x556f5ffd3a50 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.975+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffdb690 con 0x7f3eb0082040 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 zone default found 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 4 Realm: () 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 zonegroup default 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffdbf30 con 0x556f5ffd8440 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe1720 con 0x556f5ffdcd80 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.976+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe1ac0 con 0x556f5ffdcd80 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.977+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.977+0000 7f3ebeb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.977+0000 7f3ebeb3f800 20 started sync module instance, tier type = 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.977+0000 7f3ebeb3f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.977+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe0bc0 con 0x7f3eb0082040 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.978+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.978+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93936840216848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe0bc0 con 0x7f3eb0082040 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.978+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe2480 con 0x556f5ffd3a50 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.979+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93936840216848] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.979+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.979+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93936840214768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe2480 con 0x556f5ffd3a50 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.979+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe2e40 con 0x556f5ffdcd80 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.980+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93936840214768] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.980+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.980+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93936840220624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe23f0 con 0x556f5ffdcd80 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.980+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe3c00 con 0x7f3eb0082040 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.981+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.981+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93936840226528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe44a0 con 0x7f3eb0082040 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.981+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe4f60 con 0x556f5ffd3a50 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.982+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93936840226528] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.983+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93936840220624] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.983+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.983+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93936840231472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe3f00 con 0x556f5ffd3a50 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.983+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe5800 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.984+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93936840231472] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.985+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.985+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93936840233808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe3f00 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.985+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe61c0 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.986+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.986+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93936840238432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe6e30 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.986+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe7830 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.986+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93936840233808] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93936840225328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe7a90 con 0x556f5ffd8440 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3ebeb3f800 20 add_watcher() i=0 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3ebeb3f800 20 add_watcher() i=1 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3ebeb3f800 20 add_watcher() i=2 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3ebeb3f800 20 add_watcher() i=3 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3ebeb3f800 20 add_watcher() i=4 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.987+0000 7f3ebeb3f800 20 add_watcher() i=5 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.988+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93936840238432] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.988+0000 7f3ebeb3f800 20 add_watcher() i=6 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.988+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93936840225328] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.988+0000 7f3ebeb3f800 20 add_watcher() i=7 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.988+0000 7f3ebeb3f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.988+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe6980 con 0x556f5ffd3a50 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.989+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.989+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93936840241984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe6980 con 0x556f5ffd3a50 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93936840241984] v32'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3d717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 5 note: GC not initialized 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3cebfff640 20 reqs_thread_entry: start 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 20 Filter name: none 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ce9ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.990+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f6001e210 con 0x556f5ffd3a50 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.991+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.991+0000 7f3ebeb3f800 20 rados_obj.operate() r=0 bl.length=403 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.991+0000 7f3ebeb3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.991+0000 7f3ebeb3f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.991+0000 7f3ebeb3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.991+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f600243c0 con 0x556f5ffd3a50 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebeb3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebeb3f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebeb3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93936840490544 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556f6001fc90 con 0x556f5ffd3a50 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== watch-notify(notify (1) cookie 93936840231472 notify 137438953501 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f3eb4018a30 con 0x556f5ffd3a50 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3d9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 93936840231472 notifier 4670 bl.length()=567 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3d9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3d9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(64 notify.4 [notify cookie 93936840490544 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3d9e7fc640 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3d80003ea0 con 0x556f5ffd3a50 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.992+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== watch-notify(notify_complete (2) cookie 93936840490544 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3eb4018c00 con 0x556f5ffd3a50 2024-04-26T12:30:55.004 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-26T12:30:30.923089Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:30:30.923075Z","tags":[],"group_ids":[]} 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.993+0000 7f3d717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.993+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93936840241984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f60023660 con 0x556f5ffd3a50 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.994+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93936840241984] v32'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.994+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93936840216848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe7340 con 0x7f3eb0082040 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.995+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93936840216848] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.995+0000 7f3ebeb3f800 20 remove_watcher() i=0 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.995+0000 7f3ebeb3f800 2 removed watcher, disabling cache 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.995+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93936840214768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe7340 con 0x556f5ffd3a50 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.996+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93936840214768] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.996+0000 7f3ebeb3f800 20 remove_watcher() i=1 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.996+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93936840220624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe08f0 con 0x556f5ffdcd80 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.998+0000 7f3eba09a640 1 -- 172.21.15.170:0/2585399467 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93936840220624] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb007f070 con 0x556f5ffdcd80 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.998+0000 7f3ebeb3f800 20 remove_watcher() i=2 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.998+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93936840226528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe7340 con 0x7f3eb0082040 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.999+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93936840226528] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x7f3eb0082040 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.999+0000 7f3ebeb3f800 20 remove_watcher() i=3 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:54.999+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93936840231472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe1fd0 con 0x556f5ffd3a50 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.000+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93936840231472] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eb4033040 con 0x556f5ffd3a50 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.000+0000 7f3ebeb3f800 20 remove_watcher() i=4 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.000+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93936840233808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe7340 con 0x556f5ffd8440 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.001+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93936840233808] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.001+0000 7f3ebeb3f800 20 remove_watcher() i=5 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.001+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93936840238432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe1fd0 con 0x556f5ffd8440 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.002+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93936840238432] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.002+0000 7f3ebeb3f800 20 remove_watcher() i=6 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.002+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93936840225328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556f5ffe5350 con 0x556f5ffd8440 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3eba89b640 1 -- 172.21.15.170:0/2585399467 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93936840225328] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3eac077070 con 0x556f5ffd8440 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 20 remove_watcher() i=7 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ffd8440 msgr2=0x556f5ffda830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ffd8440 0x556f5ffda830 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5ffd3a50 msgr2=0x556f5ffd5f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5ffd3a50 0x556f5ffd5f10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3eb0082040 msgr2=0x7f3eb005d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f3eb0082040 0x7f3eb005d440 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556f5ffdcd80 msgr2=0x556f5ffdf240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556f5ffdcd80 0x556f5ffdf240 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d84036950 msgr2=0x7f3d84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d84036950 0x7f3d84038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00058d0 tx=0x7f3eb004f000 comp rx=0 tx=0).stop 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebb09c640 1 -- 172.21.15.170:0/2585399467 reap_dead start 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 msgr2=0x556f5ffc8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc8420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3eac03f040 tx=0x7f3eac025000 comp rx=0 tx=0).stop 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 shutdown_connections 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/2585399467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffc1040 0x556f5ffc8420 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 >> 172.21.15.170:0/2585399467 conn(0x556f5ffbd310 msgr2=0x556f5ffba970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 shutdown_connections 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/2585399467 wait complete. 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d94036950 msgr2=0x7f3d94038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d94036950 0x7f3d94038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x556f5ff99a20 tx=0x7f3eb0005ac0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffb3d10 msgr2=0x556f5ffb4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffb3d10 0x556f5ffb4130 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3eac04aca0 tx=0x7f3eac025e40 comp rx=0 tx=0).stop 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 shutdown_connections 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3d94036950 0x7f3d94038e10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/4043456510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5ffb3d10 0x556f5ffb4130 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 >> 172.21.15.170:0/4043456510 conn(0x556f5ffa7db0 msgr2=0x556f5ffa81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 shutdown_connections 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.003+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/4043456510 wait complete. 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ff9ee00 msgr2=0x556f5ffa11f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556f5ff9ee00 0x556f5ffa11f0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5fe10120 msgr2=0x556f5ff9c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556f5fe10120 0x556f5ff9c530 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556f5ffa2cd0 msgr2=0x556f5ffa5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556f5ffa2cd0 0x556f5ffa5140 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3da0036950 msgr2=0x7f3da0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3da0036950 0x7f3da0038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000a520 tx=0x7f3eb004e000 comp rx=0 tx=0).stop 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 msgr2=0x556f5ff954c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 --2- 172.21.15.170:0/1467290706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556f5fe0ede0 0x556f5ff954c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3eac000c00 tx=0x7f3eac000ed0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebb09c640 1 -- 172.21.15.170:0/1467290706 reap_dead start 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 shutdown_connections 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 >> 172.21.15.170:0/1467290706 conn(0x556f5fe95ba0 msgr2=0x556f5ff8c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 shutdown_connections 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.004+0000 7f3ebeb3f800 1 -- 172.21.15.170:0/1467290706 wait complete. 2024-04-26T12:30:55.015 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-26T12:30:30.923089Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:30:30.923075Z', 'tags': [], 'group_ids': []} 2024-04-26T12:30:55.025 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:55.025 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-26T12:30:55.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-26T12:30:55.025 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-26T12:30:55.068 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:30:55.068 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.066+0000 7f0ca7133800 1 Processor -- start 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca7133800 1 -- start start 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca7133800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d08ccd3140 0x55d08ccd16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca7133800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d08cc0a0c0 con 0x55d08ccd1c30 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca7133800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55d08cbee4d0 con 0x55d08ccd3140 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca2dd8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55d08ccd3140 0x55d08ccd16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0c9a5d7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55d08ccd1c30 0x55d08cd65430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:44062/0 (socket says 172.21.15.170:44062) 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/348827587 learned_addr learned my addr 172.21.15.170:0/348827587 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:30:55.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/348827587 >> v1:172.21.15.132:6789/0 conn(0x55d08ccd1c30 legacy=0x55d08cd65430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca25d7640 1 -- 172.21.15.170:0/348827587 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299959017 0 0) 0x55d08cc0a0c0 con 0x55d08ccd1c30 2024-04-26T12:30:55.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.067+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/348827587 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08cc1bd40 con 0x55d08ccd3140 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.069+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/348827587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd3140 0x55d08ccd16f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400a470 tx=0x7f0c9401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8a859b2c6d07a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.069+0000 7f0ca25d7640 1 -- 172.21.15.170:0/348827587 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94057070 con 0x55d08ccd3140 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.069+0000 7f0ca25d7640 1 -- 172.21.15.170:0/348827587 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c94052570 con 0x55d08ccd3140 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.069+0000 7f0ca25d7640 1 -- 172.21.15.170:0/348827587 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94052870 con 0x55d08ccd3140 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.070+0000 7f0ca7133800 1 -- 172.21.15.170:0/348827587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd3140 msgr2=0x55d08ccd16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.070+0000 7f0ca7133800 1 --2- 172.21.15.170:0/348827587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd3140 0x55d08ccd16f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400a470 tx=0x7f0c9401ce90 comp rx=0 tx=0).stop 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.070+0000 7f0ca7133800 1 -- 172.21.15.170:0/348827587 shutdown_connections 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.070+0000 7f0ca7133800 1 --2- 172.21.15.170:0/348827587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd3140 0x55d08ccd16f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.070+0000 7f0ca7133800 1 -- 172.21.15.170:0/348827587 >> 172.21.15.170:0/348827587 conn(0x55d08cd58b80 msgr2=0x55d08cd5afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.070+0000 7f0ca7133800 1 -- 172.21.15.170:0/348827587 shutdown_connections 2024-04-26T12:30:55.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.070+0000 7f0ca7133800 1 -- 172.21.15.170:0/348827587 wait complete. 2024-04-26T12:30:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.081+0000 7f0ca7133800 1 Processor -- start 2024-04-26T12:30:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.082+0000 7f0ca7133800 1 -- start start 2024-04-26T12:30:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.082+0000 7f0ca7133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce50c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.082+0000 7f0ca7133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d08cca8b40 con 0x55d08ccd1c30 2024-04-26T12:30:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.082+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce50c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.082+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce50c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49668/0 (socket says 172.21.15.170:49668) 2024-04-26T12:30:55.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.082+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/3719482594 learned_addr learned my addr 172.21.15.170:0/3719482594 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:55.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.082+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/3719482594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08cc1a590 con 0x55d08ccd1c30 2024-04-26T12:30:55.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/3719482594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce50c70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000c00 tx=0x7f0c9404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f946fe1de292a081 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0b90e09640 1 -- 172.21.15.170:0/3719482594 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94057070 con 0x55d08ccd1c30 2024-04-26T12:30:55.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0b90e09640 1 -- 172.21.15.170:0/3719482594 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c94063070 con 0x55d08ccd1c30 2024-04-26T12:30:55.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0b90e09640 1 -- 172.21.15.170:0/3719482594 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94052720 con 0x55d08ccd1c30 2024-04-26T12:30:55.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca7133800 1 -- 172.21.15.170:0/3719482594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 msgr2=0x55d08ce50c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca7133800 1 --2- 172.21.15.170:0/3719482594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce50c70 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000c00 tx=0x7f0c9404c000 comp rx=0 tx=0).stop 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca7133800 1 -- 172.21.15.170:0/3719482594 shutdown_connections 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca7133800 1 --2- 172.21.15.170:0/3719482594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce50c70 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca7133800 1 -- 172.21.15.170:0/3719482594 >> 172.21.15.170:0/3719482594 conn(0x55d08cd58b80 msgr2=0x55d08ce4c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca7133800 1 -- 172.21.15.170:0/3719482594 shutdown_connections 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.083+0000 7f0ca7133800 1 -- 172.21.15.170:0/3719482594 wait complete. 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.084+0000 7f0ca7133800 1 Processor -- start 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.084+0000 7f0ca7133800 1 -- start start 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.084+0000 7f0ca7133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce58500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.084+0000 7f0ca7133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d08cd68e60 con 0x55d08ccd1c30 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.084+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce58500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.084+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce58500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49676/0 (socket says 172.21.15.170:49676) 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.084+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/2801512752 learned_addr learned my addr 172.21.15.170:0/2801512752 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:55.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.085+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08cc118f0 con 0x55d08ccd1c30 2024-04-26T12:30:55.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.085+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce58500 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000c00 tx=0x7f0c94002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.085+0000 7f0b8f606640 1 -- 172.21.15.170:0/2801512752 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94052c70 con 0x55d08ccd1c30 2024-04-26T12:30:55.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.085+0000 7f0b8f606640 1 -- 172.21.15.170:0/2801512752 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9406c070 con 0x55d08ccd1c30 2024-04-26T12:30:55.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.085+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d08ce58a40 con 0x55d08ccd1c30 2024-04-26T12:30:55.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.085+0000 7f0b8f606640 1 -- 172.21.15.170:0/2801512752 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9405e480 con 0x55d08ccd1c30 2024-04-26T12:30:55.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.085+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08ce58f00 con 0x55d08ccd1c30 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0b8f606640 1 -- 172.21.15.170:0/2801512752 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c9406e030 con 0x55d08ccd1c30 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0b8f606640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b88036900 0x7f0b88038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0b8f606640 1 -- 172.21.15.170:0/2801512752 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c9408e2e0 con 0x55d08ccd1c30 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b88036900 0x7f0b88038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ccd3140 0x55d08ce5f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce5fb40 con 0x55d08ccd3140 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0ca35d9640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ccd3140 0x55d08ce5f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b88036900 0x7f0b88038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c000c00 tx=0x7f0c8c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.086+0000 7f0ca35d9640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ccd3140 0x55d08ce5f570 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.087+0000 7f0ca35d9640 1 -- 172.21.15.170:0/2801512752 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ccd3140 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.087+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce5cb00 con 0x55d08ccd3140 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.087+0000 7f0ca35d9640 1 -- 172.21.15.170:0/2801512752 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ccd3140 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.087+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce61e70 0x55d08ce64260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.087+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce648c0 con 0x55d08ce61e70 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.087+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce61e70 0x55d08ce64260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce61e70 0x55d08ce64260 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/2801512752 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c94070410 con 0x55d08ce61e70 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce60e20 con 0x55d08ccd3140 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0ca35d9640 1 -- 172.21.15.170:0/2801512752 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ccd3140 2024-04-26T12:30:55.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d08ce65d70 0x55d08ce681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce68940 con 0x55d08ce65d70 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d08ce65d70 0x55d08ce681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.088+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d08ce65d70 0x55d08ce681e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.089+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/2801512752 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c8c00f670 con 0x55d08ce65d70 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.089+0000 7f0ca7133800 1 Processor -- start 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.089+0000 7f0ca7133800 1 -- start start 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.089+0000 7f0ca7133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce76d70 0x55d08ce77190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.089+0000 7f0ca7133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d08cc4ee60 con 0x55d08ce76d70 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce76d70 0x55d08ce77190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce76d70 0x55d08ce77190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49686/0 (socket says 172.21.15.170:49686) 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/64380930 learned_addr learned my addr 172.21.15.170:0/64380930 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/64380930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08ce776d0 con 0x55d08ce76d70 2024-04-26T12:30:55.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce76d70 0x55d08ce77190 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0c9408c6c0 tx=0x7f0c94067db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0b8ce01640 1 -- 172.21.15.170:0/64380930 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94093070 con 0x55d08ce76d70 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0b8ce01640 1 -- 172.21.15.170:0/64380930 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c94058040 con 0x55d08ce76d70 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d08ce78140 con 0x55d08ce76d70 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0b8ce01640 1 -- 172.21.15.170:0/64380930 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94084040 con 0x55d08ce76d70 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.090+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08ce78640 con 0x55d08ce76d70 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.091+0000 7f0b8ce01640 1 -- 172.21.15.170:0/64380930 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c94096070 con 0x55d08ce76d70 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.091+0000 7f0b8ce01640 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b7c036950 0x7f0b7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.091+0000 7f0b8ce01640 1 -- 172.21.15.170:0/64380930 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c94099d50 con 0x55d08ce76d70 2024-04-26T12:30:55.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.091+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b7c036950 0x7f0b7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.091+0000 7f0ca7133800 1 Processor -- start 2024-04-26T12:30:55.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.091+0000 7f0ca7133800 1 -- start start 2024-04-26T12:30:55.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.091+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b7c036950 0x7f0b7c038e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55d08ce5ca60 tx=0x7f0c8c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0ca7133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce84310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0ca7133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d08ce51330 con 0x55d08ce83ef0 2024-04-26T12:30:55.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce84310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce84310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49688/0 (socket says 172.21.15.170:49688) 2024-04-26T12:30:55.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/3436533392 learned_addr learned my addr 172.21.15.170:0/3436533392 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:55.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/3436533392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08ce848e0 con 0x55d08ce83ef0 2024-04-26T12:30:55.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/3436533392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce84310 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0c9408efd0 tx=0x7f0c9408ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99acf1e16bc6b8dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0b867fc640 1 -- 172.21.15.170:0/3436533392 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c940ab070 con 0x55d08ce83ef0 2024-04-26T12:30:55.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0b867fc640 1 -- 172.21.15.170:0/3436533392 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9408c050 con 0x55d08ce83ef0 2024-04-26T12:30:55.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.092+0000 7f0b867fc640 1 -- 172.21.15.170:0/3436533392 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c94009af0 con 0x55d08ce83ef0 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 -- 172.21.15.170:0/3436533392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 msgr2=0x55d08ce84310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 --2- 172.21.15.170:0/3436533392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce84310 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0c9408efd0 tx=0x7f0c9408ee10 comp rx=0 tx=0).stop 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 -- 172.21.15.170:0/3436533392 shutdown_connections 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 --2- 172.21.15.170:0/3436533392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce84310 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 -- 172.21.15.170:0/3436533392 >> 172.21.15.170:0/3436533392 conn(0x55d08ce80200 msgr2=0x55d08ce7e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 -- 172.21.15.170:0/3436533392 shutdown_connections 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 -- 172.21.15.170:0/3436533392 wait complete. 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 Processor -- start 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 -- start start 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce8b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca7133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55d08ce84f70 con 0x55d08ce83ef0 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce8b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca2dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce8b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:49698/0 (socket says 172.21.15.170:49698) 2024-04-26T12:30:55.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.093+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 learned_addr learned my addr 172.21.15.170:0/1780020329 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.094+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08ce8b820 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.094+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce8b2e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0c940776b0 tx=0x7f0c9405dfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.094+0000 7f0b84ff9640 1 -- 172.21.15.170:0/1780020329 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c940b6020 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.094+0000 7f0b84ff9640 1 -- 172.21.15.170:0/1780020329 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9408c7a0 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.094+0000 7f0b84ff9640 1 -- 172.21.15.170:0/1780020329 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c940ab030 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.094+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d08ce8b820 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.094+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08ce8b820 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0b84ff9640 1 -- 172.21.15.170:0/1780020329 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c940b9020 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0b84ff9640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b6c036950 0x7f0b6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0b84ff9640 1 -- 172.21.15.170:0/1780020329 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c940ac070 con 0x55d08ce83ef0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b6c036950 0x7f0b6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b6c036950 0x7f0b6c038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00ffd0 tx=0x7f0c8c023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ce96a00 0x55d08ce98ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.095+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce99610 con 0x55d08ce96a00 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca35d9640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ce96a00 0x55d08ce98ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca35d9640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ce96a00 0x55d08ce98ec0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 20 realm 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce99a20 con 0x55d08ce96a00 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.096+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a2f0 con 0x55d08ce96a00 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca7133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca7133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce9b3f0 0x55d08ce9d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9ddf0 con 0x55d08ce9b3f0 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce9b3f0 0x55d08ce9d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.097+0000 7f0ca2dd8640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce9b3f0 0x55d08ce9d7e0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0ca7133800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0ca7133800 20 searching for the correct realm 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d08ce9fd30 0x55d08cea21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea2870 con 0x55d08ce9fd30 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d08ce9fd30 0x55d08cea21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d08ce9fd30 0x55d08cea21f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0c9a5d7640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c8c02e910 0x7f0c8c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.098+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea2870 con 0x7f0c8c02e910 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.099+0000 7f0ca35d9640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c8c02e910 0x7f0c8c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.099+0000 7f0ca35d9640 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c8c02e910 0x7f0c8c03a3c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.099+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x7f0c8c02e910 2024-04-26T12:30:55.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.099+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.100+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x7f0c8c02e910 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x7f0c8c02e910 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x7f0c8c02e910 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x7f0c8c02e910 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.101+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c00a4a0 con 0x55d08ce96a00 2024-04-26T12:30:55.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x7f0c8c02e910 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.102+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.103+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x7f0c8c02e910 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.104+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.105+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.105+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.105+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.105+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.105+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.105+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.106+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.106+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x7f0c8c02e910 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.106+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.106+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9fd30 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.106+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.106+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce9b3f0 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x55d08ce96a00 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9a690 con 0x7f0c8c02e910 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9e640 con 0x55d08ce96a00 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.107+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9e640 con 0x55d08ce96a00 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9e640 con 0x7f0c8c02e910 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 zone default found 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 4 Realm: () 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 zonegroup default 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08ce9eee0 con 0x55d08ce9b3f0 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.108+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea46d0 con 0x55d08ce9fd30 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0ca7133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea4a70 con 0x55d08ce9fd30 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0ca7133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0ca7133800 20 started sync module instance, tier type = 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0ca7133800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.109+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea3b70 con 0x7f0c8c02e910 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.110+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.110+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94354205720736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea3b70 con 0x7f0c8c02e910 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.110+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea5430 con 0x55d08ce96a00 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.111+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94354205720736] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.111+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.111+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94354205725024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea3b70 con 0x55d08ce96a00 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.111+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea5ea0 con 0x55d08ce9fd30 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.112+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94354205725024] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.113+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.113+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94354205718208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea3ae0 con 0x55d08ce9fd30 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.113+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea6c50 con 0x7f0c8c02e910 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.113+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94354205718208] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.114+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.114+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94354205729424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea7040 con 0x7f0c8c02e910 2024-04-26T12:30:55.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.114+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea7a00 con 0x55d08ce96a00 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.115+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.115+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94354205734224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea7970 con 0x55d08ce96a00 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.115+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea8970 con 0x55d08ce9b3f0 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.115+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94354205729424] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.115+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94354205734224] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.116+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.116+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94354205736480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea8470 con 0x55d08ce9b3f0 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.116+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea9210 con 0x55d08ce9b3f0 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.116+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.117+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94354205742592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea9ed0 con 0x55d08ce9b3f0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.117+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceaa8d0 con 0x55d08ce9b3f0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.117+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94354205736480] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.117+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94354205742592] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94354205730480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea9a20 con 0x55d08ce9b3f0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=1 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=2 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=3 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=4 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=5 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=6 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94354205730480] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 20 add_watcher() i=7 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 2 all 8 watchers are set, enabling cache 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.118+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08cead9d0 con 0x55d08ce96a00 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.119+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.119+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94354205746144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceaae50 con 0x55d08ce96a00 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.120+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94354205746144] v32'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.120+0000 7f0b597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.120+0000 7f0ca7133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.120+0000 7f0ca7133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.120+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb6240 con 0x55d08ce96a00 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.121+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.121+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb6910 con 0x55d08ce9b3f0 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.122+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.122+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb6910 con 0x55d08ce9fd30 2024-04-26T12:30:55.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.123+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.123+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb73d0 con 0x55d08ce96a00 2024-04-26T12:30:55.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.124+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.124+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb1f80 con 0x7f0c8c02e910 2024-04-26T12:30:55.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.125+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.125+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb1f80 con 0x55d08ce9fd30 2024-04-26T12:30:55.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.126+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.126+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb85b0 con 0x55d08ce96a00 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.127+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.127+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb85b0 con 0x55d08ce9b3f0 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.128+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.128+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb86e0 con 0x7f0c8c02e910 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.129+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.129+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb87c0 con 0x55d08ce9fd30 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.130+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.130+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb8d50 con 0x7f0c8c02e910 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.131+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.131+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb8d50 con 0x55d08ce9b3f0 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.132+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.132+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb8d50 con 0x7f0c8c02e910 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.133+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.133+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb8d50 con 0x55d08ce9b3f0 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.134+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.134+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb8d50 con 0x55d08ce96a00 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.135+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.135+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb8d50 con 0x55d08ce9fd30 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.136+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.136+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9360 con 0x7f0c8c02e910 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.137+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'69 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.137+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.138+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.138+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce96a00 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.139+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.139+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce96a00 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.140+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.140+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.141+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.141+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x7f0c8c02e910 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.142+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.142+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.143+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.143+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.144+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.144+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.144+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.144+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.145+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.145+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9b3f0 2024-04-26T12:30:55.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.147+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.147+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.148+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.148+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9b3f0 2024-04-26T12:30:55.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.149+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.149+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9fd30 2024-04-26T12:30:55.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.150+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.150+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x55d08ce9b3f0 2024-04-26T12:30:55.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.151+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.151+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb9320 con 0x7f0c8c02e910 2024-04-26T12:30:55.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.152+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ad3fff640 20 reqs_thread_entry: start 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 20 init_complete bucket index max shards: 11 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 20 Filter name: none 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ad1ffb640 20 reqs_thread_entry: start 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 20 rados->read ofs=0 len=0 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08cee3fc0 con 0x55d08ce96a00 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.153+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d08cee6a50 con 0x7f0c8c02e910 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.154+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.157 INFO:teuthology.orchestra.run.smithi170.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-26T12:30:55.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.154+0000 7f0b597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:30:55.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.154+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94354205746144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceb73d0 con 0x55d08ce96a00 2024-04-26T12:30:55.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.155+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94354205746144] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.155+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94354205720736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceaa3e0 con 0x7f0c8c02e910 2024-04-26T12:30:55.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.156+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94354205720736] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.156+0000 7f0ca7133800 20 remove_watcher() i=0 2024-04-26T12:30:55.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.156+0000 7f0ca7133800 2 removed watcher, disabling cache 2024-04-26T12:30:55.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.156+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94354205725024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceaa3e0 con 0x55d08ce96a00 2024-04-26T12:30:55.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.157+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94354205725024] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.158+0000 7f0ca7133800 20 remove_watcher() i=1 2024-04-26T12:30:55.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.158+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94354205718208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceaa3e0 con 0x55d08ce9fd30 2024-04-26T12:30:55.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.158+0000 7f0c9a5d7640 1 -- 172.21.15.170:0/1780020329 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94354205718208] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c8c037040 con 0x55d08ce9fd30 2024-04-26T12:30:55.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.158+0000 7f0ca7133800 20 remove_watcher() i=2 2024-04-26T12:30:55.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.158+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94354205729424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea36c0 con 0x7f0c8c02e910 2024-04-26T12:30:55.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.159+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94354205729424] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x7f0c8c02e910 2024-04-26T12:30:55.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.159+0000 7f0ca7133800 20 remove_watcher() i=3 2024-04-26T12:30:55.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.159+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94354205734224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08ceaa3e0 con 0x55d08ce96a00 2024-04-26T12:30:55.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.161+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94354205734224] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c9c033040 con 0x55d08ce96a00 2024-04-26T12:30:55.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.161+0000 7f0ca7133800 20 remove_watcher() i=4 2024-04-26T12:30:55.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.161+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94354205736480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea6290 con 0x55d08ce9b3f0 2024-04-26T12:30:55.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.162+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94354205736480] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.162+0000 7f0ca7133800 20 remove_watcher() i=5 2024-04-26T12:30:55.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.162+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94354205742592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea36c0 con 0x55d08ce9b3f0 2024-04-26T12:30:55.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.163+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94354205742592] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.163+0000 7f0ca7133800 20 remove_watcher() i=6 2024-04-26T12:30:55.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.163+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94354205730480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d08cea7550 con 0x55d08ce9b3f0 2024-04-26T12:30:55.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.163+0000 7f0ca2dd8640 1 -- 172.21.15.170:0/1780020329 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94354205730480] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c94095030 con 0x55d08ce9b3f0 2024-04-26T12:30:55.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.163+0000 7f0ca7133800 20 remove_watcher() i=7 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce9b3f0 msgr2=0x55d08ce9d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce9b3f0 0x55d08ce9d7e0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ce96a00 msgr2=0x55d08ce98ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ce96a00 0x55d08ce98ec0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c8c02e910 msgr2=0x7f0c8c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c8c02e910 0x7f0c8c03a3c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d08ce9fd30 msgr2=0x55d08cea21f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55d08ce9fd30 0x55d08cea21f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b6c036950 msgr2=0x7f0b6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b6c036950 0x7f0b6c038e10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00ffd0 tx=0x7f0c8c023040 comp rx=0 tx=0).stop 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 msgr2=0x55d08ce8b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca35d9640 1 -- 172.21.15.170:0/1780020329 reap_dead start 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce8b2e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0c940776b0 tx=0x7f0c9405dfe0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 shutdown_connections 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/1780020329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce83ef0 0x55d08ce8b2e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 >> 172.21.15.170:0/1780020329 conn(0x55d08ce80200 msgr2=0x55d08ce7d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 shutdown_connections 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/1780020329 wait complete. 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b7c036950 msgr2=0x7f0b7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b7c036950 0x7f0b7c038e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55d08ce5ca60 tx=0x7f0c8c006000 comp rx=0 tx=0).stop 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce76d70 msgr2=0x55d08ce77190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce76d70 0x55d08ce77190 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0c9408c6c0 tx=0x7f0c94067db0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 shutdown_connections 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b7c036950 0x7f0b7c038e10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 --2- 172.21.15.170:0/64380930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ce76d70 0x55d08ce77190 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 >> 172.21.15.170:0/64380930 conn(0x55d08ce6ae10 msgr2=0x55d08ce6b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 shutdown_connections 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.164+0000 7f0ca7133800 1 -- 172.21.15.170:0/64380930 wait complete. 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce61e70 msgr2=0x55d08ce64260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55d08ce61e70 0x55d08ce64260 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ccd3140 msgr2=0x55d08ce5f570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55d08ccd3140 0x55d08ce5f570 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d08ce65d70 msgr2=0x55d08ce681e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55d08ce65d70 0x55d08ce681e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b88036900 msgr2=0x7f0b88038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b88036900 0x7f0b88038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c000c00 tx=0x7f0c8c0013b0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 msgr2=0x55d08ce58500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 --2- 172.21.15.170:0/2801512752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d08ccd1c30 0x55d08ce58500 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000c00 tx=0x7f0c94002fb0 comp rx=0 tx=0).stop 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca35d9640 1 -- 172.21.15.170:0/2801512752 reap_dead start 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 shutdown_connections 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 >> 172.21.15.170:0/2801512752 conn(0x55d08cd58b80 msgr2=0x55d08ce4f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 shutdown_connections 2024-04-26T12:30:55.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:30:55.165+0000 7f0ca7133800 1 -- 172.21.15.170:0/2801512752 wait complete. 2024-04-26T12:30:55.174 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:30:55.187 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:30:55.193 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-26T12:31:30.194 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-26T12:31:30.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-26T12:31:30.195 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-26T12:31:30.245 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:30.245 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:30.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad91d31800 1 Processor -- start 2024-04-26T12:31:30.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad91d31800 1 -- start start 2024-04-26T12:31:30.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad91d31800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5589c4cb6870 0x5589c4cb8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad91d31800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589c4b600c0 con 0x5589c4cb23e0 2024-04-26T12:31:30.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad91d31800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5589c4b444d0 con 0x5589c4cb6870 2024-04-26T12:31:30.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad87fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5589c4cb6870 0x5589c4cb8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad8da2f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5589c4cb23e0 0x5589c4cb2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52206/0 (socket says 172.21.15.170:52206) 2024-04-26T12:31:30.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad87fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5589c4cb6870 0x5589c4cb8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34170/0 (socket says 172.21.15.170:34170) 2024-04-26T12:31:30.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad8da2f640 1 -- 172.21.15.170:0/4080195475 learned_addr learned my addr 172.21.15.170:0/4080195475 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:30.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.245+0000 7fad87fff640 1 -- 172.21.15.170:0/4080195475 >> v1:172.21.15.132:6789/0 conn(0x5589c4cb23e0 legacy=0x5589c4cb2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.246+0000 7fad87fff640 1 -- 172.21.15.170:0/4080195475 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c4b71d40 con 0x5589c4cb6870 2024-04-26T12:31:30.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.247+0000 7fad87fff640 1 --2- 172.21.15.170:0/4080195475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb6870 0x5589c4cb8c60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fad7800a470 tx=0x7fad7801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8134572f25befd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.248+0000 7fad8d22e640 1 -- 172.21.15.170:0/4080195475 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78057070 con 0x5589c4cb6870 2024-04-26T12:31:30.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.248+0000 7fad8d22e640 1 -- 172.21.15.170:0/4080195475 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad78052570 con 0x5589c4cb6870 2024-04-26T12:31:30.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.248+0000 7fad8d22e640 1 -- 172.21.15.170:0/4080195475 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78052870 con 0x5589c4cb6870 2024-04-26T12:31:30.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.248+0000 7fad91d31800 1 -- 172.21.15.170:0/4080195475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb6870 msgr2=0x5589c4cb8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.248+0000 7fad91d31800 1 --2- 172.21.15.170:0/4080195475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb6870 0x5589c4cb8c60 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fad7800a470 tx=0x7fad7801ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:30.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.249+0000 7fad91d31800 1 -- 172.21.15.170:0/4080195475 shutdown_connections 2024-04-26T12:31:30.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.249+0000 7fad91d31800 1 --2- 172.21.15.170:0/4080195475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb6870 0x5589c4cb8c60 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.249+0000 7fad91d31800 1 -- 172.21.15.170:0/4080195475 >> 172.21.15.170:0/4080195475 conn(0x5589c4cad9e0 msgr2=0x5589c4cafe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.249+0000 7fad91d31800 1 -- 172.21.15.170:0/4080195475 shutdown_connections 2024-04-26T12:31:30.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.249+0000 7fad91d31800 1 -- 172.21.15.170:0/4080195475 wait complete. 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.262+0000 7fad91d31800 1 Processor -- start 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.262+0000 7fad91d31800 1 -- start start 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.262+0000 7fad91d31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4da3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.262+0000 7fad91d31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5589c4bfeb40 con 0x5589c4cb23e0 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.263+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4da3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.263+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4da3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34186/0 (socket says 172.21.15.170:34186) 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.263+0000 7fad8da2f640 1 -- 172.21.15.170:0/2565025554 learned_addr learned my addr 172.21.15.170:0/2565025554 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.263+0000 7fad8da2f640 1 -- 172.21.15.170:0/2565025554 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c4b70590 con 0x5589c4cb23e0 2024-04-26T12:31:30.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.263+0000 7fad8da2f640 1 --2- 172.21.15.170:0/2565025554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4da3680 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fad80001e10 tx=0x7fad8000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1513f00d4b9aa3ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.263+0000 7fac7be07640 1 -- 172.21.15.170:0/2565025554 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80012020 con 0x5589c4cb23e0 2024-04-26T12:31:30.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fac7be07640 1 -- 172.21.15.170:0/2565025554 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8000e5a0 con 0x5589c4cb23e0 2024-04-26T12:31:30.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fac7be07640 1 -- 172.21.15.170:0/2565025554 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8000e8e0 con 0x5589c4cb23e0 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fad91d31800 1 -- 172.21.15.170:0/2565025554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 msgr2=0x5589c4da3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fad91d31800 1 --2- 172.21.15.170:0/2565025554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4da3680 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fad80001e10 tx=0x7fad8000b780 comp rx=0 tx=0).stop 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fad91d31800 1 -- 172.21.15.170:0/2565025554 shutdown_connections 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fad91d31800 1 --2- 172.21.15.170:0/2565025554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4da3680 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fad91d31800 1 -- 172.21.15.170:0/2565025554 >> 172.21.15.170:0/2565025554 conn(0x5589c4cad9e0 msgr2=0x5589c4d9efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fad91d31800 1 -- 172.21.15.170:0/2565025554 shutdown_connections 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.264+0000 7fad91d31800 1 -- 172.21.15.170:0/2565025554 wait complete. 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.265+0000 7fad91d31800 1 Processor -- start 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.265+0000 7fad91d31800 1 -- start start 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.265+0000 7fad91d31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4c26690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.265+0000 7fad91d31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5589c4cb9530 con 0x5589c4cb23e0 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.265+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4c26690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.265+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4c26690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34194/0 (socket says 172.21.15.170:34194) 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.265+0000 7fad8da2f640 1 -- 172.21.15.170:0/935785909 learned_addr learned my addr 172.21.15.170:0/935785909 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.266+0000 7fad8da2f640 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c4b678f0 con 0x5589c4cb23e0 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.266+0000 7fad8da2f640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4c26690 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fad8000b7c0 tx=0x7fad80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.266+0000 7fac7a604640 1 -- 172.21.15.170:0/935785909 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80012030 con 0x5589c4cb23e0 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.266+0000 7fac7a604640 1 -- 172.21.15.170:0/935785909 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80001470 con 0x5589c4cb23e0 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.266+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589c4dacb80 con 0x5589c4cb23e0 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.266+0000 7fac7a604640 1 -- 172.21.15.170:0/935785909 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8001a8d0 con 0x5589c4cb23e0 2024-04-26T12:31:30.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.266+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589c4db14e0 con 0x5589c4cb23e0 2024-04-26T12:31:30.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.267+0000 7fac7a604640 1 -- 172.21.15.170:0/935785909 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad80015020 con 0x5589c4cb23e0 2024-04-26T12:31:30.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.267+0000 7fac7a604640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac74036900 0x7fac74038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.267+0000 7fac7a604640 1 -- 172.21.15.170:0/935785909 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fad80020030 con 0x5589c4cb23e0 2024-04-26T12:31:30.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.267+0000 7fad87fff640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac74036900 0x7fac74038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.267+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4cb6870 0x5589c4db5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.267+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4db5960 con 0x5589c4cb6870 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.267+0000 7fad8e230640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4cb6870 0x5589c4db5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.268+0000 7fad87fff640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac74036900 0x7fac74038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fad78054000 tx=0x7fad7804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.268+0000 7fad8e230640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4cb6870 0x5589c4db5340 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.268+0000 7fad8e230640 1 -- 172.21.15.170:0/935785909 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4cb6870 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.268+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4db28b0 con 0x5589c4cb6870 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.268+0000 7fad8e230640 1 -- 172.21.15.170:0/935785909 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4cb6870 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.268+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4db7c90 0x5589c4dba080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.268+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dba720 con 0x5589c4db7c90 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.269+0000 7fad8da2f640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4db7c90 0x5589c4dba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.269+0000 7fad8da2f640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4db7c90 0x5589c4dba080 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.269+0000 7fad8da2f640 1 -- 172.21.15.170:0/935785909 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad80018950 con 0x5589c4db7c90 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.270+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4db6c40 con 0x5589c4cb6870 2024-04-26T12:31:30.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.270+0000 7fad8e230640 1 -- 172.21.15.170:0/935785909 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4cb6870 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.270+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5589c4dbbbd0 0x5589c4dbe020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.270+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dbe780 con 0x5589c4dbbbd0 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.270+0000 7fad87fff640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5589c4dbbbd0 0x5589c4dbe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.270+0000 7fad87fff640 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5589c4dbbbd0 0x5589c4dbe020 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.271+0000 7fad87fff640 1 -- 172.21.15.170:0/935785909 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad78052a40 con 0x5589c4dbbbd0 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.271+0000 7fad91d31800 1 Processor -- start 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.271+0000 7fad91d31800 1 -- start start 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.271+0000 7fad91d31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dccba0 0x5589c4dccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.271+0000 7fad91d31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5589c4ba4e60 con 0x5589c4dccba0 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.271+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dccba0 0x5589c4dccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dccba0 0x5589c4dccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34198/0 (socket says 172.21.15.170:34198) 2024-04-26T12:31:30.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fad8da2f640 1 -- 172.21.15.170:0/2166169070 learned_addr learned my addr 172.21.15.170:0/2166169070 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fad8da2f640 1 -- 172.21.15.170:0/2166169070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c4dcd500 con 0x5589c4dccba0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fad8da2f640 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dccba0 0x5589c4dccfc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fad8004ac00 tx=0x7fad8000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fac737fe640 1 -- 172.21.15.170:0/2166169070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8003b070 con 0x5589c4dccba0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fac737fe640 1 -- 172.21.15.170:0/2166169070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8001ad80 con 0x5589c4dccba0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589c4dcdf70 con 0x5589c4dccba0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fac737fe640 1 -- 172.21.15.170:0/2166169070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80044360 con 0x5589c4dccba0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.272+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589c4dcdf70 con 0x5589c4dccba0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.273+0000 7fac737fe640 1 -- 172.21.15.170:0/2166169070 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad8003e070 con 0x5589c4dccba0 2024-04-26T12:31:30.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.273+0000 7fac737fe640 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac68036950 0x7fac68038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.273+0000 7fac737fe640 1 -- 172.21.15.170:0/2166169070 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fad80038080 con 0x5589c4dccba0 2024-04-26T12:31:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.273+0000 7fad87fff640 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac68036950 0x7fac68038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad91d31800 1 Processor -- start 2024-04-26T12:31:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad91d31800 1 -- start start 2024-04-26T12:31:30.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad87fff640 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac68036950 0x7fac68038e10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5589c4db27f0 tx=0x7fad78005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad91d31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4dd9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad91d31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5589c4da3e00 con 0x5589c4dd9b40 2024-04-26T12:31:30.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4dd9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4dd9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34212/0 (socket says 172.21.15.170:34212) 2024-04-26T12:31:30.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.274+0000 7fad8da2f640 1 -- 172.21.15.170:0/1191971194 learned_addr learned my addr 172.21.15.170:0/1191971194 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad8da2f640 1 -- 172.21.15.170:0/1191971194 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c4dda530 con 0x5589c4dd9b40 2024-04-26T12:31:30.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad8da2f640 1 --2- 172.21.15.170:0/1191971194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4dd9f60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fad800367b0 tx=0x7fad80041cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99cb9a61a514d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fac717fa640 1 -- 172.21.15.170:0/1191971194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad8004bfc0 con 0x5589c4dd9b40 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fac717fa640 1 -- 172.21.15.170:0/1191971194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8004c6a0 con 0x5589c4dd9b40 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fac717fa640 1 -- 172.21.15.170:0/1191971194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad800446e0 con 0x5589c4dd9b40 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad91d31800 1 -- 172.21.15.170:0/1191971194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 msgr2=0x5589c4dd9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad91d31800 1 --2- 172.21.15.170:0/1191971194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4dd9f60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fad800367b0 tx=0x7fad80041cb0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad91d31800 1 -- 172.21.15.170:0/1191971194 shutdown_connections 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad91d31800 1 --2- 172.21.15.170:0/1191971194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4dd9f60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad91d31800 1 -- 172.21.15.170:0/1191971194 >> 172.21.15.170:0/1191971194 conn(0x5589c4dd5e10 msgr2=0x5589c4dd3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad91d31800 1 -- 172.21.15.170:0/1191971194 shutdown_connections 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.275+0000 7fad91d31800 1 -- 172.21.15.170:0/1191971194 wait complete. 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad91d31800 1 Processor -- start 2024-04-26T12:31:30.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad91d31800 1 -- start start 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad91d31800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4de0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad91d31800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5589c4ddac00 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4de0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad8da2f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4de0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34226/0 (socket says 172.21.15.170:34226) 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 learned_addr learned my addr 172.21.15.170:0/1242013950 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.276+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589c4de1410 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.277+0000 7fad8da2f640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4de0ed0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fad800367b0 tx=0x7fad80012db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.277+0000 7fac5f7fe640 1 -- 172.21.15.170:0/1242013950 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad800165e0 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.277+0000 7fac5f7fe640 1 -- 172.21.15.170:0/1242013950 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80070070 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.277+0000 7fac5f7fe640 1 -- 172.21.15.170:0/1242013950 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80016780 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.277+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589c4de1410 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.277+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589c4de1410 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.278+0000 7fac5f7fe640 1 -- 172.21.15.170:0/1242013950 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad8004ca40 con 0x5589c4dd9b40 2024-04-26T12:31:30.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.278+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.278+0000 7fac5f7fe640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac58036860 0x7fac58038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.278+0000 7fac5f7fe640 1 -- 172.21.15.170:0/1242013950 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fad8005a140 con 0x5589c4dd9b40 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.278+0000 7fad87fff640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac58036860 0x7fac58038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.278+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4dec640 0x5589c4deeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.278+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4def250 con 0x5589c4dec640 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad8e230640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4dec640 0x5589c4deeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad87fff640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac58036860 0x7fac58038d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fad78052fd0 tx=0x7fad7804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad8e230640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4dec640 0x5589c4deeb00 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 20 realm 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4def660 con 0x5589c4dec640 2024-04-26T12:31:30.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.279+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4deff00 con 0x5589c4dec640 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad91d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4dec640 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad91d31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4df1000 0x5589c4df33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df3930 con 0x5589c4df1000 2024-04-26T12:31:30.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.280+0000 7fad8da2f640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4df1000 0x5589c4df33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad8da2f640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4df1000 0x5589c4df33f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad91d31800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad91d31800 20 searching for the correct realm 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5589c4df59a0 0x5589c4df7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df8530 con 0x5589c4df59a0 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad87fff640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5589c4df59a0 0x5589c4df7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.281+0000 7fad87fff640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5589c4df59a0 0x5589c4df7e60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.282+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.282+0000 7fad87fff640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad78076040 0x7fad78083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.282+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df8530 con 0x7fad78076040 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.282+0000 7fad8e230640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad78076040 0x7fad78083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.282+0000 7fad8e230640 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad78076040 0x7fad78083410 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.282+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad8800a4a0 con 0x7fad78076040 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.282+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4df1000 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.283+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.283+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4dec640 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.283+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.283+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4dec640 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.283+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.283+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4df1000 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.284+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.284+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4df1000 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.284+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.284+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x7fad78076040 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.284+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8800a4a0 con 0x7fad78076040 2024-04-26T12:31:30.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.284+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4df59a0 2024-04-26T12:31:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4dec640 2024-04-26T12:31:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x7fad78076040 2024-04-26T12:31:30.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8800a4a0 con 0x7fad78076040 2024-04-26T12:31:30.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4dec640 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8800a4a0 con 0x5589c4dec640 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.285+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x7fad78076040 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.286+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.286+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df02a0 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.286+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.286+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.286+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.286+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df1000 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4dec640 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4dec640 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.287+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df1000 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.288+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.288+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df59a0 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.288+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.288+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x7fad78076040 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.288+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.288+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4dec640 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.289+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.289+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df1000 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.289+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.289+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df59a0 2024-04-26T12:31:30.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.289+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.289+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df1000 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x7fad78076040 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df59a0 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4df1000 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.290+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x5589c4dec640 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fad78090040 con 0x7fad78076040 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df42a0 con 0x5589c4dec640 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df42a0 con 0x5589c4dec640 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.291+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df4250 con 0x7fad78076040 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 zone default found 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 4 Realm: () 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 zonegroup default 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df4690 con 0x5589c4df1000 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfa390 con 0x5589c4df59a0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.292+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfa730 con 0x5589c4df59a0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.293+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.293+0000 7fad91d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.293+0000 7fad91d31800 20 started sync module instance, tier type = 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.293+0000 7fad91d31800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.293+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9830 con 0x7fad78076040 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.294+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.294+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94050201869392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9830 con 0x7fad78076040 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.294+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfaf80 con 0x5589c4dec640 2024-04-26T12:31:30.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.295+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94050201869392] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.295+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.295+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94050201867408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfaf80 con 0x5589c4dec640 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.295+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfb810 con 0x5589c4df59a0 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.296+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94050201867408] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.297+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.297+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94050201873584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfbc00 con 0x5589c4df59a0 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.297+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfc600 con 0x7fad78076040 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.298+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.298+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94050201878800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfcea0 con 0x7fad78076040 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.298+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfd920 con 0x5589c4dec640 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.299+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94050201878800] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.300+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94050201873584] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.300+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.300+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94050201883664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfc9a0 con 0x5589c4dec640 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.300+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfe1f0 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.301+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.301+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94050201880912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfe5d0 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.301+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dff0e0 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.301+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94050201883664] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.302+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94050201880912] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.302+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.302+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94050201889680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dff4d0 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.302+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dffd20 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.303+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94050201889680] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94050201892976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e00140 con 0x5589c4df1000 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=0 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=1 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=2 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=3 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=4 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=5 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=6 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94050201892976] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 20 add_watcher() i=7 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.304+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e03480 con 0x5589c4dec640 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.305+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.305+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94050201894400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e006d0 con 0x5589c4dec640 2024-04-26T12:31:30.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94050201894400] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fac3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fad91d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fad91d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fad91d31800 5 note: GC not initialized 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fac3e7fc640 20 reqs_thread_entry: start 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fad91d31800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.306+0000 7fad91d31800 20 Filter name: none 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fabaffff640 20 reqs_thread_entry: start 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e37000 con 0x5589c4dec640 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e37000 con 0x7fad78076040 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e36fc0 con 0x5589c4dec640 2024-04-26T12:31:30.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.307+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e36fc0 con 0x5589c4df59a0 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e37510 con 0x5589c4df59a0 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e37510 con 0x5589c4df59a0 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e374d0 con 0x5589c4dec640 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e374d0 con 0x5589c4dec640 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.308+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.309+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e37480 con 0x5589c4df59a0 2024-04-26T12:31:30.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.309+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.309+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e37480 con 0x5589c4df59a0 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.309+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.309+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e37480 con 0x5589c4df1000 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4dec640 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x7fad78076040 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df59a0 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.310+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df1000 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.311+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.311+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df1000 2024-04-26T12:31:30.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.311+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.311+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df59a0 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.311+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.311+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df1000 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4dec640 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df59a0 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df1000 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.312+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x7fad78076040 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df1000 2024-04-26T12:31:30.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.313+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df59a0 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df59a0 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df59a0 2024-04-26T12:31:30.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.314+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df59a0 2024-04-26T12:31:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.315+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.315+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e39130 con 0x5589c4df1000 2024-04-26T12:31:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.315+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.316+0000 7fac3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.316+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94050201894400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e34c50 con 0x5589c4dec640 2024-04-26T12:31:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.317+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94050201894400] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.317+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94050201869392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4e34c50 con 0x7fad78076040 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.318+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94050201869392] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.318+0000 7fad91d31800 20 remove_watcher() i=0 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.318+0000 7fad91d31800 2 removed watcher, disabling cache 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.318+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94050201867408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9c50 con 0x5589c4dec640 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.319+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94050201867408] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.319+0000 7fad91d31800 20 remove_watcher() i=1 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.319+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94050201873584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9c50 con 0x5589c4df59a0 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.320+0000 7fad87fff640 1 -- 172.21.15.170:0/1242013950 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94050201873584] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78081070 con 0x5589c4df59a0 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.320+0000 7fad91d31800 20 remove_watcher() i=2 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.320+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94050201878800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9c50 con 0x7fad78076040 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.321+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94050201878800] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x7fad78076040 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.321+0000 7fad91d31800 20 remove_watcher() i=3 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.321+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94050201883664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9c50 con 0x5589c4dec640 2024-04-26T12:31:30.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.322+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94050201883664] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad88033040 con 0x5589c4dec640 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.322+0000 7fad91d31800 20 remove_watcher() i=4 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.322+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94050201880912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9c50 con 0x5589c4df1000 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.324+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94050201880912] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.324+0000 7fad91d31800 20 remove_watcher() i=5 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.324+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94050201889680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4dfc950 con 0x5589c4df1000 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.325+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94050201889680] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.325+0000 7fad91d31800 20 remove_watcher() i=6 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.325+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94050201892976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5589c4df9c50 con 0x5589c4df1000 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad8da2f640 1 -- 172.21.15.170:0/1242013950 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94050201892976] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad8003d030 con 0x5589c4df1000 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 20 remove_watcher() i=7 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4df1000 msgr2=0x5589c4df33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4df1000 0x5589c4df33f0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4dec640 msgr2=0x5589c4deeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4dec640 0x5589c4deeb00 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad78076040 msgr2=0x7fad78083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fad78076040 0x7fad78083410 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5589c4df59a0 msgr2=0x5589c4df7e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5589c4df59a0 0x5589c4df7e60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac58036860 msgr2=0x7fac58038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac58036860 0x7fac58038d20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fad78052fd0 tx=0x7fad7804f000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 msgr2=0x5589c4de0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad8e230640 1 -- 172.21.15.170:0/1242013950 reap_dead start 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4de0ed0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fad800367b0 tx=0x7fad80012db0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 shutdown_connections 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 --2- 172.21.15.170:0/1242013950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dd9b40 0x5589c4de0ed0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 >> 172.21.15.170:0/1242013950 conn(0x5589c4dd5e10 msgr2=0x5589c4dd3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 shutdown_connections 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.326+0000 7fad91d31800 1 -- 172.21.15.170:0/1242013950 wait complete. 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac68036950 msgr2=0x7fac68038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac68036950 0x7fac68038e10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5589c4db27f0 tx=0x7fad78005a00 comp rx=0 tx=0).stop 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dccba0 msgr2=0x5589c4dccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dccba0 0x5589c4dccfc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fad8004ac00 tx=0x7fad8000db20 comp rx=0 tx=0).stop 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 shutdown_connections 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac68036950 0x7fac68038e10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/2166169070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4dccba0 0x5589c4dccfc0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 >> 172.21.15.170:0/2166169070 conn(0x5589c4dc0c40 msgr2=0x5589c4dc1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 shutdown_connections 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/2166169070 wait complete. 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4db7c90 msgr2=0x5589c4dba080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5589c4db7c90 0x5589c4dba080 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4cb6870 msgr2=0x5589c4db5340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5589c4cb6870 0x5589c4db5340 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5589c4dbbbd0 msgr2=0x5589c4dbe020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5589c4dbbbd0 0x5589c4dbe020 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac74036900 msgr2=0x7fac74038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fac74036900 0x7fac74038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fad78054000 tx=0x7fad7804e000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 msgr2=0x5589c4c26690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 --2- 172.21.15.170:0/935785909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5589c4cb23e0 0x5589c4c26690 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fad8000b7c0 tx=0x7fad80000ed0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad8e230640 1 -- 172.21.15.170:0/935785909 reap_dead start 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 shutdown_connections 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 >> 172.21.15.170:0/935785909 conn(0x5589c4cad9e0 msgr2=0x5589c4da2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 shutdown_connections 2024-04-26T12:31:30.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.327+0000 7fad91d31800 1 -- 172.21.15.170:0/935785909 wait complete. 2024-04-26T12:31:30.341 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-26T12:31:30.342 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-26T12:31:30.342 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-26T12:31:30.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-26T12:31:30.342 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-26T12:31:30.383 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:30.384 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.383+0000 7f89f960f800 1 Processor -- start 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.383+0000 7f89f960f800 1 -- start start 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.383+0000 7f89f960f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556af0ddb830 0x556af0e6b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.383+0000 7f89f960f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556af0d150c0 con 0x556af0e6b610 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.383+0000 7f89f960f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x556af0cf94d0 con 0x556af0ddb830 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.384+0000 7f89f4c21640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556af0ddb830 0x556af0e6b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.384+0000 7f89ec420640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x556af0e6b610 0x556af0e6dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52208/0 (socket says 172.21.15.170:52208) 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.384+0000 7f89f4c21640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x556af0ddb830 0x556af0e6b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34230/0 (socket says 172.21.15.170:34230) 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.384+0000 7f89ec420640 1 -- 172.21.15.170:0/2849025316 learned_addr learned my addr 172.21.15.170:0/2849025316 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:30.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.384+0000 7f89f4c21640 1 -- 172.21.15.170:0/2849025316 >> v1:172.21.15.132:6789/0 conn(0x556af0e6b610 legacy=0x556af0e6dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.384+0000 7f89f4c21640 1 -- 172.21.15.170:0/2849025316 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af0d26d40 con 0x556af0ddb830 2024-04-26T12:31:30.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.386+0000 7f89f4c21640 1 --2- 172.21.15.170:0/2849025316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e6b070 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f89e400a470 tx=0x7f89e401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb484d8aa2bf180 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.386+0000 7f89effff640 1 -- 172.21.15.170:0/2849025316 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4057070 con 0x556af0ddb830 2024-04-26T12:31:30.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.386+0000 7f89effff640 1 -- 172.21.15.170:0/2849025316 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e4052570 con 0x556af0ddb830 2024-04-26T12:31:30.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.386+0000 7f89effff640 1 -- 172.21.15.170:0/2849025316 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4052870 con 0x556af0ddb830 2024-04-26T12:31:30.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.386+0000 7f89f960f800 1 -- 172.21.15.170:0/2849025316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 msgr2=0x556af0e6b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.386+0000 7f89f960f800 1 --2- 172.21.15.170:0/2849025316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e6b070 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f89e400a470 tx=0x7f89e401ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:30.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.387+0000 7f89f960f800 1 -- 172.21.15.170:0/2849025316 shutdown_connections 2024-04-26T12:31:30.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.387+0000 7f89f960f800 1 --2- 172.21.15.170:0/2849025316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e6b070 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.387+0000 7f89f960f800 1 -- 172.21.15.170:0/2849025316 >> 172.21.15.170:0/2849025316 conn(0x556af0e629d0 msgr2=0x556af0e64df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.387+0000 7f89f960f800 1 -- 172.21.15.170:0/2849025316 shutdown_connections 2024-04-26T12:31:30.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.387+0000 7f89f960f800 1 -- 172.21.15.170:0/2849025316 wait complete. 2024-04-26T12:31:30.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.398+0000 7f89f960f800 1 Processor -- start 2024-04-26T12:31:30.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.398+0000 7f89f960f800 1 -- start start 2024-04-26T12:31:30.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.398+0000 7f89f960f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e689a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.398+0000 7f89f960f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556af0db3b30 con 0x556af0ddb830 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.399+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.399+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e689a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34234/0 (socket says 172.21.15.170:34234) 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.399+0000 7f89f4c21640 1 -- 172.21.15.170:0/557297454 learned_addr learned my addr 172.21.15.170:0/557297454 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.399+0000 7f89f4c21640 1 -- 172.21.15.170:0/557297454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af0d25590 con 0x556af0ddb830 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.399+0000 7f89f4c21640 1 --2- 172.21.15.170:0/557297454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e689a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f89e4055040 tx=0x7f89e404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5c6109185c5867 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f88e2e0d640 1 -- 172.21.15.170:0/557297454 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4057070 con 0x556af0ddb830 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f88e2e0d640 1 -- 172.21.15.170:0/557297454 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e4063070 con 0x556af0ddb830 2024-04-26T12:31:30.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f88e2e0d640 1 -- 172.21.15.170:0/557297454 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4052720 con 0x556af0ddb830 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f89f960f800 1 -- 172.21.15.170:0/557297454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 msgr2=0x556af0e689a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f89f960f800 1 --2- 172.21.15.170:0/557297454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e689a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f89e4055040 tx=0x7f89e404c000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f89f960f800 1 -- 172.21.15.170:0/557297454 shutdown_connections 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f89f960f800 1 --2- 172.21.15.170:0/557297454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0e689a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f89f960f800 1 -- 172.21.15.170:0/557297454 >> 172.21.15.170:0/557297454 conn(0x556af0e629d0 msgr2=0x556af0f54fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f89f960f800 1 -- 172.21.15.170:0/557297454 shutdown_connections 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.400+0000 7f89f960f800 1 -- 172.21.15.170:0/557297454 wait complete. 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f960f800 1 Processor -- start 2024-04-26T12:31:30.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f960f800 1 -- start start 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f960f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0f630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f960f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556af0e6f520 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0f630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0f630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34236/0 (socket says 172.21.15.170:34236) 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f4c21640 1 -- 172.21.15.170:0/4196315940 learned_addr learned my addr 172.21.15.170:0/4196315940 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f4c21640 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af0d1c8f0 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.401+0000 7f89f4c21640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0f630b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000c00 tx=0x7f89e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.402+0000 7f88e160a640 1 -- 172.21.15.170:0/4196315940 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e405e480 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.402+0000 7f88e160a640 1 -- 172.21.15.170:0/4196315940 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e406c070 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.402+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556af0f635f0 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.402+0000 7f88e160a640 1 -- 172.21.15.170:0/4196315940 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e405e750 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.402+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af0f63b10 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.402+0000 7f88e160a640 1 -- 172.21.15.170:0/4196315940 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f89e4077060 con 0x556af0ddb830 2024-04-26T12:31:30.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f88e160a640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88dc036900 0x7f88dc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f88e160a640 1 -- 172.21.15.170:0/4196315940 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f89e408e600 con 0x556af0ddb830 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89ec420640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88dc036900 0x7f88dc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0e6b610 0x556af0f6a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0f6a6a0 con 0x556af0e6b610 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89f5422640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0e6b610 0x556af0f6a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89ec420640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88dc036900 0x7f88dc038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000f60 tx=0x7f89dc0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89f5422640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0e6b610 0x556af0f6a120 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89f5422640 1 -- 172.21.15.170:0/4196315940 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0e6b610 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.403+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0f676f0 con 0x556af0e6b610 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.404+0000 7f89f5422640 1 -- 172.21.15.170:0/4196315940 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0e6b610 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.404+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0f6c9d0 0x556af0f6edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.404+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0f6f460 con 0x556af0f6c9d0 2024-04-26T12:31:30.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.404+0000 7f89f4c21640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0f6c9d0 0x556af0f6edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.404+0000 7f89f4c21640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0f6c9d0 0x556af0f6edc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.405+0000 7f89f4c21640 1 -- 172.21.15.170:0/4196315940 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89e4009410 con 0x556af0f6c9d0 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.405+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0f6b980 con 0x556af0e6b610 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.405+0000 7f89f5422640 1 -- 172.21.15.170:0/4196315940 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0e6b610 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.405+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556af0f70910 0x556af0f72d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.405+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0f734c0 con 0x556af0f70910 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.405+0000 7f89ec420640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556af0f70910 0x556af0f72d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.405+0000 7f89ec420640 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556af0f70910 0x556af0f72d60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89ec420640 1 -- 172.21.15.170:0/4196315940 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f89dc009050 con 0x556af0f70910 2024-04-26T12:31:30.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89f960f800 1 Processor -- start 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89f960f800 1 -- start start 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89f960f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f81920 0x556af0f81d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89f960f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556af0d59e60 con 0x556af0f81920 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f81920 0x556af0f81d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f81920 0x556af0f81d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34238/0 (socket says 172.21.15.170:34238) 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.406+0000 7f89f4c21640 1 -- 172.21.15.170:0/2444210595 learned_addr learned my addr 172.21.15.170:0/2444210595 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.407+0000 7f89f4c21640 1 -- 172.21.15.170:0/2444210595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af0f82280 con 0x556af0f81920 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.407+0000 7f89f4c21640 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f81920 0x556af0f81d40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f89e400a040 tx=0x7f89e406ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.407+0000 7f88da7fc640 1 -- 172.21.15.170:0/2444210595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e408b380 con 0x556af0f81920 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.407+0000 7f88da7fc640 1 -- 172.21.15.170:0/2444210595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e4058040 con 0x556af0f81920 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.407+0000 7f88da7fc640 1 -- 172.21.15.170:0/2444210595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e405ead0 con 0x556af0f81920 2024-04-26T12:31:30.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.407+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556af0f82cf0 con 0x556af0f81920 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.407+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af0f831f0 con 0x556af0f81920 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f88da7fc640 1 -- 172.21.15.170:0/2444210595 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f89e4095060 con 0x556af0f81920 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f88da7fc640 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88cc036950 0x7f88cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f88da7fc640 1 -- 172.21.15.170:0/2444210595 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f89e4072070 con 0x556af0f81920 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f89ec420640 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88cc036950 0x7f88cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f89f960f800 1 Processor -- start 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f89ec420640 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88cc036950 0x7f88cc038e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00bf50 tx=0x7f89dc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f89f960f800 1 -- start start 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f89f960f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f8eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.408+0000 7f89f960f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556af0e66f60 con 0x556af0f8ead0 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f8eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f8eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34246/0 (socket says 172.21.15.170:34246) 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f89f4c21640 1 -- 172.21.15.170:0/3513880740 learned_addr learned my addr 172.21.15.170:0/3513880740 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f89f4c21640 1 -- 172.21.15.170:0/3513880740 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af0f8f4c0 con 0x556af0f8ead0 2024-04-26T12:31:30.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f89f4c21640 1 --2- 172.21.15.170:0/3513880740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f8eef0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f89e4052bb0 tx=0x7f89e407dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51d601dc2b2ed1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f88cbfff640 1 -- 172.21.15.170:0/3513880740 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e40a7070 con 0x556af0f8ead0 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f88cbfff640 1 -- 172.21.15.170:0/3513880740 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e4067a80 con 0x556af0f8ead0 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.409+0000 7f88cbfff640 1 -- 172.21.15.170:0/3513880740 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e407d510 con 0x556af0f8ead0 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 -- 172.21.15.170:0/3513880740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 msgr2=0x556af0f8eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 --2- 172.21.15.170:0/3513880740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f8eef0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f89e4052bb0 tx=0x7f89e407dc60 comp rx=0 tx=0).stop 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 -- 172.21.15.170:0/3513880740 shutdown_connections 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 --2- 172.21.15.170:0/3513880740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f8eef0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 -- 172.21.15.170:0/3513880740 >> 172.21.15.170:0/3513880740 conn(0x556af0f8ada0 msgr2=0x556af0f88e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 -- 172.21.15.170:0/3513880740 shutdown_connections 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 -- 172.21.15.170:0/3513880740 wait complete. 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 Processor -- start 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 -- start start 2024-04-26T12:31:30.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f95e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f960f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x556af0f8fb20 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f95e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f4c21640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f95e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34254/0 (socket says 172.21.15.170:34254) 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.410+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 learned_addr learned my addr 172.21.15.170:0/1412570089 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.411+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af0f96360 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.411+0000 7f89f4c21640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f95e20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f89e4069920 tx=0x7f89e4055f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.411+0000 7f88ca7fc640 1 -- 172.21.15.170:0/1412570089 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e40b2020 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.411+0000 7f88ca7fc640 1 -- 172.21.15.170:0/1412570089 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e406f560 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.411+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556af0f96360 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.411+0000 7f88ca7fc640 1 -- 172.21.15.170:0/1412570089 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e40a7030 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.411+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af0f968c0 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f88ca7fc640 1 -- 172.21.15.170:0/1412570089 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f89e40b5020 con 0x556af0f8ead0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f88ca7fc640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88c0036950 0x7f88c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f88ca7fc640 1 -- 172.21.15.170:0/1412570089 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f89e40a8070 con 0x556af0f8ead0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f89ec420640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88c0036950 0x7f88c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0fa15b0 0x556af0fa3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa41a0 con 0x556af0fa15b0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.412+0000 7f89f5422640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0fa15b0 0x556af0fa3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89ec420640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88c0036950 0x7f88c0038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f89dc001b60 tx=0x7f89dc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f5422640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0fa15b0 0x556af0fa3a50 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 20 realm 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa45b0 con 0x556af0fa15b0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa4e50 con 0x556af0fa15b0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.413+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.414+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.414+0000 7f89f960f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.414+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.414+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0fa5f50 0x556af0fa8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.414+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa8880 con 0x556af0fa5f50 2024-04-26T12:31:30.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.414+0000 7f89f4c21640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0fa5f50 0x556af0fa8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.414+0000 7f89f4c21640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0fa5f50 0x556af0fa8340 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89f960f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89f960f800 20 searching for the correct realm 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556af0faa900 0x556af0facdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fad490 con 0x556af0faa900 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89ec420640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556af0faa900 0x556af0facdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89ec420640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556af0faa900 0x556af0facdc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.415+0000 7f89ec420640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f89dc038040 0x7f89dc01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.416+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fad490 con 0x7f89dc038040 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.416+0000 7f89f5422640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f89dc038040 0x7f89dc01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.416+0000 7f89f5422640 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f89dc038040 0x7f89dc01bab0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.416+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f89f000a4a0 con 0x7f89dc038040 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.416+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.416+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.416+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.417+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x7f89dc038040 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f000a4a0 con 0x7f89dc038040 2024-04-26T12:31:30.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x7f89dc038040 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f000a4a0 con 0x7f89dc038040 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.418+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f000a4a0 con 0x556af0fa15b0 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x7f89dc038040 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.419+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.420+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.421+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.421+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.421+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.421+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.421+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x7f89dc038040 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.421+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.421+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.422+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x7f89dc038040 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0faa900 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa5f50 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x556af0fa15b0 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.423+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa51f0 con 0x7f89dc038040 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:30.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa9200 con 0x556af0fa15b0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa9200 con 0x556af0fa15b0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa91d0 con 0x7f89dc038040 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 zone default found 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 4 Realm: () 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 zonegroup default 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.424+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa95f0 con 0x556af0fa5f50 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fa9200 con 0x556af0faa900 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0faf2f0 con 0x556af0faa900 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 20 started sync module instance, tier type = 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.425+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fae790 con 0x7f89dc038040 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.426+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.426+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93917797870736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fae790 con 0x7f89dc038040 2024-04-26T12:31:30.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.427+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fafcf0 con 0x556af0fa15b0 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.427+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93917797870736] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.428+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.428+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93917797873664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fae790 con 0x556af0fa15b0 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.428+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb0790 con 0x556af0faa900 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.429+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93917797873664] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.429+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.429+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93917797868256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fae700 con 0x556af0faa900 2024-04-26T12:31:30.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.429+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb1580 con 0x7f89dc038040 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.430+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.430+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93917797879904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb1e20 con 0x7f89dc038040 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.430+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb28c0 con 0x556af0fa15b0 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.430+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93917797868256] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.431+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93917797879904] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.431+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.431+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93917797884816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb1920 con 0x556af0fa15b0 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.432+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb3160 con 0x556af0fa5f50 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.432+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.433+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93917797882064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb3560 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.433+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb4070 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.433+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93917797884816] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.434+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.434+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93917797878704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb48c0 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.434+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb5280 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.434+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93917797882064] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93917797878704] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93917797887152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb5280 con 0x556af0fa5f50 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 20 add_watcher() i=0 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 20 add_watcher() i=1 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 20 add_watcher() i=2 2024-04-26T12:31:30.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 20 add_watcher() i=3 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 20 add_watcher() i=4 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 20 add_watcher() i=5 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.435+0000 7f89f960f800 20 add_watcher() i=6 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.436+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93917797887152] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.436+0000 7f89f960f800 20 add_watcher() i=7 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.436+0000 7f89f960f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.436+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb83f0 con 0x556af0fa15b0 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.436+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.436+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93917797895632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb56a0 con 0x556af0fa15b0 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93917797895632] v32'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f88aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f89f960f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f89f960f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:30.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f89f960f800 5 note: GC not initialized 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f88a9fe3640 20 reqs_thread_entry: start 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f89f960f800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.437+0000 7f89f960f800 20 Filter name: none 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f881b7fe640 20 reqs_thread_entry: start 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0febf80 con 0x556af0fa15b0 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0febf80 con 0x7f89dc038040 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0febf40 con 0x556af0fa15b0 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0febf40 con 0x556af0faa900 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.438+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fec450 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fec8d0 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fec890 con 0x556af0fa15b0 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fec890 con 0x556af0fa15b0 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fec890 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.439+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.440+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fec810 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.440+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.440+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fec7f0 con 0x556af0fa5f50 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.440+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.441+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee2b0 con 0x556af0fa15b0 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.441+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.441+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee2b0 con 0x7f89dc038040 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.441+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.441+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee2b0 con 0x556af0faa900 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.441+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.441+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee2b0 con 0x556af0fa5f50 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee2b0 con 0x556af0fa5f50 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee260 con 0x556af0faa900 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0fa5f50 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.442+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0fa15b0 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0faa900 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0fa5f50 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x7f89dc038040 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.443+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0fa5f50 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0fa15b0 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0fa15b0 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee210 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee190 con 0x556af0fa15b0 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.444+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee170 con 0x556af0fa15b0 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee170 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee170 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee170 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.445+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556af0fee170 con 0x556af0fa5f50 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.446+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.446+0000 7f88aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.446+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93917797895632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fe9de0 con 0x556af0fa15b0 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.447+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93917797895632] v32'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.447+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93917797870736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb4dd0 con 0x7f89dc038040 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.448+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93917797870736] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.448+0000 7f89f960f800 20 remove_watcher() i=0 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.448+0000 7f89f960f800 2 removed watcher, disabling cache 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.448+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93917797873664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb4dd0 con 0x556af0fa15b0 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.450+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93917797873664] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.450+0000 7f89f960f800 20 remove_watcher() i=1 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.450+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93917797868256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0faf800 con 0x556af0faa900 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.451+0000 7f89ec420640 1 -- 172.21.15.170:0/1412570089 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93917797868256] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc009050 con 0x556af0faa900 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.451+0000 7f89f960f800 20 remove_watcher() i=2 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.451+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93917797879904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb4dd0 con 0x7f89dc038040 2024-04-26T12:31:30.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.452+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93917797879904] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x7f89dc038040 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.452+0000 7f89f960f800 20 remove_watcher() i=3 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.452+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93917797884816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fae2e0 con 0x556af0fa15b0 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.454+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93917797884816] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f0033040 con 0x556af0fa15b0 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.454+0000 7f89f960f800 20 remove_watcher() i=4 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.454+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93917797882064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0faf800 con 0x556af0fa5f50 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.455+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93917797882064] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.455+0000 7f89f960f800 20 remove_watcher() i=5 2024-04-26T12:31:30.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.455+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93917797878704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb4dd0 con 0x556af0fa5f50 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.456+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93917797878704] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.456+0000 7f89f960f800 20 remove_watcher() i=6 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.456+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93917797887152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556af0fb2390 con 0x556af0fa5f50 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f4c21640 1 -- 172.21.15.170:0/1412570089 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93917797887152] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e4009410 con 0x556af0fa5f50 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 20 remove_watcher() i=7 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0fa5f50 msgr2=0x556af0fa8340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0fa5f50 0x556af0fa8340 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0fa15b0 msgr2=0x556af0fa3a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0fa15b0 0x556af0fa3a50 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f89dc038040 msgr2=0x7f89dc01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f89dc038040 0x7f89dc01bab0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556af0faa900 msgr2=0x556af0facdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x556af0faa900 0x556af0facdc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88c0036950 msgr2=0x7f88c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88c0036950 0x7f88c0038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f89dc001b60 tx=0x7f89dc010000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 msgr2=0x556af0f95e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/1412570089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f8ead0 0x556af0f95e20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f89e4069920 tx=0x7f89e4055f60 comp rx=0 tx=0).stop 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 reap_dead start 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f5422640 1 -- 172.21.15.170:0/1412570089 reap_dead start 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 shutdown_connections 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 >> 172.21.15.170:0/1412570089 conn(0x556af0f8ada0 msgr2=0x556af0f88400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 shutdown_connections 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/1412570089 wait complete. 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88cc036950 msgr2=0x7f88cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88cc036950 0x7f88cc038e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00bf50 tx=0x7f89dc00f000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f81920 msgr2=0x556af0f81d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f81920 0x556af0f81d40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f89e400a040 tx=0x7f89e406ff60 comp rx=0 tx=0).stop 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 shutdown_connections 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88cc036950 0x7f88cc038e10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 --2- 172.21.15.170:0/2444210595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0f81920 0x556af0f81d40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.457+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 >> 172.21.15.170:0/2444210595 conn(0x556af0f759c0 msgr2=0x556af0f75dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 shutdown_connections 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/2444210595 wait complete. 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0f6c9d0 msgr2=0x556af0f6edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x556af0f6c9d0 0x556af0f6edc0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0e6b610 msgr2=0x556af0f6a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x556af0e6b610 0x556af0f6a120 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556af0f70910 msgr2=0x556af0f72d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x556af0f70910 0x556af0f72d60 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88dc036900 msgr2=0x7f88dc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f88dc036900 0x7f88dc038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000f60 tx=0x7f89dc0012b0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 msgr2=0x556af0f630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 --2- 172.21.15.170:0/4196315940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x556af0ddb830 0x556af0f630b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000c00 tx=0x7f89e4002fb0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f5422640 1 -- 172.21.15.170:0/4196315940 reap_dead start 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 shutdown_connections 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 >> 172.21.15.170:0/4196315940 conn(0x556af0e629d0 msgr2=0x556af0e67460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 shutdown_connections 2024-04-26T12:31:30.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.458+0000 7f89f960f800 1 -- 172.21.15.170:0/4196315940 wait complete. 2024-04-26T12:31:30.474 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-26T12:31:30.474 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-26T12:31:30.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-26T12:31:30.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-26T12:31:30.475 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.558+0000 7f9032c98800 1 Processor -- start 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.558+0000 7f9032c98800 1 -- start start 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.558+0000 7f9032c98800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x560a2414c3e0 0x560a2414c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.558+0000 7f9032c98800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a23ffa0c0 con 0x560a2414d640 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.558+0000 7f9032c98800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x560a23fde4d0 con 0x560a2414c3e0 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.559+0000 7f903079e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x560a2414c3e0 0x560a2414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.559+0000 7f903079e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x560a2414c3e0 0x560a2414c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34256/0 (socket says 172.21.15.170:34256) 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.559+0000 7f902ff9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x560a2414d640 0x560a2414dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52212/0 (socket says 172.21.15.170:52212) 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.559+0000 7f903079e640 1 -- 172.21.15.170:0/1102139359 learned_addr learned my addr 172.21.15.170:0/1102139359 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.559+0000 7f903079e640 1 -- 172.21.15.170:0/1102139359 >> v1:172.21.15.132:6789/0 conn(0x560a2414d640 legacy=0x560a2414dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.559+0000 7f903079e640 1 -- 172.21.15.170:0/1102139359 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a2400bd40 con 0x560a2414c3e0 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.561+0000 7f903079e640 1 --2- 172.21.15.170:0/1102139359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2414c800 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9020005fd0 tx=0x7f902001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae16e6848a972f90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.561+0000 7f902f79c640 1 -- 172.21.15.170:0/1102139359 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020052540 con 0x560a2414c3e0 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.561+0000 7f902f79c640 1 -- 172.21.15.170:0/1102139359 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902004e070 con 0x560a2414c3e0 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.561+0000 7f902f79c640 1 -- 172.21.15.170:0/1102139359 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020052890 con 0x560a2414c3e0 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.562+0000 7f9032c98800 1 -- 172.21.15.170:0/1102139359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 msgr2=0x560a2414c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.562+0000 7f9032c98800 1 --2- 172.21.15.170:0/1102139359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2414c800 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9020005fd0 tx=0x7f902001cd80 comp rx=0 tx=0).stop 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.562+0000 7f9032c98800 1 -- 172.21.15.170:0/1102139359 shutdown_connections 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.562+0000 7f9032c98800 1 --2- 172.21.15.170:0/1102139359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2414c800 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.562+0000 7f9032c98800 1 -- 172.21.15.170:0/1102139359 >> 172.21.15.170:0/1102139359 conn(0x560a241479e0 msgr2=0x560a24149e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.562+0000 7f9032c98800 1 -- 172.21.15.170:0/1102139359 shutdown_connections 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.562+0000 7f9032c98800 1 -- 172.21.15.170:0/1102139359 wait complete. 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f9032c98800 1 Processor -- start 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f9032c98800 1 -- start start 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f9032c98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2423c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f9032c98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560a24098b40 con 0x560a2414c3e0 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2423c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2423c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34268/0 (socket says 172.21.15.170:34268) 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f903079e640 1 -- 172.21.15.170:0/1595030323 learned_addr learned my addr 172.21.15.170:0/1595030323 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f903079e640 1 -- 172.21.15.170:0/1595030323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a2400a590 con 0x560a2414c3e0 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.574+0000 7f903079e640 1 --2- 172.21.15.170:0/1595030323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2423c910 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9020007000 tx=0x7f902004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d85acb230040581 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f8f1e60c640 1 -- 172.21.15.170:0/1595030323 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020052860 con 0x560a2414c3e0 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f8f1e60c640 1 -- 172.21.15.170:0/1595030323 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9020058040 con 0x560a2414c3e0 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f8f1e60c640 1 -- 172.21.15.170:0/1595030323 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020052b50 con 0x560a2414c3e0 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f9032c98800 1 -- 172.21.15.170:0/1595030323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 msgr2=0x560a2423c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f9032c98800 1 --2- 172.21.15.170:0/1595030323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2423c910 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9020007000 tx=0x7f902004c000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f9032c98800 1 -- 172.21.15.170:0/1595030323 shutdown_connections 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f9032c98800 1 --2- 172.21.15.170:0/1595030323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a2423c910 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f9032c98800 1 -- 172.21.15.170:0/1595030323 >> 172.21.15.170:0/1595030323 conn(0x560a241479e0 msgr2=0x560a24238230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f9032c98800 1 -- 172.21.15.170:0/1595030323 shutdown_connections 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.575+0000 7f9032c98800 1 -- 172.21.15.170:0/1595030323 wait complete. 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f9032c98800 1 Processor -- start 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f9032c98800 1 -- start start 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f9032c98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a24244170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f9032c98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560a240bfd50 con 0x560a2414c3e0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a24244170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a24244170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34270/0 (socket says 172.21.15.170:34270) 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f903079e640 1 -- 172.21.15.170:0/3826475260 learned_addr learned my addr 172.21.15.170:0/3826475260 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.576+0000 7f903079e640 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a240018f0 con 0x560a2414c3e0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.577+0000 7f903079e640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a24244170 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f902005f040 tx=0x7f9020003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.577+0000 7f8f1ce09640 1 -- 172.21.15.170:0/3826475260 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902005d420 con 0x560a2414c3e0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.577+0000 7f8f1ce09640 1 -- 172.21.15.170:0/3826475260 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902005d5e0 con 0x560a2414c3e0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.577+0000 7f8f1ce09640 1 -- 172.21.15.170:0/3826475260 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902005d900 con 0x560a2414c3e0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.577+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a242446b0 con 0x560a2414c3e0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.577+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a24244bd0 con 0x560a2414c3e0 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.577+0000 7f8f1ce09640 1 -- 172.21.15.170:0/3826475260 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9020050070 con 0x560a2414c3e0 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f8f1ce09640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f18036900 0x7f8f18038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f8f1ce09640 1 -- 172.21.15.170:0/3826475260 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9020062070 con 0x560a2414c3e0 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f902ff9d640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f18036900 0x7f8f18038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a2414d640 0x560a2424b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2424b720 con 0x560a2414d640 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f9030f9f640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a2414d640 0x560a2424b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f902ff9d640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f18036900 0x7f8f18038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9024000f60 tx=0x7f9024001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.578+0000 7f9030f9f640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a2414d640 0x560a2424b1e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.579+0000 7f9030f9f640 1 -- 172.21.15.170:0/3826475260 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90280083e0 con 0x560a2414d640 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.579+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a24248790 con 0x560a2414d640 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.579+0000 7f9030f9f640 1 -- 172.21.15.170:0/3826475260 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90280083e0 con 0x560a2414d640 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.579+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2424da10 0x560a2424fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.579+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a242504f0 con 0x560a2424da10 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.579+0000 7f903079e640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2424da10 0x560a2424fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.579+0000 7f903079e640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2424da10 0x560a2424fe00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.580+0000 7f903079e640 1 -- 172.21.15.170:0/3826475260 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9020078070 con 0x560a2424da10 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.580+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2424c9c0 con 0x560a2414d640 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.580+0000 7f9030f9f640 1 -- 172.21.15.170:0/3826475260 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90280083e0 con 0x560a2414d640 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.580+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560a24251950 0x560a24253dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.580+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a24254520 con 0x560a24251950 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.580+0000 7f902ff9d640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560a24251950 0x560a24253dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.581+0000 7f902ff9d640 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560a24251950 0x560a24253dc0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.581+0000 7f902ff9d640 1 -- 172.21.15.170:0/3826475260 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f902400f690 con 0x560a24251950 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.581+0000 7f9032c98800 1 Processor -- start 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.581+0000 7f9032c98800 1 -- start start 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.581+0000 7f9032c98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24266de0 0x560a24267200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.581+0000 7f9032c98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560a2403ee60 con 0x560a24266de0 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.582+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24266de0 0x560a24267200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.582+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24266de0 0x560a24267200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34284/0 (socket says 172.21.15.170:34284) 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.582+0000 7f903079e640 1 -- 172.21.15.170:0/938037120 learned_addr learned my addr 172.21.15.170:0/938037120 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.582+0000 7f903079e640 1 -- 172.21.15.170:0/938037120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a24267740 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.582+0000 7f903079e640 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24266de0 0x560a24267200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f902008ca40 tx=0x7f9020068ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.582+0000 7f8f15ffb640 1 -- 172.21.15.170:0/938037120 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020064700 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.582+0000 7f8f15ffb640 1 -- 172.21.15.170:0/938037120 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90200648a0 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.583+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a242681b0 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.583+0000 7f8f15ffb640 1 -- 172.21.15.170:0/938037120 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902008e050 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.583+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a242686b0 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.583+0000 7f8f15ffb640 1 -- 172.21.15.170:0/938037120 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f902008e1f0 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.583+0000 7f8f15ffb640 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f08036950 0x7f8f08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.583+0000 7f8f15ffb640 1 -- 172.21.15.170:0/938037120 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9020054350 con 0x560a24266de0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f902ff9d640 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f08036950 0x7f8f08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f9032c98800 1 Processor -- start 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f9032c98800 1 -- start start 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f902ff9d640 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f08036950 0x7f8f08038e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x560a2424bfc0 tx=0x7f902400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f9032c98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a242742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f9032c98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560a2423cfd0 con 0x560a24273ec0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a242742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a242742e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34288/0 (socket says 172.21.15.170:34288) 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.584+0000 7f903079e640 1 -- 172.21.15.170:0/1669218434 learned_addr learned my addr 172.21.15.170:0/1669218434 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f903079e640 1 -- 172.21.15.170:0/1669218434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a242748b0 con 0x560a24273ec0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f903079e640 1 --2- 172.21.15.170:0/1669218434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a242742e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9020067c50 tx=0x7f902007ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc30d1e5e1bcbeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f8f0f7fe640 1 -- 172.21.15.170:0/1669218434 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020093070 con 0x560a24273ec0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f8f0f7fe640 1 -- 172.21.15.170:0/1669218434 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9020051a30 con 0x560a24273ec0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f8f0f7fe640 1 -- 172.21.15.170:0/1669218434 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9020067540 con 0x560a24273ec0 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f9032c98800 1 -- 172.21.15.170:0/1669218434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 msgr2=0x560a242742e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f9032c98800 1 --2- 172.21.15.170:0/1669218434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a242742e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9020067c50 tx=0x7f902007ccf0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f9032c98800 1 -- 172.21.15.170:0/1669218434 shutdown_connections 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f9032c98800 1 --2- 172.21.15.170:0/1669218434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a242742e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f9032c98800 1 -- 172.21.15.170:0/1669218434 >> 172.21.15.170:0/1669218434 conn(0x560a242701d0 msgr2=0x560a2426e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f9032c98800 1 -- 172.21.15.170:0/1669218434 shutdown_connections 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.585+0000 7f9032c98800 1 -- 172.21.15.170:0/1669218434 wait complete. 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f9032c98800 1 Processor -- start 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f9032c98800 1 -- start start 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f9032c98800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a2427b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f9032c98800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560a24274f40 con 0x560a24273ec0 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a2427b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f903079e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a2427b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34300/0 (socket says 172.21.15.170:34300) 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 learned_addr learned my addr 172.21.15.170:0/2368302687 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a2427b7b0 con 0x560a24273ec0 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.586+0000 7f903079e640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a2427b270 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9020066010 tx=0x7f9020078f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.587+0000 7f8f0dffb640 1 -- 172.21.15.170:0/2368302687 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90200b2070 con 0x560a24273ec0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.587+0000 7f8f0dffb640 1 -- 172.21.15.170:0/2368302687 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902008e8b0 con 0x560a24273ec0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.587+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a2427b7b0 con 0x560a24273ec0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.587+0000 7f8f0dffb640 1 -- 172.21.15.170:0/2368302687 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f902008eb90 con 0x560a24273ec0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.587+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a2427b7b0 con 0x560a24273ec0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.587+0000 7f8f0dffb640 1 -- 172.21.15.170:0/2368302687 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f90200b5070 con 0x560a24273ec0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f8f0dffb640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f00036900 0x7f8f00038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f8f0dffb640 1 -- 172.21.15.170:0/2368302687 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f90200aa070 con 0x560a24273ec0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f902ff9d640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f00036900 0x7f8f00038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a24286880 0x560a24288d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a24289470 con 0x560a24286880 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9030f9f640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a24286880 0x560a24288d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f902ff9d640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f00036900 0x7f8f00038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560a24254920 tx=0x7f9024010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9030f9f640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a24286880 0x560a24288d20 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90280083e0 con 0x560a24286880 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9032c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9032c98800 20 realm 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.588+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a242898a0 con 0x560a24286880 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90280083e0 con 0x560a24286880 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90280083e0 con 0x560a24286880 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a4e0 con 0x560a24286880 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90280083e0 con 0x560a24286880 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2428aea0 0x560a2428d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2428d7d0 con 0x560a2428aea0 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.589+0000 7f903079e640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2428aea0 0x560a2428d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f903079e640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2428aea0 0x560a2428d290 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f9032c98800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f9032c98800 20 searching for the correct realm 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560a2428f8f0 0x560a24291db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a24292480 con 0x560a2428f8f0 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f902ff9d640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560a2428f8f0 0x560a24291db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.590+0000 7f902ff9d640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560a2428f8f0 0x560a24291db0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.591+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.591+0000 7f902ff9d640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f902400f070 0x7f902402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.591+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a24292480 con 0x7f902400f070 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.591+0000 7f9030f9f640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f902400f070 0x7f902402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.591+0000 7f9030f9f640 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f902400f070 0x7f902402e910 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.591+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f90280083e0 con 0x7f902400f070 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.591+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90280083e0 con 0x560a24286880 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.592+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.593+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.593+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x7f902400f070 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.593+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.593+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.593+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.593+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x7f902400f070 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x7f902400f070 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.594+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.595+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.596+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x7f902400f070 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.597+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x7f902400f070 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428f8f0 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.598+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a2428aea0 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x560a24286880 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a2428a140 con 0x7f902400f070 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2428e1b0 con 0x560a24286880 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.599+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2428e1b0 con 0x560a24286880 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2428e180 con 0x7f902400f070 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 zone default found 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 4 Realm: () 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 zonegroup default 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2428e5a0 con 0x560a2428aea0 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.600+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a242942e0 con 0x560a2428f8f0 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f9032c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a24294680 con 0x560a2428f8f0 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f9032c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f9032c98800 20 started sync module instance, tier type = 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f9032c98800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.601+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24293780 con 0x7f902400f070 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.602+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.602+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94601556343664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24293780 con 0x7f902400f070 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.602+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24294ed0 con 0x560a24286880 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.603+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94601556343664] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.603+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.603+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94601556341936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24294ed0 con 0x560a24286880 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.603+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242958d0 con 0x560a2428f8f0 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.604+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.604+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94601556349920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24296170 con 0x560a2428f8f0 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.604+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24296bf0 con 0x7f902400f070 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.605+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94601556341936] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.605+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94601556349920] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.605+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.605+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94601556352192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24294a20 con 0x7f902400f070 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.605+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24297490 con 0x560a24286880 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.606+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94601556352192] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.607+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.607+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94601556354784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24297440 con 0x560a24286880 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.607+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24297ea0 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.608+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.608+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94601556359664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24298740 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.608+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242991c0 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.608+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94601556354784] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.608+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94601556359664] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.609+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.609+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94601556364464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242982d0 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.609+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24299850 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94601556364464] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94601556357008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24299850 con 0x560a2428aea0 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 20 add_watcher() i=0 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 20 add_watcher() i=1 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 20 add_watcher() i=2 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 20 add_watcher() i=3 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 20 add_watcher() i=4 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 20 add_watcher() i=5 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.610+0000 7f9032c98800 20 add_watcher() i=6 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.611+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94601556357008] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.611+0000 7f9032c98800 20 add_watcher() i=7 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.611+0000 7f9032c98800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.611+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a2429ca30 con 0x560a24286880 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.611+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.611+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94601556366240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24299c70 con 0x560a24286880 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94601556366240] v32'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f8ee67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f9032c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f9032c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f9032c98800 5 note: GC not initialized 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f8ee57e2640 20 reqs_thread_entry: start 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f9032c98800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.612+0000 7f9032c98800 20 Filter name: none 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.613+0000 7f8e56ffd640 20 reqs_thread_entry: start 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.613+0000 7f9032c98800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.613+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a242cfcb0 con 0x560a24286880 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.613+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.613+0000 7f9032c98800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.613+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a242d1200 con 0x560a2428aea0 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.614+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.614+0000 7f8ee67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.614+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94601556366240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a2429c050 con 0x560a24286880 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.615+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94601556366240] v32'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.615+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94601556343664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242993a0 con 0x7f902400f070 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.616+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94601556343664] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.616+0000 7f9032c98800 20 remove_watcher() i=0 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.616+0000 7f9032c98800 2 removed watcher, disabling cache 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.616+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94601556341936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242993a0 con 0x560a24286880 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.618+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94601556341936] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.618+0000 7f9032c98800 20 remove_watcher() i=1 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.618+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94601556349920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242934b0 con 0x560a2428f8f0 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.619+0000 7f902ff9d640 1 -- 172.21.15.170:0/2368302687 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94601556349920] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9024037040 con 0x560a2428f8f0 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.619+0000 7f9032c98800 20 remove_watcher() i=2 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.619+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94601556352192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242993a0 con 0x7f902400f070 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.620+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94601556352192] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x7f902400f070 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.620+0000 7f9032c98800 20 remove_watcher() i=3 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.620+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94601556354784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24295cc0 con 0x560a24286880 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.621+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94601556354784] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9028026040 con 0x560a24286880 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.621+0000 7f9032c98800 20 remove_watcher() i=4 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.621+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94601556359664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242993a0 con 0x560a2428aea0 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.622+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94601556359664] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.622+0000 7f9032c98800 20 remove_watcher() i=5 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.622+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94601556364464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a242966e0 con 0x560a2428aea0 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.623+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94601556364464] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.623+0000 7f9032c98800 20 remove_watcher() i=6 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.623+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94601556357008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a24295cc0 con 0x560a2428aea0 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f903079e640 1 -- 172.21.15.170:0/2368302687 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94601556357008] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90200b4030 con 0x560a2428aea0 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 20 remove_watcher() i=7 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2428aea0 msgr2=0x560a2428d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2428aea0 0x560a2428d290 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a24286880 msgr2=0x560a24288d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a24286880 0x560a24288d20 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f902400f070 msgr2=0x7f902402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f902400f070 0x7f902402e910 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560a2428f8f0 msgr2=0x560a24291db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560a2428f8f0 0x560a24291db0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f00036900 msgr2=0x7f8f00038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f00036900 0x7f8f00038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560a24254920 tx=0x7f9024010000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 msgr2=0x560a2427b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9030f9f640 1 -- 172.21.15.170:0/2368302687 reap_dead start 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a2427b270 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9020066010 tx=0x7f9020078f90 comp rx=0 tx=0).stop 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 shutdown_connections 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 --2- 172.21.15.170:0/2368302687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24273ec0 0x560a2427b270 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 >> 172.21.15.170:0/2368302687 conn(0x560a242701d0 msgr2=0x560a2426d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 shutdown_connections 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.624+0000 7f9032c98800 1 -- 172.21.15.170:0/2368302687 wait complete. 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f08036950 msgr2=0x7f8f08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f08036950 0x7f8f08038e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x560a2424bfc0 tx=0x7f902400f000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24266de0 msgr2=0x560a24267200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24266de0 0x560a24267200 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f902008ca40 tx=0x7f9020068ab0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 shutdown_connections 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f08036950 0x7f8f08038e10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/938037120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a24266de0 0x560a24267200 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 >> 172.21.15.170:0/938037120 conn(0x560a24256a70 msgr2=0x560a24256e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 shutdown_connections 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/938037120 wait complete. 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2424da10 msgr2=0x560a2424fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560a2424da10 0x560a2424fe00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a2414d640 msgr2=0x560a2424b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560a2414d640 0x560a2424b1e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560a24251950 msgr2=0x560a24253dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560a24251950 0x560a24253dc0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f18036900 msgr2=0x7f8f18038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8f18036900 0x7f8f18038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9024000f60 tx=0x7f9024001370 comp rx=0 tx=0).stop 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 msgr2=0x560a24244170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 --2- 172.21.15.170:0/3826475260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560a2414c3e0 0x560a24244170 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f902005f040 tx=0x7f9020003330 comp rx=0 tx=0).stop 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9030f9f640 1 -- 172.21.15.170:0/3826475260 reap_dead start 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 shutdown_connections 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 >> 172.21.15.170:0/3826475260 conn(0x560a241479e0 msgr2=0x560a2423b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 shutdown_connections 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.625+0000 7f9032c98800 1 -- 172.21.15.170:0/3826475260 wait complete. 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-26T12:31:30.640 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-26T12:31:30.640 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-26T12:31:30.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-26T12:31:30.640 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-26T12:31:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:30.725 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:30.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.724+0000 7f052c3a2800 1 Processor -- start 2024-04-26T12:31:30.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f052c3a2800 1 -- start start 2024-04-26T12:31:30.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f052c3a2800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564b8f542890 0x564b8f544c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f052c3a2800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b8f3ec0c0 con 0x564b8f53e400 2024-04-26T12:31:30.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f052c3a2800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x564b8f3d04d0 con 0x564b8f542890 2024-04-26T12:31:30.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f05216a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564b8f542890 0x564b8f544c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f05216a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564b8f542890 0x564b8f544c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34316/0 (socket says 172.21.15.170:34316) 2024-04-26T12:31:30.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f05216a7640 1 -- 172.21.15.170:0/2595689629 learned_addr learned my addr 172.21.15.170:0/2595689629 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f0529ea8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x564b8f53e400 0x564b8f53e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52218/0 (socket says 172.21.15.170:52218) 2024-04-26T12:31:30.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f05216a7640 1 -- 172.21.15.170:0/2595689629 >> v1:172.21.15.132:6789/0 conn(0x564b8f53e400 legacy=0x564b8f53e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.725+0000 7f05216a7640 1 -- 172.21.15.170:0/2595689629 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f3fdd40 con 0x564b8f542890 2024-04-26T12:31:30.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.727+0000 7f05216a7640 1 --2- 172.21.15.170:0/2595689629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f542890 0x564b8f544c80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f051400a520 tx=0x7f051401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60190d8899603ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f05296a7640 1 -- 172.21.15.170:0/2595689629 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0514057070 con 0x564b8f542890 2024-04-26T12:31:30.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f05296a7640 1 -- 172.21.15.170:0/2595689629 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0514052570 con 0x564b8f542890 2024-04-26T12:31:30.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f05296a7640 1 -- 172.21.15.170:0/2595689629 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051404ae60 con 0x564b8f542890 2024-04-26T12:31:30.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f052c3a2800 1 -- 172.21.15.170:0/2595689629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f542890 msgr2=0x564b8f544c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f052c3a2800 1 --2- 172.21.15.170:0/2595689629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f542890 0x564b8f544c80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f051400a520 tx=0x7f051401d010 comp rx=0 tx=0).stop 2024-04-26T12:31:30.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f052c3a2800 1 -- 172.21.15.170:0/2595689629 shutdown_connections 2024-04-26T12:31:30.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f052c3a2800 1 --2- 172.21.15.170:0/2595689629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f542890 0x564b8f544c80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f052c3a2800 1 -- 172.21.15.170:0/2595689629 >> 172.21.15.170:0/2595689629 conn(0x564b8f539a00 msgr2=0x564b8f53be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f052c3a2800 1 -- 172.21.15.170:0/2595689629 shutdown_connections 2024-04-26T12:31:30.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.728+0000 7f052c3a2800 1 -- 172.21.15.170:0/2595689629 wait complete. 2024-04-26T12:31:30.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f052c3a2800 1 Processor -- start 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f052c3a2800 1 -- start start 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f052c3a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f4b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f052c3a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b8f48ab70 con 0x564b8f53e400 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f4b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f4b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34326/0 (socket says 172.21.15.170:34326) 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f0529ea8640 1 -- 172.21.15.170:0/2420627938 learned_addr learned my addr 172.21.15.170:0/2420627938 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.740+0000 7f0529ea8640 1 -- 172.21.15.170:0/2420627938 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f3fc590 con 0x564b8f53e400 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.741+0000 7f0529ea8640 1 --2- 172.21.15.170:0/2420627938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f4b2670 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f051c00b230 tx=0x7f051c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d194ecdaca43efc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.741+0000 7f0417e07640 1 -- 172.21.15.170:0/2420627938 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c00e5c0 con 0x564b8f53e400 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.741+0000 7f0417e07640 1 -- 172.21.15.170:0/2420627938 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051c006070 con 0x564b8f53e400 2024-04-26T12:31:30.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.741+0000 7f0417e07640 1 -- 172.21.15.170:0/2420627938 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c00e890 con 0x564b8f53e400 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.741+0000 7f052c3a2800 1 -- 172.21.15.170:0/2420627938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 msgr2=0x564b8f4b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 --2- 172.21.15.170:0/2420627938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f4b2670 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f051c00b230 tx=0x7f051c00b6f0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 -- 172.21.15.170:0/2420627938 shutdown_connections 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 --2- 172.21.15.170:0/2420627938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f4b2670 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 -- 172.21.15.170:0/2420627938 >> 172.21.15.170:0/2420627938 conn(0x564b8f539a00 msgr2=0x564b8f62afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 -- 172.21.15.170:0/2420627938 shutdown_connections 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 -- 172.21.15.170:0/2420627938 wait complete. 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 Processor -- start 2024-04-26T12:31:30.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 -- start start 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f630e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f052c3a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b8f545550 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f630e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f630e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34342/0 (socket says 172.21.15.170:34342) 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.742+0000 7f0529ea8640 1 -- 172.21.15.170:0/3688414108 learned_addr learned my addr 172.21.15.170:0/3688414108 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.743+0000 7f0529ea8640 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f3f38f0 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.743+0000 7f0529ea8640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f630e20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f051c000c00 tx=0x7f051c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.743+0000 7f0416604640 1 -- 172.21.15.170:0/3688414108 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c00f8d0 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.743+0000 7f0416604640 1 -- 172.21.15.170:0/3688414108 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051c00fa90 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.743+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8f62f510 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.743+0000 7f0416604640 1 -- 172.21.15.170:0/3688414108 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c00fdb0 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.743+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8f62fa30 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f0416604640 1 -- 172.21.15.170:0/3688414108 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f051c017070 con 0x564b8f53e400 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f0416604640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0410036900 0x7f0410038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f0416604640 1 -- 172.21.15.170:0/3688414108 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f051c015020 con 0x564b8f53e400 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f05216a7640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0410036900 0x7f0410038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f542890 0x564b8f641540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f641a80 con 0x564b8f542890 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f052a6a9640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f542890 0x564b8f641540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f05216a7640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0410036900 0x7f0410038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0514054000 tx=0x7f051404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.744+0000 7f052a6a9640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f542890 0x564b8f641540 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.745+0000 7f052a6a9640 1 -- 172.21.15.170:0/3688414108 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f542890 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.745+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6422d0 con 0x564b8f542890 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.745+0000 7f052a6a9640 1 -- 172.21.15.170:0/3688414108 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f542890 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.745+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f643c20 0x564b8f6460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.745+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f646840 con 0x564b8f643c20 2024-04-26T12:31:30.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.745+0000 7f0529ea8640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f643c20 0x564b8f6460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.746+0000 7f0529ea8640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f643c20 0x564b8f6460b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.746+0000 7f0529ea8640 1 -- 172.21.15.170:0/3688414108 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f051c02e070 con 0x564b8f643c20 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.746+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f642b20 con 0x564b8f542890 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.746+0000 7f052a6a9640 1 -- 172.21.15.170:0/3688414108 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f542890 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.746+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b8f647ca0 0x564b8f64a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.746+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f64a870 con 0x564b8f647ca0 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.747+0000 7f05216a7640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b8f647ca0 0x564b8f64a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.747+0000 7f05216a7640 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b8f647ca0 0x564b8f64a110 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.747+0000 7f05216a7640 1 -- 172.21.15.170:0/3688414108 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f051405a040 con 0x564b8f647ca0 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.747+0000 7f052c3a2800 1 Processor -- start 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.747+0000 7f052c3a2800 1 -- start start 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f052c3a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f658cd0 0x564b8f6590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f052c3a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b8f631360 con 0x564b8f658cd0 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f658cd0 0x564b8f6590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f658cd0 0x564b8f6590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34346/0 (socket says 172.21.15.170:34346) 2024-04-26T12:31:30.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f0529ea8640 1 -- 172.21.15.170:0/375399111 learned_addr learned my addr 172.21.15.170:0/375399111 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f0529ea8640 1 -- 172.21.15.170:0/375399111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f659630 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f0529ea8640 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f658cd0 0x564b8f6590f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f051c00ff70 tx=0x7f051c041db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f040f7fe640 1 -- 172.21.15.170:0/375399111 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c01a7c0 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f040f7fe640 1 -- 172.21.15.170:0/375399111 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051c01a960 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8f65a0a0 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f040f7fe640 1 -- 172.21.15.170:0/375399111 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c044c80 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.748+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8f65a5a0 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.749+0000 7f040f7fe640 1 -- 172.21.15.170:0/375399111 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f051c044e20 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.749+0000 7f040f7fe640 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0404036950 0x7f0404038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.749+0000 7f040f7fe640 1 -- 172.21.15.170:0/375399111 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f051c04f540 con 0x564b8f658cd0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.749+0000 7f05216a7640 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0404036950 0x7f0404038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.749+0000 7f052c3a2800 1 Processor -- start 2024-04-26T12:31:30.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f052c3a2800 1 -- start start 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f052c3a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f666260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f05216a7640 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0404036950 0x7f0404038e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x564b8f62fe20 tx=0x7f0514005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f052c3a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b8f430e60 con 0x564b8f665e80 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f666260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f666260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34354/0 (socket says 172.21.15.170:34354) 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f0529ea8640 1 -- 172.21.15.170:0/850435423 learned_addr learned my addr 172.21.15.170:0/850435423 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f0529ea8640 1 -- 172.21.15.170:0/850435423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f666830 con 0x564b8f665e80 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f0529ea8640 1 --2- 172.21.15.170:0/850435423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f666260 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f051c0197f0 tx=0x7f051c027a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7535b8b85f4983e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f040d7fa640 1 -- 172.21.15.170:0/850435423 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c05f070 con 0x564b8f665e80 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f040d7fa640 1 -- 172.21.15.170:0/850435423 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051c0277f0 con 0x564b8f665e80 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.750+0000 7f040d7fa640 1 -- 172.21.15.170:0/850435423 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c0444b0 con 0x564b8f665e80 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 -- 172.21.15.170:0/850435423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 msgr2=0x564b8f666260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 --2- 172.21.15.170:0/850435423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f666260 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f051c0197f0 tx=0x7f051c027a50 comp rx=0 tx=0).stop 2024-04-26T12:31:30.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 -- 172.21.15.170:0/850435423 shutdown_connections 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 --2- 172.21.15.170:0/850435423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f666260 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 -- 172.21.15.170:0/850435423 >> 172.21.15.170:0/850435423 conn(0x564b8f662150 msgr2=0x564b8f6601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 -- 172.21.15.170:0/850435423 shutdown_connections 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 -- 172.21.15.170:0/850435423 wait complete. 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 Processor -- start 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 -- start start 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f66d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.751+0000 7f052c3a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564b8f666dc0 con 0x564b8f665e80 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f66d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f0529ea8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f66d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34368/0 (socket says 172.21.15.170:34368) 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 learned_addr learned my addr 172.21.15.170:0/808296352 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8f66d600 con 0x564b8f665e80 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f0529ea8640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f66d0c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f051c003fb0 tx=0x7f051c04f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f03fb7fe640 1 -- 172.21.15.170:0/808296352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c069070 con 0x564b8f665e80 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f03fb7fe640 1 -- 172.21.15.170:0/808296352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f051c04e400 con 0x564b8f665e80 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8f66d600 con 0x564b8f665e80 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8f66d600 con 0x564b8f665e80 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.752+0000 7f03fb7fe640 1 -- 172.21.15.170:0/808296352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f051c05f040 con 0x564b8f665e80 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.753+0000 7f03fb7fe640 1 -- 172.21.15.170:0/808296352 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f051c06c070 con 0x564b8f665e80 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.753+0000 7f03fb7fe640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03f40369a0 0x7f03f4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.753+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.753+0000 7f03fb7fe640 1 -- 172.21.15.170:0/808296352 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f051c055640 con 0x564b8f665e80 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.753+0000 7f05216a7640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03f40369a0 0x7f03f4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f6786d0 0x564b8f67ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67b2c0 con 0x564b8f6786d0 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052a6a9640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f6786d0 0x564b8f67ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f05216a7640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03f40369a0 0x7f03f4038e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0514000c00 tx=0x7f051404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052a6a9640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f6786d0 0x564b8f67ab70 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 20 realm 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67b6d0 con 0x564b8f6786d0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.754+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67bf70 con 0x564b8f6786d0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f6786d0 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052c3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f67d070 0x564b8f67f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67f9a0 con 0x564b8f67d070 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f0529ea8640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f67d070 0x564b8f67f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.755+0000 7f0529ea8640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f67d070 0x564b8f67f460 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f052c3a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f052c3a2800 20 searching for the correct realm 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b8f681a20 0x564b8f683ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6845b0 con 0x564b8f681a20 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f05216a7640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b8f681a20 0x564b8f683ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f05216a7640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b8f681a20 0x564b8f683ee0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.756+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f05216a7640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0514074040 0x7f0514081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6845b0 con 0x7f0514074040 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f052a6a9640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0514074040 0x7f0514081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f052a6a9640 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0514074040 0x7f0514081410 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f052400a4a0 con 0x7f0514074040 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f67d070 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.757+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f6786d0 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f6786d0 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f67d070 2024-04-26T12:31:30.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f67d070 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.758+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x7f0514074040 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f052400a4a0 con 0x7f0514074040 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f681a20 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f6786d0 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x7f0514074040 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f052400a4a0 con 0x7f0514074040 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f6786d0 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f052400a4a0 con 0x564b8f6786d0 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.759+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x7f0514074040 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.760+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.760+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b8f67c310 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.760+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.760+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.760+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.760+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f67d070 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f6786d0 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.761+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f6786d0 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f67d070 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f681a20 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x7f0514074040 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.762+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f6786d0 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.763+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.763+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f67d070 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.763+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.763+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f681a20 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.763+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.763+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f67d070 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x7f0514074040 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f681a20 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f67d070 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.764+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x564b8f6786d0 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f051408e040 con 0x7f0514074040 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f680320 con 0x564b8f6786d0 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f680320 con 0x564b8f6786d0 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.765+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6802f0 con 0x7f0514074040 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 zone default found 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 4 Realm: () 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 zonegroup default 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f680710 con 0x564b8f67d070 2024-04-26T12:31:30.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f686410 con 0x564b8f681a20 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f680320 con 0x564b8f681a20 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.766+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.767+0000 7f052c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.767+0000 7f052c3a2800 20 started sync module instance, tier type = 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.767+0000 7f052c3a2800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.767+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6858b0 con 0x7f0514074040 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.767+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.768+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882528517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6858b0 con 0x7f0514074040 2024-04-26T12:31:30.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.768+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f686dd0 con 0x564b8f6786d0 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.769+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.769+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882528517552] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.769+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882528520480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f686d80 con 0x564b8f6786d0 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.769+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f685420 con 0x564b8f681a20 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.770+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882528520480] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.770+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.770+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882528522688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f687d40 con 0x564b8f681a20 2024-04-26T12:31:30.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.770+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f688700 con 0x7f0514074040 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.771+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.771+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882528527408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f688e60 con 0x7f0514074040 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.771+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f689980 con 0x564b8f6786d0 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.771+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882528522688] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.772+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882528527408] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.772+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.772+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882528531536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f689940 con 0x564b8f6786d0 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.772+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68a220 con 0x564b8f67d070 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.773+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.773+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882528533872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68aa70 con 0x564b8f67d070 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.773+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68b2c0 con 0x564b8f67d070 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.773+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882528531536] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.774+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.774+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882528524432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68bb10 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.774+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68bb10 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.774+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882528533872] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882528524432] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882528540256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68bf30 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 20 add_watcher() i=0 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 20 add_watcher() i=1 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 20 add_watcher() i=2 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 20 add_watcher() i=3 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 20 add_watcher() i=4 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 20 add_watcher() i=5 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.775+0000 7f052c3a2800 20 add_watcher() i=6 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.776+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882528540256] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.776+0000 7f052c3a2800 20 add_watcher() i=7 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.776+0000 7f052c3a2800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.776+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68f1a0 con 0x564b8f6786d0 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.777+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.777+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882528541680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68c4c0 con 0x564b8f6786d0 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.777+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882528541680] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f03db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052c3a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052c3a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052c3a2800 5 note: GC not initialized 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f03da7fc640 20 reqs_thread_entry: start 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052c3a2800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052c3a2800 20 Filter name: none 2024-04-26T12:31:30.796 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f034bfff640 20 reqs_thread_entry: start 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052c3a2800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6c2440 con 0x564b8f6786d0 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.778+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.779+0000 7f052c3a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.779+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6c3990 con 0x564b8f67d070 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.779+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.780+0000 7f03db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.780+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882528541680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68e920 con 0x564b8f6786d0 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.781+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94882528541680] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.781+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882528517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68bbf0 con 0x7f0514074040 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.782+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94882528517552] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.782+0000 7f052c3a2800 20 remove_watcher() i=0 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.782+0000 7f052c3a2800 2 removed watcher, disabling cache 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.782+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882528520480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f68bbf0 con 0x564b8f6786d0 2024-04-26T12:31:30.797 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.783+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94882528520480] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.783+0000 7f052c3a2800 20 remove_watcher() i=1 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.783+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882528522688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f686920 con 0x564b8f681a20 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.784+0000 7f05216a7640 1 -- 172.21.15.170:0/808296352 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94882528522688] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051407f070 con 0x564b8f681a20 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.784+0000 7f052c3a2800 20 remove_watcher() i=2 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.784+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882528527408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6871c0 con 0x7f0514074040 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.785+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94882528527408] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x7f0514074040 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.785+0000 7f052c3a2800 20 remove_watcher() i=3 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.785+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882528531536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f688430 con 0x564b8f6786d0 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.786+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94882528531536] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0524033040 con 0x564b8f6786d0 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.786+0000 7f052c3a2800 20 remove_watcher() i=4 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.786+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882528533872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f6871c0 con 0x564b8f67d070 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.787+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94882528533872] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.787+0000 7f052c3a2800 20 remove_watcher() i=5 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.787+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882528524432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f688430 con 0x564b8f67d070 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.788+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94882528524432] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.788+0000 7f052c3a2800 20 remove_watcher() i=6 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.788+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882528540256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b8f688430 con 0x564b8f67d070 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f0529ea8640 1 -- 172.21.15.170:0/808296352 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94882528540256] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f051c06b030 con 0x564b8f67d070 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 20 remove_watcher() i=7 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f67d070 msgr2=0x564b8f67f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f67d070 0x564b8f67f460 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f6786d0 msgr2=0x564b8f67ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f6786d0 0x564b8f67ab70 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0514074040 msgr2=0x7f0514081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0514074040 0x7f0514081410 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b8f681a20 msgr2=0x564b8f683ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x564b8f681a20 0x564b8f683ee0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03f40369a0 msgr2=0x7f03f4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f03f40369a0 0x7f03f4038e60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0514000c00 tx=0x7f051404f000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 msgr2=0x564b8f66d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f66d0c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f051c003fb0 tx=0x7f051c04f210 comp rx=0 tx=0).stop 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052a6a9640 1 -- 172.21.15.170:0/808296352 reap_dead start 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 shutdown_connections 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 --2- 172.21.15.170:0/808296352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f665e80 0x564b8f66d0c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 >> 172.21.15.170:0/808296352 conn(0x564b8f662150 msgr2=0x564b8f65f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 shutdown_connections 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.789+0000 7f052c3a2800 1 -- 172.21.15.170:0/808296352 wait complete. 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0404036950 msgr2=0x7f0404038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0404036950 0x7f0404038e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x564b8f62fe20 tx=0x7f0514005ac0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f658cd0 msgr2=0x564b8f6590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f658cd0 0x564b8f6590f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f051c00ff70 tx=0x7f051c041db0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 shutdown_connections 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0404036950 0x7f0404038e10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/375399111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f658cd0 0x564b8f6590f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 >> 172.21.15.170:0/375399111 conn(0x564b8f64cd70 msgr2=0x564b8f64d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 shutdown_connections 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/375399111 wait complete. 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f643c20 msgr2=0x564b8f6460b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564b8f643c20 0x564b8f6460b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f542890 msgr2=0x564b8f641540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564b8f542890 0x564b8f641540 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b8f647ca0 msgr2=0x564b8f64a110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x564b8f647ca0 0x564b8f64a110 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0410036900 msgr2=0x7f0410038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0410036900 0x7f0410038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0514054000 tx=0x7f051404e000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 msgr2=0x564b8f630e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 --2- 172.21.15.170:0/3688414108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564b8f53e400 0x564b8f630e20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f051c000c00 tx=0x7f051c000ed0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052a6a9640 1 -- 172.21.15.170:0/3688414108 reap_dead start 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 shutdown_connections 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 >> 172.21.15.170:0/3688414108 conn(0x564b8f539a00 msgr2=0x564b8f6297e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 shutdown_connections 2024-04-26T12:31:30.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.790+0000 7f052c3a2800 1 -- 172.21.15.170:0/3688414108 wait complete. 2024-04-26T12:31:30.803 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-04-26T12:31:30.803 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-04-26T12:31:30.804 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-26T12:31:30.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-26T12:31:30.804 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-26T12:31:30.848 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:30.848 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.848+0000 7f7d23133800 1 Processor -- start 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.848+0000 7f7d23133800 1 -- start start 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d23133800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b19ee18890 0x55b19ee1ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d23133800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b19ecc20c0 con 0x55b19ee14400 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d23133800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55b19eca64d0 con 0x55b19ee18890 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d1e5f4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b19ee18890 0x55b19ee1ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d1edf5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55b19ee14400 0x55b19ee14820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52220/0 (socket says 172.21.15.170:52220) 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d1edf5640 1 -- 172.21.15.170:0/1832756662 learned_addr learned my addr 172.21.15.170:0/1832756662 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:30.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/1832756662 >> v1:172.21.15.132:6789/0 conn(0x55b19ee14400 legacy=0x55b19ee14820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.849+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/1832756662 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19ecd3d40 con 0x55b19ee18890 2024-04-26T12:31:30.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.851+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/1832756662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee18890 0x55b19ee1ac80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a470 tx=0x7f7d1401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb46e4af6987bd1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.851+0000 7f7d1ddf3640 1 -- 172.21.15.170:0/1832756662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d14057070 con 0x55b19ee18890 2024-04-26T12:31:30.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.851+0000 7f7d1ddf3640 1 -- 172.21.15.170:0/1832756662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d14052570 con 0x55b19ee18890 2024-04-26T12:31:30.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.851+0000 7f7d1ddf3640 1 -- 172.21.15.170:0/1832756662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d14052870 con 0x55b19ee18890 2024-04-26T12:31:30.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.852+0000 7f7d23133800 1 -- 172.21.15.170:0/1832756662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee18890 msgr2=0x55b19ee1ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.852+0000 7f7d23133800 1 --2- 172.21.15.170:0/1832756662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee18890 0x55b19ee1ac80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a470 tx=0x7f7d1401ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:30.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.852+0000 7f7d23133800 1 -- 172.21.15.170:0/1832756662 shutdown_connections 2024-04-26T12:31:30.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.852+0000 7f7d23133800 1 --2- 172.21.15.170:0/1832756662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee18890 0x55b19ee1ac80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.852+0000 7f7d23133800 1 -- 172.21.15.170:0/1832756662 >> 172.21.15.170:0/1832756662 conn(0x55b19ee0fa00 msgr2=0x55b19ee11e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.852+0000 7f7d23133800 1 -- 172.21.15.170:0/1832756662 shutdown_connections 2024-04-26T12:31:30.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.852+0000 7f7d23133800 1 -- 172.21.15.170:0/1832756662 wait complete. 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.863+0000 7f7d23133800 1 Processor -- start 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.863+0000 7f7d23133800 1 -- start start 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.864+0000 7f7d23133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ed88670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.864+0000 7f7d23133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b19ed60b70 con 0x55b19ee14400 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.864+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ed88670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.864+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ed88670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34386/0 (socket says 172.21.15.170:34386) 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.864+0000 7f7d1edf5640 1 -- 172.21.15.170:0/2866496416 learned_addr learned my addr 172.21.15.170:0/2866496416 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.864+0000 7f7d1edf5640 1 -- 172.21.15.170:0/2866496416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19ecd2590 con 0x55b19ee14400 2024-04-26T12:31:30.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.864+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/2866496416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ed88670 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001e10 tx=0x7f7d1000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b72bbd8e5858fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7c0ce09640 1 -- 172.21.15.170:0/2866496416 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d10012020 con 0x55b19ee14400 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7c0ce09640 1 -- 172.21.15.170:0/2866496416 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1000e5a0 con 0x55b19ee14400 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7c0ce09640 1 -- 172.21.15.170:0/2866496416 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1000e8e0 con 0x55b19ee14400 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7d23133800 1 -- 172.21.15.170:0/2866496416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 msgr2=0x55b19ed88670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7d23133800 1 --2- 172.21.15.170:0/2866496416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ed88670 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001e10 tx=0x7f7d1000b780 comp rx=0 tx=0).stop 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7d23133800 1 -- 172.21.15.170:0/2866496416 shutdown_connections 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7d23133800 1 --2- 172.21.15.170:0/2866496416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ed88670 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7d23133800 1 -- 172.21.15.170:0/2866496416 >> 172.21.15.170:0/2866496416 conn(0x55b19ee0fa00 msgr2=0x55b19ef00fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7d23133800 1 -- 172.21.15.170:0/2866496416 shutdown_connections 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.865+0000 7f7d23133800 1 -- 172.21.15.170:0/2866496416 wait complete. 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d23133800 1 Processor -- start 2024-04-26T12:31:30.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d23133800 1 -- start start 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d23133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ef10310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d23133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b19ee1b550 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ef10310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ef10310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34392/0 (socket says 172.21.15.170:34392) 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d1edf5640 1 -- 172.21.15.170:0/1392660695 learned_addr learned my addr 172.21.15.170:0/1392660695 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d1edf5640 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19ecc98f0 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ef10310 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001e10 tx=0x7f7d10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.866+0000 7f7c0b606640 1 -- 172.21.15.170:0/1392660695 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d10012030 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.867+0000 7f7c0b606640 1 -- 172.21.15.170:0/1392660695 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1001a7a0 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.867+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b19ef10850 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.867+0000 7f7c0b606640 1 -- 172.21.15.170:0/1392660695 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1001aac0 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.867+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19ef10d70 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.867+0000 7f7c0b606640 1 -- 172.21.15.170:0/1392660695 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7d10015020 con 0x55b19ee14400 2024-04-26T12:31:30.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.867+0000 7f7c0b606640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7c04036950 0x7f7c04038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7c0b606640 1 -- 172.21.15.170:0/1392660695 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f7d10020030 con 0x55b19ee14400 2024-04-26T12:31:30.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7c04036950 0x7f7c04038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ee18890 0x55b19ef17380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef178c0 con 0x55b19ee18890 2024-04-26T12:31:30.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d1f5f6640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ee18890 0x55b19ef17380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7c04036950 0x7f7c04038e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d14054000 tx=0x7f7d1404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d1f5f6640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ee18890 0x55b19ef17380 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/1392660695 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ee18890 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.868+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef14950 con 0x55b19ee18890 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.869+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/1392660695 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ee18890 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.869+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef19bd0 0x55b19ef1bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.869+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef1c6b0 con 0x55b19ef19bd0 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.869+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef19bd0 0x55b19ef1bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.869+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef19bd0 0x55b19ef1bfc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.869+0000 7f7d1edf5640 1 -- 172.21.15.170:0/1392660695 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef19bd0 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.870+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef18b80 con 0x55b19ee18890 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.870+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/1392660695 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ee18890 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.870+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b19ef1db10 0x55b19ef1ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.870+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef20730 con 0x55b19ef1db10 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.870+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b19ef1db10 0x55b19ef1ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.870+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b19ef1db10 0x55b19ef1ffa0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.870+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/1392660695 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d14052940 con 0x55b19ef1db10 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.871+0000 7f7d23133800 1 Processor -- start 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.871+0000 7f7d23133800 1 -- start start 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.871+0000 7f7d23133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef2eb90 0x55b19ef2efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.871+0000 7f7d23133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b19ed06e60 con 0x55b19ef2eb90 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.871+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef2eb90 0x55b19ef2efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.871+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef2eb90 0x55b19ef2efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34394/0 (socket says 172.21.15.170:34394) 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.871+0000 7f7d1edf5640 1 -- 172.21.15.170:0/3383058530 learned_addr learned my addr 172.21.15.170:0/3383058530 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.872+0000 7f7d1edf5640 1 -- 172.21.15.170:0/3383058530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19ef2f4f0 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.872+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef2eb90 0x55b19ef2efb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7d1001a6f0 tx=0x7f7d10017e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.872+0000 7f7c08e01640 1 -- 172.21.15.170:0/3383058530 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d10042040 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.872+0000 7f7c08e01640 1 -- 172.21.15.170:0/3383058530 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d10045b20 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.872+0000 7f7c08e01640 1 -- 172.21.15.170:0/3383058530 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d10045e40 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.872+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b19ef2ff60 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.872+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19ef30460 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7c08e01640 1 -- 172.21.15.170:0/3383058530 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7d1004ca10 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7c08e01640 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7bf8036860 0x7f7bf8038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7c08e01640 1 -- 172.21.15.170:0/3383058530 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f7d10037d80 con 0x55b19ef2eb90 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7bf8036860 0x7f7bf8038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d23133800 1 Processor -- start 2024-04-26T12:31:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d23133800 1 -- start start 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7bf8036860 0x7f7bf8038d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55b19ef18180 tx=0x7f7d14005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d23133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef3c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d23133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b19ef0b8f0 con 0x55b19ef3bc90 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef3c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef3c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34398/0 (socket says 172.21.15.170:34398) 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.873+0000 7f7d1edf5640 1 -- 172.21.15.170:0/3313318579 learned_addr learned my addr 172.21.15.170:0/3313318579 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d1edf5640 1 -- 172.21.15.170:0/3313318579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19ef3c680 con 0x55b19ef3bc90 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/3313318579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef3c0b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001620 tx=0x7f7d1002d3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f78b5bb3e0cd40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7c027fc640 1 -- 172.21.15.170:0/3313318579 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1005c070 con 0x55b19ef3bc90 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7c027fc640 1 -- 172.21.15.170:0/3313318579 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d100447c0 con 0x55b19ef3bc90 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7c027fc640 1 -- 172.21.15.170:0/3313318579 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1003b070 con 0x55b19ef3bc90 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d23133800 1 -- 172.21.15.170:0/3313318579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 msgr2=0x55b19ef3c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d23133800 1 --2- 172.21.15.170:0/3313318579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef3c0b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001620 tx=0x7f7d1002d3f0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d23133800 1 -- 172.21.15.170:0/3313318579 shutdown_connections 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d23133800 1 --2- 172.21.15.170:0/3313318579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef3c0b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d23133800 1 -- 172.21.15.170:0/3313318579 >> 172.21.15.170:0/3313318579 conn(0x55b19ef37ff0 msgr2=0x55b19ef36050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d23133800 1 -- 172.21.15.170:0/3313318579 shutdown_connections 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.874+0000 7f7d23133800 1 -- 172.21.15.170:0/3313318579 wait complete. 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d23133800 1 Processor -- start 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d23133800 1 -- start start 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d23133800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef43070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d23133800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b19ef3cd30 con 0x55b19ef3bc90 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef43070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d1edf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef43070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34406/0 (socket says 172.21.15.170:34406) 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 learned_addr learned my addr 172.21.15.170:0/329142003 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19ef435b0 con 0x55b19ef3bc90 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.875+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef43070 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7d10049a20 tx=0x7f7d100252c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.876+0000 7f7c00ff9640 1 -- 172.21.15.170:0/329142003 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d10067020 con 0x55b19ef3bc90 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.876+0000 7f7c00ff9640 1 -- 172.21.15.170:0/329142003 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1005d040 con 0x55b19ef3bc90 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.876+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b19ef435b0 con 0x55b19ef3bc90 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.876+0000 7f7c00ff9640 1 -- 172.21.15.170:0/329142003 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1005c070 con 0x55b19ef3bc90 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.876+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19ef435b0 con 0x55b19ef3bc90 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.876+0000 7f7c00ff9640 1 -- 172.21.15.170:0/329142003 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7d1006a020 con 0x55b19ef3bc90 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7c00ff9640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7be8036900 0x7f7be8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7c00ff9640 1 -- 172.21.15.170:0/329142003 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f7d1006dd10 con 0x55b19ef3bc90 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7be8036900 0x7f7be8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ef4e7f0 0x55b19ef50cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef51400 con 0x55b19ef4e7f0 2024-04-26T12:31:30.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d1f5f6640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ef4e7f0 0x55b19ef50cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7be8036900 0x7f7be8038dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d14052fd0 tx=0x7f7d1404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d1f5f6640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ef4e7f0 0x55b19ef50cb0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d23133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d23133800 20 realm 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.877+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef51810 con 0x55b19ef4e7f0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef520b0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef4e7f0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef531b0 0x55b19ef555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef55b20 con 0x55b19ef531b0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.878+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef531b0 0x55b19ef555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d1edf5640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef531b0 0x55b19ef555a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d23133800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d23133800 20 searching for the correct realm 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b19ef57b70 0x55b19ef5a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5a700 con 0x55b19ef57b70 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b19ef57b70 0x55b19ef5a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.879+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b19ef57b70 0x55b19ef5a030 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.880+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.880+0000 7f7d1e5f4640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7d14076040 0x7f7d14083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.880+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5a700 con 0x7f7d14076040 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.880+0000 7f7d1f5f6640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7d14076040 0x7f7d14083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.880+0000 7f7d1f5f6640 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7d14076040 0x7f7d14083410 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.880+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d1800a4a0 con 0x7f7d14076040 2024-04-26T12:31:30.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.880+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef531b0 2024-04-26T12:31:30.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.881+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.881+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef4e7f0 2024-04-26T12:31:30.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.881+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.881+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef4e7f0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.881+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.881+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef531b0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef531b0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x7f7d14076040 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1800a4a0 con 0x7f7d14076040 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef57b70 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef4e7f0 2024-04-26T12:31:30.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.882+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x7f7d14076040 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1800a4a0 con 0x7f7d14076040 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef4e7f0 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1800a4a0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x7f7d14076040 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef52450 con 0x55b19ef57b70 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.883+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef57b70 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef531b0 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef57b70 2024-04-26T12:31:30.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef57b70 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.884+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef531b0 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef57b70 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.885+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x7f7d14076040 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef531b0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef57b70 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.886+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef531b0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.887+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.887+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x7f7d14076040 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.887+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.887+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef57b70 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.887+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.887+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef531b0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f7d14090040 con 0x7f7d14076040 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.888+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef56470 con 0x55b19ef4e7f0 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef56470 con 0x55b19ef4e7f0 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef56470 con 0x7f7d14076040 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 zone default found 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 4 Realm: () 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 zonegroup default 2024-04-26T12:31:30.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef56860 con 0x55b19ef531b0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.889+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef56470 con 0x55b19ef57b70 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d23133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5c560 con 0x55b19ef57b70 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d23133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d23133800 20 started sync module instance, tier type = 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d23133800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.890+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5ba00 con 0x7f7d14076040 2024-04-26T12:31:30.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.891+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.891+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94221364477744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5ba00 con 0x7f7d14076040 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.891+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5cf80 con 0x55b19ef4e7f0 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.892+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94221364477744] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.892+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.892+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94221364480624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5ba00 con 0x55b19ef4e7f0 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.892+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5da10 con 0x55b19ef57b70 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.893+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94221364480624] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.893+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.893+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94221364475216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5b970 con 0x55b19ef57b70 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.893+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5e8d0 con 0x7f7d14076040 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.894+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94221364475216] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.894+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.895+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94221364487200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5ecf0 con 0x7f7d14076040 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.895+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5f6b0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.895+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.895+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94221364490752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5fad0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.896+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef60550 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.896+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94221364487200] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.896+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94221364490752] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.896+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.897+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94221364488256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5fad0 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.897+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef60e20 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.897+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94221364498880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef61a90 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef62490 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94221364488256] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94221364498880] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94221364491808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef62000 con 0x55b19ef531b0 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 20 add_watcher() i=0 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 20 add_watcher() i=1 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 20 add_watcher() i=2 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 20 add_watcher() i=3 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 20 add_watcher() i=4 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 20 add_watcher() i=5 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.898+0000 7f7d23133800 20 add_watcher() i=6 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.899+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94221364491808] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.899+0000 7f7d23133800 20 add_watcher() i=7 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.899+0000 7f7d23133800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.899+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef65760 con 0x55b19ef4e7f0 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.900+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.900+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94221364499936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef62c20 con 0x55b19ef4e7f0 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94221364499936] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7bd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d23133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d23133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d23133800 5 note: GC not initialized 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7b4ffff640 20 reqs_thread_entry: start 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d23133800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d23133800 20 Filter name: none 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7b4dffb640 20 reqs_thread_entry: start 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d23133800 20 rados->read ofs=0 len=0 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.901+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef98960 con 0x55b19ef4e7f0 2024-04-26T12:31:30.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.902+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.902+0000 7f7d23133800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:31:30.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.902+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef99eb0 con 0x55b19ef531b0 2024-04-26T12:31:30.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.902+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.903+0000 7f7bd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:30.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.903+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94221364499936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef64e90 con 0x55b19ef4e7f0 2024-04-26T12:31:30.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.904+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94221364499936] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.904+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94221364477744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef615e0 con 0x7f7d14076040 2024-04-26T12:31:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.905+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94221364477744] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.905+0000 7f7d23133800 20 remove_watcher() i=0 2024-04-26T12:31:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.905+0000 7f7d23133800 2 removed watcher, disabling cache 2024-04-26T12:31:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.905+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94221364480624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef615e0 con 0x55b19ef4e7f0 2024-04-26T12:31:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.906+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94221364480624] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.906+0000 7f7d23133800 20 remove_watcher() i=1 2024-04-26T12:31:30.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.906+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94221364475216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef615e0 con 0x55b19ef57b70 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.907+0000 7f7d1e5f4640 1 -- 172.21.15.170:0/329142003 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94221364475216] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14081070 con 0x55b19ef57b70 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.907+0000 7f7d23133800 20 remove_watcher() i=2 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.907+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94221364487200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5b550 con 0x7f7d14076040 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.908+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94221364487200] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x7f7d14076040 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.908+0000 7f7d23133800 20 remove_watcher() i=3 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.908+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94221364490752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5b550 con 0x55b19ef4e7f0 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.909+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94221364490752] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d18033040 con 0x55b19ef4e7f0 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.909+0000 7f7d23133800 20 remove_watcher() i=4 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.909+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94221364488256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5f200 con 0x55b19ef531b0 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.910+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94221364488256] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.910+0000 7f7d23133800 20 remove_watcher() i=5 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.910+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94221364498880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef5f200 con 0x55b19ef531b0 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.911+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94221364498880] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.911+0000 7f7d23133800 20 remove_watcher() i=6 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.911+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94221364491808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b19ef611c0 con 0x55b19ef531b0 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d1edf5640 1 -- 172.21.15.170:0/329142003 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94221364491808] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d10018950 con 0x55b19ef531b0 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 20 remove_watcher() i=7 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef531b0 msgr2=0x55b19ef555a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef531b0 0x55b19ef555a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ef4e7f0 msgr2=0x55b19ef50cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ef4e7f0 0x55b19ef50cb0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7d14076040 msgr2=0x7f7d14083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f7d14076040 0x7f7d14083410 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b19ef57b70 msgr2=0x55b19ef5a030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b19ef57b70 0x55b19ef5a030 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7be8036900 msgr2=0x7f7be8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7be8036900 0x7f7be8038dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d14052fd0 tx=0x7f7d1404f000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 msgr2=0x55b19ef43070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 --2- 172.21.15.170:0/329142003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef3bc90 0x55b19ef43070 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7d10049a20 tx=0x7f7d100252c0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 reap_dead start 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/329142003 reap_dead start 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 shutdown_connections 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 >> 172.21.15.170:0/329142003 conn(0x55b19ef37ff0 msgr2=0x55b19ef35650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 shutdown_connections 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.912+0000 7f7d23133800 1 -- 172.21.15.170:0/329142003 wait complete. 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7bf8036860 msgr2=0x7f7bf8038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7bf8036860 0x7f7bf8038d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55b19ef18180 tx=0x7f7d14005a00 comp rx=0 tx=0).stop 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef2eb90 msgr2=0x55b19ef2efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef2eb90 0x55b19ef2efb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7d1001a6f0 tx=0x7f7d10017e80 comp rx=0 tx=0).stop 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 shutdown_connections 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7bf8036860 0x7f7bf8038d20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/3383058530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ef2eb90 0x55b19ef2efb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 >> 172.21.15.170:0/3383058530 conn(0x55b19ef22c30 msgr2=0x55b19ef23030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 shutdown_connections 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/3383058530 wait complete. 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef19bd0 msgr2=0x55b19ef1bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b19ef19bd0 0x55b19ef1bfc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ee18890 msgr2=0x55b19ef17380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b19ee18890 0x55b19ef17380 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b19ef1db10 msgr2=0x55b19ef1ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b19ef1db10 0x55b19ef1ffa0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7c04036950 msgr2=0x7f7c04038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7c04036950 0x7f7c04038e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d14054000 tx=0x7f7d1404e000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 msgr2=0x55b19ef10310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 --2- 172.21.15.170:0/1392660695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b19ee14400 0x55b19ef10310 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7d10001e10 tx=0x7f7d10000ed0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d1f5f6640 1 -- 172.21.15.170:0/1392660695 reap_dead start 2024-04-26T12:31:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 shutdown_connections 2024-04-26T12:31:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 >> 172.21.15.170:0/1392660695 conn(0x55b19ee0fa00 msgr2=0x55b19eeff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 shutdown_connections 2024-04-26T12:31:30.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.913+0000 7f7d23133800 1 -- 172.21.15.170:0/1392660695 wait complete. 2024-04-26T12:31:30.927 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-04-26T12:31:30.928 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-04-26T12:31:30.928 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-26T12:31:30.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-26T12:31:30.928 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-26T12:31:30.972 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:30.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.972+0000 7fcfb3619800 1 Processor -- start 2024-04-26T12:31:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.972+0000 7fcfb3619800 1 -- start start 2024-04-26T12:31:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb3619800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a4325f1140 0x55a4325ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb3619800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4325280c0 con 0x55a4325efc30 2024-04-26T12:31:30.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb3619800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55a43250c4d0 con 0x55a4325f1140 2024-04-26T12:31:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb1118640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a4325f1140 0x55a4325ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb1118640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55a4325f1140 0x55a4325ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34408/0 (socket says 172.21.15.170:34408) 2024-04-26T12:31:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb0917640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55a4325efc30 0x55a432683470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52236/0 (socket says 172.21.15.170:52236) 2024-04-26T12:31:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb1118640 1 -- 172.21.15.170:0/185836936 learned_addr learned my addr 172.21.15.170:0/185836936 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb1118640 1 -- 172.21.15.170:0/185836936 >> v1:172.21.15.132:6789/0 conn(0x55a4325efc30 legacy=0x55a432683470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.973+0000 7fcfb1118640 1 -- 172.21.15.170:0/185836936 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a432539d40 con 0x55a4325f1140 2024-04-26T12:31:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.975+0000 7fcfb1118640 1 --2- 172.21.15.170:0/185836936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325f1140 0x55a4325ef6f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00a520 tx=0x7fcfac01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543e6daecc2d9e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.975+0000 7fcfabfff640 1 -- 172.21.15.170:0/185836936 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac057070 con 0x55a4325f1140 2024-04-26T12:31:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.975+0000 7fcfabfff640 1 -- 172.21.15.170:0/185836936 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac052570 con 0x55a4325f1140 2024-04-26T12:31:30.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.975+0000 7fcfabfff640 1 -- 172.21.15.170:0/185836936 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac04ae60 con 0x55a4325f1140 2024-04-26T12:31:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.976+0000 7fcfb3619800 1 -- 172.21.15.170:0/185836936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325f1140 msgr2=0x55a4325ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.976+0000 7fcfb3619800 1 --2- 172.21.15.170:0/185836936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325f1140 0x55a4325ef6f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00a520 tx=0x7fcfac01d010 comp rx=0 tx=0).stop 2024-04-26T12:31:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.976+0000 7fcfb3619800 1 -- 172.21.15.170:0/185836936 shutdown_connections 2024-04-26T12:31:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.976+0000 7fcfb3619800 1 --2- 172.21.15.170:0/185836936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325f1140 0x55a4325ef6f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.976+0000 7fcfb3619800 1 -- 172.21.15.170:0/185836936 >> 172.21.15.170:0/185836936 conn(0x55a432676ba0 msgr2=0x55a432678fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.976+0000 7fcfb3619800 1 -- 172.21.15.170:0/185836936 shutdown_connections 2024-04-26T12:31:30.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.976+0000 7fcfb3619800 1 -- 172.21.15.170:0/185836936 wait complete. 2024-04-26T12:31:30.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.987+0000 7fcfb3619800 1 Processor -- start 2024-04-26T12:31:30.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.987+0000 7fcfb3619800 1 -- start start 2024-04-26T12:31:30.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.987+0000 7fcfb3619800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a43276eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.987+0000 7fcfb3619800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a4325c6b70 con 0x55a4325efc30 2024-04-26T12:31:30.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.988+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a43276eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.988+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a43276eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34424/0 (socket says 172.21.15.170:34424) 2024-04-26T12:31:30.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.988+0000 7fcfb1118640 1 -- 172.21.15.170:0/2317453941 learned_addr learned my addr 172.21.15.170:0/2317453941 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.988+0000 7fcfb1118640 1 -- 172.21.15.170:0/2317453941 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a432538590 con 0x55a4325efc30 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.988+0000 7fcfb1118640 1 --2- 172.21.15.170:0/2317453941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a43276eec0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcfac000c00 tx=0x7fcfac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac6972e1cc64520 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.988+0000 7fce9f606640 1 -- 172.21.15.170:0/2317453941 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac057040 con 0x55a4325efc30 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.988+0000 7fce9f606640 1 -- 172.21.15.170:0/2317453941 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac052720 con 0x55a4325efc30 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fce9f606640 1 -- 172.21.15.170:0/2317453941 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac052a40 con 0x55a4325efc30 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fcfb3619800 1 -- 172.21.15.170:0/2317453941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 msgr2=0x55a43276eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2317453941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a43276eec0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcfac000c00 tx=0x7fcfac04c000 comp rx=0 tx=0).stop 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fcfb3619800 1 -- 172.21.15.170:0/2317453941 shutdown_connections 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2317453941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a43276eec0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fcfb3619800 1 -- 172.21.15.170:0/2317453941 >> 172.21.15.170:0/2317453941 conn(0x55a432676ba0 msgr2=0x55a43276a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fcfb3619800 1 -- 172.21.15.170:0/2317453941 shutdown_connections 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.989+0000 7fcfb3619800 1 -- 172.21.15.170:0/2317453941 wait complete. 2024-04-26T12:31:30.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb3619800 1 Processor -- start 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb3619800 1 -- start start 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb3619800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a4327766f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb3619800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a432686e40 con 0x55a4325efc30 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a4327766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a4327766f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34436/0 (socket says 172.21.15.170:34436) 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb1118640 1 -- 172.21.15.170:0/249268289 learned_addr learned my addr 172.21.15.170:0/249268289 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb1118640 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a43252f8f0 con 0x55a4325efc30 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.990+0000 7fcfb1118640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a4327766f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0524f0 tx=0x7fcfac003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.991+0000 7fce9de03640 1 -- 172.21.15.170:0/249268289 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac073070 con 0x55a4325efc30 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.991+0000 7fce9de03640 1 -- 172.21.15.170:0/249268289 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac052d70 con 0x55a4325efc30 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.991+0000 7fce9de03640 1 -- 172.21.15.170:0/249268289 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac057070 con 0x55a4325efc30 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.991+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a432776c30 con 0x55a4325efc30 2024-04-26T12:31:30.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.991+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a432777150 con 0x55a4325efc30 2024-04-26T12:31:31.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.991+0000 7fce9de03640 1 -- 172.21.15.170:0/249268289 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfac076070 con 0x55a4325efc30 2024-04-26T12:31:31.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.991+0000 7fce9de03640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce98036900 0x7fce98038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fce9de03640 1 -- 172.21.15.170:0/249268289 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fcfac08db90 con 0x55a4325efc30 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb0917640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce98036900 0x7fce98038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4325f1140 0x55a43277d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a43277dce0 con 0x55a4325f1140 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb1919640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4325f1140 0x55a43277d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb0917640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce98036900 0x7fce98038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000f60 tx=0x7fcf9c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb1919640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4325f1140 0x55a43277d760 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb1919640 1 -- 172.21.15.170:0/249268289 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4325f1140 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.992+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a43277ad30 con 0x55a4325f1140 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.993+0000 7fcfb1919640 1 -- 172.21.15.170:0/249268289 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4325f1140 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.993+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a432780030 0x55a432782420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.993+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a432782b10 con 0x55a432780030 2024-04-26T12:31:31.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.993+0000 7fcfb1118640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a432780030 0x55a432782420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.993+0000 7fcfb1118640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a432780030 0x55a432782420 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.993+0000 7fcfb1118640 1 -- 172.21.15.170:0/249268289 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfac075030 con 0x55a432780030 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.993+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a43277efb0 con 0x55a4325f1140 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.994+0000 7fcfb1919640 1 -- 172.21.15.170:0/249268289 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4325f1140 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.994+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a432783f70 0x55a4327863e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.994+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a432786b40 con 0x55a432783f70 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.994+0000 7fcfb0917640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a432783f70 0x55a4327863e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.994+0000 7fcfb0917640 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a432783f70 0x55a4327863e0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.994+0000 7fcfb0917640 1 -- 172.21.15.170:0/249268289 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf9c00f690 con 0x55a432783f70 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb3619800 1 Processor -- start 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb3619800 1 -- start start 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb3619800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a432794fa0 0x55a4327953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb3619800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a43256ce60 con 0x55a432794fa0 2024-04-26T12:31:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a432794fa0 0x55a4327953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a432794fa0 0x55a4327953c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34444/0 (socket says 172.21.15.170:34444) 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb1118640 1 -- 172.21.15.170:0/2243740416 learned_addr learned my addr 172.21.15.170:0/2243740416 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.995+0000 7fcfb1118640 1 -- 172.21.15.170:0/2243740416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a432795900 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.996+0000 7fcfb1118640 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a432794fa0 0x55a4327953c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcfac006430 tx=0x7fcfac077d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.996+0000 7fce96ffd640 1 -- 172.21.15.170:0/2243740416 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac008000 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.996+0000 7fce96ffd640 1 -- 172.21.15.170:0/2243740416 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac0081a0 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.996+0000 7fce96ffd640 1 -- 172.21.15.170:0/2243740416 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac0774e0 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.996+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a432796370 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.996+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a432796870 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.996+0000 7fce96ffd640 1 -- 172.21.15.170:0/2243740416 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfac094060 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fce96ffd640 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce8c036900 0x7fce8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fce96ffd640 1 -- 172.21.15.170:0/2243740416 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fcfac097d10 con 0x55a432794fa0 2024-04-26T12:31:31.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb0917640 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce8c036900 0x7fce8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb3619800 1 Processor -- start 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb3619800 1 -- start start 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb0917640 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce8c036900 0x7fce8c038dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55a43277e5e0 tx=0x7fcf9c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb3619800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb3619800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a43276f580 con 0x55a4327a2150 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34460/0 (socket says 172.21.15.170:34460) 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.997+0000 7fcfb1118640 1 -- 172.21.15.170:0/2237488389 learned_addr learned my addr 172.21.15.170:0/2237488389 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb1118640 1 -- 172.21.15.170:0/2237488389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4327a2b40 con 0x55a4327a2150 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb1118640 1 --2- 172.21.15.170:0/2237488389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a2570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcfac008370 tx=0x7fcfac073fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace13f76bc98ba46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fce94ff9640 1 -- 172.21.15.170:0/2237488389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac06e400 con 0x55a4327a2150 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fce94ff9640 1 -- 172.21.15.170:0/2237488389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac08d290 con 0x55a4327a2150 2024-04-26T12:31:31.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fce94ff9640 1 -- 172.21.15.170:0/2237488389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac082420 con 0x55a4327a2150 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb3619800 1 -- 172.21.15.170:0/2237488389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 msgr2=0x55a4327a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2237488389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a2570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcfac008370 tx=0x7fcfac073fb0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb3619800 1 -- 172.21.15.170:0/2237488389 shutdown_connections 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2237488389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a2570 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb3619800 1 -- 172.21.15.170:0/2237488389 >> 172.21.15.170:0/2237488389 conn(0x55a43279e460 msgr2=0x55a43279c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb3619800 1 -- 172.21.15.170:0/2237488389 shutdown_connections 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.998+0000 7fcfb3619800 1 -- 172.21.15.170:0/2237488389 wait complete. 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb3619800 1 Processor -- start 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb3619800 1 -- start start 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb3619800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb3619800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55a4327a31d0 con 0x55a4327a2150 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb1118640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34462/0 (socket says 172.21.15.170:34462) 2024-04-26T12:31:31.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 learned_addr learned my addr 172.21.15.170:0/1645686087 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4327a99b0 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:30.999+0000 7fcfb1118640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a9470 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcfac008370 tx=0x7fcfac065f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.000+0000 7fce82ffd640 1 -- 172.21.15.170:0/1645686087 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac06e400 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.000+0000 7fce82ffd640 1 -- 172.21.15.170:0/1645686087 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac04dad0 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.000+0000 7fce82ffd640 1 -- 172.21.15.170:0/1645686087 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac007750 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.000+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4327a99b0 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.000+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4327a99b0 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.000+0000 7fce82ffd640 1 -- 172.21.15.170:0/1645686087 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfac0a7040 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fce82ffd640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce7c036900 0x7fce7c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fce82ffd640 1 -- 172.21.15.170:0/1645686087 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fcfac0a5020 con 0x55a4327a2150 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb0917640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce7c036900 0x7fce7c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4327b4a10 0x55a4327b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b7620 con 0x55a4327b4a10 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb1919640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4327b4a10 0x55a4327b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb0917640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce7c036900 0x7fce7c038dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55a432786f40 tx=0x7fcf9c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb1919640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4327b4a10 0x55a4327b6ed0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb3619800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb3619800 20 realm 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.001+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b7a30 con 0x55a4327b4a10 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b82d0 con 0x55a4327b4a10 2024-04-26T12:31:31.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a4327b93d0 0x55a4327bb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327bbd40 con 0x55a4327b93d0 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.002+0000 7fcfb1118640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a4327b93d0 0x55a4327bb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb1118640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a4327b93d0 0x55a4327bb7c0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb3619800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb3619800 20 searching for the correct realm 2024-04-26T12:31:31.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a4327bddb0 0x55a4327c0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c0940 con 0x55a4327bddb0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb0917640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a4327bddb0 0x55a4327c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.003+0000 7fcfb0917640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a4327bddb0 0x55a4327c0270 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.004+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.004+0000 7fcfb0917640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcf9c00f070 0x7fcf9c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.004+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c0940 con 0x7fcf9c00f070 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.004+0000 7fcfb1919640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcf9c00f070 0x7fcf9c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.004+0000 7fcfb1919640 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcf9c00f070 0x7fcf9c02e910 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.004+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcfa400a4a0 con 0x7fcf9c00f070 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.004+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.005+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x7fcf9c00f070 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa400a4a0 con 0x7fcf9c00f070 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.006+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x7fcf9c00f070 2024-04-26T12:31:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa400a4a0 con 0x7fcf9c00f070 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa400a4a0 con 0x55a4327b4a10 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x7fcf9c00f070 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.007+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.008+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.008+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.008+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.008+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.008+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.008+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.009+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.009+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.009+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.009+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x7fcf9c00f070 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.010+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x7fcf9c00f070 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.011+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327bddb0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b93d0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x55a4327b4a10 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a4327b8670 con 0x7fcf9c00f070 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.012+0000 7fcfb3619800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327bc6b0 con 0x55a4327b4a10 2024-04-26T12:31:31.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327bc6b0 con 0x55a4327b4a10 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327bc660 con 0x7fcf9c00f070 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 zone default found 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 4 Realm: () 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:31.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 zonegroup default 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.013+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327bcaa0 con 0x55a4327b93d0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c27a0 con 0x55a4327bddb0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c2b40 con 0x55a4327bddb0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 20 started sync module instance, tier type = 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.014+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c1c40 con 0x7fcf9c00f070 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.015+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.015+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94163709990800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c2060 con 0x7fcf9c00f070 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.015+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c3390 con 0x55a4327b4a10 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.016+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94163709990800] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.016+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.016+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94163709992128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c3390 con 0x55a4327b4a10 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.016+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c3d50 con 0x55a4327bddb0 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.017+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94163709992128] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.018+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.018+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94163709996768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c3300 con 0x55a4327bddb0 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.018+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c4ad0 con 0x7fcf9c00f070 2024-04-26T12:31:31.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.019+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94163709996768] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.019+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.019+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94163710001392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c4ec0 con 0x7fcf9c00f070 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.019+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c58c0 con 0x55a4327b4a10 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.020+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.020+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94163710006224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c57f0 con 0x55a4327b4a10 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.020+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c6810 con 0x55a4327b93d0 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.020+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94163710001392] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.021+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.021+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94163710010112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c6c00 con 0x55a4327b93d0 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.021+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c7600 con 0x55a4327b93d0 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.021+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94163710006224] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.022+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94163710010112] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.022+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.022+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94163710008496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c79f0 con 0x55a4327b93d0 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.022+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c8240 con 0x55a4327b93d0 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94163710008496] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94163710016912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c8660 con 0x55a4327b93d0 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 20 add_watcher() i=0 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 20 add_watcher() i=1 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 20 add_watcher() i=2 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 20 add_watcher() i=3 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 20 add_watcher() i=4 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 20 add_watcher() i=5 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb3619800 20 add_watcher() i=6 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.023+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94163710016912] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.024+0000 7fcfb3619800 20 add_watcher() i=7 2024-04-26T12:31:31.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.024+0000 7fcfb3619800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.024+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327cb930 con 0x55a4327b4a10 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.024+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.024+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94163710018336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c8bf0 con 0x55a4327b4a10 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94163710018336] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fce677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fcfb3619800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fcfb3619800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fcfb3619800 5 note: GC not initialized 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fce667e4640 20 reqs_thread_entry: start 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fcfb3619800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.025+0000 7fcfb3619800 20 Filter name: none 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.026+0000 7fcdd7fff640 20 reqs_thread_entry: start 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.026+0000 7fcfb3619800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.026+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a4327febe0 con 0x55a4327b4a10 2024-04-26T12:31:31.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.026+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.026+0000 7fcfb3619800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:31:31.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.026+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a432800130 con 0x55a4327b93d0 2024-04-26T12:31:31.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.027+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.027+0000 7fce677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.028+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94163710018336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327cab50 con 0x55a4327b4a10 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.028+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94163710018336] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.028+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94163709990800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c8320 con 0x7fcf9c00f070 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.029+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94163709990800] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.029+0000 7fcfb3619800 20 remove_watcher() i=0 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.029+0000 7fcfb3619800 2 removed watcher, disabling cache 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.029+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94163709992128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c8320 con 0x55a4327b4a10 2024-04-26T12:31:31.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.030+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94163709992128] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.030+0000 7fcfb3619800 20 remove_watcher() i=1 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.030+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94163709996768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c1cc0 con 0x55a4327bddb0 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.031+0000 7fcfb0917640 1 -- 172.21.15.170:0/1645686087 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94163709996768] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf9c037040 con 0x55a4327bddb0 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.031+0000 7fcfb3619800 20 remove_watcher() i=2 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.031+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94163710001392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c8320 con 0x7fcf9c00f070 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.032+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94163710001392] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x7fcf9c00f070 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.032+0000 7fcfb3619800 20 remove_watcher() i=3 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.032+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94163710006224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c2ee0 con 0x55a4327b4a10 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.033+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94163710006224] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfa4033040 con 0x55a4327b4a10 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.033+0000 7fcfb3619800 20 remove_watcher() i=4 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.033+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94163710010112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c40f0 con 0x55a4327b93d0 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.034+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94163710010112] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.034+0000 7fcfb3619800 20 remove_watcher() i=5 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.034+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94163710008496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c8320 con 0x55a4327b93d0 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.035+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94163710008496] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.035+0000 7fcfb3619800 20 remove_watcher() i=6 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.035+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94163710016912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a4327c2ee0 con 0x55a4327b93d0 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb1118640 1 -- 172.21.15.170:0/1645686087 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94163710016912] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfac0ba020 con 0x55a4327b93d0 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 20 remove_watcher() i=7 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a4327b93d0 msgr2=0x55a4327bb7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a4327b93d0 0x55a4327bb7c0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4327b4a10 msgr2=0x55a4327b6ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4327b4a10 0x55a4327b6ed0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcf9c00f070 msgr2=0x7fcf9c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcf9c00f070 0x7fcf9c02e910 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a4327bddb0 msgr2=0x55a4327c0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55a4327bddb0 0x55a4327c0270 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce7c036900 msgr2=0x7fce7c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce7c036900 0x7fce7c038dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55a432786f40 tx=0x7fcf9c010000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb1919640 1 -- 172.21.15.170:0/1645686087 reap_dead start 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 msgr2=0x55a4327a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.036+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a9470 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcfac008370 tx=0x7fcfac065f60 comp rx=0 tx=0).stop 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 shutdown_connections 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/1645686087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4327a2150 0x55a4327a9470 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 >> 172.21.15.170:0/1645686087 conn(0x55a43279e460 msgr2=0x55a43279bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 shutdown_connections 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/1645686087 wait complete. 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce8c036900 msgr2=0x7fce8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce8c036900 0x7fce8c038dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55a43277e5e0 tx=0x7fcf9c00f000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a432794fa0 msgr2=0x55a4327953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a432794fa0 0x55a4327953c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcfac006430 tx=0x7fcfac077d40 comp rx=0 tx=0).stop 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 shutdown_connections 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce8c036900 0x7fce8c038dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/2243740416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a432794fa0 0x55a4327953c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 >> 172.21.15.170:0/2243740416 conn(0x55a432789040 msgr2=0x55a432789440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 shutdown_connections 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/2243740416 wait complete. 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a432780030 msgr2=0x55a432782420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55a432780030 0x55a432782420 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4325f1140 msgr2=0x55a43277d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55a4325f1140 0x55a43277d760 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a432783f70 msgr2=0x55a4327863e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55a432783f70 0x55a4327863e0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce98036900 msgr2=0x7fce98038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fce98036900 0x7fce98038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000f60 tx=0x7fcf9c001370 comp rx=0 tx=0).stop 2024-04-26T12:31:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 msgr2=0x55a4327766f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 --2- 172.21.15.170:0/249268289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55a4325efc30 0x55a4327766f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0524f0 tx=0x7fcfac003020 comp rx=0 tx=0).stop 2024-04-26T12:31:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb1919640 1 -- 172.21.15.170:0/249268289 reap_dead start 2024-04-26T12:31:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 shutdown_connections 2024-04-26T12:31:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 >> 172.21.15.170:0/249268289 conn(0x55a432676ba0 msgr2=0x55a43276d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.037+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 shutdown_connections 2024-04-26T12:31:31.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.038+0000 7fcfb3619800 1 -- 172.21.15.170:0/249268289 wait complete. 2024-04-26T12:31:31.050 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-26T12:31:31.050 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-26T12:31:31.050 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-26T12:31:31.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-26T12:31:31.051 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-26T12:31:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:31.095 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.095+0000 7fbd94612800 1 Processor -- start 2024-04-26T12:31:31.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.095+0000 7fbd94612800 1 -- start start 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.095+0000 7fbd94612800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55befd3fde20 0x55befd492460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.095+0000 7fbd94612800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55befd3360c0 con 0x55befd3ff160 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.095+0000 7fbd94612800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55befd31a4d0 con 0x55befd3fde20 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.095+0000 7fbd8755b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55befd3fde20 0x55befd492460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.095+0000 7fbd8fd5c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55befd3ff160 0x55befd3fd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52238/0 (socket says 172.21.15.170:52238) 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.096+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2201888474 learned_addr learned my addr 172.21.15.170:0/2201888474 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.096+0000 7fbd8755b640 1 -- 172.21.15.170:0/2201888474 >> v1:172.21.15.132:6789/0 conn(0x55befd3ff160 legacy=0x55befd3fd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.096+0000 7fbd8755b640 1 -- 172.21.15.170:0/2201888474 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befd347d40 con 0x55befd3fde20 2024-04-26T12:31:31.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2201888474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd492460 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a470 tx=0x7fbd7801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a178b53c71a4ca29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd8f55b640 1 -- 172.21.15.170:0/2201888474 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd78057070 con 0x55befd3fde20 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd8f55b640 1 -- 172.21.15.170:0/2201888474 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd78052570 con 0x55befd3fde20 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd8f55b640 1 -- 172.21.15.170:0/2201888474 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd78052870 con 0x55befd3fde20 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd94612800 1 -- 172.21.15.170:0/2201888474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 msgr2=0x55befd492460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd94612800 1 --2- 172.21.15.170:0/2201888474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd492460 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a470 tx=0x7fbd7801ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd94612800 1 -- 172.21.15.170:0/2201888474 shutdown_connections 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd94612800 1 --2- 172.21.15.170:0/2201888474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd492460 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd94612800 1 -- 172.21.15.170:0/2201888474 >> 172.21.15.170:0/2201888474 conn(0x55befd484ba0 msgr2=0x55befd486fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd94612800 1 -- 172.21.15.170:0/2201888474 shutdown_connections 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.098+0000 7fbd94612800 1 -- 172.21.15.170:0/2201888474 wait complete. 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.110+0000 7fbd94612800 1 Processor -- start 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.110+0000 7fbd94612800 1 -- start start 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.110+0000 7fbd94612800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd57cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.110+0000 7fbd94612800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55befd3d4b70 con 0x55befd3fde20 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.110+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd57cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.110+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd57cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34476/0 (socket says 172.21.15.170:34476) 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.110+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/3366146429 learned_addr learned my addr 172.21.15.170:0/3366146429 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.111+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/3366146429 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befd346590 con 0x55befd3fde20 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.111+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/3366146429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd57cd10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001dd0 tx=0x7fbd8000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b62556d5c2469f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.111+0000 7fbc7de0b640 1 -- 172.21.15.170:0/3366146429 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd80012020 con 0x55befd3fde20 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.111+0000 7fbc7de0b640 1 -- 172.21.15.170:0/3366146429 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8000e5a0 con 0x55befd3fde20 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.111+0000 7fbc7de0b640 1 -- 172.21.15.170:0/3366146429 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000e900 con 0x55befd3fde20 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 -- 172.21.15.170:0/3366146429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 msgr2=0x55befd57cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 --2- 172.21.15.170:0/3366146429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd57cd10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001dd0 tx=0x7fbd8000b6c0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 -- 172.21.15.170:0/3366146429 shutdown_connections 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 --2- 172.21.15.170:0/3366146429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd57cd10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 -- 172.21.15.170:0/3366146429 >> 172.21.15.170:0/3366146429 conn(0x55befd484ba0 msgr2=0x55befd578630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 -- 172.21.15.170:0/3366146429 shutdown_connections 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 -- 172.21.15.170:0/3366146429 wait complete. 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 Processor -- start 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 -- start start 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd5846d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd94612800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55befd494cb0 con 0x55befd3fde20 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd5846d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd5846d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34492/0 (socket says 172.21.15.170:34492) 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.112+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/4285009342 learned_addr learned my addr 172.21.15.170:0/4285009342 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.113+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befd33d8f0 con 0x55befd3fde20 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.113+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd5846d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001dd0 tx=0x7fbd80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.113+0000 7fbc77fff640 1 -- 172.21.15.170:0/4285009342 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd80012030 con 0x55befd3fde20 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.113+0000 7fbc77fff640 1 -- 172.21.15.170:0/4285009342 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8001a720 con 0x55befd3fde20 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.113+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55befd584c10 con 0x55befd3fde20 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.113+0000 7fbc77fff640 1 -- 172.21.15.170:0/4285009342 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8001aa40 con 0x55befd3fde20 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.113+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55befd585130 con 0x55befd3fde20 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbc77fff640 1 -- 172.21.15.170:0/4285009342 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbd80015020 con 0x55befd3fde20 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbc77fff640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc78036900 0x7fbc78038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbc77fff640 1 -- 172.21.15.170:0/4285009342 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fbd80020030 con 0x55befd3fde20 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbd8755b640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc78036900 0x7fbc78038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd3ff160 0x55befd58b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd58bc80 con 0x55befd3ff160 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbd9055d640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd3ff160 0x55befd58b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbd8755b640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc78036900 0x7fbc78038dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbd78054000 tx=0x7fbd7804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.114+0000 7fbd9055d640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd3ff160 0x55befd58b740 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.115+0000 7fbd9055d640 1 -- 172.21.15.170:0/4285009342 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd3ff160 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.115+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd588d10 con 0x55befd3ff160 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.115+0000 7fbd9055d640 1 -- 172.21.15.170:0/4285009342 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd3ff160 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.115+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd58df90 0x55befd590380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.115+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd590a20 con 0x55befd58df90 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.115+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd58df90 0x55befd590380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.115+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd58df90 0x55befd590380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.116+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/4285009342 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd80018950 con 0x55befd58df90 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.116+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd58cf40 con 0x55befd3ff160 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.116+0000 7fbd9055d640 1 -- 172.21.15.170:0/4285009342 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd3ff160 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.116+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55befd591ed0 0x55befd594320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.116+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd594a80 con 0x55befd591ed0 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.116+0000 7fbd8755b640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55befd591ed0 0x55befd594320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.116+0000 7fbd8755b640 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55befd591ed0 0x55befd594320 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.117+0000 7fbd8755b640 1 -- 172.21.15.170:0/4285009342 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd78052940 con 0x55befd591ed0 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.117+0000 7fbd94612800 1 Processor -- start 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.117+0000 7fbd94612800 1 -- start start 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.117+0000 7fbd94612800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5a2ee0 0x55befd5a3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.117+0000 7fbd94612800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55befd37ae60 con 0x55befd5a2ee0 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.117+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5a2ee0 0x55befd5a3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.117+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5a2ee0 0x55befd5a3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34504/0 (socket says 172.21.15.170:34504) 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2210770361 learned_addr learned my addr 172.21.15.170:0/2210770361 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2210770361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befd5a3840 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5a2ee0 0x55befd5a3300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001740 tx=0x7fbd8000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbc757fa640 1 -- 172.21.15.170:0/2210770361 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8003c070 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbc757fa640 1 -- 172.21.15.170:0/2210770361 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd80041040 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55befd5a42b0 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbc757fa640 1 -- 172.21.15.170:0/2210770361 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd80017dc0 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.118+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55befd5a42b0 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbc757fa640 1 -- 172.21.15.170:0/2210770361 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbd8004cab0 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbc757fa640 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc68036900 0x7fbc68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbc757fa640 1 -- 172.21.15.170:0/2210770361 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fbd80051ab0 con 0x55befd5a2ee0 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc68036900 0x7fbc68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbd94612800 1 Processor -- start 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbd94612800 1 -- start start 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc68036900 0x7fbc68038dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55befd588c30 tx=0x7fbd78005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbd94612800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.119+0000 7fbd94612800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55befd57d490 con 0x55befd5afd90 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34510/0 (socket says 172.21.15.170:34510) 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/3411396078 learned_addr learned my addr 172.21.15.170:0/3411396078 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/3411396078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befd5b07a0 con 0x55befd5afd90 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/3411396078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b01b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbd8004ab70 tx=0x7fbd80016d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58867a3e676e716 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbc6effd640 1 -- 172.21.15.170:0/3411396078 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8005e020 con 0x55befd5afd90 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbc6effd640 1 -- 172.21.15.170:0/3411396078 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd80041420 con 0x55befd5afd90 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.120+0000 7fbc6effd640 1 -- 172.21.15.170:0/3411396078 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000fd10 con 0x55befd5afd90 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 -- 172.21.15.170:0/3411396078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 msgr2=0x55befd5b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 --2- 172.21.15.170:0/3411396078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b01b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbd8004ab70 tx=0x7fbd80016d10 comp rx=0 tx=0).stop 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 -- 172.21.15.170:0/3411396078 shutdown_connections 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 --2- 172.21.15.170:0/3411396078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b01b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 -- 172.21.15.170:0/3411396078 >> 172.21.15.170:0/3411396078 conn(0x55befd5ac0d0 msgr2=0x55befd5aa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 -- 172.21.15.170:0/3411396078 shutdown_connections 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 -- 172.21.15.170:0/3411396078 wait complete. 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 Processor -- start 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 -- start start 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd94612800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55befd5b0ec0 con 0x55befd5afd90 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd8fd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34524/0 (socket says 172.21.15.170:34524) 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.121+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 learned_addr learned my addr 172.21.15.170:0/2401811793 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.122+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befd5b76b0 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.122+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b7170 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbd80044460 tx=0x7fbd80058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.122+0000 7fbc6d7fa640 1 -- 172.21.15.170:0/2401811793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd800446b0 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.122+0000 7fbc6d7fa640 1 -- 172.21.15.170:0/2401811793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd800165c0 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.122+0000 7fbc6d7fa640 1 -- 172.21.15.170:0/2401811793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd80037870 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.122+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55befd5b76b0 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.122+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55befd5b76b0 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbc6d7fa640 1 -- 172.21.15.170:0/2401811793 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbd80074060 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbc6d7fa640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc58036900 0x7fbc58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbc6d7fa640 1 -- 172.21.15.170:0/2401811793 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fbd8006a050 con 0x55befd5afd90 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc58036900 0x7fbc58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd5c2880 0x55befd5c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c5490 con 0x55befd5c2880 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbd9055d640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd5c2880 0x55befd5c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.123+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc58036900 0x7fbc58038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd78052fd0 tx=0x7fbd7804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd9055d640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd5c2880 0x55befd5c4d40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 realm 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c58a0 con 0x55befd5c2880 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6170 con 0x55befd5c2880 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c2880 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd5c7000 0x55befd5c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.124+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c9b50 con 0x55befd5c7000 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd5c7000 0x55befd5c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd8fd5c640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd5c7000 0x55befd5c93f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd94612800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd94612800 20 searching for the correct realm 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55befd5cbc00 0x55befd5ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5ce790 con 0x55befd5cbc00 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.125+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55befd5cbc00 0x55befd5ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55befd5cbc00 0x55befd5ce0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd8755b640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbd78076040 0x7fbd78083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5ce790 con 0x7fbd78076040 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd9055d640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbd78076040 0x7fbd78083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd9055d640 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbd78076040 0x7fbd78083410 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd8800a4a0 con 0x7fbd78076040 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.126+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c7000 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.127+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.127+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c2880 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.127+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.127+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c2880 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.127+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.127+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c7000 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c7000 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x7fbd78076040 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8800a4a0 con 0x7fbd78076040 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5cbc00 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c2880 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.128+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x7fbd78076040 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8800a4a0 con 0x7fbd78076040 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5c2880 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8800a4a0 con 0x55befd5c2880 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x7fbd78076040 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55befd5c6510 con 0x55befd5cbc00 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.129+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5cbc00 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c7000 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5cbc00 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5cbc00 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.130+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c2880 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c2880 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c7000 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5cbc00 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x7fbd78076040 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.131+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c2880 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c7000 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5cbc00 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c7000 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.132+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.133+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x7fbd78076040 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.133+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.133+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5cbc00 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.133+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.133+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c7000 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.133+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.133+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x55befd5c2880 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd78090040 con 0x7fbd78076040 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5ca500 con 0x55befd5c2880 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5ca500 con 0x55befd5c2880 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.134+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5ca4d0 con 0x7fbd78076040 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 zone default found 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 4 Realm: () 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 zonegroup default 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5ca8f0 con 0x55befd5c7000 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5ca500 con 0x55befd5cbc00 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d05f0 con 0x55befd5cbc00 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 started sync module instance, tier type = 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.135+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5cfa90 con 0x7fbd78076040 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.136+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.136+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94278782877616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5cfa90 con 0x7fbd78076040 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.137+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d0ff0 con 0x55befd5c2880 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.137+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94278782877616] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.138+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.138+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94278782880512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5cfa90 con 0x55befd5c2880 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.138+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d1a80 con 0x55befd5cbc00 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.138+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94278782880512] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.139+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.139+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94278782875104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5cfa00 con 0x55befd5cbc00 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.139+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d2940 con 0x7fbd78076040 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.140+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94278782875104] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.140+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.140+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94278782887056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d2d60 con 0x7fbd78076040 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.140+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d3720 con 0x55befd5c2880 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.141+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.141+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94278782887056] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.141+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94278782890608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d3b40 con 0x55befd5c2880 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.141+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d40b0 con 0x55befd5c7000 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.142+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94278782890608] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.142+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.142+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94278782891664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d3ab0 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.142+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d4f70 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.143+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94278782891664] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.143+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.143+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94278782895264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d57c0 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.143+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d6010 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94278782895264] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94278782901088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d6430 con 0x55befd5c7000 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 20 add_watcher() i=0 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 20 add_watcher() i=1 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 20 add_watcher() i=2 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 20 add_watcher() i=3 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 20 add_watcher() i=4 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 20 add_watcher() i=5 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.144+0000 7fbd94612800 20 add_watcher() i=6 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.145+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94278782901088] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.145+0000 7fbd94612800 20 add_watcher() i=7 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.145+0000 7fbd94612800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.145+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d97b0 con 0x55befd5c2880 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.145+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.145+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94278782902512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d69c0 con 0x55befd5c2880 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.146+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94278782902512] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.146+0000 7fbc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.146+0000 7fbd94612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.146+0000 7fbd94612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.146+0000 7fbd94612800 5 note: GC not initialized 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbc44fe1640 20 reqs_thread_entry: start 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbd94612800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbd94612800 20 Filter name: none 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbbbe7fc640 20 reqs_thread_entry: start 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbd94612800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd60cac0 con 0x55befd5c2880 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbd94612800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.147+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55befd60e010 con 0x55befd5c7000 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.148+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.149+0000 7fbc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.149+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94278782902512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d8910 con 0x55befd5c2880 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.150+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94278782902512] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.150+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94278782877616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d60f0 con 0x7fbd78076040 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.150+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94278782877616] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.151+0000 7fbd94612800 20 remove_watcher() i=0 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.151+0000 7fbd94612800 2 removed watcher, disabling cache 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.151+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94278782880512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d60f0 con 0x55befd5c2880 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.152+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94278782880512] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.152+0000 7fbd94612800 20 remove_watcher() i=1 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.152+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94278782875104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d60f0 con 0x55befd5cbc00 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.153+0000 7fbd8755b640 1 -- 172.21.15.170:0/2401811793 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94278782875104] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd78081070 con 0x55befd5cbc00 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.153+0000 7fbd94612800 20 remove_watcher() i=2 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.153+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94278782887056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5cf5e0 con 0x7fbd78076040 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.154+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94278782887056] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x7fbd78076040 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.154+0000 7fbd94612800 20 remove_watcher() i=3 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.154+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94278782890608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d2490 con 0x55befd5c2880 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.155+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94278782890608] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88033040 con 0x55befd5c2880 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.155+0000 7fbd94612800 20 remove_watcher() i=4 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.155+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94278782891664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5cf5e0 con 0x55befd5c7000 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.156+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94278782891664] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.156+0000 7fbd94612800 20 remove_watcher() i=5 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.156+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94278782895264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5d2490 con 0x55befd5c7000 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.157+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94278782895264] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.157+0000 7fbd94612800 20 remove_watcher() i=6 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.157+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94278782901088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55befd5cf5e0 con 0x55befd5c7000 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd8fd5c640 1 -- 172.21.15.170:0/2401811793 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94278782901088] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd8003e030 con 0x55befd5c7000 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 20 remove_watcher() i=7 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd5c7000 msgr2=0x55befd5c93f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd5c7000 0x55befd5c93f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd5c2880 msgr2=0x55befd5c4d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd5c2880 0x55befd5c4d40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbd78076040 msgr2=0x7fbd78083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fbd78076040 0x7fbd78083410 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55befd5cbc00 msgr2=0x55befd5ce0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55befd5cbc00 0x55befd5ce0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc58036900 msgr2=0x7fbc58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc58036900 0x7fbc58038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd78052fd0 tx=0x7fbd7804f000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 msgr2=0x55befd5b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd9055d640 1 -- 172.21.15.170:0/2401811793 reap_dead start 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b7170 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbd80044460 tx=0x7fbd80058000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 shutdown_connections 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2401811793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5afd90 0x55befd5b7170 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 >> 172.21.15.170:0/2401811793 conn(0x55befd5ac0d0 msgr2=0x55befd5a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 shutdown_connections 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2401811793 wait complete. 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc68036900 msgr2=0x7fbc68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc68036900 0x7fbc68038dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55befd588c30 tx=0x7fbd78005a00 comp rx=0 tx=0).stop 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5a2ee0 msgr2=0x55befd5a3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5a2ee0 0x55befd5a3300 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001740 tx=0x7fbd8000db20 comp rx=0 tx=0).stop 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 shutdown_connections 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc68036900 0x7fbc68038dc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 --2- 172.21.15.170:0/2210770361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd5a2ee0 0x55befd5a3300 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 >> 172.21.15.170:0/2210770361 conn(0x55befd596f80 msgr2=0x55befd597380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 shutdown_connections 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.158+0000 7fbd94612800 1 -- 172.21.15.170:0/2210770361 wait complete. 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd58df90 msgr2=0x55befd590380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55befd58df90 0x55befd590380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd3ff160 msgr2=0x55befd58b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55befd3ff160 0x55befd58b740 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55befd591ed0 msgr2=0x55befd594320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55befd591ed0 0x55befd594320 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc78036900 msgr2=0x7fbc78038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc78036900 0x7fbc78038dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbd78054000 tx=0x7fbd7804e000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 msgr2=0x55befd5846d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 --2- 172.21.15.170:0/4285009342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55befd3fde20 0x55befd5846d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001dd0 tx=0x7fbd80000ed0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd9055d640 1 -- 172.21.15.170:0/4285009342 reap_dead start 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 shutdown_connections 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 >> 172.21.15.170:0/4285009342 conn(0x55befd484ba0 msgr2=0x55befd57b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 shutdown_connections 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.159+0000 7fbd94612800 1 -- 172.21.15.170:0/4285009342 wait complete. 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-26T12:00:00.000000Z","epoch":1714132800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-04-26T12:31:31.174 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-04-26T12:31:31.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-26T12:31:31.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-26T12:31:31.174 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-26T12:31:31.225 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:31.225 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.225+0000 7fec3cd3d800 1 Processor -- start 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.225+0000 7fec3cd3d800 1 -- start start 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.225+0000 7fec3cd3d800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5608dc0e4170 0x5608dc0e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.225+0000 7fec3cd3d800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5608dc01b0c0 con 0x5608dc0e2c60 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.225+0000 7fec3cd3d800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5608dbfff4d0 con 0x5608dc0e4170 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.226+0000 7fec38a9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5608dc0e4170 0x5608dc0e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.226+0000 7fec3829a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5608dc0e2c60 0x5608dc1764a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52242/0 (socket says 172.21.15.170:52242) 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.226+0000 7fec3829a640 1 -- 172.21.15.170:0/3775369154 learned_addr learned my addr 172.21.15.170:0/3775369154 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.226+0000 7fec38a9b640 1 -- 172.21.15.170:0/3775369154 >> v1:172.21.15.132:6789/0 conn(0x5608dc0e2c60 legacy=0x5608dc1764a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.226+0000 7fec38a9b640 1 -- 172.21.15.170:0/3775369154 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608dc02cd40 con 0x5608dc0e4170 2024-04-26T12:31:31.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec38a9b640 1 --2- 172.21.15.170:0/3775369154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e4170 0x5608dc0e2720 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fec2800a470 tx=0x7fec2801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd2495d7a54d03d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec37a99640 1 -- 172.21.15.170:0/3775369154 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28057070 con 0x5608dc0e4170 2024-04-26T12:31:31.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec37a99640 1 -- 172.21.15.170:0/3775369154 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec28052570 con 0x5608dc0e4170 2024-04-26T12:31:31.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec37a99640 1 -- 172.21.15.170:0/3775369154 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28052870 con 0x5608dc0e4170 2024-04-26T12:31:31.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec3cd3d800 1 -- 172.21.15.170:0/3775369154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e4170 msgr2=0x5608dc0e2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/3775369154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e4170 0x5608dc0e2720 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fec2800a470 tx=0x7fec2801ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:31.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec3cd3d800 1 -- 172.21.15.170:0/3775369154 shutdown_connections 2024-04-26T12:31:31.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/3775369154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e4170 0x5608dc0e2720 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec3cd3d800 1 -- 172.21.15.170:0/3775369154 >> 172.21.15.170:0/3775369154 conn(0x5608dc169bd0 msgr2=0x5608dc16bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec3cd3d800 1 -- 172.21.15.170:0/3775369154 shutdown_connections 2024-04-26T12:31:31.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.228+0000 7fec3cd3d800 1 -- 172.21.15.170:0/3775369154 wait complete. 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.240+0000 7fec3cd3d800 1 Processor -- start 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.240+0000 7fec3cd3d800 1 -- start start 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.240+0000 7fec3cd3d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc261f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.240+0000 7fec3cd3d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5608dc0b9ba0 con 0x5608dc0e2c60 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc261f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc261f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34532/0 (socket says 172.21.15.170:34532) 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7fec38a9b640 1 -- 172.21.15.170:0/4131060322 learned_addr learned my addr 172.21.15.170:0/4131060322 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7fec38a9b640 1 -- 172.21.15.170:0/4131060322 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608dc02b590 con 0x5608dc0e2c60 2024-04-26T12:31:31.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7fec38a9b640 1 --2- 172.21.15.170:0/4131060322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc261f10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fec28055040 tx=0x7fec2804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49384321f49f1f88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7feb26e0d640 1 -- 172.21.15.170:0/4131060322 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28057070 con 0x5608dc0e2c60 2024-04-26T12:31:31.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7feb26e0d640 1 -- 172.21.15.170:0/4131060322 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec28063070 con 0x5608dc0e2c60 2024-04-26T12:31:31.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.241+0000 7feb26e0d640 1 -- 172.21.15.170:0/4131060322 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28052720 con 0x5608dc0e2c60 2024-04-26T12:31:31.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 -- 172.21.15.170:0/4131060322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 msgr2=0x5608dc261f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/4131060322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc261f10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fec28055040 tx=0x7fec2804c000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 -- 172.21.15.170:0/4131060322 shutdown_connections 2024-04-26T12:31:31.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/4131060322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc261f10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 -- 172.21.15.170:0/4131060322 >> 172.21.15.170:0/4131060322 conn(0x5608dc169bd0 msgr2=0x5608dc25d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 -- 172.21.15.170:0/4131060322 shutdown_connections 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 -- 172.21.15.170:0/4131060322 wait complete. 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 Processor -- start 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 -- start start 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc2696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.242+0000 7fec3cd3d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5608dc179e70 con 0x5608dc0e2c60 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc2696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc2696b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34540/0 (socket says 172.21.15.170:34540) 2024-04-26T12:31:31.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7fec38a9b640 1 -- 172.21.15.170:0/1169656704 learned_addr learned my addr 172.21.15.170:0/1169656704 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7fec38a9b640 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608dc0228f0 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7fec38a9b640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc2696b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fec28060040 tx=0x7fec28002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7feb2560a640 1 -- 172.21.15.170:0/1169656704 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28052dd0 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7feb2560a640 1 -- 172.21.15.170:0/1169656704 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2806c070 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608dc269bf0 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7feb2560a640 1 -- 172.21.15.170:0/1169656704 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2805e5b0 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.243+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608dc26a110 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.244+0000 7feb2560a640 1 -- 172.21.15.170:0/1169656704 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fec28077060 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.244+0000 7feb2560a640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20036900 0x7feb20038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.244+0000 7feb2560a640 1 -- 172.21.15.170:0/1169656704 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fec2808e4f0 con 0x5608dc0e2c60 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.244+0000 7fec3829a640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20036900 0x7feb20038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.244+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc0e4170 0x5608dc270720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.244+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc270cf0 con 0x5608dc0e4170 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.244+0000 7fec3929c640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc0e4170 0x5608dc270720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec3829a640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20036900 0x7feb20038dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fec2c000f60 tx=0x7fec2c0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec3929c640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc0e4170 0x5608dc270720 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec3929c640 1 -- 172.21.15.170:0/1169656704 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc0e4170 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc26dcf0 con 0x5608dc0e4170 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec3929c640 1 -- 172.21.15.170:0/1169656704 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc0e4170 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc273060 0x5608dc275450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc275b40 con 0x5608dc273060 2024-04-26T12:31:31.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.245+0000 7fec38a9b640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc273060 0x5608dc275450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.246+0000 7fec38a9b640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc273060 0x5608dc275450 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.246+0000 7fec38a9b640 1 -- 172.21.15.170:0/1169656704 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec28079450 con 0x5608dc273060 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.246+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc272010 con 0x5608dc0e4170 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.246+0000 7fec3929c640 1 -- 172.21.15.170:0/1169656704 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc0e4170 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.246+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5608dc276ff0 0x5608dc279440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.246+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc279ba0 con 0x5608dc276ff0 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.246+0000 7fec3829a640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5608dc276ff0 0x5608dc279440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.247+0000 7fec3829a640 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5608dc276ff0 0x5608dc279440 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.247+0000 7fec3829a640 1 -- 172.21.15.170:0/1169656704 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc276ff0 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.247+0000 7fec3cd3d800 1 Processor -- start 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.247+0000 7fec3cd3d800 1 -- start start 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.247+0000 7fec3cd3d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc288000 0x5608dc288420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.247+0000 7fec3cd3d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5608dc05fe60 con 0x5608dc288000 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc288000 0x5608dc288420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc288000 0x5608dc288420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34548/0 (socket says 172.21.15.170:34548) 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7fec38a9b640 1 -- 172.21.15.170:0/2469324190 learned_addr learned my addr 172.21.15.170:0/2469324190 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7fec38a9b640 1 -- 172.21.15.170:0/2469324190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608dc288960 con 0x5608dc288000 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7fec38a9b640 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc288000 0x5608dc288420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec28009bc0 tx=0x7fec2806f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7feb1e7fc640 1 -- 172.21.15.170:0/2469324190 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2808a070 con 0x5608dc288000 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7feb1e7fc640 1 -- 172.21.15.170:0/2469324190 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec28058040 con 0x5608dc288000 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608dc2893d0 con 0x5608dc288000 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7feb1e7fc640 1 -- 172.21.15.170:0/2469324190 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28069040 con 0x5608dc288000 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.248+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608dc2893d0 con 0x5608dc288000 2024-04-26T12:31:31.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7feb1e7fc640 1 -- 172.21.15.170:0/2469324190 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fec2806e030 con 0x5608dc288000 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7feb1e7fc640 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb10036950 0x7feb10038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7feb1e7fc640 1 -- 172.21.15.170:0/2469324190 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fec2807c0c0 con 0x5608dc288000 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7fec3829a640 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb10036950 0x7feb10038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7fec3cd3d800 1 Processor -- start 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7fec3cd3d800 1 -- start start 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7fec3829a640 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb10036950 0x7feb10038e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00bf50 tx=0x7fec2c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7fec3cd3d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc295310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.249+0000 7fec3cd3d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5608dc2625d0 con 0x5608dc294ef0 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc295310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc295310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34552/0 (socket says 172.21.15.170:34552) 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7fec38a9b640 1 -- 172.21.15.170:0/1883946396 learned_addr learned my addr 172.21.15.170:0/1883946396 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7fec38a9b640 1 -- 172.21.15.170:0/1883946396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608dc2958e0 con 0x5608dc294ef0 2024-04-26T12:31:31.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7fec38a9b640 1 --2- 172.21.15.170:0/1883946396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc295310 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fec2800a3e0 tx=0x7fec28069350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad3191fe6e1527a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7feb0ffff640 1 -- 172.21.15.170:0/1883946396 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28093070 con 0x5608dc294ef0 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7feb0ffff640 1 -- 172.21.15.170:0/1883946396 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec28055bc0 con 0x5608dc294ef0 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.250+0000 7feb0ffff640 1 -- 172.21.15.170:0/1883946396 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2806f750 con 0x5608dc294ef0 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1883946396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 msgr2=0x5608dc295310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1883946396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc295310 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fec2800a3e0 tx=0x7fec28069350 comp rx=0 tx=0).stop 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1883946396 shutdown_connections 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1883946396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc295310 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1883946396 >> 172.21.15.170:0/1883946396 conn(0x5608dc291250 msgr2=0x5608dc28f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1883946396 shutdown_connections 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1883946396 wait complete. 2024-04-26T12:31:31.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 Processor -- start 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 -- start start 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc29c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec3cd3d800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5608dc295f90 con 0x5608dc294ef0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc29c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec38a9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc29c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34566/0 (socket says 172.21.15.170:34566) 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 learned_addr learned my addr 172.21.15.170:0/30321878 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.251+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608dc29c800 con 0x5608dc294ef0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.252+0000 7fec38a9b640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc29c2c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fec2808cf30 tx=0x7fec28071d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.252+0000 7feb0e7fc640 1 -- 172.21.15.170:0/30321878 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28069980 con 0x5608dc294ef0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.252+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608dc29c800 con 0x5608dc294ef0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.252+0000 7feb0e7fc640 1 -- 172.21.15.170:0/30321878 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec280b1070 con 0x5608dc294ef0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.252+0000 7feb0e7fc640 1 -- 172.21.15.170:0/30321878 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec28069c90 con 0x5608dc294ef0 2024-04-26T12:31:31.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.252+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608dc29cca0 con 0x5608dc294ef0 2024-04-26T12:31:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7feb0e7fc640 1 -- 172.21.15.170:0/30321878 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fec2808e850 con 0x5608dc294ef0 2024-04-26T12:31:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7feb0e7fc640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb04036860 0x7feb04038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7feb0e7fc640 1 -- 172.21.15.170:0/30321878 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fec280a81b0 con 0x5608dc294ef0 2024-04-26T12:31:31.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7fec3829a640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb04036860 0x7feb04038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc2a7a30 0x5608dc2a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2aa640 con 0x5608dc2a7a30 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.253+0000 7fec3929c640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc2a7a30 0x5608dc2a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3829a640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb04036860 0x7feb04038d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fec2c001b60 tx=0x7fec2c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3929c640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc2a7a30 0x5608dc2a9ef0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 20 realm 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2aaa50 con 0x5608dc2a7a30 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab320 con 0x5608dc2a7a30 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.254+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.255+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.255+0000 7fec3cd3d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.255+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.255+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc2ac420 0x5608dc2ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.255+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2aee20 con 0x5608dc2ac420 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.255+0000 7fec38a9b640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc2ac420 0x5608dc2ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.255+0000 7fec38a9b640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc2ac420 0x5608dc2ae810 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3cd3d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3cd3d800 20 searching for the correct realm 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5608dc2b0db0 0x5608dc2b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b3940 con 0x5608dc2b0db0 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3829a640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5608dc2b0db0 0x5608dc2b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3829a640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5608dc2b0db0 0x5608dc2b3270 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3829a640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fec2c037040 0x7fec2c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b3940 con 0x7fec2c037040 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.256+0000 7fec3929c640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fec2c037040 0x7fec2c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.257+0000 7fec3929c640 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fec2c037040 0x7fec2c036410 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.257+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec3000a4a0 con 0x7fec2c037040 2024-04-26T12:31:31.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.257+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.257+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.257+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.258+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x7fec2c037040 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3000a4a0 con 0x7fec2c037040 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x7fec2c037040 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3000a4a0 con 0x7fec2c037040 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec3000a4a0 con 0x5608dc2a7a30 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.259+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x7fec2c037040 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.260+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.260+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.260+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.260+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.260+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.260+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.261+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x7fec2c037040 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.262+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.263+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.263+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.263+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.263+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.263+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.263+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.264+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.264+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x7fec2c037040 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.264+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.264+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.264+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.264+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2ac420 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ab6c0 con 0x7fec2c037040 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:31.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2af6e0 con 0x5608dc2a7a30 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.265+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2af6e0 con 0x5608dc2a7a30 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2af6e0 con 0x7fec2c037040 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 zone default found 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 4 Realm: () 2024-04-26T12:31:31.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 zonegroup default 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2aff80 con 0x5608dc2ac420 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.266+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b57a0 con 0x5608dc2b0db0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b5b40 con 0x5608dc2b0db0 2024-04-26T12:31:31.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3cd3d800 20 started sync module instance, tier type = 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3cd3d800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.267+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b4c40 con 0x7fec2c037040 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.268+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.268+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596053553472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b4c40 con 0x7fec2c037040 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.268+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b6500 con 0x5608dc2a7a30 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.269+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596053553472] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.269+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.269+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596053551472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b6500 con 0x5608dc2a7a30 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.269+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b6f20 con 0x5608dc2b0db0 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.270+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.270+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596053559824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b77c0 con 0x5608dc2b0db0 2024-04-26T12:31:31.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.270+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b8260 con 0x7fec2c037040 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.271+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596053551472] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.271+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596053559824] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.272+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.272+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596053562128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b6050 con 0x7fec2c037040 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.272+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b8b40 con 0x5608dc2a7a30 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.273+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.273+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596053566976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b8f70 con 0x5608dc2a7a30 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.273+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b9a60 con 0x5608dc2ac420 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.273+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596053562128] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.273+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596053566976] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.274+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.274+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596053570864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b8a20 con 0x5608dc2ac420 2024-04-26T12:31:31.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.274+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2ba300 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.275+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.275+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596053575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2baf70 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.275+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2bb970 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.275+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596053570864] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.275+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596053575328] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596053576384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2bb500 con 0x5608dc2ac420 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 20 add_watcher() i=0 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 20 add_watcher() i=1 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 20 add_watcher() i=2 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 20 add_watcher() i=3 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 20 add_watcher() i=4 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 20 add_watcher() i=5 2024-04-26T12:31:31.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec3cd3d800 20 add_watcher() i=6 2024-04-26T12:31:31.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.276+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596053576384] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.277+0000 7fec3cd3d800 20 add_watcher() i=7 2024-04-26T12:31:31.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.277+0000 7fec3cd3d800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:31.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.277+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2bec10 con 0x5608dc2a7a30 2024-04-26T12:31:31.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.277+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.277+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596053564720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2bc0c0 con 0x5608dc2a7a30 2024-04-26T12:31:31.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.278+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596053564720] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.278+0000 7feaeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.278+0000 7fec3cd3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:31.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.278+0000 7fec3cd3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.278+0000 7fec3cd3d800 5 note: GC not initialized 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.278+0000 7feaedfe3640 20 reqs_thread_entry: start 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.278+0000 7fec3cd3d800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 20 Filter name: none 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fea5f7fe640 20 reqs_thread_entry: start 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2f22b0 con 0x5608dc2ac420 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-26T12:31:31.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2f08f0 con 0x5608dc2a7a30 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.279+0000 7fec3cd3d800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.280+0000 7fec3cd3d800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.280+0000 7fec3cd3d800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.280+0000 7fec3cd3d800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.280+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2f11e0 con 0x5608dc2ac420 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec3cd3d800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec3cd3d800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:31:31.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec3cd3d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94596053798192 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2f58a0 con 0x5608dc2ac420 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== watch-notify(notify (1) cookie 94596053576384 notify 137438953492 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5608dc2f1d00 con 0x5608dc2ac420 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7feb0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94596053576384 notifier 4733 bl.length()=556 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7feb0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7feb0ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7feb0ffff640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feafc003ea0 con 0x5608dc2ac420 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(65 notify.7 [notify cookie 94596053798192 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.281+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== watch-notify(notify_complete (2) cookie 94596053798192 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fec2807f030 con 0x5608dc2ac420 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.282+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2f0d30 con 0x5608dc2a7a30 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec3cd3d800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec3cd3d800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec3cd3d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T12:31:31.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94596053799280 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2f5820 con 0x5608dc2ac420 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== watch-notify(notify (1) cookie 94596053570864 notify 137438953493 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fec2807f030 con 0x5608dc2ac420 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7feb0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94596053570864 notifier 4733 bl.length()=177 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7feb0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7feb0f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(68 notify.5 [notify cookie 94596053799280 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7feb0f7fe640 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fea6c003400 con 0x5608dc2ac420 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.283+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== watch-notify(notify_complete (2) cookie 94596053799280 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5608dc26a110 con 0x5608dc2ac420 2024-04-26T12:31:31.300 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-26T12:31:31.280835Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:31:31.280819Z","tags":[],"group_ids":[]} 2024-04-26T12:31:31.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.284+0000 7feaeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.284+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596053564720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2f3800 con 0x5608dc2a7a30 2024-04-26T12:31:31.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.285+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94596053564720] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.285+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596053553472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b7d30 con 0x7fec2c037040 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.286+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94596053553472] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.286+0000 7fec3cd3d800 20 remove_watcher() i=0 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.286+0000 7fec3cd3d800 2 removed watcher, disabling cache 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.286+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596053551472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b7d30 con 0x5608dc2a7a30 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.287+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94596053551472] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.287+0000 7fec3cd3d800 20 remove_watcher() i=1 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.287+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596053559824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b4970 con 0x5608dc2b0db0 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.288+0000 7fec3829a640 1 -- 172.21.15.170:0/30321878 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94596053559824] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec2c009050 con 0x5608dc2b0db0 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.288+0000 7fec3cd3d800 20 remove_watcher() i=2 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.288+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596053562128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b7d30 con 0x7fec2c037040 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.289+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94596053562128] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x7fec2c037040 2024-04-26T12:31:31.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.289+0000 7fec3cd3d800 20 remove_watcher() i=3 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.289+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596053566976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b6a10 con 0x5608dc2a7a30 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.290+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94596053566976] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec30033040 con 0x5608dc2a7a30 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.290+0000 7fec3cd3d800 20 remove_watcher() i=4 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.290+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596053570864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b7310 con 0x5608dc2ac420 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.291+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94596053570864] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.291+0000 7fec3cd3d800 20 remove_watcher() i=5 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.291+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596053575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b7d30 con 0x5608dc2ac420 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.292+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94596053575328] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.292+0000 7fec3cd3d800 20 remove_watcher() i=6 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.292+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596053576384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608dc2b8600 con 0x5608dc2ac420 2024-04-26T12:31:31.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec38a9b640 1 -- 172.21.15.170:0/30321878 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94596053576384] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec28095070 con 0x5608dc2ac420 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 20 remove_watcher() i=7 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc2ac420 msgr2=0x5608dc2ae810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc2ac420 0x5608dc2ae810 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc2a7a30 msgr2=0x5608dc2a9ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc2a7a30 0x5608dc2a9ef0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fec2c037040 msgr2=0x7fec2c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fec2c037040 0x7fec2c036410 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5608dc2b0db0 msgr2=0x5608dc2b3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5608dc2b0db0 0x5608dc2b3270 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb04036860 msgr2=0x7feb04038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb04036860 0x7feb04038d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fec2c001b60 tx=0x7fec2c010000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3929c640 1 -- 172.21.15.170:0/30321878 reap_dead start 2024-04-26T12:31:31.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 msgr2=0x5608dc29c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc29c2c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fec2808cf30 tx=0x7fec28071d20 comp rx=0 tx=0).stop 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 shutdown_connections 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/30321878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc294ef0 0x5608dc29c2c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 >> 172.21.15.170:0/30321878 conn(0x5608dc291250 msgr2=0x5608dc28e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.293+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 shutdown_connections 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/30321878 wait complete. 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb10036950 msgr2=0x7feb10038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb10036950 0x7feb10038e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fec2c00bf50 tx=0x7fec2c00f000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc288000 msgr2=0x5608dc288420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc288000 0x5608dc288420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec28009bc0 tx=0x7fec2806f6b0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 shutdown_connections 2024-04-26T12:31:31.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb10036950 0x7feb10038e10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/2469324190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc288000 0x5608dc288420 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 >> 172.21.15.170:0/2469324190 conn(0x5608dc27c0a0 msgr2=0x5608dc27c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 shutdown_connections 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/2469324190 wait complete. 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc273060 msgr2=0x5608dc275450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5608dc273060 0x5608dc275450 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc0e4170 msgr2=0x5608dc270720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5608dc0e4170 0x5608dc270720 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5608dc276ff0 msgr2=0x5608dc279440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5608dc276ff0 0x5608dc279440 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20036900 msgr2=0x7feb20038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7feb20036900 0x7feb20038dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fec2c000f60 tx=0x7fec2c0012b0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 msgr2=0x5608dc2696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 --2- 172.21.15.170:0/1169656704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5608dc0e2c60 0x5608dc2696b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fec28060040 tx=0x7fec28002fb0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3929c640 1 -- 172.21.15.170:0/1169656704 reap_dead start 2024-04-26T12:31:31.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 shutdown_connections 2024-04-26T12:31:31.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 >> 172.21.15.170:0/1169656704 conn(0x5608dc169bd0 msgr2=0x5608dc260900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 shutdown_connections 2024-04-26T12:31:31.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.294+0000 7fec3cd3d800 1 -- 172.21.15.170:0/1169656704 wait complete. 2024-04-26T12:31:31.312 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-26T12:31:31.280835Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:31:31.280819Z', 'tags': [], 'group_ids': []} 2024-04-26T12:31:31.324 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:31:31.329 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-26T12:31:31.329 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-26T12:31:31.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-26T12:31:31.330 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-26T12:31:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:31.374 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7faca1a3a800 1 Processor -- start 2024-04-26T12:31:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7faca1a3a800 1 -- start start 2024-04-26T12:31:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7faca1a3a800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b0e161b120 0x55b0e16196d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7faca1a3a800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0e15520c0 con 0x55b0e1619c10 2024-04-26T12:31:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7faca1a3a800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55b0e15364d0 con 0x55b0e161b120 2024-04-26T12:31:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7fac9c6d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55b0e161b120 0x55b0e16196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7fac9bed4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55b0e1619c10 0x55b0e16ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:52252/0 (socket says 172.21.15.170:52252) 2024-04-26T12:31:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7fac9bed4640 1 -- 172.21.15.170:0/2133009287 learned_addr learned my addr 172.21.15.170:0/2133009287 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7fac9c6d5640 1 -- 172.21.15.170:0/2133009287 >> v1:172.21.15.132:6789/0 conn(0x55b0e1619c10 legacy=0x55b0e16ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.374+0000 7fac9c6d5640 1 -- 172.21.15.170:0/2133009287 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e1563d40 con 0x55b0e161b120 2024-04-26T12:31:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.376+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/2133009287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e161b120 0x55b0e16196d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fac9000a470 tx=0x7fac9001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d698ec3849aea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.376+0000 7fac9b6d3640 1 -- 172.21.15.170:0/2133009287 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90057070 con 0x55b0e161b120 2024-04-26T12:31:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.376+0000 7fac9b6d3640 1 -- 172.21.15.170:0/2133009287 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90052570 con 0x55b0e161b120 2024-04-26T12:31:31.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.376+0000 7fac9b6d3640 1 -- 172.21.15.170:0/2133009287 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90052870 con 0x55b0e161b120 2024-04-26T12:31:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.377+0000 7faca1a3a800 1 -- 172.21.15.170:0/2133009287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e161b120 msgr2=0x55b0e16196d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.377+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2133009287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e161b120 0x55b0e16196d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fac9000a470 tx=0x7fac9001ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.377+0000 7faca1a3a800 1 -- 172.21.15.170:0/2133009287 shutdown_connections 2024-04-26T12:31:31.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.377+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2133009287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e161b120 0x55b0e16196d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.377+0000 7faca1a3a800 1 -- 172.21.15.170:0/2133009287 >> 172.21.15.170:0/2133009287 conn(0x55b0e16a0ba0 msgr2=0x55b0e16a2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.377+0000 7faca1a3a800 1 -- 172.21.15.170:0/2133009287 shutdown_connections 2024-04-26T12:31:31.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.377+0000 7faca1a3a800 1 -- 172.21.15.170:0/2133009287 wait complete. 2024-04-26T12:31:31.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7faca1a3a800 1 Processor -- start 2024-04-26T12:31:31.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7faca1a3a800 1 -- start start 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7faca1a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e1798ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7faca1a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b0e15f0b70 con 0x55b0e1619c10 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e1798ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e1798ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34584/0 (socket says 172.21.15.170:34584) 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7fac9c6d5640 1 -- 172.21.15.170:0/2227847771 learned_addr learned my addr 172.21.15.170:0/2227847771 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7fac9c6d5640 1 -- 172.21.15.170:0/2227847771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e1562590 con 0x55b0e1619c10 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.389+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/2227847771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e1798ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fac90000c00 tx=0x7fac9004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a226cb28b951c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7fab8a60c640 1 -- 172.21.15.170:0/2227847771 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90057070 con 0x55b0e1619c10 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7fab8a60c640 1 -- 172.21.15.170:0/2227847771 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90063070 con 0x55b0e1619c10 2024-04-26T12:31:31.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7fab8a60c640 1 -- 172.21.15.170:0/2227847771 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90052720 con 0x55b0e1619c10 2024-04-26T12:31:31.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7faca1a3a800 1 -- 172.21.15.170:0/2227847771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 msgr2=0x55b0e1798ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2227847771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e1798ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fac90000c00 tx=0x7fac9004c000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7faca1a3a800 1 -- 172.21.15.170:0/2227847771 shutdown_connections 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2227847771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e1798ea0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7faca1a3a800 1 -- 172.21.15.170:0/2227847771 >> 172.21.15.170:0/2227847771 conn(0x55b0e16a0ba0 msgr2=0x55b0e17947c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7faca1a3a800 1 -- 172.21.15.170:0/2227847771 shutdown_connections 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.390+0000 7faca1a3a800 1 -- 172.21.15.170:0/2227847771 wait complete. 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7faca1a3a800 1 Processor -- start 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7faca1a3a800 1 -- start start 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7faca1a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e17a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7faca1a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b0e16b0e60 con 0x55b0e1619c10 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e17a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e17a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34592/0 (socket says 172.21.15.170:34592) 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7fac9c6d5640 1 -- 172.21.15.170:0/728040863 learned_addr learned my addr 172.21.15.170:0/728040863 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.391+0000 7fac9c6d5640 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e15598f0 con 0x55b0e1619c10 2024-04-26T12:31:31.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.392+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e17a0750 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fac90000c00 tx=0x7fac90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.392+0000 7fab88e09640 1 -- 172.21.15.170:0/728040863 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90052c70 con 0x55b0e1619c10 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.392+0000 7fab88e09640 1 -- 172.21.15.170:0/728040863 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9006c070 con 0x55b0e1619c10 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.392+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0e17a0c90 con 0x55b0e1619c10 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.392+0000 7fab88e09640 1 -- 172.21.15.170:0/728040863 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9005e480 con 0x55b0e1619c10 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.392+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0e17a1150 con 0x55b0e1619c10 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7fab88e09640 1 -- 172.21.15.170:0/728040863 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fac9006e030 con 0x55b0e1619c10 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7fab88e09640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab84036900 0x7fab84038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7fab88e09640 1 -- 172.21.15.170:0/728040863 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fac9008e3a0 con 0x55b0e1619c10 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7fac9bed4640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab84036900 0x7fab84038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e161b120 0x55b0e17a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17a7d90 con 0x55b0e161b120 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7fac9ced6640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e161b120 0x55b0e17a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7fac9bed4640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab84036900 0x7fab84038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac8c000f60 tx=0x7fac8c0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.393+0000 7fac9ced6640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e161b120 0x55b0e17a77c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.394+0000 7fac9ced6640 1 -- 172.21.15.170:0/728040863 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e161b120 2024-04-26T12:31:31.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.394+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17a4d90 con 0x55b0e161b120 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.394+0000 7fac9ced6640 1 -- 172.21.15.170:0/728040863 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e161b120 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.394+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17aa0a0 0x55b0e17ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.394+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17acb30 con 0x55b0e17aa0a0 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.394+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17aa0a0 0x55b0e17ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.395+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17aa0a0 0x55b0e17ac490 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.395+0000 7fac9c6d5640 1 -- 172.21.15.170:0/728040863 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac9008e0b0 con 0x55b0e17aa0a0 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.395+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17a9020 con 0x55b0e161b120 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.395+0000 7fac9ced6640 1 -- 172.21.15.170:0/728040863 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e161b120 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.395+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b0e17adf90 0x55b0e17b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.395+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17b0b60 con 0x55b0e17adf90 2024-04-26T12:31:31.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.395+0000 7fac9bed4640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b0e17adf90 0x55b0e17b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.396+0000 7fac9bed4640 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b0e17adf90 0x55b0e17b0400 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.396+0000 7fac9bed4640 1 -- 172.21.15.170:0/728040863 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17adf90 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.396+0000 7faca1a3a800 1 Processor -- start 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.396+0000 7faca1a3a800 1 -- start start 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.396+0000 7faca1a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17befc0 0x55b0e17bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.396+0000 7faca1a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b0e1596e60 con 0x55b0e17befc0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17befc0 0x55b0e17bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17befc0 0x55b0e17bf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34606/0 (socket says 172.21.15.170:34606) 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fac9c6d5640 1 -- 172.21.15.170:0/2367943734 learned_addr learned my addr 172.21.15.170:0/2367943734 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fac9c6d5640 1 -- 172.21.15.170:0/2367943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e17bf920 con 0x55b0e17befc0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17befc0 0x55b0e17bf3e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fac9008c6e0 tx=0x7fac90067db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fab81ffb640 1 -- 172.21.15.170:0/2367943734 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90084040 con 0x55b0e17befc0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fab81ffb640 1 -- 172.21.15.170:0/2367943734 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90058040 con 0x55b0e17befc0 2024-04-26T12:31:31.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7fab81ffb640 1 -- 172.21.15.170:0/2367943734 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90067950 con 0x55b0e17befc0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0e17c0390 con 0x55b0e17befc0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.397+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0e17c0890 con 0x55b0e17befc0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.398+0000 7fab81ffb640 1 -- 172.21.15.170:0/2367943734 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fac90009af0 con 0x55b0e17befc0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.398+0000 7fab81ffb640 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab74036950 0x7fab74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.398+0000 7fab81ffb640 1 -- 172.21.15.170:0/2367943734 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fac9009cab0 con 0x55b0e17befc0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.398+0000 7fac9bed4640 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab74036950 0x7fab74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.398+0000 7faca1a3a800 1 Processor -- start 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.398+0000 7faca1a3a800 1 -- start start 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fac9bed4640 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab74036950 0x7fab74038e10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00bf50 tx=0x7fac8c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7faca1a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7faca1a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b0e1799560 con 0x55b0e17cc0e0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34608/0 (socket says 172.21.15.170:34608) 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fac9c6d5640 1 -- 172.21.15.170:0/1396287159 learned_addr learned my addr 172.21.15.170:0/1396287159 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fac9c6d5640 1 -- 172.21.15.170:0/1396287159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e17ccad0 con 0x55b0e17cc0e0 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/1396287159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17cc500 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fac900097e0 tx=0x7fac90002d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad092eedb7c196d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fab737fe640 1 -- 172.21.15.170:0/1396287159 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac900aa020 con 0x55b0e17cc0e0 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fab737fe640 1 -- 172.21.15.170:0/1396287159 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9008ca30 con 0x55b0e17cc0e0 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.399+0000 7fab737fe640 1 -- 172.21.15.170:0/1396287159 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac9004f2a0 con 0x55b0e17cc0e0 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 -- 172.21.15.170:0/1396287159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 msgr2=0x55b0e17cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 --2- 172.21.15.170:0/1396287159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17cc500 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fac900097e0 tx=0x7fac90002d80 comp rx=0 tx=0).stop 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 -- 172.21.15.170:0/1396287159 shutdown_connections 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 --2- 172.21.15.170:0/1396287159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17cc500 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 -- 172.21.15.170:0/1396287159 >> 172.21.15.170:0/1396287159 conn(0x55b0e17c8440 msgr2=0x55b0e17c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 -- 172.21.15.170:0/1396287159 shutdown_connections 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 -- 172.21.15.170:0/1396287159 wait complete. 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 Processor -- start 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 -- start start 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7faca1a3a800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55b0e17cd180 con 0x55b0e17cc0e0 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7fac9c6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17d34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:34620/0 (socket says 172.21.15.170:34620) 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.400+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 learned_addr learned my addr 172.21.15.170:0/160004889 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.401+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e17d3a10 con 0x55b0e17cc0e0 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.401+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17d34d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fac900097e0 tx=0x7fac90089ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.401+0000 7fab71ffb640 1 -- 172.21.15.170:0/160004889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac900bf070 con 0x55b0e17cc0e0 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.401+0000 7fab71ffb640 1 -- 172.21.15.170:0/160004889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90068cf0 con 0x55b0e17cc0e0 2024-04-26T12:31:31.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.401+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0e17d3a10 con 0x55b0e17cc0e0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.401+0000 7fab71ffb640 1 -- 172.21.15.170:0/160004889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac90097980 con 0x55b0e17cc0e0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.401+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0e17d3a10 con 0x55b0e17cc0e0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.402+0000 7fab71ffb640 1 -- 172.21.15.170:0/160004889 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fac900c2070 con 0x55b0e17cc0e0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.402+0000 7fab71ffb640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab64036950 0x7fab64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.402+0000 7fab71ffb640 1 -- 172.21.15.170:0/160004889 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fac900b5030 con 0x55b0e17cc0e0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.402+0000 7fac9bed4640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab64036950 0x7fab64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.402+0000 7fac9bed4640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab64036950 0x7fab64038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fac8c001b60 tx=0x7fac8c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.402+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e17dec50 0x55b0e17e1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e1860 con 0x55b0e17dec50 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7fac9ced6640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e17dec50 0x55b0e17e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7fac9ced6640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e17dec50 0x55b0e17e1110 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 20 realm 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e1c70 con 0x55b0e17dec50 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.403+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e2540 con 0x55b0e17dec50 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7faca1a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7faca1a3a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17e3640 0x55b0e17e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e6040 con 0x55b0e17e3640 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17e3640 0x55b0e17e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.404+0000 7fac9c6d5640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17e3640 0x55b0e17e5a30 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7faca1a3a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7faca1a3a800 20 searching for the correct realm 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b0e17e7fd0 0x55b0e17ea490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17eab60 con 0x55b0e17e7fd0 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7fac9bed4640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b0e17e7fd0 0x55b0e17ea490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7fac9bed4640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b0e17e7fd0 0x55b0e17ea490 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7fac9bed4640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fac8c038040 0x7fac8c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17eab60 con 0x7fac8c038040 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.405+0000 7fac9ced6640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fac8c038040 0x7fac8c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.406+0000 7fac9ced6640 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fac8c038040 0x7fac8c01bab0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.406+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fac9400a4a0 con 0x7fac8c038040 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.406+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.406+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.406+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.406+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x7fac8c038040 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac9400a4a0 con 0x7fac8c038040 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.407+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x7fac8c038040 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac9400a4a0 con 0x7fac8c038040 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac9400a4a0 con 0x55b0e17dec50 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.408+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x7fac8c038040 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.409+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.409+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.409+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.409+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.409+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.409+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.410+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x7fac8c038040 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.411+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.412+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x7fac8c038040 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17e3640 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x55b0e17dec50 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.413+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e28e0 con 0x7fac8c038040 2024-04-26T12:31:31.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e6900 con 0x55b0e17dec50 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e6900 con 0x55b0e17dec50 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:31.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e6900 con 0x7fac8c038040 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 zone default found 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 4 Realm: () 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 zonegroup default 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.414+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17e71a0 con 0x55b0e17e3640 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ec9c0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ecd60 con 0x55b0e17e7fd0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 20 started sync module instance, tier type = 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.415+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ebe60 con 0x7fac8c038040 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.416+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.416+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94218185785936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ebe60 con 0x7fac8c038040 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.416+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ed610 con 0x55b0e17dec50 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.417+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94218185785936] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.418+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.418+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94218185789696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ebe60 con 0x55b0e17dec50 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.418+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ee0a0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.419+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.419+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94218185792368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ee940 con 0x55b0e17e7fd0 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.419+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ef400 con 0x7fac8c038040 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.419+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94218185789696] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.420+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.420+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94218185797328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ef7f0 con 0x7fac8c038040 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.420+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f01f0 con 0x55b0e17dec50 2024-04-26T12:31:31.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.420+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94218185792368] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.421+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94218185797328] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.421+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.421+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94218185783728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17efd00 con 0x55b0e17dec50 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.421+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f0a90 con 0x55b0e17e3640 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.422+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.422+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94218185803232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17efd00 con 0x55b0e17e3640 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.422+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f19a0 con 0x55b0e17e3640 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.422+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94218185783728] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.423+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94218185803232] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.423+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.423+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94218185794704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f1d40 con 0x55b0e17e3640 2024-04-26T12:31:31.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.423+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f25d0 con 0x55b0e17e3640 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94218185810144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f2dc0 con 0x55b0e17e3640 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 20 add_watcher() i=0 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 20 add_watcher() i=1 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 20 add_watcher() i=2 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 20 add_watcher() i=3 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 20 add_watcher() i=4 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 20 add_watcher() i=5 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94218185794704] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.424+0000 7faca1a3a800 20 add_watcher() i=6 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.425+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94218185810144] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.425+0000 7faca1a3a800 20 add_watcher() i=7 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.425+0000 7faca1a3a800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:31.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.425+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f1480 con 0x55b0e17dec50 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.425+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.425+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94218185812048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f1480 con 0x55b0e17dec50 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.426+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94218185812048] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.426+0000 7fab527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.426+0000 7faca1a3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.426+0000 7faca1a3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.426+0000 7faca1a3a800 5 note: GC not initialized 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.427+0000 7fab517e2640 20 reqs_thread_entry: start 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.427+0000 7faca1a3a800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.427+0000 7faca1a3a800 20 Filter name: none 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.427+0000 7faac2ffd640 20 reqs_thread_entry: start 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.427+0000 7faca1a3a800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.427+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.439 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.427+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18294d0 con 0x55b0e17e3640 2024-04-26T12:31:31.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.428+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.428+0000 7faca1a3a800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:31:31.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.428+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-26T12:31:31.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.428+0000 7faca1a3a800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-26T12:31:31.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.428+0000 7faca1a3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:31:31.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.428+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182d840 con 0x7fac8c038040 2024-04-26T12:31:31.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7faca1a3a800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7faca1a3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94218186052096 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182e4b0 con 0x55b0e17e3640 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== watch-notify(notify (1) cookie 94218185803232 notify 137438953495 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55b0e17c0390 con 0x55b0e17e3640 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7fab737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94218185803232 notifier 4740 bl.length()=382 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(64 notify.5 [notify cookie 94218186052096 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7fab737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7fab737fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.429+0000 7fab737fe640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fab60003ea0 con 0x55b0e17e3640 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.430+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.430+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== watch-notify(notify_complete (2) cookie 94218186052096 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0e17bf920 con 0x55b0e17e3640 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.430+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182d200 con 0x55b0e17dec50 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.430+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.430+0000 7faca1a3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 : miss 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.430+0000 7faca1a3a800 20 rados->read ofs=0 len=0 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.430+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 8.0 8:0061f48e:root::.bucket.meta.myfoo6%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182b910 con 0x55b0e17e7fd0 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7faca1a3a800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 info.flags=0x17 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7faca1a3a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 to cache LRU end 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7faca1a3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7faca1a3a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7faca1a3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.431+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 8.0 8:0061f48e:root::.bucket.meta.myfoo6%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1835a40 con 0x55b0e17e7fd0 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 info.flags=0x17 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 to cache LRU end 2024-04-26T12:31:31.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9, ofs0, ns] 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.9 7:93e5b521:::notify.7:head [notify cookie 94218186047376 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1830020 con 0x55b0e17e3640 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== watch-notify(notify (1) cookie 94218185810144 notify 137438953496 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55b0e17bf920 con 0x55b0e17e3640 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fab737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94218185810144 notifier 4740 bl.length()=748 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fab737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 info.flags=0x17 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fab737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 to cache LRU end 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fab737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fab737fe640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fab60003ea0 con 0x55b0e17e3640 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(69 notify.7 [notify cookie 94218186047376 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(70 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== watch-notify(notify_complete (2) cookie 94218186047376 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0e17a1150 con 0x55b0e17e3640 2024-04-26T12:31:31.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): orig_sources= new_sources= 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): potential sources added=[] removed=[] 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): orig_dests= new_dests= 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): potential dests added=[] removed=[] 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.432+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18353d0 con 0x55b0e17dec50 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.433+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(71 bud.buckets [call] v32'11 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.433+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1831c40 con 0x55b0e17dec50 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.434+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(72 bud.buckets [call] v32'12 uv12 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.434+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182fb40 con 0x55b0e17dec50 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.435+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.435+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-26T12:31:31.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.435+0000 7faca1a3a800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.435+0000 7faca1a3a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.435+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94218186047376 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182fb40 con 0x7fac8c038040 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== watch-notify(notify (1) cookie 94218185797328 notify 137438953489 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55b0e1832c50 con 0x7fac8c038040 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fab72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94218185797328 notifier 4740 bl.length()=316 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(74 notify.3 [notify cookie 94218186047376 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fab72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fab72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fab72ffd640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faad0003400 con 0x7fac8c038040 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== watch-notify(notify_complete (2) cookie 94218186047376 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fac94018b00 con 0x7fac8c038040 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7faca1a3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 : hit (requested=0x17, cached=0x17) 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7faca1a3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.436+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:76 8.0 8:0061f48e:root::.bucket.meta.myfoo6%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182cff0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.437+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(76 .bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.437+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 info.flags=0x17 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.437+0000 7faca1a3a800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 to cache LRU end 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.437+0000 7faca1a3a800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.437+0000 7faca1a3a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9, ofs0, ns] 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.437+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94218186064192 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1832e20 con 0x55b0e17e3640 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== watch-notify(notify (1) cookie 94218185810144 notify 137438953497 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55b0e17a1150 con 0x55b0e17e3640 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fab72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94218185810144 notifier 4740 bl.length()=748 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fab72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 info.flags=0x17 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fab72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 to cache LRU end 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fab72ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fab72ffd640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faad00037c0 con 0x55b0e17e3640 2024-04-26T12:31:31.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(77 notify.7 [notify cookie 94218186064192 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== watch-notify(notify_complete (2) cookie 94218186064192 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0e17a0c90 con 0x55b0e17e3640 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): orig_sources= new_sources= 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): potential sources added=[] removed=[] 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): orig_dests= new_dests= 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7faca1a3a800 20 handle_bi_update(): bucket=:myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]): potential dests added=[] removed=[] 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.438+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:79 4.18 4:1ad7e467:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x7fac8c038040 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.439+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(79 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.439+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:80 4.e 4:71a24961:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x7fac8c038040 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.439+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(80 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.439+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:81 4.3e 4:7d129eda:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x7fac8c038040 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.439+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(81 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.439+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:82 4.24 4:2486ef6d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x55b0e17e3640 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.440+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(82 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.440+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:83 4.12 4:4aa29545:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x55b0e17dec50 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.440+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(83 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.440+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:84 4.20 4:0404fa5b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x55b0e17dec50 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.441+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(84 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.441+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:85 4.f 4:f212361e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x55b0e17dec50 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.441+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(85 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac94033040 con 0x55b0e17dec50 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.441+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:86 4.3d 4:bc0f3ee8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x7fac8c038040 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.441+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(86 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac94033040 con 0x7fac8c038040 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.441+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:87 4.24 4:2632118c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x55b0e17e3640 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(87 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x55b0e17e3640 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(88 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [call out=377b] v0'0 uv25 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7faca1a3a800 10 cls_bucket_list_unordered: got thirteen 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 4.14 4:288e2374:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18305c0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(89 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7faca1a3a800 20 get_obj_state: octx=0x7fac9400ab10 obj=myfoo6:thirteen state=0x55b0e182a398 s->prefetch_data=0 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.442+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:90 3.1bs0 3:d83de5ce:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182e8e0 con 0x55b0e17e7fd0 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(90 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 10 manifest: total_size = 8 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.1808330979010371672 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.acl 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.etag 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-26T12:31:31.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 get_obj_state: octx=0x7fac9400ab10 obj=myfoo6:thirteen state=0x55b0e182a398 s->prefetch_data=0 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 : hit (requested=0x17, cached=0x17) 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.443+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:91 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1839480 con 0x55b0e17e3640 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.444+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(91 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [stat,call,call] v32'26 uv26 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.444+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:92 3.1bs0 3:d83de5ce:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1837910 con 0x55b0e17e7fd0 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.445+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(92 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.445+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:93 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1838e50 con 0x55b0e17e3640 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:1 objects processed in :myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9]). Next marker thirteen 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.445+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1838e50 con 0x7fac8c038040 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(93 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [stat,call,call] v32'27 uv27 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fab737fe640 20 handle_completion(): completion ok for obj=thirteen 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fac9405c040 con 0x7fac8c038040 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7faca1a3a800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7faca1a3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94218186055936 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e18389a0 con 0x55b0e17e3640 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== watch-notify(notify (1) cookie 94218185803232 notify 137438953498 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55b0e17a0c90 con 0x55b0e17e3640 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fab72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94218185803232 notifier 4740 bl.length()=556 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fab72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fab72ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(95 notify.5 [notify cookie 94218186055936 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fab72ffd640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faad0003560 con 0x55b0e17e3640 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== watch-notify(notify_complete (2) cookie 94218186055936 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0e15598f0 con 0x55b0e17e3640 2024-04-26T12:31:31.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.447+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182e100 con 0x55b0e17dec50 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.448+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fac9405c040 con 0x55b0e17dec50 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.448+0000 7faca1a3a800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.448+0000 7faca1a3a800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.448+0000 7faca1a3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.448+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94218186055936 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1838b00 con 0x55b0e17e3640 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== watch-notify(notify (1) cookie 94218185803232 notify 137438953499 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b0e15598f0 con 0x55b0e17e3640 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fab737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94218185803232 notifier 4740 bl.length()=177 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(98 notify.5 [notify cookie 94218186055936 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fab737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fab737fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fab737fe640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fab60003ea0 con 0x55b0e17e3640 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== watch-notify(notify_complete (2) cookie 94218186055936 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0e1562590 con 0x55b0e17e3640 2024-04-26T12:31:31.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7faca1a3a800 10 removing user index: bar 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.449+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e182e0d0 con 0x55b0e17e3640 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(100 bar [delete] v32'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7faca1a3a800 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7faca1a3a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94218186055888 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1838b00 con 0x55b0e17e3640 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== watch-notify(notify (1) cookie 94218185810144 notify 137438953500 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55b0e1562590 con 0x55b0e17e3640 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7fab737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94218185810144 notifier 4740 bl.length()=152 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== osd_op_reply(101 notify.7 [notify cookie 94218186055888 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7fab737fe640 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fab60003ea0 con 0x55b0e17e3640 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.450+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.451+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== watch-notify(notify_complete (2) cookie 94218186055888 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b0e1563d40 con 0x55b0e17e3640 2024-04-26T12:31:31.467 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-26T12:31:31.280835Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:31:31.280819Z","tags":[],"group_ids":[]} 2024-04-26T12:31:31.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.451+0000 7fab527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.451+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94218185812048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e1838b00 con 0x55b0e17dec50 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.452+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94218185812048] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac9405c040 con 0x55b0e17dec50 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.452+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94218185785936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17f2810 con 0x7fac8c038040 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.453+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94218185785936] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac9405c040 con 0x7fac8c038040 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.453+0000 7faca1a3a800 20 remove_watcher() i=0 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.453+0000 7faca1a3a800 2 removed watcher, disabling cache 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.453+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94218185789696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ec250 con 0x55b0e17dec50 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.454+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94218185789696] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac9405c040 con 0x55b0e17dec50 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.454+0000 7faca1a3a800 20 remove_watcher() i=1 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.454+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94218185792368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ec250 con 0x55b0e17e7fd0 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.455+0000 7fac9bed4640 1 -- 172.21.15.170:0/160004889 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94218185792368] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac8c009050 con 0x55b0e17e7fd0 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.455+0000 7faca1a3a800 20 remove_watcher() i=2 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.455+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94218185797328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17edb70 con 0x7fac8c038040 2024-04-26T12:31:31.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.456+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94218185797328] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac9405c040 con 0x7fac8c038040 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.456+0000 7faca1a3a800 20 remove_watcher() i=3 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.456+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94218185783728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ec250 con 0x55b0e17dec50 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.457+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94218185783728] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac9405c040 con 0x55b0e17dec50 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.457+0000 7faca1a3a800 20 remove_watcher() i=4 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.457+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94218185803232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17edb70 con 0x55b0e17e3640 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.458+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 48 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94218185803232] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.458+0000 7faca1a3a800 20 remove_watcher() i=5 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.458+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94218185794704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17eb9b0 con 0x55b0e17e3640 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.459+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 49 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94218185794704] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.459+0000 7faca1a3a800 20 remove_watcher() i=6 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.459+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94218185810144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b0e17ec250 con 0x55b0e17e3640 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.460+0000 7fac9c6d5640 1 -- 172.21.15.170:0/160004889 <== osd.0 v2:172.21.15.132:6800/965566727 50 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94218185810144] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac900c1030 con 0x55b0e17e3640 2024-04-26T12:31:31.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.460+0000 7faca1a3a800 20 remove_watcher() i=7 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.460+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17e3640 msgr2=0x55b0e17e5a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.460+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17e3640 0x55b0e17e5a30 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e17dec50 msgr2=0x55b0e17e1110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e17dec50 0x55b0e17e1110 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fac8c038040 msgr2=0x7fac8c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fac8c038040 0x7fac8c01bab0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b0e17e7fd0 msgr2=0x55b0e17ea490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55b0e17e7fd0 0x55b0e17ea490 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab64036950 msgr2=0x7fab64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab64036950 0x7fab64038e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fac8c001b60 tx=0x7fac8c010000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 msgr2=0x55b0e17d34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7fac9ced6640 1 -- 172.21.15.170:0/160004889 reap_dead start 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17d34d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fac900097e0 tx=0x7fac90089ea0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 shutdown_connections 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/160004889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17cc0e0 0x55b0e17d34d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 >> 172.21.15.170:0/160004889 conn(0x55b0e17c8440 msgr2=0x55b0e17c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 shutdown_connections 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/160004889 wait complete. 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab74036950 msgr2=0x7fab74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab74036950 0x7fab74038e10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00bf50 tx=0x7fac8c00f000 comp rx=0 tx=0).stop 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17befc0 msgr2=0x55b0e17bf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17befc0 0x55b0e17bf3e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fac9008c6e0 tx=0x7fac90067db0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 shutdown_connections 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab74036950 0x7fab74038e10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 --2- 172.21.15.170:0/2367943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e17befc0 0x55b0e17bf3e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 >> 172.21.15.170:0/2367943734 conn(0x55b0e17b3060 msgr2=0x55b0e17b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 shutdown_connections 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.461+0000 7faca1a3a800 1 -- 172.21.15.170:0/2367943734 wait complete. 2024-04-26T12:31:31.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17aa0a0 msgr2=0x55b0e17ac490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55b0e17aa0a0 0x55b0e17ac490 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e161b120 msgr2=0x55b0e17a77c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55b0e161b120 0x55b0e17a77c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b0e17adf90 msgr2=0x55b0e17b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55b0e17adf90 0x55b0e17b0400 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab84036900 msgr2=0x7fab84038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fab84036900 0x7fab84038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac8c000f60 tx=0x7fac8c0012b0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 msgr2=0x55b0e17a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 --2- 172.21.15.170:0/728040863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b0e1619c10 0x55b0e17a0750 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fac90000c00 tx=0x7fac90002fb0 comp rx=0 tx=0).stop 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7fac9ced6640 1 -- 172.21.15.170:0/728040863 reap_dead start 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 shutdown_connections 2024-04-26T12:31:31.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 >> 172.21.15.170:0/728040863 conn(0x55b0e16a0ba0 msgr2=0x55b0e1797890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:31.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 shutdown_connections 2024-04-26T12:31:31.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:31.462+0000 7faca1a3a800 1 -- 172.21.15.170:0/728040863 wait complete. 2024-04-26T12:31:31.478 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-26T12:31:31.280835Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:31:31.280819Z', 'tags': [], 'group_ids': []} 2024-04-26T12:31:36.486 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:31:36.486 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-26T12:31:36.486 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-26T12:31:36.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-26T12:31:36.486 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-26T12:31:36.545 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:36.545 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:36.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.544+0000 7f170c52e800 1 Processor -- start 2024-04-26T12:31:36.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.544+0000 7f170c52e800 1 -- start start 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.544+0000 7f170c52e800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559ff2a309a0 0x559ff2a32d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.544+0000 7f170c52e800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ff28da0c0 con 0x559ff2a2ca00 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.544+0000 7f170c52e800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x559ff28be4d0 con 0x559ff2a309a0 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.545+0000 7f16fffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559ff2a309a0 0x559ff2a32d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.545+0000 7f16fffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559ff2a309a0 0x559ff2a32d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36356/0 (socket says 172.21.15.170:36356) 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.545+0000 7f1708267640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559ff2a2ca00 0x559ff2a2ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:59340/0 (socket says 172.21.15.170:59340) 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.545+0000 7f16fffff640 1 -- 172.21.15.170:0/3699209703 learned_addr learned my addr 172.21.15.170:0/3699209703 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.545+0000 7f16fffff640 1 -- 172.21.15.170:0/3699209703 >> v1:172.21.15.132:6789/0 conn(0x559ff2a2ca00 legacy=0x559ff2a2ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.545+0000 7f16fffff640 1 -- 172.21.15.170:0/3699209703 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff28ebd40 con 0x559ff2a309a0 2024-04-26T12:31:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.547+0000 7f16fffff640 1 --2- 172.21.15.170:0/3699209703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a309a0 0x559ff2a32d90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f16f000a520 tx=0x7f16f001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7fb4777644a61c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.547+0000 7f1707a66640 1 -- 172.21.15.170:0/3699209703 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f0057070 con 0x559ff2a309a0 2024-04-26T12:31:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.547+0000 7f1707a66640 1 -- 172.21.15.170:0/3699209703 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0052570 con 0x559ff2a309a0 2024-04-26T12:31:36.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.547+0000 7f1707a66640 1 -- 172.21.15.170:0/3699209703 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f004ae60 con 0x559ff2a309a0 2024-04-26T12:31:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.548+0000 7f170c52e800 1 -- 172.21.15.170:0/3699209703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a309a0 msgr2=0x559ff2a32d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.548+0000 7f170c52e800 1 --2- 172.21.15.170:0/3699209703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a309a0 0x559ff2a32d90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f16f000a520 tx=0x7f16f001d010 comp rx=0 tx=0).stop 2024-04-26T12:31:36.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.548+0000 7f170c52e800 1 -- 172.21.15.170:0/3699209703 shutdown_connections 2024-04-26T12:31:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.548+0000 7f170c52e800 1 --2- 172.21.15.170:0/3699209703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a309a0 0x559ff2a32d90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.548+0000 7f170c52e800 1 -- 172.21.15.170:0/3699209703 >> 172.21.15.170:0/3699209703 conn(0x559ff2a271b0 msgr2=0x559ff2a295d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.548+0000 7f170c52e800 1 -- 172.21.15.170:0/3699209703 shutdown_connections 2024-04-26T12:31:36.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.548+0000 7f170c52e800 1 -- 172.21.15.170:0/3699209703 wait complete. 2024-04-26T12:31:36.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.561+0000 7f170c52e800 1 Processor -- start 2024-04-26T12:31:36.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.561+0000 7f170c52e800 1 -- start start 2024-04-26T12:31:36.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.561+0000 7f170c52e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2b1d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.561+0000 7f170c52e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559ff2978ba0 con 0x559ff2a2ca00 2024-04-26T12:31:36.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.562+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2b1d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.562+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2b1d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36368/0 (socket says 172.21.15.170:36368) 2024-04-26T12:31:36.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.562+0000 7f1708267640 1 -- 172.21.15.170:0/3129883546 learned_addr learned my addr 172.21.15.170:0/3129883546 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.562+0000 7f1708267640 1 -- 172.21.15.170:0/3129883546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff28ea590 con 0x559ff2a2ca00 2024-04-26T12:31:36.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.562+0000 7f1708267640 1 --2- 172.21.15.170:0/3129883546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2b1d6d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f16f8001e40 tx=0x7f16f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6bc31b51ff3f4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.562+0000 7f15f660c640 1 -- 172.21.15.170:0/3129883546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f800e5c0 con 0x559ff2a2ca00 2024-04-26T12:31:36.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f15f660c640 1 -- 172.21.15.170:0/3129883546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f8006070 con 0x559ff2a2ca00 2024-04-26T12:31:36.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f15f660c640 1 -- 172.21.15.170:0/3129883546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f800e910 con 0x559ff2a2ca00 2024-04-26T12:31:36.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f170c52e800 1 -- 172.21.15.170:0/3129883546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 msgr2=0x559ff2b1d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f170c52e800 1 --2- 172.21.15.170:0/3129883546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2b1d6d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f16f8001e40 tx=0x7f16f8001e70 comp rx=0 tx=0).stop 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f170c52e800 1 -- 172.21.15.170:0/3129883546 shutdown_connections 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f170c52e800 1 --2- 172.21.15.170:0/3129883546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2b1d6d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f170c52e800 1 -- 172.21.15.170:0/3129883546 >> 172.21.15.170:0/3129883546 conn(0x559ff2a271b0 msgr2=0x559ff2b18ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f170c52e800 1 -- 172.21.15.170:0/3129883546 shutdown_connections 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.563+0000 7f170c52e800 1 -- 172.21.15.170:0/3129883546 wait complete. 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f170c52e800 1 Processor -- start 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f170c52e800 1 -- start start 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f170c52e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2a2c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f170c52e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559ff2a335d0 con 0x559ff2a2ca00 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2a2c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2a2c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36378/0 (socket says 172.21.15.170:36378) 2024-04-26T12:31:36.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f1708267640 1 -- 172.21.15.170:0/499752745 learned_addr learned my addr 172.21.15.170:0/499752745 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.564+0000 7f1708267640 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff28e18f0 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.565+0000 7f1708267640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2a2c1d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f16f8000f60 tx=0x7f16f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.565+0000 7f15f4e09640 1 -- 172.21.15.170:0/499752745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f800f8d0 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.565+0000 7f15f4e09640 1 -- 172.21.15.170:0/499752745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f800fa70 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.565+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ff2b26bc0 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.565+0000 7f15f4e09640 1 -- 172.21.15.170:0/499752745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f800fd90 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.565+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ff2b2b520 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f15f4e09640 1 -- 172.21.15.170:0/499752745 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16f8017070 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f15f4e09640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15f00368b0 0x7f15f0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f15f4e09640 1 -- 172.21.15.170:0/499752745 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f16f8015020 con 0x559ff2a2ca00 2024-04-26T12:31:36.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f16fffff640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15f00368b0 0x7f15f0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2a309a0 0x559ff2b2f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b2f940 con 0x559ff2a309a0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f1708a68640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2a309a0 0x559ff2b2f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.566+0000 7f16fffff640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15f00368b0 0x7f15f0038d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16f000a520 tx=0x7f16f004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.567+0000 7f1708a68640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2a309a0 0x559ff2b2f340 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.567+0000 7f1708a68640 1 -- 172.21.15.170:0/499752745 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2a309a0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.567+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b2c8c0 con 0x559ff2a309a0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.567+0000 7f1708a68640 1 -- 172.21.15.170:0/499752745 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2a309a0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.567+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b31c20 0x559ff2b34010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.567+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b346b0 con 0x559ff2b31c20 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.567+0000 7f1708267640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b31c20 0x559ff2b34010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.568+0000 7f1708267640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b31c20 0x559ff2b34010 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.568+0000 7f1708267640 1 -- 172.21.15.170:0/499752745 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b31c20 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.568+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b30bd0 con 0x559ff2a309a0 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.568+0000 7f1708a68640 1 -- 172.21.15.170:0/499752745 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2a309a0 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.569+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559ff2b35b60 0x559ff2b37fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.569+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b38730 con 0x559ff2b35b60 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.569+0000 7f16fffff640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559ff2b35b60 0x559ff2b37fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.569+0000 7f16fffff640 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559ff2b35b60 0x559ff2b37fd0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.569+0000 7f16fffff640 1 -- 172.21.15.170:0/499752745 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16f005a040 con 0x559ff2b35b60 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f170c52e800 1 Processor -- start 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f170c52e800 1 -- start start 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f170c52e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b46b60 0x559ff2b46f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f170c52e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559ff291ee60 con 0x559ff2b46b60 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b46b60 0x559ff2b46f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b46b60 0x559ff2b46f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36394/0 (socket says 172.21.15.170:36394) 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f1708267640 1 -- 172.21.15.170:0/221468669 learned_addr learned my addr 172.21.15.170:0/221468669 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f1708267640 1 -- 172.21.15.170:0/221468669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff2b474c0 con 0x559ff2b46b60 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.570+0000 7f1708267640 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b46b60 0x559ff2b46f80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f16f804b540 tx=0x7f16f8044950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.571+0000 7f15edffb640 1 -- 172.21.15.170:0/221468669 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f803fe90 con 0x559ff2b46b60 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.571+0000 7f15edffb640 1 -- 172.21.15.170:0/221468669 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f8017960 con 0x559ff2b46b60 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.571+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ff2b47f30 con 0x559ff2b46b60 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.571+0000 7f15edffb640 1 -- 172.21.15.170:0/221468669 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8017c80 con 0x559ff2b46b60 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.571+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ff2b48430 con 0x559ff2b46b60 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.571+0000 7f15edffb640 1 -- 172.21.15.170:0/221468669 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16f801a480 con 0x559ff2b46b60 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f15edffb640 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15e0036aa0 0x7f15e0038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f15edffb640 1 -- 172.21.15.170:0/221468669 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f16f8038020 con 0x559ff2b46b60 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f16fffff640 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15e0036aa0 0x7f15e0038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f170c52e800 1 Processor -- start 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f170c52e800 1 -- start start 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f16fffff640 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15e0036aa0 0x7f15e0038f60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x559ff2b2c830 tx=0x7f16f0005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f170c52e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b54130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f170c52e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559ff2b1de50 con 0x559ff2b53d10 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b54130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b54130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36410/0 (socket says 172.21.15.170:36410) 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.572+0000 7f1708267640 1 -- 172.21.15.170:0/3091940409 learned_addr learned my addr 172.21.15.170:0/3091940409 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.573+0000 7f1708267640 1 -- 172.21.15.170:0/3091940409 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff2b54700 con 0x559ff2b53d10 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.573+0000 7f1708267640 1 --2- 172.21.15.170:0/3091940409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b54130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f16f8031fd0 tx=0x7f16f8026440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f93f847d8de05c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.573+0000 7f15e77fe640 1 -- 172.21.15.170:0/3091940409 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8061070 con 0x559ff2b53d10 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.573+0000 7f15e77fe640 1 -- 172.21.15.170:0/3091940409 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f801d5f0 con 0x559ff2b53d10 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.573+0000 7f15e77fe640 1 -- 172.21.15.170:0/3091940409 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8045090 con 0x559ff2b53d10 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.573+0000 7f170c52e800 1 -- 172.21.15.170:0/3091940409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 msgr2=0x559ff2b54130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.573+0000 7f170c52e800 1 --2- 172.21.15.170:0/3091940409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b54130 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f16f8031fd0 tx=0x7f16f8026440 comp rx=0 tx=0).stop 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 -- 172.21.15.170:0/3091940409 shutdown_connections 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 --2- 172.21.15.170:0/3091940409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b54130 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 -- 172.21.15.170:0/3091940409 >> 172.21.15.170:0/3091940409 conn(0x559ff2b50030 msgr2=0x559ff2b4e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 -- 172.21.15.170:0/3091940409 shutdown_connections 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 -- 172.21.15.170:0/3091940409 wait complete. 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 Processor -- start 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 -- start start 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b5b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f170c52e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559ff2b54e20 con 0x559ff2b53d10 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b5b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f1708267640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b5b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36416/0 (socket says 172.21.15.170:36416) 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.574+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 learned_addr learned my addr 172.21.15.170:0/798463002 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.575+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff2b5b6a0 con 0x559ff2b53d10 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.575+0000 7f1708267640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b5b160 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f16f8026910 tx=0x7f16f800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.575+0000 7f15e5ffb640 1 -- 172.21.15.170:0/798463002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8061030 con 0x559ff2b53d10 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.575+0000 7f15e5ffb640 1 -- 172.21.15.170:0/798463002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f806e070 con 0x559ff2b53d10 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.575+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ff2b5b6a0 con 0x559ff2b53d10 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.575+0000 7f15e5ffb640 1 -- 172.21.15.170:0/798463002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8045090 con 0x559ff2b53d10 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.575+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ff2b5bb40 con 0x559ff2b53d10 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.576+0000 7f15e5ffb640 1 -- 172.21.15.170:0/798463002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16f8059040 con 0x559ff2b53d10 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.576+0000 7f15e5ffb640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15d8036900 0x7f15d8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.576+0000 7f15e5ffb640 1 -- 172.21.15.170:0/798463002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f16f8056040 con 0x559ff2b53d10 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.576+0000 7f16fffff640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15d8036900 0x7f15d8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.576+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.576+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2b668c0 0x559ff2b68d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.576+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b694d0 con 0x559ff2b668c0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f16fffff640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15d8036900 0x7f15d8038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16f0052fd0 tx=0x7f16f004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f1708a68640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2b668c0 0x559ff2b68d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f1708a68640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2b668c0 0x559ff2b68d80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 20 realm 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b698e0 con 0x559ff2b668c0 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.577+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a1b0 con 0x559ff2b668c0 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f170c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b6b2b0 0x559ff2b6d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6dcb0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.578+0000 7f1708267640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b6b2b0 0x559ff2b6d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f1708267640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b6b2b0 0x559ff2b6d6a0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f170c52e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f170c52e800 20 searching for the correct realm 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559ff2b6fbf0 0x559ff2b720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b72730 con 0x559ff2b6fbf0 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f16fffff640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559ff2b6fbf0 0x559ff2b720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.579+0000 7f16fffff640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559ff2b6fbf0 0x559ff2b720b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.580+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.580+0000 7f16fffff640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16f0082040 0x7f16f005d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.580+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b72730 con 0x7f16f0082040 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.580+0000 7f1708a68640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16f0082040 0x7f16f005d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.580+0000 7f1708a68640 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16f0082040 0x7f16f005d440 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f170000a4a0 con 0x7f16f0082040 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.581+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.582+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.582+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.582+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.582+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x7f16f0082040 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.582+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4a0 con 0x7f16f0082040 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.582+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x7f16f0082040 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4a0 con 0x7f16f0082040 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4a0 con 0x559ff2b668c0 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.583+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x7f16f0082040 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.584+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.584+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.584+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.584+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.584+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.584+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.585+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.586+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.586+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.586+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.586+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.586+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x7f16f0082040 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.586+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.586+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.587+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.587+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.587+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.587+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.587+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.587+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.588+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.588+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x7f16f0082040 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.588+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.588+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6fbf0 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.588+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.588+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b6b2b0 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x559ff2b668c0 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6a550 con 0x7f16f0082040 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6e500 con 0x559ff2b668c0 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.589+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6e500 con 0x559ff2b668c0 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6e500 con 0x7f16f0082040 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 zone default found 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 4 Realm: () 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 zonegroup default 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b6edf0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.590+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b74590 con 0x559ff2b6fbf0 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b74930 con 0x559ff2b6fbf0 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f170c52e800 20 started sync module instance, tier type = 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f170c52e800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.591+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b73a30 con 0x7f16f0082040 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.592+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.592+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145460256592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b73a30 con 0x7f16f0082040 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.592+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b752f0 con 0x559ff2b668c0 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.593+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94145460256592] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.594+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.594+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145460254560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b752f0 con 0x559ff2b668c0 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.594+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b75cb0 con 0x559ff2b6fbf0 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.595+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94145460254560] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.595+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.595+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145460260416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b75260 con 0x559ff2b6fbf0 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.595+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b76a90 con 0x7f16f0082040 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.596+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.596+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94145460260416] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.596+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145460266368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b77330 con 0x7f16f0082040 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.596+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b76110 con 0x559ff2b668c0 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.597+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94145460266368] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.598+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.598+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145460268432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b778c0 con 0x559ff2b668c0 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.598+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b782c0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.599+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94145460268432] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.599+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.599+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145460269488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b786b0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.599+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b79070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.600+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94145460269488] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.600+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.600+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145460272592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b79070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.600+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b79a70 con 0x559ff2b6b2b0 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94145460272592] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145460278656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b79eb0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 20 add_watcher() i=0 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 20 add_watcher() i=1 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 20 add_watcher() i=2 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 20 add_watcher() i=3 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 20 add_watcher() i=4 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 20 add_watcher() i=5 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.601+0000 7f170c52e800 20 add_watcher() i=6 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.602+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94145460278656] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.602+0000 7f170c52e800 20 add_watcher() i=7 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.602+0000 7f170c52e800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.602+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b78c80 con 0x559ff2b668c0 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.602+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.602+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145460279712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b7a7b0 con 0x559ff2b668c0 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.603+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94145460279712] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.603+0000 7f15be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 5 note: GC not initialized 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f15bd7e2640 20 reqs_thread_entry: start 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 20 Filter name: none 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f152effd640 20 reqs_thread_entry: start 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.604+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2bb0710 con 0x559ff2b6b2b0 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2baed50 con 0x559ff2b6b2b0 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.605+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2baf640 con 0x559ff2b6b2b0 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f170c52e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f170c52e800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f170c52e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94145460498832 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2bb3d00 con 0x559ff2b6b2b0 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== watch-notify(notify (1) cookie 94145460269488 notify 137438953501 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559ff2bb0160 con 0x559ff2b6b2b0 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f15e77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94145460269488 notifier 4747 bl.length()=556 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f15e77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f15e77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.606+0000 7f15e77fe640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f15cc003ea0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.607+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(65 notify.5 [notify cookie 94145460498832 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.607+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.607+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== watch-notify(notify_complete (2) cookie 94145460498832 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f16f8085040 con 0x559ff2b6b2b0 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.607+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2baf5c0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f170c52e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f170c52e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f170c52e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94145460498704 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559ff2bb3d00 con 0x559ff2b6fbf0 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== watch-notify(notify (1) cookie 94145460260416 notify 137438953478 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f16f008d040 con 0x559ff2b6fbf0 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f15e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94145460260416 notifier 4747 bl.length()=177 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f15e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f15e6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(68 notify.2 [notify cookie 94145460498704 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.608+0000 7f15e6ffd640 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f153c003400 con 0x559ff2b6fbf0 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.609+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.609+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== watch-notify(notify_complete (2) cookie 94145460498704 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559ff28ebd40 con 0x559ff2b6fbf0 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-26T12:31:36.607204Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:31:36.607188Z","tags":[],"group_ids":[]} 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.609+0000 7f15be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.609+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145460279712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b63730 con 0x559ff2b668c0 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.610+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94145460279712] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.610+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145460256592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b63280 con 0x7f16f0082040 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.611+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94145460256592] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.611+0000 7f170c52e800 20 remove_watcher() i=0 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.611+0000 7f170c52e800 2 removed watcher, disabling cache 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.611+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145460254560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b73f30 con 0x559ff2b668c0 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.613+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94145460254560] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.613+0000 7f170c52e800 20 remove_watcher() i=1 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.613+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145460260416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b73760 con 0x559ff2b6fbf0 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.614+0000 7f16fffff640 1 -- 172.21.15.170:0/798463002 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94145460260416] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f007f070 con 0x559ff2b6fbf0 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.614+0000 7f170c52e800 20 remove_watcher() i=2 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.614+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145460266368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b74e40 con 0x7f16f0082040 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.615+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94145460266368] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x7f16f0082040 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.615+0000 7f170c52e800 20 remove_watcher() i=3 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.615+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145460268432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b74e40 con 0x559ff2b668c0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.616+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94145460268432] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1700033040 con 0x559ff2b668c0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.616+0000 7f170c52e800 20 remove_watcher() i=4 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.616+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145460269488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b76d90 con 0x559ff2b6b2b0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.617+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94145460269488] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.617+0000 7f170c52e800 20 remove_watcher() i=5 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.617+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145460272592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b74e40 con 0x559ff2b6b2b0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.618+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94145460272592] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.618+0000 7f170c52e800 20 remove_watcher() i=6 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.618+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145460278656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559ff2b77dd0 con 0x559ff2b6b2b0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f1708267640 1 -- 172.21.15.170:0/798463002 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94145460278656] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f802e070 con 0x559ff2b6b2b0 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 20 remove_watcher() i=7 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b6b2b0 msgr2=0x559ff2b6d6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b6b2b0 0x559ff2b6d6a0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2b668c0 msgr2=0x559ff2b68d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2b668c0 0x559ff2b68d80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16f0082040 msgr2=0x7f16f005d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f16f0082040 0x7f16f005d440 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559ff2b6fbf0 msgr2=0x559ff2b720b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.619+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559ff2b6fbf0 0x559ff2b720b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15d8036900 msgr2=0x7f15d8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15d8036900 0x7f15d8038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16f0052fd0 tx=0x7f16f004f000 comp rx=0 tx=0).stop 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 msgr2=0x559ff2b5b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b5b160 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f16f8026910 tx=0x7f16f800cdd0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f1708a68640 1 -- 172.21.15.170:0/798463002 reap_dead start 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 shutdown_connections 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/798463002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b53d10 0x559ff2b5b160 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 >> 172.21.15.170:0/798463002 conn(0x559ff2b50030 msgr2=0x559ff2b4d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 shutdown_connections 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/798463002 wait complete. 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15e0036aa0 msgr2=0x7f15e0038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15e0036aa0 0x7f15e0038f60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x559ff2b2c830 tx=0x7f16f0005ac0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b46b60 msgr2=0x559ff2b46f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b46b60 0x559ff2b46f80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f16f804b540 tx=0x7f16f8044950 comp rx=0 tx=0).stop 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 shutdown_connections 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15e0036aa0 0x7f15e0038f60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/221468669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2b46b60 0x559ff2b46f80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 >> 172.21.15.170:0/221468669 conn(0x559ff2b3ac00 msgr2=0x559ff2b3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 shutdown_connections 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/221468669 wait complete. 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b31c20 msgr2=0x559ff2b34010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559ff2b31c20 0x559ff2b34010 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2a309a0 msgr2=0x559ff2b2f340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559ff2a309a0 0x559ff2b2f340 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559ff2b35b60 msgr2=0x559ff2b37fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.620+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559ff2b35b60 0x559ff2b37fd0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15f00368b0 msgr2=0x7f15f0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f15f00368b0 0x7f15f0038d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16f000a520 tx=0x7f16f004e000 comp rx=0 tx=0).stop 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 msgr2=0x559ff2a2c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 --2- 172.21.15.170:0/499752745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ff2a2ca00 0x559ff2a2c1d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f16f8000f60 tx=0x7f16f8000bc0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f1708a68640 1 -- 172.21.15.170:0/499752745 reap_dead start 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 shutdown_connections 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 >> 172.21.15.170:0/499752745 conn(0x559ff2a271b0 msgr2=0x559ff2b1c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 shutdown_connections 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.621+0000 7f170c52e800 1 -- 172.21.15.170:0/499752745 wait complete. 2024-04-26T12:31:36.674 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-26T12:31:36.607204Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:31:36.607188Z', 'tags': [], 'group_ids': []} 2024-04-26T12:31:36.687 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:31:36.692 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-26T12:31:36.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-26T12:31:36.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-26T12:31:36.693 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-26T12:31:36.737 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:36.737 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.736+0000 7fdc2320e800 1 Processor -- start 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.736+0000 7fdc2320e800 1 -- start start 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.736+0000 7fdc2320e800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5631b8221b50 0x5631b8223f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.736+0000 7fdc2320e800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631b80ca0c0 con 0x5631b821e040 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.736+0000 7fdc2320e800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5631b80ae4d0 con 0x5631b8221b50 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.737+0000 7fdc2050c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5631b8221b50 0x5631b8223f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.737+0000 7fdc2050c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5631b8221b50 0x5631b8223f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36420/0 (socket says 172.21.15.170:36420) 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.737+0000 7fdc2050c640 1 -- 172.21.15.170:0/3473144194 learned_addr learned my addr 172.21.15.170:0/3473144194 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.737+0000 7fdc20d0d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5631b821e040 0x5631b8220430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:59346/0 (socket says 172.21.15.170:59346) 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.737+0000 7fdc2050c640 1 -- 172.21.15.170:0/3473144194 >> v1:172.21.15.132:6789/0 conn(0x5631b821e040 legacy=0x5631b8220430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.737+0000 7fdc2050c640 1 -- 172.21.15.170:0/3473144194 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b80dbd40 con 0x5631b8221b50 2024-04-26T12:31:36.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2050c640 1 --2- 172.21.15.170:0/3473144194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8221b50 0x5631b8223f40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400a520 tx=0x7fdc1401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2464b4168d443aa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc1fd0b640 1 -- 172.21.15.170:0/3473144194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc14057070 con 0x5631b8221b50 2024-04-26T12:31:36.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc1fd0b640 1 -- 172.21.15.170:0/3473144194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc14052570 con 0x5631b8221b50 2024-04-26T12:31:36.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc1fd0b640 1 -- 172.21.15.170:0/3473144194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1404ae60 con 0x5631b8221b50 2024-04-26T12:31:36.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2320e800 1 -- 172.21.15.170:0/3473144194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8221b50 msgr2=0x5631b8223f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2320e800 1 --2- 172.21.15.170:0/3473144194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8221b50 0x5631b8223f40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400a520 tx=0x7fdc1401d010 comp rx=0 tx=0).stop 2024-04-26T12:31:36.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2320e800 1 -- 172.21.15.170:0/3473144194 shutdown_connections 2024-04-26T12:31:36.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2320e800 1 --2- 172.21.15.170:0/3473144194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8221b50 0x5631b8223f40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2320e800 1 -- 172.21.15.170:0/3473144194 >> 172.21.15.170:0/3473144194 conn(0x5631b82179b0 msgr2=0x5631b8219dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2320e800 1 -- 172.21.15.170:0/3473144194 shutdown_connections 2024-04-26T12:31:36.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.739+0000 7fdc2320e800 1 -- 172.21.15.170:0/3473144194 wait complete. 2024-04-26T12:31:36.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.751+0000 7fdc2320e800 1 Processor -- start 2024-04-26T12:31:36.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.751+0000 7fdc2320e800 1 -- start start 2024-04-26T12:31:36.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.751+0000 7fdc2320e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b830e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.751+0000 7fdc2320e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631b8168b70 con 0x5631b821e040 2024-04-26T12:31:36.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b830e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b830e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36422/0 (socket says 172.21.15.170:36422) 2024-04-26T12:31:36.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdc20d0d640 1 -- 172.21.15.170:0/375577055 learned_addr learned my addr 172.21.15.170:0/375577055 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdc20d0d640 1 -- 172.21.15.170:0/375577055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b80da590 con 0x5631b821e040 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/375577055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b830e730 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc10001e10 tx=0x7fdc1000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51562ef89cf4175c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdb0ee0d640 1 -- 172.21.15.170:0/375577055 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1000e5c0 con 0x5631b821e040 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdb0ee0d640 1 -- 172.21.15.170:0/375577055 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc10006070 con 0x5631b821e040 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.752+0000 7fdb0ee0d640 1 -- 172.21.15.170:0/375577055 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1000e930 con 0x5631b821e040 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 -- 172.21.15.170:0/375577055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 msgr2=0x5631b830e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 --2- 172.21.15.170:0/375577055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b830e730 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc10001e10 tx=0x7fdc1000b6c0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 -- 172.21.15.170:0/375577055 shutdown_connections 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 --2- 172.21.15.170:0/375577055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b830e730 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 -- 172.21.15.170:0/375577055 >> 172.21.15.170:0/375577055 conn(0x5631b82179b0 msgr2=0x5631b830a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 -- 172.21.15.170:0/375577055 shutdown_connections 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 -- 172.21.15.170:0/375577055 wait complete. 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.753+0000 7fdc2320e800 1 Processor -- start 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc2320e800 1 -- start start 2024-04-26T12:31:36.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc2320e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b83160d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc2320e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631b8226790 con 0x5631b821e040 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b83160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b83160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36430/0 (socket says 172.21.15.170:36430) 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1781267952 learned_addr learned my addr 172.21.15.170:0/1781267952 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b80d18f0 con 0x5631b821e040 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.754+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b83160d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdc10004000 tx=0x7fdc10000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.755+0000 7fdb0d60a640 1 -- 172.21.15.170:0/1781267952 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1001a880 con 0x5631b821e040 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.755+0000 7fdb0d60a640 1 -- 172.21.15.170:0/1781267952 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1001aa20 con 0x5631b821e040 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.755+0000 7fdb0d60a640 1 -- 172.21.15.170:0/1781267952 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1001ad20 con 0x5631b821e040 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.755+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631b8316610 con 0x5631b821e040 2024-04-26T12:31:36.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.755+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631b8316ad0 con 0x5631b821e040 2024-04-26T12:31:36.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.755+0000 7fdb0d60a640 1 -- 172.21.15.170:0/1781267952 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdc10017070 con 0x5631b821e040 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdb0d60a640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdb08036900 0x7fdb08038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdb0d60a640 1 -- 172.21.15.170:0/1781267952 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fdc10015020 con 0x5631b821e040 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdb08036900 0x7fdb08038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b8221b50 0x5631b831d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b831d660 con 0x5631b8221b50 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdc2150e640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b8221b50 0x5631b831d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdb08036900 0x7fdb08038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdc14054000 tx=0x7fdc1404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdc2150e640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b8221b50 0x5631b831d070 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.756+0000 7fdc2150e640 1 -- 172.21.15.170:0/1781267952 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b8221b50 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.757+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b831a710 con 0x5631b8221b50 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.757+0000 7fdc2150e640 1 -- 172.21.15.170:0/1781267952 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b8221b50 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.757+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b831f9b0 0x5631b8321da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.757+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b8322490 con 0x5631b831f9b0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.757+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b831f9b0 0x5631b8321da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.757+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b831f9b0 0x5631b8321da0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.758+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1781267952 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc1002e070 con 0x5631b831f9b0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.758+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b831e930 con 0x5631b8221b50 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.758+0000 7fdc2150e640 1 -- 172.21.15.170:0/1781267952 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b8221b50 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.758+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631b83238f0 0x5631b8325d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.758+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b83264c0 con 0x5631b83238f0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.758+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631b83238f0 0x5631b8325d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.758+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631b83238f0 0x5631b8325d60 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc2050c640 1 -- 172.21.15.170:0/1781267952 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc1405a040 con 0x5631b83238f0 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc2320e800 1 Processor -- start 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc2320e800 1 -- start start 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc2320e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8334920 0x5631b8334d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc2320e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631b810ee60 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8334920 0x5631b8334d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8334920 0x5631b8334d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36442/0 (socket says 172.21.15.170:36442) 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.759+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1116328604 learned_addr learned my addr 172.21.15.170:0/1116328604 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.760+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1116328604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b8335280 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.760+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8334920 0x5631b8334d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdc1001af70 tx=0x7fdc10017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.760+0000 7fdb067fc640 1 -- 172.21.15.170:0/1116328604 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc10017490 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.760+0000 7fdb067fc640 1 -- 172.21.15.170:0/1116328604 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1003f970 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.760+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631b8335cf0 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.760+0000 7fdb067fc640 1 -- 172.21.15.170:0/1116328604 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1003fc70 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.760+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631b83361f0 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdb067fc640 1 -- 172.21.15.170:0/1116328604 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdc10044b00 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdb067fc640 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaf8036900 0x7fdaf8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdb067fc640 1 -- 172.21.15.170:0/1116328604 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fdc10038030 con 0x5631b8334920 2024-04-26T12:31:36.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaf8036900 0x7fdaf8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdc2320e800 1 Processor -- start 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdc2320e800 1 -- start start 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaf8036900 0x7fdaf8038dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5631b831df60 tx=0x7fdc14005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdc2320e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b821da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.761+0000 7fdc2320e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631b830eeb0 con 0x5631b821d630 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b821da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b821da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36458/0 (socket says 172.21.15.170:36458) 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdc20d0d640 1 -- 172.21.15.170:0/3748102723 learned_addr learned my addr 172.21.15.170:0/3748102723 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdc20d0d640 1 -- 172.21.15.170:0/3748102723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b821be30 con 0x5631b821d630 2024-04-26T12:31:36.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/3748102723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b821da50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdc10040010 tx=0x7fdc10019960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7535b1365b35ddba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdaf7fff640 1 -- 172.21.15.170:0/3748102723 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc10055040 con 0x5631b821d630 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdaf7fff640 1 -- 172.21.15.170:0/3748102723 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1004a0a0 con 0x5631b821d630 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.762+0000 7fdaf7fff640 1 -- 172.21.15.170:0/3748102723 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc10031640 con 0x5631b821d630 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 -- 172.21.15.170:0/3748102723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 msgr2=0x5631b821da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 --2- 172.21.15.170:0/3748102723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b821da50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdc10040010 tx=0x7fdc10019960 comp rx=0 tx=0).stop 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 -- 172.21.15.170:0/3748102723 shutdown_connections 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 --2- 172.21.15.170:0/3748102723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b821da50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 -- 172.21.15.170:0/3748102723 >> 172.21.15.170:0/3748102723 conn(0x5631b833dd40 msgr2=0x5631b833bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 -- 172.21.15.170:0/3748102723 shutdown_connections 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 -- 172.21.15.170:0/3748102723 wait complete. 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 Processor -- start 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 -- start start 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b834af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.763+0000 7fdc2320e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5631b821c240 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b834af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdc20d0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b834af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36464/0 (socket says 172.21.15.170:36464) 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 learned_addr learned my addr 172.21.15.170:0/1261976928 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b834b4d0 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b834af90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdc10044a90 tx=0x7fdc10014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdaf67fc640 1 -- 172.21.15.170:0/1261976928 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc1006d070 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdaf67fc640 1 -- 172.21.15.170:0/1261976928 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc10061040 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdaf67fc640 1 -- 172.21.15.170:0/1261976928 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc10044fd0 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631b834b4d0 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.764+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631b834b4d0 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.765+0000 7fdaf67fc640 1 -- 172.21.15.170:0/1261976928 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdc1004b840 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.765+0000 7fdaf67fc640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaec036860 0x7fdaec038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.765+0000 7fdaf67fc640 1 -- 172.21.15.170:0/1261976928 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fdc10072d00 con 0x5631b821d630 2024-04-26T12:31:36.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaec036860 0x7fdaec038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b83566a0 0x5631b8358b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b83592b0 con 0x5631b83566a0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2150e640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b83566a0 0x5631b8358b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaec036860 0x7fdaec038d20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc14055040 tx=0x7fdc1404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2150e640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b83566a0 0x5631b8358b60 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2320e800 20 realm 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.766+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b83596c0 con 0x5631b83566a0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b8359f90 con 0x5631b83566a0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b83566a0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b835b090 0x5631b835d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b835da90 con 0x5631b835b090 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.767+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b835b090 0x5631b835d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.768+0000 7fdc20d0d640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b835b090 0x5631b835d480 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.768+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.768+0000 7fdc2320e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.768+0000 7fdc2320e800 20 searching for the correct realm 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.768+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631b835fa40 0x5631b8361f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.768+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b83625d0 con 0x5631b835fa40 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.768+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631b835fa40 0x5631b8361f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.769+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631b835fa40 0x5631b8361f00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.769+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.769+0000 7fdc2050c640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdc14074040 0x7fdc14081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.769+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b83625d0 con 0x7fdc14074040 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.769+0000 7fdc2150e640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdc14074040 0x7fdc14081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.769+0000 7fdc2150e640 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdc14074040 0x7fdc14081410 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc1800a4a0 con 0x7fdc14074040 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b835b090 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b83566a0 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b83566a0 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.770+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b835b090 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b835b090 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x7fdc14074040 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1800a4a0 con 0x7fdc14074040 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b835fa40 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.771+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b83566a0 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x7fdc14074040 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1800a4a0 con 0x7fdc14074040 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b83566a0 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1800a4a0 con 0x5631b83566a0 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x7fdc14074040 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5631b835a330 con 0x5631b835fa40 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.772+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835fa40 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835b090 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835fa40 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835fa40 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.773+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b83566a0 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b83566a0 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835b090 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835fa40 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.774+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x7fdc14074040 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b83566a0 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835b090 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835fa40 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.775+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835b090 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.776+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.776+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x7fdc14074040 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.776+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.776+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835fa40 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.776+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.776+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b835b090 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x5631b83566a0 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc1408e040 con 0x7fdc14074040 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b835e350 con 0x5631b83566a0 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.777+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b835e350 con 0x5631b83566a0 2024-04-26T12:31:36.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b835e350 con 0x7fdc14074040 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 20 zone default found 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 4 Realm: () 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 20 zonegroup default 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b835ebf0 con 0x5631b835b090 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.778+0000 7fdc2320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b8364430 con 0x5631b835fa40 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b83647d0 con 0x5631b835fa40 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 20 started sync module instance, tier type = 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:36.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.779+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b83638d0 con 0x7fdc14074040 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.780+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.780+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94771543948832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b83638d0 con 0x7fdc14074040 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.780+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8365080 con 0x5631b83566a0 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.781+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94771543948832] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.781+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.781+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94771543952240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b83638d0 con 0x5631b83566a0 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.781+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8365b10 con 0x5631b835fa40 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.782+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94771543952240] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.783+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.783+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94771543946272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8363840 con 0x5631b835fa40 2024-04-26T12:31:36.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.783+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b83669d0 con 0x7fdc14074040 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.784+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.784+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94771543959296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8367110 con 0x7fdc14074040 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.784+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8367c30 con 0x5631b83566a0 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.784+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94771543946272] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.785+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94771543959296] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.785+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.785+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94771543963392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8367bf0 con 0x5631b83566a0 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.785+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b83684d0 con 0x5631b835b090 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.786+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94771543963392] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.786+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.786+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94771543965728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8367bf0 con 0x5631b835b090 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.786+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8368e90 con 0x5631b835b090 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.787+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94771543965728] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.787+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.787+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94771543957248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b83696e0 con 0x5631b835b090 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.787+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b836a0a0 con 0x5631b835b090 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94771543957248] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94771543970832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b836a0a0 con 0x5631b835b090 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 20 add_watcher() i=0 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 20 add_watcher() i=1 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 20 add_watcher() i=2 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 20 add_watcher() i=3 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 20 add_watcher() i=4 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 20 add_watcher() i=5 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.788+0000 7fdc2320e800 20 add_watcher() i=6 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.789+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94771543970832] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.789+0000 7fdc2320e800 20 add_watcher() i=7 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.789+0000 7fdc2320e800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.789+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b836d3d0 con 0x5631b83566a0 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.789+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.789+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94771543973216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b836a630 con 0x5631b83566a0 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.790+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94771543973216] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.790+0000 7fdad6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 5 note: GC not initialized 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdad5fe3640 20 reqs_thread_entry: start 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 20 Filter name: none 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fda477fe640 20 reqs_thread_entry: start 2024-04-26T12:31:36.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5631b83a0b10 con 0x7fdc14074040 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.791+0000 7fdc2320e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.792+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b83a4e80 con 0x5631b835b090 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.793+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.793+0000 7fdad6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.793+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94771543973216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8353870 con 0x5631b83566a0 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.794+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94771543973216] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.794+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94771543948832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8369d60 con 0x7fdc14074040 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.795+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94771543948832] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.795+0000 7fdc2320e800 20 remove_watcher() i=0 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.795+0000 7fdc2320e800 2 removed watcher, disabling cache 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.795+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94771543952240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8369d60 con 0x5631b83566a0 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.797+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94771543952240] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.797+0000 7fdc2320e800 20 remove_watcher() i=1 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.797+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94771543946272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8369d60 con 0x5631b835fa40 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.798+0000 7fdc2050c640 1 -- 172.21.15.170:0/1261976928 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94771543946272] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc1407f070 con 0x5631b835fa40 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.798+0000 7fdc2320e800 20 remove_watcher() i=2 2024-04-26T12:31:36.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.798+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94771543959296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8363420 con 0x7fdc14074040 2024-04-26T12:31:36.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.799+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94771543959296] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x7fdc14074040 2024-04-26T12:31:36.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.799+0000 7fdc2320e800 20 remove_watcher() i=3 2024-04-26T12:31:36.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.799+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94771543963392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8363420 con 0x5631b83566a0 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.800+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94771543963392] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc18033040 con 0x5631b83566a0 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.800+0000 7fdc2320e800 20 remove_watcher() i=4 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.800+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94771543965728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8367700 con 0x5631b835b090 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.801+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94771543965728] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.801+0000 7fdc2320e800 20 remove_watcher() i=5 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.801+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94771543957248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8367700 con 0x5631b835b090 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.802+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94771543957248] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.802+0000 7fdc2320e800 20 remove_watcher() i=6 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.802+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94771543970832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5631b8365f00 con 0x5631b835b090 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc20d0d640 1 -- 172.21.15.170:0/1261976928 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94771543970832] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc10058040 con 0x5631b835b090 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 20 remove_watcher() i=7 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b835b090 msgr2=0x5631b835d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b835b090 0x5631b835d480 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b83566a0 msgr2=0x5631b8358b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b83566a0 0x5631b8358b60 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdc14074040 msgr2=0x7fdc14081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fdc14074040 0x7fdc14081410 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631b835fa40 msgr2=0x5631b8361f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5631b835fa40 0x5631b8361f00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaec036860 msgr2=0x7fdaec038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaec036860 0x7fdaec038d20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc14055040 tx=0x7fdc1404f000 comp rx=0 tx=0).stop 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 msgr2=0x5631b834af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b834af90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdc10044a90 tx=0x7fdc10014ef0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2150e640 1 -- 172.21.15.170:0/1261976928 reap_dead start 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 shutdown_connections 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1261976928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821d630 0x5631b834af90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 >> 172.21.15.170:0/1261976928 conn(0x5631b833dd40 msgr2=0x5631b833b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 shutdown_connections 2024-04-26T12:31:36.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1261976928 wait complete. 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaf8036900 msgr2=0x7fdaf8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaf8036900 0x7fdaf8038dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5631b831df60 tx=0x7fdc14005ac0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8334920 msgr2=0x5631b8334d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8334920 0x5631b8334d40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdc1001af70 tx=0x7fdc10017d30 comp rx=0 tx=0).stop 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 shutdown_connections 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdaf8036900 0x7fdaf8038dc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1116328604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b8334920 0x5631b8334d40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 >> 172.21.15.170:0/1116328604 conn(0x5631b83289c0 msgr2=0x5631b8328dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.803+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 shutdown_connections 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1116328604 wait complete. 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b831f9b0 msgr2=0x5631b8321da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5631b831f9b0 0x5631b8321da0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b8221b50 msgr2=0x5631b831d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5631b8221b50 0x5631b831d070 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631b83238f0 msgr2=0x5631b8325d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5631b83238f0 0x5631b8325d60 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdb08036900 msgr2=0x7fdb08038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fdb08036900 0x7fdb08038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdc14054000 tx=0x7fdc1404e000 comp rx=0 tx=0).stop 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 msgr2=0x5631b83160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 --2- 172.21.15.170:0/1781267952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5631b821e040 0x5631b83160d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdc10004000 tx=0x7fdc10000bc0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2150e640 1 -- 172.21.15.170:0/1781267952 reap_dead start 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 shutdown_connections 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 >> 172.21.15.170:0/1781267952 conn(0x5631b82179b0 msgr2=0x5631b830d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 shutdown_connections 2024-04-26T12:31:36.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.804+0000 7fdc2320e800 1 -- 172.21.15.170:0/1781267952 wait complete. 2024-04-26T12:31:36.814 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-26T12:31:36.819 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:31:36.819 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-26T12:31:36.823 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-26T12:31:36.823 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-26T12:31:36.823 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-26T12:31:36.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-26T12:31:36.824 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-26T12:31:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:36.867 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c7540f800 1 Processor -- start 2024-04-26T12:31:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c7540f800 1 -- start start 2024-04-26T12:31:36.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c7540f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55c7b0760f90 0x55c7b0763380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c7540f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7b060d0c0 con 0x55c7b07638c0 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c7540f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55c7b05f14d0 con 0x55c7b0760f90 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c70b5c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55c7b0760f90 0x55c7b0763380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c7035b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55c7b07638c0 0x55c7b0765cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:59362/0 (socket says 172.21.15.170:59362) 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c70b5c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55c7b0760f90 0x55c7b0763380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36468/0 (socket says 172.21.15.170:36468) 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c7035b640 1 -- 172.21.15.170:0/390019681 learned_addr learned my addr 172.21.15.170:0/390019681 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c70b5c640 1 -- 172.21.15.170:0/390019681 >> v1:172.21.15.132:6789/0 conn(0x55c7b07638c0 legacy=0x55c7b0765cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.866+0000 7f0c70b5c640 1 -- 172.21.15.170:0/390019681 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b061ed40 con 0x55c7b0760f90 2024-04-26T12:31:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.868+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/390019681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b0763380 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000a470 tx=0x7f0c6001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab465e4a84c1dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.868+0000 7f0c6fb5a640 1 -- 172.21.15.170:0/390019681 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60057070 con 0x55c7b0760f90 2024-04-26T12:31:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.868+0000 7f0c6fb5a640 1 -- 172.21.15.170:0/390019681 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c60052570 con 0x55c7b0760f90 2024-04-26T12:31:36.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.868+0000 7f0c6fb5a640 1 -- 172.21.15.170:0/390019681 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60052870 con 0x55c7b0760f90 2024-04-26T12:31:36.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.869+0000 7f0c7540f800 1 -- 172.21.15.170:0/390019681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 msgr2=0x55c7b0763380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.869+0000 7f0c7540f800 1 --2- 172.21.15.170:0/390019681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b0763380 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000a470 tx=0x7f0c6001ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:36.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.869+0000 7f0c7540f800 1 -- 172.21.15.170:0/390019681 shutdown_connections 2024-04-26T12:31:36.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.869+0000 7f0c7540f800 1 --2- 172.21.15.170:0/390019681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b0763380 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.869+0000 7f0c7540f800 1 -- 172.21.15.170:0/390019681 >> 172.21.15.170:0/390019681 conn(0x55c7b075aa00 msgr2=0x55c7b075ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.869+0000 7f0c7540f800 1 -- 172.21.15.170:0/390019681 shutdown_connections 2024-04-26T12:31:36.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.869+0000 7f0c7540f800 1 -- 172.21.15.170:0/390019681 wait complete. 2024-04-26T12:31:36.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c7540f800 1 Processor -- start 2024-04-26T12:31:36.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c7540f800 1 -- start start 2024-04-26T12:31:36.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c7540f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b07608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c7540f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c7b06abb70 con 0x55c7b0760f90 2024-04-26T12:31:36.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b07608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b07608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36470/0 (socket says 172.21.15.170:36470) 2024-04-26T12:31:36.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c70b5c640 1 -- 172.21.15.170:0/2080490227 learned_addr learned my addr 172.21.15.170:0/2080490227 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.881+0000 7f0c70b5c640 1 -- 172.21.15.170:0/2080490227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b061d590 con 0x55c7b0760f90 2024-04-26T12:31:36.884 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.882+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/2080490227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b07608d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0c60055040 tx=0x7f0c6004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328b35285871ce5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.882+0000 7f0b5ee0d640 1 -- 172.21.15.170:0/2080490227 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60057070 con 0x55c7b0760f90 2024-04-26T12:31:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.882+0000 7f0b5ee0d640 1 -- 172.21.15.170:0/2080490227 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c60063070 con 0x55c7b0760f90 2024-04-26T12:31:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.882+0000 7f0b5ee0d640 1 -- 172.21.15.170:0/2080490227 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60052720 con 0x55c7b0760f90 2024-04-26T12:31:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 -- 172.21.15.170:0/2080490227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 msgr2=0x55c7b07608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 --2- 172.21.15.170:0/2080490227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b07608d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0c60055040 tx=0x7f0c6004c000 comp rx=0 tx=0).stop 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 -- 172.21.15.170:0/2080490227 shutdown_connections 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 --2- 172.21.15.170:0/2080490227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b07608d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 -- 172.21.15.170:0/2080490227 >> 172.21.15.170:0/2080490227 conn(0x55c7b075aa00 msgr2=0x55c7b084d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 -- 172.21.15.170:0/2080490227 shutdown_connections 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 -- 172.21.15.170:0/2080490227 wait complete. 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 Processor -- start 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 -- start start 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b085b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c7540f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c7b0767670 con 0x55c7b0760f90 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b085b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b085b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36474/0 (socket says 172.21.15.170:36474) 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.883+0000 7f0c70b5c640 1 -- 172.21.15.170:0/3832704633 learned_addr learned my addr 172.21.15.170:0/3832704633 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.884+0000 7f0c70b5c640 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b06148f0 con 0x55c7b0760f90 2024-04-26T12:31:36.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.884+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b085b0c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0c60000c00 tx=0x7f0c60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.884+0000 7f0b5d60a640 1 -- 172.21.15.170:0/3832704633 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c6005e480 con 0x55c7b0760f90 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.884+0000 7f0b5d60a640 1 -- 172.21.15.170:0/3832704633 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6006c070 con 0x55c7b0760f90 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.884+0000 7f0b5d60a640 1 -- 172.21.15.170:0/3832704633 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c6005e750 con 0x55c7b0760f90 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.884+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7b085b600 con 0x55c7b0760f90 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.884+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7b085bb20 con 0x55c7b0760f90 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0b5d60a640 1 -- 172.21.15.170:0/3832704633 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c60077060 con 0x55c7b0760f90 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0b5d60a640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b58036950 0x7f0b58038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0b5d60a640 1 -- 172.21.15.170:0/3832704633 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c6008e570 con 0x55c7b0760f90 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0c7035b640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b58036950 0x7f0b58038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b07638c0 0x55c7b0862130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0862700 con 0x55c7b07638c0 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0c7135d640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b07638c0 0x55c7b0862130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.885+0000 7f0c7035b640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b58036950 0x7f0b58038e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000f60 tx=0x7f0c640012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.886+0000 7f0c7135d640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b07638c0 0x55c7b0862130 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.886+0000 7f0c7135d640 1 -- 172.21.15.170:0/3832704633 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b07638c0 2024-04-26T12:31:36.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.886+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b085f700 con 0x55c7b07638c0 2024-04-26T12:31:36.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.886+0000 7f0c7135d640 1 -- 172.21.15.170:0/3832704633 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b07638c0 2024-04-26T12:31:36.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.886+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b0864a50 0x55c7b0866e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.886+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0867530 con 0x55c7b0864a50 2024-04-26T12:31:36.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.886+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b0864a50 0x55c7b0866e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.887+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b0864a50 0x55c7b0866e40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.887+0000 7f0c70b5c640 1 -- 172.21.15.170:0/3832704633 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c600797d0 con 0x55c7b0864a50 2024-04-26T12:31:36.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.887+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0863a00 con 0x55c7b07638c0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.887+0000 7f0c7135d640 1 -- 172.21.15.170:0/3832704633 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b07638c0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.887+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55c7b08689e0 0x55c7b086ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.887+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b086b590 con 0x55c7b08689e0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.887+0000 7f0c7035b640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55c7b08689e0 0x55c7b086ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.888+0000 7f0c7035b640 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55c7b08689e0 0x55c7b086ae30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.888+0000 7f0c7035b640 1 -- 172.21.15.170:0/3832704633 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08689e0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.888+0000 7f0c7540f800 1 Processor -- start 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.888+0000 7f0c7540f800 1 -- start start 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.888+0000 7f0c7540f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b08799f0 0x55c7b0879e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.888+0000 7f0c7540f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c7b0651e60 con 0x55c7b08799f0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b08799f0 0x55c7b0879e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b08799f0 0x55c7b0879e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36490/0 (socket says 172.21.15.170:36490) 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0c70b5c640 1 -- 172.21.15.170:0/3928919300 learned_addr learned my addr 172.21.15.170:0/3928919300 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0c70b5c640 1 -- 172.21.15.170:0/3928919300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b087a350 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b08799f0 0x55c7b0879e10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0c6008c8b0 tx=0x7f0c6006fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0b567fc640 1 -- 172.21.15.170:0/3928919300 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60009790 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0b567fc640 1 -- 172.21.15.170:0/3928919300 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c60058040 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7b087adc0 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0b567fc640 1 -- 172.21.15.170:0/3928919300 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c60009a80 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.889+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7b087adc0 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.890+0000 7f0b567fc640 1 -- 172.21.15.170:0/3928919300 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c60095060 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.890+0000 7f0b567fc640 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b48036900 0x7f0b48038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.890+0000 7f0b567fc640 1 -- 172.21.15.170:0/3928919300 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c600820e0 con 0x55c7b08799f0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.890+0000 7f0c7035b640 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b48036900 0x7f0b48038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.890+0000 7f0c7540f800 1 Processor -- start 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.890+0000 7f0c7540f800 1 -- start start 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.890+0000 7f0c7035b640 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b48036900 0x7f0b48038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400bf50 tx=0x7f0c6400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0c7540f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b0886d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0c7540f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c7b075ee90 con 0x55c7b0886900 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b0886d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b0886d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36494/0 (socket says 172.21.15.170:36494) 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0c70b5c640 1 -- 172.21.15.170:0/2621443124 learned_addr learned my addr 172.21.15.170:0/2621443124 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0c70b5c640 1 -- 172.21.15.170:0/2621443124 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b08872f0 con 0x55c7b0886900 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/2621443124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b0886d20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0c6005ff00 tx=0x7f0c60080eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa0c511d752805a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0b47fff640 1 -- 172.21.15.170:0/2621443124 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c600a7070 con 0x55c7b0886900 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0b47fff640 1 -- 172.21.15.170:0/2621443124 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c60068d20 con 0x55c7b0886900 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.891+0000 7f0b47fff640 1 -- 172.21.15.170:0/2621443124 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c6006fa40 con 0x55c7b0886900 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 -- 172.21.15.170:0/2621443124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 msgr2=0x55c7b0886d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 --2- 172.21.15.170:0/2621443124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b0886d20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0c6005ff00 tx=0x7f0c60080eb0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 -- 172.21.15.170:0/2621443124 shutdown_connections 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 --2- 172.21.15.170:0/2621443124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b0886d20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 -- 172.21.15.170:0/2621443124 >> 172.21.15.170:0/2621443124 conn(0x55c7b0882c60 msgr2=0x55c7b0880cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 -- 172.21.15.170:0/2621443124 shutdown_connections 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 -- 172.21.15.170:0/2621443124 wait complete. 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 Processor -- start 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 -- start start 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b088dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c7540f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c7b08879a0 con 0x55c7b0886900 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.892+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b088dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0c70b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b088dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36504/0 (socket says 172.21.15.170:36504) 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 learned_addr learned my addr 172.21.15.170:0/1701542583 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7b088e290 con 0x55c7b0886900 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b088dd50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0c600a5040 tx=0x7f0c6005aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0b467fc640 1 -- 172.21.15.170:0/1701542583 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c600b0070 con 0x55c7b0886900 2024-04-26T12:31:36.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0b467fc640 1 -- 172.21.15.170:0/1701542583 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6005ea20 con 0x55c7b0886900 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0b467fc640 1 -- 172.21.15.170:0/1701542583 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c600a7040 con 0x55c7b0886900 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7b088e290 con 0x55c7b0886900 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.893+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7b088e290 con 0x55c7b0886900 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.894+0000 7f0b467fc640 1 -- 172.21.15.170:0/1701542583 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c600b3070 con 0x55c7b0886900 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.894+0000 7f0b467fc640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b3c036950 0x7f0b3c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.894+0000 7f0b467fc640 1 -- 172.21.15.170:0/1701542583 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c6006ba30 con 0x55c7b0886900 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.894+0000 7f0c7035b640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b3c036950 0x7f0b3c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7035b640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b3c036950 0x7f0b3c038e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c64001b60 tx=0x7f0c64010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b0899320 0x55c7b089b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089bf30 con 0x55c7b0899320 2024-04-26T12:31:36.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7135d640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b0899320 0x55c7b089b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7135d640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b0899320 0x55c7b089b7e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7540f800 20 realm 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.895+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089c340 con 0x55c7b0899320 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cc10 con 0x55c7b0899320 2024-04-26T12:31:36.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b089dd10 0x55c7b08a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a0710 con 0x55c7b089dd10 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.896+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b089dd10 0x55c7b08a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c70b5c640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b089dd10 0x55c7b08a0100 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c7540f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c7540f800 20 searching for the correct realm 2024-04-26T12:31:36.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55c7b08a26c0 0x55c7b08a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a5250 con 0x55c7b08a26c0 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c7035b640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55c7b08a26c0 0x55c7b08a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.897+0000 7f0c7035b640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55c7b08a26c0 0x55c7b08a4b80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c7035b640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c64038040 0x7f0c6401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a5250 con 0x7f0c64038040 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c7135d640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c64038040 0x7f0c6401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c7135d640 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c64038040 0x7f0c6401bab0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c6800a4a0 con 0x7f0c64038040 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.898+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.899+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.899+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.899+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.899+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.899+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.899+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.899+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x7f0c64038040 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c6800a4a0 con 0x7f0c64038040 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x7f0c64038040 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c6800a4a0 con 0x7f0c64038040 2024-04-26T12:31:36.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.900+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c6800a4a0 con 0x55c7b0899320 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x7f0c64038040 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.901+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.902+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x7f0c64038040 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.903+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.904+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.904+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.904+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.904+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.904+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.904+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x7f0c64038040 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b08a26c0 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b089dd10 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.905+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x55c7b0899320 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7b089cfb0 con 0x7f0c64038040 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a0fd0 con 0x55c7b0899320 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a0fd0 con 0x55c7b0899320 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.906+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a0fd0 con 0x7f0c64038040 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 zone default found 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 4 Realm: () 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 zonegroup default 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a1870 con 0x55c7b089dd10 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a70b0 con 0x55c7b08a26c0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.907+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a7450 con 0x55c7b08a26c0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.908+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.908+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.908+0000 7f0c7540f800 20 started sync module instance, tier type = 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.908+0000 7f0c7540f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.908+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a6550 con 0x7f0c64038040 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.909+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.909+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94316148714144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a6550 con 0x7f0c64038040 2024-04-26T12:31:36.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.909+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a7ca0 con 0x55c7b0899320 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.910+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94316148714144] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.910+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.910+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94316148718032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a6550 con 0x55c7b0899320 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.910+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a8710 con 0x55c7b08a26c0 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.911+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94316148718032] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.911+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.911+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94316148711584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a64c0 con 0x55c7b08a26c0 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.911+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a95d0 con 0x7f0c64038040 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.912+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.912+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94316148724480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a9d10 con 0x7f0c64038040 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.912+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08aa830 con 0x55c7b0899320 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.913+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94316148711584] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.913+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94316148724480] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.913+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.913+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94316148728576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08aa7f0 con 0x55c7b0899320 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.913+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ab0d0 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.915+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.915+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94316148730912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08aa7f0 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.915+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94316148728576] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.915+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ac020 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.916+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94316148730912] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.916+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.916+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94316148734704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08abfe0 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.916+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ac8b0 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94316148734704] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94316148733040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08aca90 con 0x55c7b089dd10 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 20 add_watcher() i=0 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 20 add_watcher() i=1 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 20 add_watcher() i=2 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 20 add_watcher() i=3 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 20 add_watcher() i=4 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 20 add_watcher() i=5 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.917+0000 7f0c7540f800 20 add_watcher() i=6 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.918+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94316148733040] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.918+0000 7f0c7540f800 20 add_watcher() i=7 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.918+0000 7f0c7540f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.918+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08afe60 con 0x55c7b0899320 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.918+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.918+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94316148738432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ad250 con 0x55c7b0899320 2024-04-26T12:31:36.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.919+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94316148738432] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.919+0000 7f0b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.920+0000 7f0c7540f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.920+0000 7f0c7540f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.920+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08b87c0 con 0x55c7b0899320 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.921+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.921+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08b8df0 con 0x55c7b089dd10 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.922+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.922+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08b8df0 con 0x55c7b08a26c0 2024-04-26T12:31:36.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.923+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.923+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08b98d0 con 0x55c7b0899320 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.923+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.924+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08b6520 con 0x7f0c64038040 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.924+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'70 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.924+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08b64f0 con 0x55c7b08a26c0 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.925+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.925+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08baab0 con 0x55c7b0899320 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.926+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.926+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08baab0 con 0x55c7b089dd10 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.927+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.927+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08baab0 con 0x7f0c64038040 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.929+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.929+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08babf0 con 0x55c7b08a26c0 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.930+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.930+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb250 con 0x7f0c64038040 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.930+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'71 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.931+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb250 con 0x55c7b089dd10 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.932+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.932+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb250 con 0x7f0c64038040 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.932+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.932+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb250 con 0x55c7b089dd10 2024-04-26T12:31:36.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.933+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.933+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb250 con 0x55c7b0899320 2024-04-26T12:31:36.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.934+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.934+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb250 con 0x55c7b08a26c0 2024-04-26T12:31:36.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.936+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.936+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb860 con 0x7f0c64038040 2024-04-26T12:31:36.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.936+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'72 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.936+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.937+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.937+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b0899320 2024-04-26T12:31:36.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.939+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.939+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b0899320 2024-04-26T12:31:36.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.939+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.939+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.941+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.941+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x7f0c64038040 2024-04-26T12:31:36.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.941+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.941+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.942+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.942+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.943+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.943+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.944+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.944+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.945+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.945+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b089dd10 2024-04-26T12:31:36.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.946+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.946+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.947+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.947+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b089dd10 2024-04-26T12:31:36.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.948+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.948+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b08a26c0 2024-04-26T12:31:36.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.949+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.949+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x55c7b089dd10 2024-04-26T12:31:36.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.950+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.950+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08bb800 con 0x7f0c64038040 2024-04-26T12:31:36.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.951+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0b25fe3640 20 reqs_thread_entry: start 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 20 Filter name: none 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0a977fe640 20 reqs_thread_entry: start 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e68a0 con 0x7f0c64038040 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.952+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e9270 con 0x55c7b0899320 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv12 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 : miss 2024-04-26T12:31:36.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:96 8.0 8:0061f48e:root::.bucket.meta.myfoo6%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e9060 con 0x55c7b08a26c0 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(96 .bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 info.flags=0x17 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 to cache LRU end 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 2024-04-26T12:31:36.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:97 4.18 4:1ad7e467:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966550 con 0x7f0c64038040 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.953+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(97 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.954+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:98 4.e 4:71a24961:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966550 con 0x7f0c64038040 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.954+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(98 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.954+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:99 4.3e 4:7d129eda:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966590 con 0x7f0c64038040 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.954+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(99 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.954+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 4.24 4:2486ef6d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966590 con 0x55c7b089dd10 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.955+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(100 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.955+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:101 4.12 4:4aa29545:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966590 con 0x55c7b0899320 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.955+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(101 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.955+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:102 4.20 4:0404fa5b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966590 con 0x55c7b0899320 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.955+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(102 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.955+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 4.f 4:f212361e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966550 con 0x55c7b0899320 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.956+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(103 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.956+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:104 4.3d 4:bc0f3ee8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966550 con 0x7f0c64038040 2024-04-26T12:31:36.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.956+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(104 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.956+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:105 4.24 4:2632118c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966550 con 0x55c7b089dd10 2024-04-26T12:31:36.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.956+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(105 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.956+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:106 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966550 con 0x55c7b089dd10 2024-04-26T12:31:36.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(106 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [call out=289b] v0'0 uv27 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 10 cls_bucket_list_unordered: got thirteen 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:107 4.14 4:288e2374:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0966510 con 0x55c7b08a26c0 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(107 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 20 get_obj_state: octx=0x7f0c6800aad0 obj=myfoo6:thirteen state=0x55c7b09645d8 s->prefetch_data=0 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:108 3.1bs0 3:d83de5ce:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0965400 con 0x55c7b08a26c0 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(108 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 10 manifest: total_size = 8 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 20 get_obj_state: setting s->obj_tag to _mttHoGOzc0stHwBA5Kh3_jbacZi0dC4 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 20 get_obj_state: octx=0x7f0c6800aad0 obj=myfoo6:thirteen state=0x55c7b09645d8 s->prefetch_data=0 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 20 prepare_atomic_modification: state is not atomic. state=0x55c7b09645d8 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.957+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:109 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0965cc0 con 0x55c7b089dd10 2024-04-26T12:31:36.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.959+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(109 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [stat,call,call] v32'28 uv28 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.959+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:110 3.1bs0 3:d83de5ce:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0965cc0 con 0x55c7b08a26c0 2024-04-26T12:31:36.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(110 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9_thirteen [call] v32'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:111 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08edc10 con 0x55c7b089dd10 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 20 list_objects_ordered: starting attempt 1 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:112 4.18 4:1ad7e467:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08edc10 con 0x7f0c64038040 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:113 4.e 4:71a24961:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f1f00 con 0x7f0c64038040 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:114 4.3e 4:7d129eda:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f4840 con 0x7f0c64038040 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:115 4.24 4:2486ef6d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f72d0 con 0x55c7b089dd10 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:116 4.12 4:4aa29545:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08edc10 con 0x55c7b0899320 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:117 4.20 4:0404fa5b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fc0b0 con 0x55c7b0899320 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:118 4.f 4:f212361e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08feed0 con 0x55c7b0899320 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:119 4.3d 4:bc0f3ee8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0901d00 con 0x7f0c64038040 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:120 4.24 4:2632118c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904b30 con 0x55c7b089dd10 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:121 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0907500 con 0x55c7b089dd10 2024-04-26T12:31:36.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.960+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:122 4.14 4:288e2374:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0909ef0 con 0x55c7b08a26c0 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(112 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(113 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(114 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(115 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== osd_op_reply(119 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(116 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(120 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(122 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(117 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.961+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(118 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(111 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [stat,call,call] v32'29 uv29 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0b47fff640 20 handle_completion(): completion ok for obj=thirteen 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(121 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [call out=124b] v0'0 uv29 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9])"; uploads.size()=0; is_truncated=0 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:123 4.18 4:1ad7e467:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fee50 con 0x7f0c64038040 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:124 4.e 4:71a24961:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b09016b0 con 0x7f0c64038040 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:125 4.3e 4:7d129eda:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0905fe0 con 0x7f0c64038040 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:126 4.24 4:2486ef6d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f61b0 con 0x55c7b089dd10 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:127 4.12 4:4aa29545:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f4840 con 0x55c7b0899320 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:128 4.20 4:0404fa5b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fee10 con 0x55c7b0899320 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:129 4.f 4:f212361e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b09016b0 con 0x55c7b0899320 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:130 4.3d 4:bc0f3ee8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f1a50 con 0x7f0c64038040 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:131 4.24 4:2632118c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0905fe0 con 0x55c7b089dd10 2024-04-26T12:31:36.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:132 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f61b0 con 0x55c7b089dd10 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:133 4.14 4:288e2374:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fee10 con 0x55c7b08a26c0 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(123 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(124 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(127 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(128 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== osd_op_reply(125 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(130 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(129 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(126 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(133 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(132 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [call out=124b] v0'0 uv29 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.962+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(131 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.963+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fe7a0 con 0x55c7b0899320 2024-04-26T12:31:36.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(134 bud.buckets [call] v32'13 uv13 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7540f800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fe7a0 con 0x55c7b0899320 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7540f800 20 rados_obj.operate() r=0 bl.length=166 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7540f800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7540f800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.964+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fe7a0 con 0x55c7b0899320 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0c7540f800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0c7540f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94316149085600 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08fe7a0 con 0x7f0c64038040 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== watch-notify(notify (1) cookie 94316148724480 notify 137438953491 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55c7b08babf0 con 0x7f0c64038040 2024-04-26T12:31:36.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0b477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94316148724480 notifier 4761 bl.length()=150 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0b477fe640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0aa40032c0 con 0x7f0c64038040 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.965+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 34 ==== osd_op_reply(137 notify.3 [notify cookie 94316149085600 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.966+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 35 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.966+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 36 ==== watch-notify(notify_complete (2) cookie 94316149085600 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7b08b68c0 con 0x7f0c64038040 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.966+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:139 8.0 8:0061f48e:root::.bucket.meta.myfoo6%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904330 con 0x55c7b08a26c0 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(139 .bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0c7540f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 from cache 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0c7540f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9, ofs0, ns] 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94316148985808 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904330 con 0x55c7b089dd10 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== watch-notify(notify (1) cookie 94316148733040 notify 137438953503 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55c7b08ba770 con 0x55c7b089dd10 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0b47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94316148733040 notifier 4761 bl.length()=207 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0b47fff640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b34003d60 con 0x55c7b089dd10 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.967+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(140 notify.7 [notify cookie 94316148985808 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== watch-notify(notify_complete (2) cookie 94316148985808 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c6007f040 con 0x55c7b089dd10 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:142 4.18 4:1ad7e467:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904330 con 0x7f0c64038040 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:143 4.e 4:71a24961:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7400 con 0x7f0c64038040 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:144 4.3e 4:7d129eda:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7cd0 con 0x7f0c64038040 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:145 4.24 4:2486ef6d:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ff850 con 0x55c7b089dd10 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:146 4.12 4:4aa29545:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f65d0 con 0x55c7b0899320 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:147 4.20 4:0404fa5b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904330 con 0x55c7b0899320 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:148 4.f 4:f212361e:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904e50 con 0x55c7b0899320 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:149 4.3d 4:bc0f3ee8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7400 con 0x7f0c64038040 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:150 4.24 4:2632118c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ff850 con 0x55c7b089dd10 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:151 4.7 4:e27a050a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7cd0 con 0x55c7b089dd10 2024-04-26T12:31:36.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.968+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:152 4.14 4:288e2374:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7400 con 0x55c7b08a26c0 2024-04-26T12:31:36.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.969+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(152 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.10 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.969+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 37 ==== osd_op_reply(142 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.0 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.969+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(147 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.5 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.969+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== osd_op_reply(148 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.6 [delete] v32'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(151 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.9 [delete] v32'30 uv30 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 38 ==== osd_op_reply(143 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(145 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.3 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(150 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 39 ==== osd_op_reply(144 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.2 [delete] v32'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 40 ==== osd_op_reply(149 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.7 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(146 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9.4 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7540f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 : miss 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7540f800 20 rados->read ofs=0 len=0 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:153 6.a 6:517c6fc0:::pubsub..bucket.myfoo6%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7400 con 0x7f0c64038040 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 41 ==== osd_op_reply(153 pubsub..bucket.myfoo6/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7540f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 info.flags=0x0 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7540f800 10 adding default.rgw.log++pubsub..bucket.myfoo6/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 to cache LRU end 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.970+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:154 6.a 6:517c6fc0:::pubsub..bucket.myfoo6%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7400 con 0x7f0c64038040 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.971+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 42 ==== osd_op_reply(154 pubsub..bucket.myfoo6/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.9 [delete] v32'38 uv31 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.971+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08e7400 con 0x55c7b0899320 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.972+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== osd_op_reply(155 bud.buckets [call] v32'14 uv14 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.972+0000 7f0c7540f800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.972+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f65d0 con 0x55c7b0899320 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.973+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.973+0000 7f0c7540f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.973+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94316149098624 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f65d0 con 0x55c7b089dd10 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.973+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== watch-notify(notify (1) cookie 94316148730912 notify 137438953504 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f0c6007f040 con 0x55c7b089dd10 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.973+0000 7f0b477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94316148730912 notifier 4761 bl.length()=170 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.973+0000 7f0b477fe640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0aa40032a0 con 0x55c7b089dd10 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.973+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(157 notify.5 [notify cookie 94316149098624 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.974+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.974+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== watch-notify(notify_complete (2) cookie 94316149098624 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7b085bb20 con 0x55c7b089dd10 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.974+0000 7f0c7540f800 10 removing email index: 2024-04-26T12:31:36.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.974+0000 7f0c7540f800 10 removing user buckets index 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.974+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f65d0 con 0x55c7b0899320 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== osd_op_reply(159 bud.buckets [delete] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c7540f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94316149098624 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f65d0 con 0x55c7b089dd10 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== watch-notify(notify (1) cookie 94316148734704 notify 137438953505 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c7b085bb20 con 0x55c7b089dd10 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0b47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94316148734704 notifier 4761 bl.length()=160 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0b47fff640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b34003d60 con 0x55c7b089dd10 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== osd_op_reply(160 notify.6 [notify cookie 94316149098624 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 48 ==== watch-notify(notify_complete (2) cookie 94316149098624 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7b085b600 con 0x55c7b089dd10 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 49 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c7540f800 10 removing user index: bud 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.975+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f65d0 con 0x7f0c64038040 2024-04-26T12:31:36.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.976+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 43 ==== osd_op_reply(162 bud [call,call,delete] v32'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.976+0000 7f0c7540f800 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.976+0000 7f0c7540f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.976+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94316149098624 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08f65d0 con 0x55c7b089dd10 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.977+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 50 ==== watch-notify(notify (1) cookie 94316148730912 notify 137438953506 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c7b085b600 con 0x55c7b089dd10 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.977+0000 7f0b477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94316148730912 notifier 4761 bl.length()=152 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.977+0000 7f0b477fe640 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0aa40032a0 con 0x55c7b089dd10 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.977+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 51 ==== osd_op_reply(163 notify.5 [notify cookie 94316149098624 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.977+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 52 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.977+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 53 ==== watch-notify(notify_complete (2) cookie 94316149098624 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7b06148f0 con 0x55c7b089dd10 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.978+0000 7f0b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.978+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94316148738432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904330 con 0x55c7b0899320 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.979+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94316148738432] v32'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.979+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94316148714144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b0904330 con 0x7f0c64038040 2024-04-26T12:31:36.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.980+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 44 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94316148714144] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.980+0000 7f0c7540f800 20 remove_watcher() i=0 2024-04-26T12:31:36.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.980+0000 7f0c7540f800 2 removed watcher, disabling cache 2024-04-26T12:31:36.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.980+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94316148718032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ac980 con 0x55c7b0899320 2024-04-26T12:31:36.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.981+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94316148718032] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.981+0000 7f0c7540f800 20 remove_watcher() i=1 2024-04-26T12:31:36.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.981+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94316148711584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a6aa0 con 0x55c7b08a26c0 2024-04-26T12:31:36.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.982+0000 7f0c7035b640 1 -- 172.21.15.170:0/1701542583 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94316148711584] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c64009050 con 0x55c7b08a26c0 2024-04-26T12:31:36.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.982+0000 7f0c7540f800 20 remove_watcher() i=2 2024-04-26T12:31:36.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.982+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94316148724480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ac980 con 0x7f0c64038040 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.983+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.2 v2:172.21.15.170:6800/1189813177 45 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94316148724480] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x7f0c64038040 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.983+0000 7f0c7540f800 20 remove_watcher() i=3 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.983+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94316148728576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a60a0 con 0x55c7b0899320 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.984+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 <== osd.1 v2:172.21.15.170:6808/2372702203 48 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94316148728576] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c68033040 con 0x55c7b0899320 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.984+0000 7f0c7540f800 20 remove_watcher() i=4 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.984+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94316148730912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08a6aa0 con 0x55c7b089dd10 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.985+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 54 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94316148730912] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.985+0000 7f0c7540f800 20 remove_watcher() i=5 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.985+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94316148734704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08ac980 con 0x55c7b089dd10 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.986+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 55 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94316148734704] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.986+0000 7f0c7540f800 20 remove_watcher() i=6 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.986+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94316148733040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7b08aa300 con 0x55c7b089dd10 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c70b5c640 1 -- 172.21.15.170:0/1701542583 <== osd.0 v2:172.21.15.132:6800/965566727 56 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94316148733040] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c600b2030 con 0x55c7b089dd10 2024-04-26T12:31:36.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 20 remove_watcher() i=7 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b089dd10 msgr2=0x55c7b08a0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b089dd10 0x55c7b08a0100 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b0899320 msgr2=0x55c7b089b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b0899320 0x55c7b089b7e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c64038040 msgr2=0x7f0c6401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c64038040 0x7f0c6401bab0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55c7b08a26c0 msgr2=0x55c7b08a4b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55c7b08a26c0 0x55c7b08a4b80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b3c036950 msgr2=0x7f0b3c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b3c036950 0x7f0b3c038e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c64001b60 tx=0x7f0c64010000 comp rx=0 tx=0).stop 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7135d640 1 -- 172.21.15.170:0/1701542583 reap_dead start 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 msgr2=0x55c7b088dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b088dd50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0c600a5040 tx=0x7f0c6005aef0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 shutdown_connections 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/1701542583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0886900 0x55c7b088dd50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 >> 172.21.15.170:0/1701542583 conn(0x55c7b0882c60 msgr2=0x55c7b08802c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 shutdown_connections 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/1701542583 wait complete. 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b48036900 msgr2=0x7f0b48038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b48036900 0x7f0b48038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400bf50 tx=0x7f0c6400f000 comp rx=0 tx=0).stop 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b08799f0 msgr2=0x55c7b0879e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b08799f0 0x55c7b0879e10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0c6008c8b0 tx=0x7f0c6006fef0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 shutdown_connections 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b48036900 0x7f0b48038dc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3928919300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b08799f0 0x55c7b0879e10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 >> 172.21.15.170:0/3928919300 conn(0x55c7b086da90 msgr2=0x55c7b086de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 shutdown_connections 2024-04-26T12:31:36.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.987+0000 7f0c7540f800 1 -- 172.21.15.170:0/3928919300 wait complete. 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b0864a50 msgr2=0x55c7b0866e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55c7b0864a50 0x55c7b0866e40 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b07638c0 msgr2=0x55c7b0862130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55c7b07638c0 0x55c7b0862130 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55c7b08689e0 msgr2=0x55c7b086ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55c7b08689e0 0x55c7b086ae30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b58036950 msgr2=0x7f0b58038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b58036950 0x7f0b58038e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0c64000f60 tx=0x7f0c640012b0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 msgr2=0x55c7b085b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 --2- 172.21.15.170:0/3832704633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7b0760f90 0x55c7b085b0c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0c60000c00 tx=0x7f0c60002fb0 comp rx=0 tx=0).stop 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7135d640 1 -- 172.21.15.170:0/3832704633 reap_dead start 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 shutdown_connections 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 >> 172.21.15.170:0/3832704633 conn(0x55c7b075aa00 msgr2=0x55c7b075f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:36.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 shutdown_connections 2024-04-26T12:31:36.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:36.988+0000 7f0c7540f800 1 -- 172.21.15.170:0/3832704633 wait complete. 2024-04-26T12:31:36.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-26T12:31:36.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-26T12:31:36.998 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-26T12:31:37.084 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:31:37.084 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f310a611800 1 Processor -- start 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f310a611800 1 -- start start 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f310a611800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x555a6d91de20 0x555a6d91e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f310a611800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a6d7cc0c0 con 0x555a6d91e780 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f310a611800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x555a6d7b04d0 con 0x555a6d91de20 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f3105cfd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x555a6d91de20 0x555a6d91e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f30fffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x555a6d91e780 0x555a6d91ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:59374/0 (socket says 172.21.15.170:59374) 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f30fffff640 1 -- 172.21.15.170:0/1000785732 learned_addr learned my addr 172.21.15.170:0/1000785732 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f3105cfd640 1 -- 172.21.15.170:0/1000785732 >> v1:172.21.15.132:6789/0 conn(0x555a6d91e780 legacy=0x555a6d91ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.083+0000 7f3105cfd640 1 -- 172.21.15.170:0/1000785732 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6d7ddd40 con 0x555a6d91de20 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.085+0000 7f3105cfd640 1 --2- 172.21.15.170:0/1000785732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6d91e240 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f30f800a470 tx=0x7f30f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5cc38e08e2d484 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.085+0000 7f31054fc640 1 -- 172.21.15.170:0/1000785732 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8057070 con 0x555a6d91de20 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.085+0000 7f31054fc640 1 -- 172.21.15.170:0/1000785732 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f804adc0 con 0x555a6d91de20 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.085+0000 7f31054fc640 1 -- 172.21.15.170:0/1000785732 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8052590 con 0x555a6d91de20 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.086+0000 7f310a611800 1 -- 172.21.15.170:0/1000785732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 msgr2=0x555a6d91e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.086+0000 7f310a611800 1 --2- 172.21.15.170:0/1000785732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6d91e240 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f30f800a470 tx=0x7f30f801ce90 comp rx=0 tx=0).stop 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.086+0000 7f310a611800 1 -- 172.21.15.170:0/1000785732 shutdown_connections 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.086+0000 7f310a611800 1 --2- 172.21.15.170:0/1000785732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6d91e240 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.086+0000 7f310a611800 1 -- 172.21.15.170:0/1000785732 >> 172.21.15.170:0/1000785732 conn(0x555a6d919a00 msgr2=0x555a6d91be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:37.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.086+0000 7f310a611800 1 -- 172.21.15.170:0/1000785732 shutdown_connections 2024-04-26T12:31:37.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.086+0000 7f310a611800 1 -- 172.21.15.170:0/1000785732 wait complete. 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.097+0000 7f310a611800 1 Processor -- start 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f310a611800 1 -- start start 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f310a611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da12a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f310a611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555a6d86ab70 con 0x555a6d91de20 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da12a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da12a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36522/0 (socket says 172.21.15.170:36522) 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f3105cfd640 1 -- 172.21.15.170:0/1898913328 learned_addr learned my addr 172.21.15.170:0/1898913328 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f3105cfd640 1 -- 172.21.15.170:0/1898913328 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6d7dc590 con 0x555a6d91de20 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.098+0000 7f3105cfd640 1 --2- 172.21.15.170:0/1898913328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da12a70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f30f8055040 tx=0x7f30f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf30b7efd2386064 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f2ff3e07640 1 -- 172.21.15.170:0/1898913328 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8057040 con 0x555a6d91de20 2024-04-26T12:31:37.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f2ff3e07640 1 -- 172.21.15.170:0/1898913328 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f8062070 con 0x555a6d91de20 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f2ff3e07640 1 -- 172.21.15.170:0/1898913328 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f805d470 con 0x555a6d91de20 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f310a611800 1 -- 172.21.15.170:0/1898913328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 msgr2=0x555a6da12a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f310a611800 1 --2- 172.21.15.170:0/1898913328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da12a70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f30f8055040 tx=0x7f30f804c000 comp rx=0 tx=0).stop 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f310a611800 1 -- 172.21.15.170:0/1898913328 shutdown_connections 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f310a611800 1 --2- 172.21.15.170:0/1898913328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da12a70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f310a611800 1 -- 172.21.15.170:0/1898913328 >> 172.21.15.170:0/1898913328 conn(0x555a6d919a00 msgr2=0x555a6da0e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f310a611800 1 -- 172.21.15.170:0/1898913328 shutdown_connections 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.099+0000 7f310a611800 1 -- 172.21.15.170:0/1898913328 wait complete. 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f310a611800 1 Processor -- start 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f310a611800 1 -- start start 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f310a611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da1a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f310a611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555a6d91f5e0 con 0x555a6d91de20 2024-04-26T12:31:37.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da1a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da1a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36534/0 (socket says 172.21.15.170:36534) 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f3105cfd640 1 -- 172.21.15.170:0/1052805747 learned_addr learned my addr 172.21.15.170:0/1052805747 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f3105cfd640 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6d7d38f0 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f3105cfd640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da1a330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f30f801ce60 tx=0x7f30f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f2ff2604640 1 -- 172.21.15.170:0/1052805747 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f806b070 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f2ff2604640 1 -- 172.21.15.170:0/1052805747 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f805d970 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f2ff2604640 1 -- 172.21.15.170:0/1052805747 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8057070 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.100+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a6da1a870 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.101+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a6da1ad90 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.101+0000 7f2ff2604640 1 -- 172.21.15.170:0/1052805747 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f30f805dc90 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.101+0000 7f2ff2604640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fec036950 0x7f2fec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.101+0000 7f2ff2604640 1 -- 172.21.15.170:0/1052805747 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f30f808e240 con 0x555a6d91de20 2024-04-26T12:31:37.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f30fffff640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fec036950 0x7f2fec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6d91e780 0x555a6da213a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da218e0 con 0x555a6d91e780 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f31064fe640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6d91e780 0x555a6da213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f30fffff640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fec036950 0x7f2fec038e10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000f60 tx=0x7f30f00012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f31064fe640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6d91e780 0x555a6da213a0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f31064fe640 1 -- 172.21.15.170:0/1052805747 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6d91e780 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.102+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da1e970 con 0x555a6d91e780 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.103+0000 7f31064fe640 1 -- 172.21.15.170:0/1052805747 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6d91e780 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.103+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da23bf0 0x555a6da25fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.103+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da26680 con 0x555a6da23bf0 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.103+0000 7f3105cfd640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da23bf0 0x555a6da25fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.103+0000 7f3105cfd640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da23bf0 0x555a6da25fe0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.103+0000 7f3105cfd640 1 -- 172.21.15.170:0/1052805747 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f30f805a040 con 0x555a6da23bf0 2024-04-26T12:31:37.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.103+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da22ba0 con 0x555a6d91e780 2024-04-26T12:31:37.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.104+0000 7f31064fe640 1 -- 172.21.15.170:0/1052805747 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6d91e780 2024-04-26T12:31:37.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.104+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555a6da27ae0 0x555a6da29f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.104+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da2a6d0 con 0x555a6da27ae0 2024-04-26T12:31:37.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.104+0000 7f30fffff640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555a6da27ae0 0x555a6da29f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.104+0000 7f30fffff640 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555a6da27ae0 0x555a6da29f70 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.104+0000 7f30fffff640 1 -- 172.21.15.170:0/1052805747 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da27ae0 2024-04-26T12:31:37.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f310a611800 1 Processor -- start 2024-04-26T12:31:37.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f310a611800 1 -- start start 2024-04-26T12:31:37.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f310a611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da38b80 0x555a6da38fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f310a611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555a6d810e60 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da38b80 0x555a6da38fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da38b80 0x555a6da38fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36536/0 (socket says 172.21.15.170:36536) 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f3105cfd640 1 -- 172.21.15.170:0/1917039394 learned_addr learned my addr 172.21.15.170:0/1917039394 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f3105cfd640 1 -- 172.21.15.170:0/1917039394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6da394e0 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.105+0000 7f3105cfd640 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da38b80 0x555a6da38fa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f30f8070e90 tx=0x7f30f8072da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f2feb7fe640 1 -- 172.21.15.170:0/1917039394 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8089070 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f2feb7fe640 1 -- 172.21.15.170:0/1917039394 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f8009620 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a6da39f50 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f2feb7fe640 1 -- 172.21.15.170:0/1917039394 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8009900 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a6da39f50 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f2feb7fe640 1 -- 172.21.15.170:0/1917039394 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f30f808c8d0 con 0x555a6da38b80 2024-04-26T12:31:37.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f2feb7fe640 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fe0036950 0x7f2fe0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.106+0000 7f2feb7fe640 1 -- 172.21.15.170:0/1917039394 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f30f808fdf0 con 0x555a6da38b80 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f30fffff640 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fe0036950 0x7f2fe0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f310a611800 1 Processor -- start 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f310a611800 1 -- start start 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f30fffff640 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fe0036950 0x7f2fe0038e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30f000bf50 tx=0x7f30f000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f310a611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da45f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f310a611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555a6da13130 con 0x555a6da45b10 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da45f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da45f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36540/0 (socket says 172.21.15.170:36540) 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.107+0000 7f3105cfd640 1 -- 172.21.15.170:0/4209434001 learned_addr learned my addr 172.21.15.170:0/4209434001 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:37.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f3105cfd640 1 -- 172.21.15.170:0/4209434001 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6da46500 con 0x555a6da45b10 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f3105cfd640 1 --2- 172.21.15.170:0/4209434001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da45f30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f30f8070540 tx=0x7f30f8097af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce6b809cae171e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f2fe97fa640 1 -- 172.21.15.170:0/4209434001 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f806e5f0 con 0x555a6da45b10 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f2fe97fa640 1 -- 172.21.15.170:0/4209434001 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f80a0070 con 0x555a6da45b10 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f2fe97fa640 1 -- 172.21.15.170:0/4209434001 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8051c70 con 0x555a6da45b10 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f310a611800 1 -- 172.21.15.170:0/4209434001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 msgr2=0x555a6da45f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f310a611800 1 --2- 172.21.15.170:0/4209434001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da45f30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f30f8070540 tx=0x7f30f8097af0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f310a611800 1 -- 172.21.15.170:0/4209434001 shutdown_connections 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f310a611800 1 --2- 172.21.15.170:0/4209434001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da45f30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f310a611800 1 -- 172.21.15.170:0/4209434001 >> 172.21.15.170:0/4209434001 conn(0x555a6da41e70 msgr2=0x555a6da3fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f310a611800 1 -- 172.21.15.170:0/4209434001 shutdown_connections 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.108+0000 7f310a611800 1 -- 172.21.15.170:0/4209434001 wait complete. 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f310a611800 1 Processor -- start 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f310a611800 1 -- start start 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f310a611800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da4cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f310a611800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555a6da46bb0 con 0x555a6da45b10 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da4cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f3105cfd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da4cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:36552/0 (socket says 172.21.15.170:36552) 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 learned_addr learned my addr 172.21.15.170:0/2684897856 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.109+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6da4d4c0 con 0x555a6da45b10 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.110+0000 7f3105cfd640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da4cf80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f30f800a010 tx=0x7f30f8083f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.110+0000 7f2fd77fe640 1 -- 172.21.15.170:0/2684897856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8097440 con 0x555a6da45b10 2024-04-26T12:31:37.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.110+0000 7f2fd77fe640 1 -- 172.21.15.170:0/2684897856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f8072740 con 0x555a6da45b10 2024-04-26T12:31:37.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.110+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a6da4d4c0 con 0x555a6da45b10 2024-04-26T12:31:37.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.110+0000 7f2fd77fe640 1 -- 172.21.15.170:0/2684897856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30f8085630 con 0x555a6da45b10 2024-04-26T12:31:37.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.110+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a6da4d4c0 con 0x555a6da45b10 2024-04-26T12:31:37.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.110+0000 7f2fd77fe640 1 -- 172.21.15.170:0/2684897856 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f30f80b7020 con 0x555a6da45b10 2024-04-26T12:31:37.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f2fd77fe640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fd00368b0 0x7f2fd0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f2fd77fe640 1 -- 172.21.15.170:0/2684897856 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f30f80b5020 con 0x555a6da45b10 2024-04-26T12:31:37.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f30fffff640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fd00368b0 0x7f2fd0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f30fffff640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fd00368b0 0x7f2fd0038d70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001b60 tx=0x7f30f0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6da58610 0x555a6da5aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5b220 con 0x555a6da58610 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.111+0000 7f31064fe640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6da58610 0x555a6da5aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f31064fe640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6da58610 0x555a6da5aad0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 20 realm 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5b630 con 0x555a6da58610 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5bf00 con 0x555a6da58610 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.112+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f310a611800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da5d000 0x555a6da5f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5fa00 con 0x555a6da5d000 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f3105cfd640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da5d000 0x555a6da5f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f3105cfd640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da5d000 0x555a6da5f3f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.113+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.114+0000 7f310a611800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.114+0000 7f310a611800 20 searching for the correct realm 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.114+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x555a6da61940 0x555a6da63e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.114+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da64480 con 0x555a6da61940 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.114+0000 7f30fffff640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x555a6da61940 0x555a6da63e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.114+0000 7f30fffff640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x555a6da61940 0x555a6da63e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.114+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f30fffff640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f30f0037040 0x7f30f0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da64480 con 0x7f30f0037040 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f31064fe640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f30f0037040 0x7f30f0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f31064fe640 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f30f0037040 0x7f30f0036410 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f310000a4a0 con 0x7f30f0037040 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.115+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.116+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x7f30f0037040 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310000a4a0 con 0x7f30f0037040 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x7f30f0037040 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310000a4a0 con 0x7f30f0037040 2024-04-26T12:31:37.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.117+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310000a4a0 con 0x555a6da58610 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x7f30f0037040 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.118+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.119+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x7f30f0037040 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.120+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.121+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x7f30f0037040 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da61940 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da5d000 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x555a6da58610 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.122+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a6da5c2a0 con 0x7f30f0037040 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:31:37.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da60250 con 0x555a6da58610 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da60250 con 0x555a6da58610 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da60250 con 0x7f30f0037040 2024-04-26T12:31:37.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 zone default found 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 4 Realm: () 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 zonegroup default 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.123+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da60af0 con 0x555a6da5d000 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da662e0 con 0x555a6da61940 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da66680 con 0x555a6da61940 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 20 started sync module instance, tier type = 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.124+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da65780 con 0x7f30f0037040 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.125+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.125+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93846875036528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da65780 con 0x7f30f0037040 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.125+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da67040 con 0x555a6da58610 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.126+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93846875036528] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.127+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.127+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93846875034832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da67040 con 0x555a6da58610 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.127+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da67a40 con 0x555a6da61940 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.128+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93846875034832] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.128+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.128+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93846875040656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da66fb0 con 0x555a6da61940 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.128+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da68900 con 0x7f30f0037040 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.129+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.129+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93846875047472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da69080 con 0x7f30f0037040 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.129+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da69ba0 con 0x555a6da58610 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.129+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93846875040656] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.130+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.130+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93846875047472] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.130+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93846875051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da69b60 con 0x555a6da58610 2024-04-26T12:31:37.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.130+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da68b10 con 0x555a6da5d000 2024-04-26T12:31:37.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.131+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93846875051632] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.131+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.131+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93846875045424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6a5b0 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.131+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6ae40 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.132+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93846875045424] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.133+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.133+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93846875054336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6b020 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.133+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6b870 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93846875054336] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93846875058208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6b8f0 con 0x555a6da5d000 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 20 add_watcher() i=0 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 20 add_watcher() i=1 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 20 add_watcher() i=2 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 20 add_watcher() i=3 2024-04-26T12:31:37.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 20 add_watcher() i=4 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 20 add_watcher() i=5 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.134+0000 7f310a611800 20 add_watcher() i=6 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.135+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93846875058208] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.135+0000 7f310a611800 20 add_watcher() i=7 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.135+0000 7f310a611800 2 all 8 watchers are set, enabling cache 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.135+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6ebc0 con 0x555a6da58610 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.135+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.135+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93846875059632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6be80 con 0x555a6da58610 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.136+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93846875059632] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.136+0000 7f2fb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.136+0000 7f310a611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.136+0000 7f310a611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.136+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da6e520 con 0x555a6da58610 2024-04-26T12:31:37.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.138+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.138+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da77de0 con 0x555a6da5d000 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.138+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.139+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da77de0 con 0x555a6da61940 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.139+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.139+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da78880 con 0x555a6da58610 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.140+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.141+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da77380 con 0x7f30f0037040 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.141+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'73 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.141+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da77380 con 0x555a6da61940 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.143+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.143+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da79a60 con 0x555a6da58610 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.144+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.144+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da79af0 con 0x555a6da5d000 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.145+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.145+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da79b80 con 0x7f30f0037040 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.146+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.146+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da79c10 con 0x555a6da61940 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.147+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.147+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a0c0 con 0x7f30f0037040 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.148+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'74 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.148+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a0c0 con 0x555a6da5d000 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.149+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.149+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a0c0 con 0x7f30f0037040 2024-04-26T12:31:37.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.150+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.150+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a500 con 0x555a6da5d000 2024-04-26T12:31:37.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.151+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.151+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a500 con 0x555a6da58610 2024-04-26T12:31:37.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.152+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.152+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da79690 con 0x555a6da61940 2024-04-26T12:31:37.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.153+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.153+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da79750 con 0x7f30f0037040 2024-04-26T12:31:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.154+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'75 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.154+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da79750 con 0x555a6da61940 2024-04-26T12:31:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.155+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.155+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da58610 2024-04-26T12:31:37.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.156+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.156+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da58610 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.157+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.157+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da61940 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.158+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.158+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x7f30f0037040 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.159+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.159+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da61940 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.160+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.160+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da61940 2024-04-26T12:31:37.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.161+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.161+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da61940 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.162+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.162+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da61940 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.163+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.163+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da5d000 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.164+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.164+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da61940 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.165+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.165+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da5d000 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.166+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.166+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da61940 2024-04-26T12:31:37.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.167+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.168+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x555a6da5d000 2024-04-26T12:31:37.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.169+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.169+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6da7a710 con 0x7f30f0037040 2024-04-26T12:31:37.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.170+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.170+0000 7f2fb67fc640 20 reqs_thread_entry: start 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.170+0000 7f310a611800 20 init_complete bucket index max shards: 11 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.170+0000 7f310a611800 20 Filter name: none 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f2f27fff640 20 reqs_thread_entry: start 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6daa5430 con 0x555a6da5d000 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 20 rados_obj.operate() r=0 bl.length=380 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.171+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6daa7ec0 con 0x555a6da5d000 2024-04-26T12:31:37.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.172+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.172+0000 7f310a611800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 : miss 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.172+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.172+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:96 8.b 8:d0356c02:root::.bucket.meta.myfoo7%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6daa7dc0 con 0x555a6da61940 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 20 rados_obj.operate() r=0 bl.length=382 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 info.flags=0x17 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 to cache LRU end 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:97 4.15 4:a8032695:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db252d0 con 0x555a6da61940 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(97 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:98 4.2f 4:f424cb98:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25350 con 0x555a6da58610 2024-04-26T12:31:37.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(98 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.173+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:99 4.5 4:a2a01998:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25350 con 0x555a6da61940 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.174+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(99 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.174+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 4.17 4:e82dd404:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25350 con 0x555a6da5d000 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.174+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(100 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.174+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:101 4.2a 4:56f87c61:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25350 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.174+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(101 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.174+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:102 4.28 4:14d0f129:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25350 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.175+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(102 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5 [call out=378b] v0'0 uv4 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.175+0000 7f310a611800 10 cls_bucket_list_unordered: got fourteen 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.175+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 4.12 4:49daedb4:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25350 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.175+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(103 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.175+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:104 4.f 4:f2edc2f2:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25a00 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.175+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(104 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.175+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 4.22 4:443c6f7f:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25a00 con 0x555a6da58610 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.176+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(105 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.176+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:106 4.1b 4:d9265b3b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25a00 con 0x7f30f0037040 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.176+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(106 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.176+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:107 4.3f 4:fd2be90b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db25a00 con 0x7f30f0037040 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.176+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(107 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 20 get_obj_state: octx=0x7f310000aaf0 obj=myfoo7:fourteen state=0x555a6db23548 s->prefetch_data=0 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:108 3.1es0 3:7b67e253:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db24370 con 0x555a6da5d000 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(108 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 10 manifest: total_size = 8 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.13603062776017887632 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 20 get_obj_state: octx=0x7f310000aaf0 obj=myfoo7:fourteen state=0x555a6db23548 s->prefetch_data=0 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 20 prepare_atomic_modification: state is not atomic. state=0x555a6db23548 2024-04-26T12:31:37.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.177+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:109 4.28 4:14d0f129:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6db24c30 con 0x555a6da58610 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.178+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(109 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.178+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:110 3.1es0 3:7b67e253:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6db24c30 con 0x555a6da5d000 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.179+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(110 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10_fourteen [call] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.179+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:111 4.28 4:14d0f129:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6db24cd0 con 0x555a6da58610 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.179+0000 7f310a611800 20 list_objects_ordered: starting attempt 1 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.179+0000 7f310a611800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.179+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:112 4.15 4:a8032695:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db24cd0 con 0x555a6da61940 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.179+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:113 4.2f 4:f424cb98:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6db24cd0 con 0x555a6da58610 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:114 4.5 4:a2a01998:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab2ea0 con 0x555a6da61940 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:115 4.17 4:e82dd404:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab2ea0 con 0x555a6da5d000 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:116 4.2a 4:56f87c61:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da58610 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:117 4.28 4:14d0f129:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dabae80 con 0x555a6da58610 2024-04-26T12:31:37.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:118 4.12 4:49daedb4:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dabd8b0 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:119 4.f 4:f2edc2f2:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac01f0 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:120 4.22 4:443c6f7f:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac2c70 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:121 4.1b 4:d9265b3b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac5a50 con 0x7f30f0037040 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:122 4.3f 4:fd2be90b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac8880 con 0x7f30f0037040 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(112 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(115 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.180+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(114 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(116 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(113 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(121 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(122 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(118 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(119 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(120 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(111 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f2fe8ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(117 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10])"; uploads.size()=0; is_truncated=0 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:123 4.15 4:a8032695:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab80f0 con 0x555a6da61940 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:124 4.2f 4:f424cb98:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac8880 con 0x555a6da58610 2024-04-26T12:31:37.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:125 4.5 4:a2a01998:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac8230 con 0x555a6da61940 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:126 4.17 4:e82dd404:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac58b0 con 0x555a6da5d000 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:127 4.2a 4:56f87c61:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab80f0 con 0x555a6da58610 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:128 4.28 4:14d0f129:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac8880 con 0x555a6da58610 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:129 4.12 4:49daedb4:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac8230 con 0x555a6da58610 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.181+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:130 4.f 4:f2edc2f2:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab80f0 con 0x555a6da58610 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== osd_op_reply(124 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(126 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(127 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(123 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== osd_op_reply(128 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(125 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:131 4.22 4:443c6f7f:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac8230 con 0x555a6da58610 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:132 4.1b 4:d9265b3b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac8880 con 0x7f30f0037040 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:133 4.3f 4:fd2be90b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab80f0 con 0x7f30f0037040 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(130 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== osd_op_reply(129 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(131 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(132 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(133 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.182+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(134 fud.buckets [call] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f310a611800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x7f30f0037040 2024-04-26T12:31:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f310a611800 20 rados_obj.operate() r=0 bl.length=168 2024-04-26T12:31:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f310a611800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-04-26T12:31:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f310a611800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-26T12:31:37.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.184+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x7f30f0037040 2024-04-26T12:31:37.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.185+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'47 uv47 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.185+0000 7f310a611800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-26T12:31:37.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.185+0000 7f310a611800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93846875325984 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x7f30f0037040 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== watch-notify(notify (1) cookie 93846875047472 notify 137438953492 ret 0) ==== 192+0+0 (crc 0 0 0) 0x555a6da6e4e0 con 0x7f30f0037040 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f2fe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 93846875047472 notifier 4768 bl.length()=150 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f2fe8ff9640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2f300032c0 con 0x7f30f0037040 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(137 notify.3 [notify cookie 93846875325984 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== watch-notify(notify_complete (2) cookie 93846875325984 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a6da77720 con 0x7f30f0037040 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.186+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:139 8.b 8:d0356c02:root::.bucket.meta.myfoo7%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da61940 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.187+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.187+0000 7f310a611800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 from cache 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.187+0000 7f310a611800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10, ofs0, ns] 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.187+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93846875325984 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== watch-notify(notify (1) cookie 93846875054336 notify 137438953507 ret 0) ==== 250+0+0 (crc 0 0 0) 0x555a6da77130 con 0x555a6da5d000 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f2fe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 93846875054336 notifier 4768 bl.length()=208 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f2fe97fa640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2fc8003d60 con 0x555a6da5d000 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(140 notify.6 [notify cookie 93846875325984 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== watch-notify(notify_complete (2) cookie 93846875325984 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f30f807f040 con 0x555a6da5d000 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:142 4.15 4:a8032695:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da61940 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:143 4.2f 4:f424cb98:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6daba800 con 0x555a6da58610 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:144 4.5 4:a2a01998:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac5460 con 0x555a6da61940 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:145 4.17 4:e82dd404:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac58c0 con 0x555a6da5d000 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:146 4.2a 4:56f87c61:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac6880 con 0x555a6da58610 2024-04-26T12:31:37.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:147 4.28 4:14d0f129:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:148 4.12 4:49daedb4:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac5460 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:149 4.f 4:f2edc2f2:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac58c0 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:150 4.22 4:443c6f7f:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:151 4.1b 4:d9265b3b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac5460 con 0x7f30f0037040 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.188+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:152 4.3f 4:fd2be90b:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dac58c0 con 0x7f30f0037040 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.190+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(151 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.9 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.190+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== osd_op_reply(142 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.0 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.190+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== osd_op_reply(152 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.10 [delete] v32'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.190+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(143 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.1 [delete] v32'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.190+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 48 ==== osd_op_reply(146 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.4 [delete] v32'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 49 ==== osd_op_reply(147 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.5 [delete] v32'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 50 ==== osd_op_reply(148 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.6 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 51 ==== osd_op_reply(150 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.8 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 35 ==== osd_op_reply(144 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.2 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 52 ==== osd_op_reply(149 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.7 [delete] v32'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(145 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10.3 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f310a611800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 : miss 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f310a611800 20 rados->read ofs=0 len=0 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:153 6.10 6:0c103826:::pubsub..bucket.myfoo7%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(153 pubsub..bucket.myfoo7/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f310a611800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f310a611800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 info.flags=0x0 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f310a611800 10 adding default.rgw.log++pubsub..bucket.myfoo7/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 to cache LRU end 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.191+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:154 6.10 6:0c103826:::pubsub..bucket.myfoo7%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.192+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(154 pubsub..bucket.myfoo7/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.10 [delete] v32'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.192+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.193+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(155 fud.buckets [call] v32'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.193+0000 7f310a611800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.193+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f310a611800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 93846875428992 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da61940 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 36 ==== watch-notify(notify (1) cookie 93846875040656 notify 137438953479 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555a6daa7280 con 0x555a6da61940 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f2fe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 93846875040656 notifier 4768 bl.length()=170 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f2fe8ff9640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2f300032c0 con 0x555a6da61940 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 37 ==== osd_op_reply(157 notify.2 [notify cookie 93846875428992 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 38 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.194+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 39 ==== watch-notify(notify_complete (2) cookie 93846875428992 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a6da793e0 con 0x555a6da61940 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.195+0000 7f310a611800 10 removing email index: 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.195+0000 7f310a611800 10 removing user buckets index 2024-04-26T12:31:37.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.195+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.195+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(159 fud.buckets [delete] v32'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.195+0000 7f310a611800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.195+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93846875307312 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== watch-notify(notify (1) cookie 93846875054336 notify 137438953508 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7f30f807f040 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f2fe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 93846875054336 notifier 4768 bl.length()=160 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f2fe97fa640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2fc8003d60 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(160 notify.6 [notify cookie 93846875307312 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== watch-notify(notify_complete (2) cookie 93846875307312 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a6da1ad90 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f310a611800 10 removing user index: fud 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.196+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(162 fud [call,call,delete] v32'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f310a611800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-26T12:31:37.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f310a611800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93846875307312 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== watch-notify(notify (1) cookie 93846875045424 notify 137438953509 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555a6da1ad90 con 0x555a6da5d000 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f2fe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 93846875045424 notifier 4768 bl.length()=152 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f2fe8ff9640 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2f300032c0 con 0x555a6da5d000 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 48 ==== osd_op_reply(163 notify.5 [notify cookie 93846875307312 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.197+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 49 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.198+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 50 ==== watch-notify(notify_complete (2) cookie 93846875307312 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a6da1a870 con 0x555a6da5d000 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.198+0000 7f2fb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.198+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93846875059632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da58610 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.199+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 53 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93846875059632] v32'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.199+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93846875036528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x7f30f0037040 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.200+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93846875036528] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.200+0000 7f310a611800 20 remove_watcher() i=0 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.200+0000 7f310a611800 2 removed watcher, disabling cache 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.200+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93846875034832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da58610 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.202+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 54 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93846875034832] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.202+0000 7f310a611800 20 remove_watcher() i=1 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.202+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93846875040656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da61940 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.202+0000 7f30fffff640 1 -- 172.21.15.170:0/2684897856 <== osd.3 v2:172.21.15.170:6816/2349137764 40 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93846875040656] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f0009050 con 0x555a6da61940 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.203+0000 7f310a611800 20 remove_watcher() i=2 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.203+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93846875047472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x7f30f0037040 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.203+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.2 v2:172.21.15.170:6800/1189813177 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93846875047472] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x7f30f0037040 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.203+0000 7f310a611800 20 remove_watcher() i=3 2024-04-26T12:31:37.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.203+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93846875051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da58610 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.204+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 <== osd.1 v2:172.21.15.170:6808/2372702203 55 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93846875051632] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3100033040 con 0x555a6da58610 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.204+0000 7f310a611800 20 remove_watcher() i=4 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.204+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93846875045424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.206+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 51 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93846875045424] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.206+0000 7f310a611800 20 remove_watcher() i=5 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.206+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93846875054336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.207+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 52 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93846875054336] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.207+0000 7f310a611800 20 remove_watcher() i=6 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.207+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93846875058208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a6dab8090 con 0x555a6da5d000 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f3105cfd640 1 -- 172.21.15.170:0/2684897856 <== osd.0 v2:172.21.15.132:6800/965566727 53 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93846875058208] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30f8079d70 con 0x555a6da5d000 2024-04-26T12:31:37.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 20 remove_watcher() i=7 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da5d000 msgr2=0x555a6da5f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da5d000 0x555a6da5f3f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6da58610 msgr2=0x555a6da5aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6da58610 0x555a6da5aad0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f30f0037040 msgr2=0x7f30f0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f30f0037040 0x7f30f0036410 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x555a6da61940 msgr2=0x555a6da63e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x555a6da61940 0x555a6da63e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fd00368b0 msgr2=0x7f2fd0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fd00368b0 0x7f2fd0038d70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001b60 tx=0x7f30f0010000 comp rx=0 tx=0).stop 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 msgr2=0x555a6da4cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da4cf80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f30f800a010 tx=0x7f30f8083f70 comp rx=0 tx=0).stop 2024-04-26T12:31:37.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f31064fe640 1 -- 172.21.15.170:0/2684897856 reap_dead start 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 shutdown_connections 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/2684897856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da45b10 0x555a6da4cf80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 >> 172.21.15.170:0/2684897856 conn(0x555a6da41e70 msgr2=0x555a6da3f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 shutdown_connections 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/2684897856 wait complete. 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fe0036950 msgr2=0x7f2fe0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fe0036950 0x7f2fe0038e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30f000bf50 tx=0x7f30f000f000 comp rx=0 tx=0).stop 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da38b80 msgr2=0x555a6da38fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da38b80 0x555a6da38fa0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f30f8070e90 tx=0x7f30f8072da0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 shutdown_connections 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fe0036950 0x7f2fe0038e10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.208+0000 7f310a611800 1 --2- 172.21.15.170:0/1917039394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6da38b80 0x555a6da38fa0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 >> 172.21.15.170:0/1917039394 conn(0x555a6da2cc20 msgr2=0x555a6da2d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:37.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 shutdown_connections 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1917039394 wait complete. 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da23bf0 msgr2=0x555a6da25fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x555a6da23bf0 0x555a6da25fe0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6d91e780 msgr2=0x555a6da213a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555a6d91e780 0x555a6da213a0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555a6da27ae0 msgr2=0x555a6da29f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555a6da27ae0 0x555a6da29f70 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fec036950 msgr2=0x7f2fec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2fec036950 0x7f2fec038e10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000f60 tx=0x7f30f00012b0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 msgr2=0x555a6da1a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 --2- 172.21.15.170:0/1052805747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6d91de20 0x555a6da1a330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f30f801ce60 tx=0x7f30f8002fb0 comp rx=0 tx=0).stop 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f31064fe640 1 -- 172.21.15.170:0/1052805747 reap_dead start 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 shutdown_connections 2024-04-26T12:31:37.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 >> 172.21.15.170:0/1052805747 conn(0x555a6d919a00 msgr2=0x555a6da11460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:31:37.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 shutdown_connections 2024-04-26T12:31:37.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:31:37.209+0000 7f310a611800 1 -- 172.21.15.170:0/1052805747 wait complete. 2024-04-26T12:32:17.224 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-26T12:32:17.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-26T12:32:17.225 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-26T12:32:17.275 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:17.275 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:17.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.275+0000 7fd52183c800 1 Processor -- start 2024-04-26T12:32:17.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.275+0000 7fd52183c800 1 -- start start 2024-04-26T12:32:17.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.275+0000 7fd52183c800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55cfa154a970 0x55cfa1553470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.275+0000 7fd52183c800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cfa13f70c0 con 0x55cfa1548e30 2024-04-26T12:32:17.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.275+0000 7fd52183c800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55cfa13db4d0 con 0x55cfa154a970 2024-04-26T12:32:17.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.276+0000 7fd51bcd4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55cfa154a970 0x55cfa1553470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.276+0000 7fd51bcd4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55cfa154a970 0x55cfa1553470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44408/0 (socket says 172.21.15.170:44408) 2024-04-26T12:32:17.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.276+0000 7fd51bcd4640 1 -- 172.21.15.170:0/3682070707 learned_addr learned my addr 172.21.15.170:0/3682070707 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.276+0000 7fd51bcd4640 1 -- 172.21.15.170:0/3682070707 >> v1:172.21.15.132:6789/0 conn(0x55cfa1548e30 legacy=0x55cfa1549250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.276+0000 7fd51b4d3640 1 -- 172.21.15.170:0/3682070707 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800036668 0 0) 0x55cfa13f70c0 con 0x55cfa1548e30 2024-04-26T12:32:17.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.276+0000 7fd51bcd4640 1 -- 172.21.15.170:0/3682070707 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa1408d40 con 0x55cfa154a970 2024-04-26T12:32:17.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.278+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/3682070707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa154a970 0x55cfa1553470 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd51000a520 tx=0x7fd51001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d204a63116668514 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.278+0000 7fd51b4d3640 1 -- 172.21.15.170:0/3682070707 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd510057070 con 0x55cfa154a970 2024-04-26T12:32:17.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.278+0000 7fd51b4d3640 1 -- 172.21.15.170:0/3682070707 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510052440 con 0x55cfa154a970 2024-04-26T12:32:17.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.278+0000 7fd51b4d3640 1 -- 172.21.15.170:0/3682070707 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd51004ae60 con 0x55cfa154a970 2024-04-26T12:32:17.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.279+0000 7fd52183c800 1 -- 172.21.15.170:0/3682070707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa154a970 msgr2=0x55cfa1553470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.279+0000 7fd52183c800 1 --2- 172.21.15.170:0/3682070707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa154a970 0x55cfa1553470 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd51000a520 tx=0x7fd51001d010 comp rx=0 tx=0).stop 2024-04-26T12:32:17.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.279+0000 7fd52183c800 1 -- 172.21.15.170:0/3682070707 shutdown_connections 2024-04-26T12:32:17.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.279+0000 7fd52183c800 1 --2- 172.21.15.170:0/3682070707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa154a970 0x55cfa1553470 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.279+0000 7fd52183c800 1 -- 172.21.15.170:0/3682070707 >> 172.21.15.170:0/3682070707 conn(0x55cfa1544990 msgr2=0x55cfa1546db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.279+0000 7fd52183c800 1 -- 172.21.15.170:0/3682070707 shutdown_connections 2024-04-26T12:32:17.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.279+0000 7fd52183c800 1 -- 172.21.15.170:0/3682070707 wait complete. 2024-04-26T12:32:17.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd52183c800 1 Processor -- start 2024-04-26T12:32:17.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd52183c800 1 -- start start 2024-04-26T12:32:17.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd52183c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa163d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd52183c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cfa1495b40 con 0x55cfa1548e30 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa163d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa163d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44418/0 (socket says 172.21.15.170:44418) 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd51c4d5640 1 -- 172.21.15.170:0/3952153582 learned_addr learned my addr 172.21.15.170:0/3952153582 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.293+0000 7fd51c4d5640 1 -- 172.21.15.170:0/3952153582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa1407590 con 0x55cfa1548e30 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.294+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/3952153582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa163d980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006fd0 tx=0x7fd50c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0c443f027ab4e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.294+0000 7fd40a60c640 1 -- 172.21.15.170:0/3952153582 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c017070 con 0x55cfa1548e30 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.294+0000 7fd40a60c640 1 -- 172.21.15.170:0/3952153582 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c0025c0 con 0x55cfa1548e30 2024-04-26T12:32:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.294+0000 7fd40a60c640 1 -- 172.21.15.170:0/3952153582 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c002920 con 0x55cfa1548e30 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 -- 172.21.15.170:0/3952153582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 msgr2=0x55cfa163d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 --2- 172.21.15.170:0/3952153582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa163d980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006fd0 tx=0x7fd50c001ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 -- 172.21.15.170:0/3952153582 shutdown_connections 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 --2- 172.21.15.170:0/3952153582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa163d980 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 -- 172.21.15.170:0/3952153582 >> 172.21.15.170:0/3952153582 conn(0x55cfa1544990 msgr2=0x55cfa16392a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 -- 172.21.15.170:0/3952153582 shutdown_connections 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 -- 172.21.15.170:0/3952153582 wait complete. 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 Processor -- start 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 -- start start 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa16453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd52183c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cfa1555c90 con 0x55cfa1548e30 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.295+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa16453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa16453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44428/0 (socket says 172.21.15.170:44428) 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd51c4d5640 1 -- 172.21.15.170:0/815412701 learned_addr learned my addr 172.21.15.170:0/815412701 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd51c4d5640 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa13fe8f0 con 0x55cfa1548e30 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa16453c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006f70 tx=0x7fd50c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd408e09640 1 -- 172.21.15.170:0/815412701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c022020 con 0x55cfa1548e30 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd408e09640 1 -- 172.21.15.170:0/815412701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c012790 con 0x55cfa1548e30 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd408e09640 1 -- 172.21.15.170:0/815412701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c017040 con 0x55cfa1548e30 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfa1645900 con 0x55cfa1548e30 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.296+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa1645e80 con 0x55cfa1548e30 2024-04-26T12:32:17.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.297+0000 7fd408e09640 1 -- 172.21.15.170:0/815412701 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd50c025020 con 0x55cfa1548e30 2024-04-26T12:32:17.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.297+0000 7fd408e09640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd404036950 0x7fd404038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.297+0000 7fd408e09640 1 -- 172.21.15.170:0/815412701 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fd50c04c1e0 con 0x55cfa1548e30 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.297+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd404036950 0x7fd404038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.297+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa154a970 0x55cfa164c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.297+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa164c9b0 con 0x55cfa154a970 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.298+0000 7fd51ccd6640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa154a970 0x55cfa164c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.298+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd404036950 0x7fd404038e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd510054000 tx=0x7fd51004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.298+0000 7fd51ccd6640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa154a970 0x55cfa164c340 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.298+0000 7fd51ccd6640 1 -- 172.21.15.170:0/815412701 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa154a970 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.298+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16499e0 con 0x55cfa154a970 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.299+0000 7fd51ccd6640 1 -- 172.21.15.170:0/815412701 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa154a970 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.299+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa164ecc0 0x55cfa16510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.299+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16517a0 con 0x55cfa164ecc0 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.299+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa164ecc0 0x55cfa16510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.299+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa164ecc0 0x55cfa16510b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.300+0000 7fd51c4d5640 1 -- 172.21.15.170:0/815412701 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd50c00f070 con 0x55cfa164ecc0 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.300+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa164dc70 con 0x55cfa154a970 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.300+0000 7fd51ccd6640 1 -- 172.21.15.170:0/815412701 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa154a970 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.300+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cfa1652c00 0x55cfa1655070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.300+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16557d0 con 0x55cfa1652c00 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.300+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cfa1652c00 0x55cfa1655070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.301+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cfa1652c00 0x55cfa1655070 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.301+0000 7fd51bcd4640 1 -- 172.21.15.170:0/815412701 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd51005a040 con 0x55cfa1652c00 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.301+0000 7fd52183c800 1 Processor -- start 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.301+0000 7fd52183c800 1 -- start start 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.301+0000 7fd52183c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1663c00 0x55cfa1664020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.301+0000 7fd52183c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cfa143be60 con 0x55cfa1663c00 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1663c00 0x55cfa1664020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1663c00 0x55cfa1664020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44436/0 (socket says 172.21.15.170:44436) 2024-04-26T12:32:17.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd51c4d5640 1 -- 172.21.15.170:0/321728815 learned_addr learned my addr 172.21.15.170:0/321728815 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd51c4d5640 1 -- 172.21.15.170:0/321728815 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa1664560 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1663c00 0x55cfa1664020 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0064c0 tx=0x7fd50c026fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd401ffb640 1 -- 172.21.15.170:0/321728815 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c019d70 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd401ffb640 1 -- 172.21.15.170:0/321728815 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c034070 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfa1664fd0 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd401ffb640 1 -- 172.21.15.170:0/321728815 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c01d490 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.302+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa16654d0 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.303+0000 7fd401ffb640 1 -- 172.21.15.170:0/321728815 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd50c036030 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.303+0000 7fd401ffb640 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3f4036950 0x7fd3f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.303+0000 7fd401ffb640 1 -- 172.21.15.170:0/321728815 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fd50c04ddd0 con 0x55cfa1663c00 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.303+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3f4036950 0x7fd3f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd52183c800 1 Processor -- start 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd52183c800 1 -- start start 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3f4036950 0x7fd3f4038e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55cfa164d270 tx=0x7fd510005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd52183c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd52183c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cfa163e100 con 0x55cfa1670f90 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44452/0 (socket says 172.21.15.170:44452) 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd51c4d5640 1 -- 172.21.15.170:0/2350704439 learned_addr learned my addr 172.21.15.170:0/2350704439 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.304+0000 7fd51c4d5640 1 -- 172.21.15.170:0/2350704439 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa1671980 con 0x55cfa1670f90 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/2350704439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16713b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd50c012660 tx=0x7fd50c04afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe3ae66da11e062 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd3fb7fe640 1 -- 172.21.15.170:0/2350704439 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c0206c0 con 0x55cfa1670f90 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd3fb7fe640 1 -- 172.21.15.170:0/2350704439 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c043b30 con 0x55cfa1670f90 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd3fb7fe640 1 -- 172.21.15.170:0/2350704439 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c01d630 con 0x55cfa1670f90 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd52183c800 1 -- 172.21.15.170:0/2350704439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 msgr2=0x55cfa16713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd52183c800 1 --2- 172.21.15.170:0/2350704439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16713b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd50c012660 tx=0x7fd50c04afa0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd52183c800 1 -- 172.21.15.170:0/2350704439 shutdown_connections 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd52183c800 1 --2- 172.21.15.170:0/2350704439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16713b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd52183c800 1 -- 172.21.15.170:0/2350704439 >> 172.21.15.170:0/2350704439 conn(0x55cfa166d260 msgr2=0x55cfa166b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd52183c800 1 -- 172.21.15.170:0/2350704439 shutdown_connections 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.305+0000 7fd52183c800 1 -- 172.21.15.170:0/2350704439 wait complete. 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd52183c800 1 Processor -- start 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd52183c800 1 -- start start 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd52183c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16782e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd52183c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55cfa1672050 con 0x55cfa1670f90 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd51c4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16782e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44466/0 (socket says 172.21.15.170:44466) 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 learned_addr learned my addr 172.21.15.170:0/1512325183 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa1678820 con 0x55cfa1670f90 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.306+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16782e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00f8e0 tx=0x7fd50c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.307+0000 7fd3f9ffb640 1 -- 172.21.15.170:0/1512325183 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c00f300 con 0x55cfa1670f90 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.307+0000 7fd3f9ffb640 1 -- 172.21.15.170:0/1512325183 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c066070 con 0x55cfa1670f90 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.307+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfa1678820 con 0x55cfa1670f90 2024-04-26T12:32:17.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.307+0000 7fd3f9ffb640 1 -- 172.21.15.170:0/1512325183 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50c04a870 con 0x55cfa1670f90 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.307+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa1678820 con 0x55cfa1670f90 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd3f9ffb640 1 -- 172.21.15.170:0/1512325183 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd50c05d040 con 0x55cfa1670f90 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd3f9ffb640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3ec036900 0x7fd3ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd3f9ffb640 1 -- 172.21.15.170:0/1512325183 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fd50c05b020 con 0x55cfa1670f90 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3ec036900 0x7fd3ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa1683ad0 0x55cfa1685f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16866e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.308+0000 7fd51ccd6640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa1683ad0 0x55cfa1685f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3ec036900 0x7fd3ec038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cfa1655bd0 tx=0x7fd51004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd51ccd6640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa1683ad0 0x55cfa1685f90 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 20 realm 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1686b10 con 0x55cfa1683ad0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.309+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd52183c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1687780 con 0x55cfa1683ad0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd52183c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa1688140 0x55cfa168a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa168ab40 con 0x55cfa1688140 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.310+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa1688140 0x55cfa168a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd51c4d5640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa1688140 0x55cfa168a530 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd52183c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd52183c800 20 searching for the correct realm 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cfa168cad0 0x55cfa168ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa168f660 con 0x55cfa168cad0 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cfa168cad0 0x55cfa168ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.311+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cfa168cad0 0x55cfa168ef90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.312+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.312+0000 7fd51bcd4640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd510085040 0x7fd510076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.312+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa168f660 con 0x7fd510085040 2024-04-26T12:32:17.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.312+0000 7fd51ccd6640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd510085040 0x7fd510076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.312+0000 7fd51ccd6640 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd510085040 0x7fd510076430 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.312+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd5140083e0 con 0x7fd510085040 2024-04-26T12:32:17.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.312+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.313+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.313+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.313+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5140083e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.313+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.313+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.313+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x7fd510085040 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.314+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x7fd510085040 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x7fd510085040 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.315+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.316+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.317+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.317+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.317+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.317+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.317+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.317+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x7fd510085040 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.318+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.319+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.319+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.319+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.319+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.319+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.319+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x7fd510085040 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.320+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.320+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa168cad0 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.320+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.320+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1688140 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.320+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.320+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x55cfa1683ad0 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16873e0 con 0x7fd510085040 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa168aee0 con 0x55cfa1683ad0 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.321+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa168aee0 con 0x55cfa1683ad0 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa168aee0 con 0x7fd510085040 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 zone default found 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 4 Realm: () 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:17.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 zonegroup default 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa168b780 con 0x55cfa1688140 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.322+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16914c0 con 0x55cfa168cad0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd52183c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1691860 con 0x55cfa168cad0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd52183c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd52183c800 20 started sync module instance, tier type = 2024-04-26T12:32:17.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd52183c800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.323+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1690960 con 0x7fd510085040 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.324+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.324+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94350254607696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1690960 con 0x7fd510085040 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.324+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1692130 con 0x55cfa1683ad0 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.325+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94350254607696] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.325+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.325+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94350254611456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1690960 con 0x55cfa1683ad0 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.325+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1692be0 con 0x55cfa168cad0 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.327+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94350254611456] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.327+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.327+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94350254605488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16908d0 con 0x55cfa168cad0 2024-04-26T12:32:17.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.327+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1693aa0 con 0x7fd510085040 2024-04-26T12:32:17.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.328+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94350254605488] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.328+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.328+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94350254618096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1693ec0 con 0x7fd510085040 2024-04-26T12:32:17.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.328+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1694880 con 0x55cfa1683ad0 2024-04-26T12:32:17.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.329+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94350254618096] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.329+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.329+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94350254619632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1694880 con 0x55cfa1683ad0 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.329+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1695240 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.330+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94350254619632] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.330+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.331+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94350254621648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16947f0 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.331+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1696100 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.332+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94350254621648] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.332+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.332+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94350254626352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1696950 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.332+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16971a0 con 0x55cfa1688140 2024-04-26T12:32:17.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94350254626352] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94350254630528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1697050 con 0x55cfa1688140 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 20 add_watcher() i=0 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 20 add_watcher() i=1 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 20 add_watcher() i=2 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 20 add_watcher() i=3 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 20 add_watcher() i=4 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 20 add_watcher() i=5 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.333+0000 7fd52183c800 20 add_watcher() i=6 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.334+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94350254630528] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.334+0000 7fd52183c800 20 add_watcher() i=7 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.334+0000 7fd52183c800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.334+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa169a6a0 con 0x55cfa1683ad0 2024-04-26T12:32:17.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.334+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.334+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94350254631648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1697a70 con 0x55cfa1683ad0 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.335+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94350254631648] v32'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.335+0000 7fd3d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.335+0000 7fd52183c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.335+0000 7fd52183c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.335+0000 7fd52183c800 5 note: GC not initialized 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd3d17e2640 20 reqs_thread_entry: start 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 20 Filter name: none 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd342ffd640 20 reqs_thread_entry: start 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16cdcd0 con 0x55cfa1683ad0 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.336+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16cd7b0 con 0x55cfa1688140 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.338+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.338+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16cd7b0 con 0x55cfa1688140 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.339+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.340+0000 7fd3d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.340+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94350254631648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16cd7b0 con 0x55cfa1683ad0 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.341+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94350254631648] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.341+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94350254607696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16cd7b0 con 0x7fd510085040 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.342+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94350254607696] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.342+0000 7fd52183c800 20 remove_watcher() i=0 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.342+0000 7fd52183c800 2 removed watcher, disabling cache 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.342+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94350254611456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16cd7b0 con 0x55cfa1683ad0 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.343+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94350254611456] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.343+0000 7fd52183c800 20 remove_watcher() i=1 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.343+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94350254605488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16cd7b0 con 0x55cfa168cad0 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.344+0000 7fd51bcd4640 1 -- 172.21.15.170:0/1512325183 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94350254605488] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd510073070 con 0x55cfa168cad0 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.344+0000 7fd52183c800 20 remove_watcher() i=2 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.344+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94350254618096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1691c00 con 0x7fd510085040 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.345+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94350254618096] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x7fd510085040 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.345+0000 7fd52183c800 20 remove_watcher() i=3 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.345+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94350254619632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16904b0 con 0x55cfa1683ad0 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.346+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94350254619632] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd514026040 con 0x55cfa1683ad0 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.346+0000 7fd52183c800 20 remove_watcher() i=4 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.346+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94350254621648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16935f0 con 0x55cfa1688140 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.347+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94350254621648] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.347+0000 7fd52183c800 20 remove_watcher() i=5 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.347+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94350254626352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa1691c00 con 0x55cfa1688140 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.348+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94350254626352] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.348+0000 7fd52183c800 20 remove_watcher() i=6 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.348+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94350254630528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cfa16904b0 con 0x55cfa1688140 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.349+0000 7fd51c4d5640 1 -- 172.21.15.170:0/1512325183 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94350254630528] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd50c06bd70 con 0x55cfa1688140 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.349+0000 7fd52183c800 20 remove_watcher() i=7 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa1688140 msgr2=0x55cfa168a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa1688140 0x55cfa168a530 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa1683ad0 msgr2=0x55cfa1685f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa1683ad0 0x55cfa1685f90 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd510085040 msgr2=0x7fd510076430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd510085040 0x7fd510076430 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cfa168cad0 msgr2=0x55cfa168ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55cfa168cad0 0x55cfa168ef90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3ec036900 msgr2=0x7fd3ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3ec036900 0x7fd3ec038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55cfa1655bd0 tx=0x7fd51004f000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 msgr2=0x55cfa16782e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/1512325183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1670f90 0x55cfa16782e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00f8e0 tx=0x7fd50c01ebf0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 reap_dead start 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd51ccd6640 1 -- 172.21.15.170:0/1512325183 reap_dead start 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 shutdown_connections 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 >> 172.21.15.170:0/1512325183 conn(0x55cfa166d260 msgr2=0x55cfa166a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 shutdown_connections 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/1512325183 wait complete. 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3f4036950 msgr2=0x7fd3f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3f4036950 0x7fd3f4038e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55cfa164d270 tx=0x7fd510005ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1663c00 msgr2=0x55cfa1664020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1663c00 0x55cfa1664020 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0064c0 tx=0x7fd50c026fa0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 shutdown_connections 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd3f4036950 0x7fd3f4038e10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 --2- 172.21.15.170:0/321728815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1663c00 0x55cfa1664020 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 >> 172.21.15.170:0/321728815 conn(0x55cfa1657ca0 msgr2=0x55cfa16580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 shutdown_connections 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.350+0000 7fd52183c800 1 -- 172.21.15.170:0/321728815 wait complete. 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa164ecc0 msgr2=0x55cfa16510b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55cfa164ecc0 0x55cfa16510b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa154a970 msgr2=0x55cfa164c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55cfa154a970 0x55cfa164c340 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cfa1652c00 msgr2=0x55cfa1655070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55cfa1652c00 0x55cfa1655070 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd404036950 msgr2=0x7fd404038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd404036950 0x7fd404038e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd510054000 tx=0x7fd51004e000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 msgr2=0x55cfa16453c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 --2- 172.21.15.170:0/815412701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55cfa1548e30 0x55cfa16453c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd50c006f70 tx=0x7fd50c001250 comp rx=0 tx=0).stop 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd51ccd6640 1 -- 172.21.15.170:0/815412701 reap_dead start 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 shutdown_connections 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 >> 172.21.15.170:0/815412701 conn(0x55cfa1544990 msgr2=0x55cfa163c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 shutdown_connections 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.351+0000 7fd52183c800 1 -- 172.21.15.170:0/815412701 wait complete. 2024-04-26T12:32:17.360 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-26T12:32:17.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-26T12:32:17.360 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.402+0000 7f9fce1a2800 1 Processor -- start 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.402+0000 7f9fce1a2800 1 -- start start 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fce1a2800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ab654a0e50 0x55ab654a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fce1a2800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab6534f0c0 con 0x55ab654a17b0 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fce1a2800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55ab653334d0 con 0x55ab654a0e50 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fcbca8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ab654a0e50 0x55ab654a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fcbca8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55ab654a0e50 0x55ab654a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44472/0 (socket says 172.21.15.170:44472) 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fcb4a7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55ab654a17b0 0x55ab654a1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58738/0 (socket says 172.21.15.170:58738) 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fcbca8640 1 -- 172.21.15.170:0/2326806117 learned_addr learned my addr 172.21.15.170:0/2326806117 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fcbca8640 1 -- 172.21.15.170:0/2326806117 >> v1:172.21.15.132:6789/0 conn(0x55ab654a17b0 legacy=0x55ab654a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.403+0000 7f9fcbca8640 1 -- 172.21.15.170:0/2326806117 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab65360d40 con 0x55ab654a0e50 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.405+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/2326806117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab654a1270 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400a520 tx=0x7f9fc401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b17c38e5e2dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.405+0000 7f9fcaca6640 1 -- 172.21.15.170:0/2326806117 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4057070 con 0x55ab654a0e50 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.405+0000 7f9fcaca6640 1 -- 172.21.15.170:0/2326806117 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4052570 con 0x55ab654a0e50 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.405+0000 7f9fcaca6640 1 -- 172.21.15.170:0/2326806117 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4052870 con 0x55ab654a0e50 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.406+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2326806117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 msgr2=0x55ab654a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.406+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/2326806117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab654a1270 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400a520 tx=0x7f9fc401d010 comp rx=0 tx=0).stop 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.406+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2326806117 shutdown_connections 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.406+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/2326806117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab654a1270 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.406+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2326806117 >> 172.21.15.170:0/2326806117 conn(0x55ab6549c990 msgr2=0x55ab6549edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.406+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2326806117 shutdown_connections 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.406+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2326806117 wait complete. 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.417+0000 7f9fce1a2800 1 Processor -- start 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.417+0000 7f9fce1a2800 1 -- start start 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.418+0000 7f9fce1a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab65595a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.418+0000 7f9fce1a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ab653edb40 con 0x55ab654a0e50 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.418+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab65595a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.418+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab65595a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44486/0 (socket says 172.21.15.170:44486) 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.418+0000 7f9fcbca8640 1 -- 172.21.15.170:0/354562355 learned_addr learned my addr 172.21.15.170:0/354562355 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.418+0000 7f9fcbca8640 1 -- 172.21.15.170:0/354562355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6535f590 con 0x55ab654a0e50 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.418+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/354562355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab65595a40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4055040 tx=0x7f9fc404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbf62dc7cebc83b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9eb9e0b640 1 -- 172.21.15.170:0/354562355 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4057040 con 0x55ab654a0e50 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9eb9e0b640 1 -- 172.21.15.170:0/354562355 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4052870 con 0x55ab654a0e50 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9eb9e0b640 1 -- 172.21.15.170:0/354562355 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4052b90 con 0x55ab654a0e50 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9fce1a2800 1 -- 172.21.15.170:0/354562355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 msgr2=0x55ab65595a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/354562355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab65595a40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4055040 tx=0x7f9fc404c000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9fce1a2800 1 -- 172.21.15.170:0/354562355 shutdown_connections 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/354562355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab65595a40 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9fce1a2800 1 -- 172.21.15.170:0/354562355 >> 172.21.15.170:0/354562355 conn(0x55ab6549c990 msgr2=0x55ab65591360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9fce1a2800 1 -- 172.21.15.170:0/354562355 shutdown_connections 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.419+0000 7f9fce1a2800 1 -- 172.21.15.170:0/354562355 wait complete. 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fce1a2800 1 Processor -- start 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fce1a2800 1 -- start start 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fce1a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab6559d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fce1a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ab654a25b0 con 0x55ab654a0e50 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab6559d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab6559d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44498/0 (socket says 172.21.15.170:44498) 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fcbca8640 1 -- 172.21.15.170:0/4148834329 learned_addr learned my addr 172.21.15.170:0/4148834329 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fcbca8640 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab653568f0 con 0x55ab654a0e50 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.420+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab6559d250 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40524f0 tx=0x7f9fc4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.421+0000 7f9eb3fff640 1 -- 172.21.15.170:0/4148834329 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4073070 con 0x55ab654a0e50 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.421+0000 7f9eb3fff640 1 -- 172.21.15.170:0/4148834329 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc405d570 con 0x55ab654a0e50 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.421+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab6559d790 con 0x55ab654a0e50 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.421+0000 7f9eb3fff640 1 -- 172.21.15.170:0/4148834329 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4057070 con 0x55ab654a0e50 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.421+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6559dcb0 con 0x55ab654a0e50 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.421+0000 7f9eb3fff640 1 -- 172.21.15.170:0/4148834329 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9fc4076070 con 0x55ab654a0e50 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9eb3fff640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9eb4036950 0x7f9eb4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9eb3fff640 1 -- 172.21.15.170:0/4148834329 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9fc408de40 con 0x55ab654a0e50 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9eb4036950 0x7f9eb4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab654a17b0 0x55ab655a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655a4800 con 0x55ab654a17b0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9fcc4a9640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab654a17b0 0x55ab655a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9eb4036950 0x7f9eb4038e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000f60 tx=0x7f9fc0001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.422+0000 7f9fcc4a9640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab654a17b0 0x55ab655a42c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.423+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/4148834329 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab654a17b0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.423+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655a1890 con 0x55ab654a17b0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.423+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/4148834329 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab654a17b0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.423+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655a6af0 0x55ab655a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.423+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655a95d0 con 0x55ab655a6af0 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.423+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655a6af0 0x55ab655a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.423+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655a6af0 0x55ab655a8ee0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.424+0000 7f9fcbca8640 1 -- 172.21.15.170:0/4148834329 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9fc4075030 con 0x55ab655a6af0 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.424+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655a5aa0 con 0x55ab654a17b0 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.424+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/4148834329 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab654a17b0 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.424+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ab655aaa80 0x55ab655aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.424+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ad630 con 0x55ab655aaa80 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.424+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ab655aaa80 0x55ab655aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.424+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ab655aaa80 0x55ab655aced0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/4148834329 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9fc000f690 con 0x55ab655aaa80 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fce1a2800 1 Processor -- start 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fce1a2800 1 -- start start 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fce1a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655bba90 0x55ab655bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fce1a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ab65393e60 con 0x55ab655bba90 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655bba90 0x55ab655bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655bba90 0x55ab655bbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44506/0 (socket says 172.21.15.170:44506) 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.425+0000 7f9fcbca8640 1 -- 172.21.15.170:0/2041381262 learned_addr learned my addr 172.21.15.170:0/2041381262 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.426+0000 7f9fcbca8640 1 -- 172.21.15.170:0/2041381262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab655bc3f0 con 0x55ab655bba90 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.426+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655bba90 0x55ab655bbeb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40064f0 tx=0x7f9fc405da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.426+0000 7f9eb17fa640 1 -- 172.21.15.170:0/2041381262 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4076c80 con 0x55ab655bba90 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.426+0000 7f9eb17fa640 1 -- 172.21.15.170:0/2041381262 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4076e20 con 0x55ab655bba90 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.426+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab655bce60 con 0x55ab655bba90 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.426+0000 7f9eb17fa640 1 -- 172.21.15.170:0/2041381262 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4076820 con 0x55ab655bba90 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.426+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab655bce60 con 0x55ab655bba90 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.427+0000 7f9eb17fa640 1 -- 172.21.15.170:0/2041381262 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9fc4007e00 con 0x55ab655bba90 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.427+0000 7f9eb17fa640 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ea4036950 0x7f9ea4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.427+0000 7f9eb17fa640 1 -- 172.21.15.170:0/2041381262 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9fc407f0e0 con 0x55ab655bba90 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.427+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ea4036950 0x7f9ea4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.427+0000 7f9fce1a2800 1 Processor -- start 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fce1a2800 1 -- start start 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ea4036950 0x7f9ea4038e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55ab655a50a0 tx=0x7f9fc000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fce1a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fce1a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ab65596100 con 0x55ab655c8a90 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44510/0 (socket says 172.21.15.170:44510) 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1948146237 learned_addr learned my addr 172.21.15.170:0/1948146237 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1948146237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab655c9480 con 0x55ab655c8a90 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/1948146237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655c8eb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4097fd0 tx=0x7f9fc40897e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e28882d5578a7a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9eaaffd640 1 -- 172.21.15.170:0/1948146237 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc40a7070 con 0x55ab655c8a90 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9eaaffd640 1 -- 172.21.15.170:0/1948146237 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4079800 con 0x55ab655c8a90 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.428+0000 7f9eaaffd640 1 -- 172.21.15.170:0/1948146237 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc40769c0 con 0x55ab655c8a90 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1948146237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 msgr2=0x55ab655c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1948146237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655c8eb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4097fd0 tx=0x7f9fc40897e0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1948146237 shutdown_connections 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1948146237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655c8eb0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1948146237 >> 172.21.15.170:0/1948146237 conn(0x55ab655c4da0 msgr2=0x55ab655c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1948146237 shutdown_connections 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1948146237 wait complete. 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 Processor -- start 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 -- start start 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.429+0000 7f9fce1a2800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55ab655c9b10 con 0x55ab655c8a90 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9fcbca8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655cfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44512/0 (socket says 172.21.15.170:44512) 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 learned_addr learned my addr 172.21.15.170:0/1246004207 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab655d0380 con 0x55ab655c8a90 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655cfe40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9fc404d020 tx=0x7f9fc4091fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9ea97fa640 1 -- 172.21.15.170:0/1246004207 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc404ccc0 con 0x55ab655c8a90 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9ea97fa640 1 -- 172.21.15.170:0/1246004207 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc4094480 con 0x55ab655c8a90 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab655d0380 con 0x55ab655c8a90 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9ea97fa640 1 -- 172.21.15.170:0/1246004207 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc4094760 con 0x55ab655c8a90 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.430+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab655d0380 con 0x55ab655c8a90 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.431+0000 7f9ea97fa640 1 -- 172.21.15.170:0/1246004207 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9fc40b9020 con 0x55ab655c8a90 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.431+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.431+0000 7f9ea97fa640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e94036950 0x7f9e94038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.431+0000 7f9ea97fa640 1 -- 172.21.15.170:0/1246004207 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9fc40bcd20 con 0x55ab655c8a90 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.431+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e94036950 0x7f9e94038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.431+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab655db540 0x55ab655dd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.431+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655de130 con 0x55ab655db540 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fcc4a9640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab655db540 0x55ab655dd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e94036950 0x7f9e94038e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55ab655ada30 tx=0x7f9fc0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fcc4a9640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab655db540 0x55ab655dd9e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 20 realm 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655de540 con 0x55ab655db540 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.432+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655dede0 con 0x55ab655db540 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fce1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fce1a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655dfee0 0x55ab655e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e2850 con 0x55ab655dfee0 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655dfee0 0x55ab655e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.433+0000 7f9fcbca8640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655dfee0 0x55ab655e22d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fce1a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fce1a2800 20 searching for the correct realm 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ab655e48a0 0x55ab655e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e7430 con 0x55ab655e48a0 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ab655e48a0 0x55ab655e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ab655e48a0 0x55ab655e6d60 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.434+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.435+0000 7f9fcb4a7640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9fc000f070 0x7f9fc002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.435+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e7430 con 0x7f9fc000f070 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.435+0000 7f9fcc4a9640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9fc000f070 0x7f9fc002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.435+0000 7f9fcc4a9640 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9fc000f070 0x7f9fc002e910 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.435+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x7f9fc000f070 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.435+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.436+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.436+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.436+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.436+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.436+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.436+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.436+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.437+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.437+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.437+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x7f9fc000f070 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x7f9fc000f070 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x7f9fc000f070 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x7f9fc000f070 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc00a4a0 con 0x55ab655db540 2024-04-26T12:32:17.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.438+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x7f9fc000f070 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.439+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.439+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.439+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.439+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.439+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.439+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.439+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.440+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x7f9fc000f070 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.441+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x7f9fc000f070 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.442+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655e48a0 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.443+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.443+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655dfee0 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.443+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.443+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x55ab655db540 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.443+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.443+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab655df180 con 0x7f9fc000f070 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:17.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e31a0 con 0x55ab655db540 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e31a0 con 0x55ab655db540 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e3170 con 0x7f9fc000f070 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 zone default found 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 4 Realm: () 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 zonegroup default 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.444+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e3590 con 0x55ab655dfee0 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e9290 con 0x55ab655e48a0 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e9630 con 0x55ab655e48a0 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 20 started sync module instance, tier type = 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.445+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e8730 con 0x7f9fc000f070 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.446+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.446+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94194628463440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e8730 con 0x7f9fc000f070 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.446+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e9e80 con 0x55ab655db540 2024-04-26T12:32:17.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.447+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94194628463440] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.447+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.448+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94194628461664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e9e80 con 0x55ab655db540 2024-04-26T12:32:17.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.448+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ea840 con 0x55ab655e48a0 2024-04-26T12:32:17.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.449+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94194628461664] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.449+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.449+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94194628467152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e9df0 con 0x55ab655e48a0 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.449+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eb700 con 0x7f9fc000f070 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.450+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.450+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94194628473904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ebe60 con 0x7f9fc000f070 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.450+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ec980 con 0x55ab655db540 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.450+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94194628467152] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.451+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.451+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94194628478032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ec940 con 0x55ab655db540 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.451+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ed3d0 con 0x55ab655dfee0 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.451+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94194628473904] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.452+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.452+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94194628480736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ed7c0 con 0x55ab655dfee0 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.452+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ee1e0 con 0x55ab655dfee0 2024-04-26T12:32:17.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.452+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94194628478032] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.453+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94194628480736] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.453+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.453+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94194628484304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ee5d0 con 0x55ab655dfee0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.453+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eee20 con 0x55ab655dfee0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94194628484304] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94194628486528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eee50 con 0x55ab655dfee0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 20 add_watcher() i=0 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 20 add_watcher() i=1 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 20 add_watcher() i=2 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 20 add_watcher() i=3 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 20 add_watcher() i=4 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 20 add_watcher() i=5 2024-04-26T12:32:17.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.454+0000 7f9fce1a2800 20 add_watcher() i=6 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.455+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94194628486528] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.455+0000 7f9fce1a2800 20 add_watcher() i=7 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.455+0000 7f9fce1a2800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.455+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab655f2160 con 0x55ab655db540 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.455+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.455+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94194628487952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655ef3e0 con 0x55ab655db540 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.456+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94194628487952] v32'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.456+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.456+0000 7f9fce1a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.456+0000 7f9fce1a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.456+0000 7f9fce1a2800 5 note: GC not initialized 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9e80fe1640 20 reqs_thread_entry: start 2024-04-26T12:32:17.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9fce1a2800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9fce1a2800 20 Filter name: none 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9dfa7fc640 20 reqs_thread_entry: start 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9fce1a2800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab656253d0 con 0x55ab655db540 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9fce1a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.457+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab65626920 con 0x55ab655dfee0 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.458+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.459+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.459+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94194628487952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655f1300 con 0x55ab655db540 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.460+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94194628487952] v32'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.460+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94194628463440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eeb10 con 0x7f9fc000f070 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.460+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94194628463440] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.461+0000 7f9fce1a2800 20 remove_watcher() i=0 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.461+0000 7f9fce1a2800 2 removed watcher, disabling cache 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.461+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94194628461664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eeb10 con 0x55ab655db540 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.462+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94194628461664] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.462+0000 7f9fce1a2800 20 remove_watcher() i=1 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.462+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94194628467152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eeb10 con 0x55ab655e48a0 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.463+0000 7f9fcb4a7640 1 -- 172.21.15.170:0/1246004207 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94194628467152] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc0037040 con 0x55ab655e48a0 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.463+0000 7f9fce1a2800 20 remove_watcher() i=2 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.463+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94194628473904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e99d0 con 0x7f9fc000f070 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.464+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94194628473904] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x7f9fc000f070 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.464+0000 7f9fce1a2800 20 remove_watcher() i=3 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.464+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94194628478032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eb430 con 0x55ab655db540 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.465+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94194628478032] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc033040 con 0x55ab655db540 2024-04-26T12:32:17.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.465+0000 7f9fce1a2800 20 remove_watcher() i=4 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.465+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94194628480736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e99d0 con 0x55ab655dfee0 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.466+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94194628480736] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.466+0000 7f9fce1a2800 20 remove_watcher() i=5 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.466+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94194628484304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655eb430 con 0x55ab655dfee0 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.467+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94194628484304] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.467+0000 7f9fce1a2800 20 remove_watcher() i=6 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.467+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94194628486528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab655e99d0 con 0x55ab655dfee0 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fcbca8640 1 -- 172.21.15.170:0/1246004207 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94194628486528] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc4083030 con 0x55ab655dfee0 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 20 remove_watcher() i=7 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655dfee0 msgr2=0x55ab655e22d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655dfee0 0x55ab655e22d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab655db540 msgr2=0x55ab655dd9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab655db540 0x55ab655dd9e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9fc000f070 msgr2=0x7f9fc002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9fc000f070 0x7f9fc002e910 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ab655e48a0 msgr2=0x55ab655e6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55ab655e48a0 0x55ab655e6d60 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e94036950 msgr2=0x7f9e94038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e94036950 0x7f9e94038e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55ab655ada30 tx=0x7f9fc0010000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 msgr2=0x55ab655cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/1246004207 reap_dead start 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.468+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655cfe40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9fc404d020 tx=0x7f9fc4091fe0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 shutdown_connections 2024-04-26T12:32:17.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/1246004207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655c8a90 0x55ab655cfe40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 >> 172.21.15.170:0/1246004207 conn(0x55ab655c4da0 msgr2=0x55ab655c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 shutdown_connections 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/1246004207 wait complete. 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ea4036950 msgr2=0x7f9ea4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ea4036950 0x7f9ea4038e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55ab655a50a0 tx=0x7f9fc000f000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655bba90 msgr2=0x55ab655bbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655bba90 0x55ab655bbeb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40064f0 tx=0x7f9fc405da00 comp rx=0 tx=0).stop 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 shutdown_connections 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9ea4036950 0x7f9ea4038e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/2041381262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab655bba90 0x55ab655bbeb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 >> 172.21.15.170:0/2041381262 conn(0x55ab655afb30 msgr2=0x55ab655aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 shutdown_connections 2024-04-26T12:32:17.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/2041381262 wait complete. 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655a6af0 msgr2=0x55ab655a8ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55ab655a6af0 0x55ab655a8ee0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab654a17b0 msgr2=0x55ab655a42c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55ab654a17b0 0x55ab655a42c0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ab655aaa80 msgr2=0x55ab655aced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55ab655aaa80 0x55ab655aced0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9eb4036950 msgr2=0x7f9eb4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9eb4036950 0x7f9eb4038e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000f60 tx=0x7f9fc0001370 comp rx=0 tx=0).stop 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 msgr2=0x55ab6559d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 --2- 172.21.15.170:0/4148834329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ab654a0e50 0x55ab6559d250 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40524f0 tx=0x7f9fc4003020 comp rx=0 tx=0).stop 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fcc4a9640 1 -- 172.21.15.170:0/4148834329 reap_dead start 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 shutdown_connections 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.469+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 >> 172.21.15.170:0/4148834329 conn(0x55ab6549c990 msgr2=0x55ab65594430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.470+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 shutdown_connections 2024-04-26T12:32:17.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.470+0000 7f9fce1a2800 1 -- 172.21.15.170:0/4148834329 wait complete. 2024-04-26T12:32:17.483 INFO:teuthology.orchestra.run.smithi170.stdout:{"entries":[],"summary":[]} 2024-04-26T12:32:17.483 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-26T12:32:17.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-26T12:32:17.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-26T12:32:17.483 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-26T12:32:17.567 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:17.567 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:17.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.566+0000 7f1fd4b75800 1 Processor -- start 2024-04-26T12:32:17.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd4b75800 1 -- start start 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd4b75800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x560e479d7aa0 0x560e479d9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd4b75800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e478800c0 con 0x560e479d3f90 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd4b75800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x560e478644d0 con 0x560e479d7aa0 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd1e73640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x560e479d7aa0 0x560e479d9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd2674640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x560e479d3f90 0x560e479d6380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58744/0 (socket says 172.21.15.170:58744) 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd2674640 1 -- 172.21.15.170:0/1055320793 learned_addr learned my addr 172.21.15.170:0/1055320793 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/1055320793 >> v2:172.21.15.132:3300/0 conn(0x560e479d7aa0 0x560e479d9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44522/0 (socket says 172.21.15.170:44522) 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd1e73640 1 -- 172.21.15.170:0/1055320793 >> v1:172.21.15.132:6789/0 conn(0x560e479d3f90 legacy=0x560e479d6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.567+0000 7f1fd1e73640 1 -- 172.21.15.170:0/1055320793 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e47891d40 con 0x560e479d7aa0 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.569+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/1055320793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d7aa0 0x560e479d9e90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800a470 tx=0x7f1fc801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66b69789207de3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.569+0000 7f1fd1672640 1 -- 172.21.15.170:0/1055320793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc8057070 con 0x560e479d7aa0 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.569+0000 7f1fd1672640 1 -- 172.21.15.170:0/1055320793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc8052570 con 0x560e479d7aa0 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.569+0000 7f1fd1672640 1 -- 172.21.15.170:0/1055320793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc8052870 con 0x560e479d7aa0 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.570+0000 7f1fd4b75800 1 -- 172.21.15.170:0/1055320793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d7aa0 msgr2=0x560e479d9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.570+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/1055320793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d7aa0 0x560e479d9e90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800a470 tx=0x7f1fc801ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.570+0000 7f1fd4b75800 1 -- 172.21.15.170:0/1055320793 shutdown_connections 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.570+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/1055320793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d7aa0 0x560e479d9e90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.570+0000 7f1fd4b75800 1 -- 172.21.15.170:0/1055320793 >> 172.21.15.170:0/1055320793 conn(0x560e479cda00 msgr2=0x560e479cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.570+0000 7f1fd4b75800 1 -- 172.21.15.170:0/1055320793 shutdown_connections 2024-04-26T12:32:17.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.570+0000 7f1fd4b75800 1 -- 172.21.15.170:0/1055320793 wait complete. 2024-04-26T12:32:17.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.581+0000 7f1fd4b75800 1 Processor -- start 2024-04-26T12:32:17.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.582+0000 7f1fd4b75800 1 -- start start 2024-04-26T12:32:17.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.582+0000 7f1fd4b75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e479d38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.582+0000 7f1fd4b75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560e4791eb70 con 0x560e479d3f90 2024-04-26T12:32:17.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.582+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e479d38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.582+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e479d38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44534/0 (socket says 172.21.15.170:44534) 2024-04-26T12:32:17.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.582+0000 7f1fd2674640 1 -- 172.21.15.170:0/28851591 learned_addr learned my addr 172.21.15.170:0/28851591 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.582+0000 7f1fd2674640 1 -- 172.21.15.170:0/28851591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e47890590 con 0x560e479d3f90 2024-04-26T12:32:17.584 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd2674640 1 --2- 172.21.15.170:0/28851591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e479d38d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4001d50 tx=0x7f1fc400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c2f15a8bf44b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1ec0608640 1 -- 172.21.15.170:0/28851591 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4013030 con 0x560e479d3f90 2024-04-26T12:32:17.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1ec0608640 1 -- 172.21.15.170:0/28851591 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc400e470 con 0x560e479d3f90 2024-04-26T12:32:17.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1ec0608640 1 -- 172.21.15.170:0/28851591 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc400e810 con 0x560e479d3f90 2024-04-26T12:32:17.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd4b75800 1 -- 172.21.15.170:0/28851591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 msgr2=0x560e479d38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/28851591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e479d38d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4001d50 tx=0x7f1fc400b6c0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd4b75800 1 -- 172.21.15.170:0/28851591 shutdown_connections 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/28851591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e479d38d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd4b75800 1 -- 172.21.15.170:0/28851591 >> 172.21.15.170:0/28851591 conn(0x560e479cda00 msgr2=0x560e47ac0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd4b75800 1 -- 172.21.15.170:0/28851591 shutdown_connections 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.583+0000 7f1fd4b75800 1 -- 172.21.15.170:0/28851591 wait complete. 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.584+0000 7f1fd4b75800 1 Processor -- start 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.584+0000 7f1fd4b75800 1 -- start start 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.584+0000 7f1fd4b75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e47ace270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.584+0000 7f1fd4b75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560e479da6d0 con 0x560e479d3f90 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.584+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e47ace270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.584+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e47ace270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44538/0 (socket says 172.21.15.170:44538) 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.584+0000 7f1fd2674640 1 -- 172.21.15.170:0/505544251 learned_addr learned my addr 172.21.15.170:0/505544251 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.585+0000 7f1fd2674640 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e478878f0 con 0x560e479d3f90 2024-04-26T12:32:17.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.585+0000 7f1fd2674640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e47ace270 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x560e479d2f00 tx=0x7f1fc4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.585+0000 7f1ebee05640 1 -- 172.21.15.170:0/505544251 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4027070 con 0x560e479d3f90 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.585+0000 7f1ebee05640 1 -- 172.21.15.170:0/505544251 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc4019900 con 0x560e479d3f90 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.585+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e47ace7b0 con 0x560e479d3f90 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.585+0000 7f1ebee05640 1 -- 172.21.15.170:0/505544251 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4019c60 con 0x560e479d3f90 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.585+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e47acecd0 con 0x560e479d3f90 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1ebee05640 1 -- 172.21.15.170:0/505544251 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1fc402a070 con 0x560e479d3f90 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1ebee05640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eb8036900 0x7f1eb8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1ebee05640 1 -- 172.21.15.170:0/505544251 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f1fc401f070 con 0x560e479d3f90 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eb8036900 0x7f1eb8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e479d7aa0 0x560e47ad52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47ad5860 con 0x560e479d7aa0 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1fd2e75640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e479d7aa0 0x560e47ad52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.586+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eb8036900 0x7f1eb8038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8054000 tx=0x7f1fc804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.598 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.587+0000 7f1fd2e75640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e479d7aa0 0x560e47ad52e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.587+0000 7f1fd2e75640 1 -- 172.21.15.170:0/505544251 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e479d7aa0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.587+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47ad28b0 con 0x560e479d7aa0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.587+0000 7f1fd2e75640 1 -- 172.21.15.170:0/505544251 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e479d7aa0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.587+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47ad7bb0 0x560e47ad9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.587+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47ada690 con 0x560e47ad7bb0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.587+0000 7f1fd2674640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47ad7bb0 0x560e47ad9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.588+0000 7f1fd2674640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47ad7bb0 0x560e47ad9fa0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.588+0000 7f1fd2674640 1 -- 172.21.15.170:0/505544251 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1fc4029030 con 0x560e47ad7bb0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.588+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47ad6b60 con 0x560e479d7aa0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.588+0000 7f1fd2e75640 1 -- 172.21.15.170:0/505544251 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e479d7aa0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.589+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560e47adbb40 0x560e47addf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.589+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47ade6f0 con 0x560e47adbb40 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.589+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560e47adbb40 0x560e47addf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.589+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560e47adbb40 0x560e47addf90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.589+0000 7f1fd1e73640 1 -- 172.21.15.170:0/505544251 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1fc8052a60 con 0x560e47adbb40 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.589+0000 7f1fd4b75800 1 Processor -- start 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.589+0000 7f1fd4b75800 1 -- start start 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd4b75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47aecb50 0x560e47aecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd4b75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560e478c4e60 con 0x560e47aecb50 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47aecb50 0x560e47aecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47aecb50 0x560e47aecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44540/0 (socket says 172.21.15.170:44540) 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd2674640 1 -- 172.21.15.170:0/2324065299 learned_addr learned my addr 172.21.15.170:0/2324065299 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd2674640 1 -- 172.21.15.170:0/2324065299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e47aed4b0 con 0x560e47aecb50 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd2674640 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47aecb50 0x560e47aecf70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1fc404ab10 tx=0x7f1fc40177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1eb7fff640 1 -- 172.21.15.170:0/2324065299 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc403a030 con 0x560e47aecb50 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1eb7fff640 1 -- 172.21.15.170:0/2324065299 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc40446a0 con 0x560e47aecb50 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e47aedf20 con 0x560e47aecb50 2024-04-26T12:32:17.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.590+0000 7f1eb7fff640 1 -- 172.21.15.170:0/2324065299 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4044ae0 con 0x560e47aecb50 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.591+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e47aee420 con 0x560e47aecb50 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.591+0000 7f1eb7fff640 1 -- 172.21.15.170:0/2324065299 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1fc403d070 con 0x560e47aecb50 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.591+0000 7f1eb7fff640 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eac036900 0x7f1eac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.591+0000 7f1eb7fff640 1 -- 172.21.15.170:0/2324065299 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f1fc403b070 con 0x560e47aecb50 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eac036900 0x7f1eac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd4b75800 1 Processor -- start 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd4b75800 1 -- start start 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eac036900 0x7f1eac038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560e47ad6160 tx=0x7f1fc8005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd4b75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47afa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd4b75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560e479d1f50 con 0x560e47af9ce0 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47afa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47afa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44556/0 (socket says 172.21.15.170:44556) 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd2674640 1 -- 172.21.15.170:0/2824832929 learned_addr learned my addr 172.21.15.170:0/2824832929 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.592+0000 7f1fd2674640 1 -- 172.21.15.170:0/2824832929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e47afa6d0 con 0x560e47af9ce0 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd2674640 1 --2- 172.21.15.170:0/2824832929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47afa100 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1fc402eff0 tx=0x7f1fc402a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac368891afdb313 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1eb5ffb640 1 -- 172.21.15.170:0/2824832929 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc405b020 con 0x560e47af9ce0 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1eb5ffb640 1 -- 172.21.15.170:0/2824832929 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc4036e20 con 0x560e47af9ce0 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1eb5ffb640 1 -- 172.21.15.170:0/2824832929 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4049260 con 0x560e47af9ce0 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2824832929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 msgr2=0x560e47afa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/2824832929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47afa100 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1fc402eff0 tx=0x7f1fc402a670 comp rx=0 tx=0).stop 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2824832929 shutdown_connections 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/2824832929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47afa100 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2824832929 >> 172.21.15.170:0/2824832929 conn(0x560e47af5ff0 msgr2=0x560e47af4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2824832929 shutdown_connections 2024-04-26T12:32:17.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2824832929 wait complete. 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 Processor -- start 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.593+0000 7f1fd4b75800 1 -- start start 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.594+0000 7f1fd4b75800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47b010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.594+0000 7f1fd4b75800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x560e47afad60 con 0x560e47af9ce0 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.594+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47b010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.594+0000 7f1fd2674640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47b010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44564/0 (socket says 172.21.15.170:44564) 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.594+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 learned_addr learned my addr 172.21.15.170:0/327546835 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.594+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e47b015e0 con 0x560e47af9ce0 2024-04-26T12:32:17.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.594+0000 7f1fd2674640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47b010a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4036df0 tx=0x7f1fc40485a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.596+0000 7f1ea3fff640 1 -- 172.21.15.170:0/327546835 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4070070 con 0x560e47af9ce0 2024-04-26T12:32:17.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.596+0000 7f1ea3fff640 1 -- 172.21.15.170:0/327546835 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc4048a90 con 0x560e47af9ce0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.596+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e47b015e0 con 0x560e47af9ce0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.596+0000 7f1ea3fff640 1 -- 172.21.15.170:0/327546835 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4019250 con 0x560e47af9ce0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.596+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e47b015e0 con 0x560e47af9ce0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.597+0000 7f1ea3fff640 1 -- 172.21.15.170:0/327546835 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1fc4073070 con 0x560e47af9ce0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1ea3fff640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e9c036950 0x7f1e9c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1ea3fff640 1 -- 172.21.15.170:0/327546835 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f1fc4066030 con 0x560e47af9ce0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e9c036950 0x7f1e9c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e47b0c7a0 0x560e47b0ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b0f3b0 con 0x560e47b0c7a0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1fd2e75640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e47b0c7a0 0x560e47b0ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e9c036950 0x7f1e9c038e10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8055040 tx=0x7f1fc804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.598+0000 7f1fd2e75640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e47b0c7a0 0x560e47b0ec60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 realm 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b0f7c0 con 0x560e47b0c7a0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10090 con 0x560e47b0c7a0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b0c7a0 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47b11190 0x560e47b13580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.599+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b13b90 con 0x560e47b11190 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.600+0000 7f1fd2674640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47b11190 0x560e47b13580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.600+0000 7f1fd2674640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47b11190 0x560e47b13580 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.600+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.600+0000 7f1fd4b75800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.600+0000 7f1fd4b75800 20 searching for the correct realm 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.600+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560e47b15b40 0x560e47b18000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.600+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b186d0 con 0x560e47b15b40 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.601+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560e47b15b40 0x560e47b18000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.601+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560e47b15b40 0x560e47b18000 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.601+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.601+0000 7f1fd1e73640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1fc8076040 0x7f1fc8083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.601+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b186d0 con 0x7f1fc8076040 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.602+0000 7f1fd2e75640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1fc8076040 0x7f1fc8083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.602+0000 7f1fd2e75640 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1fc8076040 0x7f1fc8083410 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.602+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x7f1fc8076040 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.602+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b11190 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b0c7a0 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b0c7a0 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b11190 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.603+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b11190 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x7f1fc8076040 2024-04-26T12:32:17.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x7f1fc8076040 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b15b40 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b0c7a0 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.604+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x7f1fc8076040 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x7f1fc8076040 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b0c7a0 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc00a4a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x7f1fc8076040 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e47b10430 con 0x560e47b15b40 2024-04-26T12:32:17.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.605+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b15b40 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b11190 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b15b40 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b15b40 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b0c7a0 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.606+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.607+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b0c7a0 2024-04-26T12:32:17.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.607+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.607+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b11190 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.607+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.607+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b15b40 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.607+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.607+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x7f1fc8076040 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b0c7a0 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b11190 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b15b40 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.608+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b11190 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x7f1fc8076040 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b15b40 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b11190 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.609+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x560e47b0c7a0 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1fc8090040 con 0x7f1fc8076040 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:17.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b14450 con 0x560e47b0c7a0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b14450 con 0x560e47b0c7a0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.610+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b14450 con 0x7f1fc8076040 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 20 zone default found 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 4 Realm: () 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 20 zonegroup default 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b14cf0 con 0x560e47b11190 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.611+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1a530 con 0x560e47b15b40 2024-04-26T12:32:17.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1a8d0 con 0x560e47b15b40 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd4b75800 20 started sync module instance, tier type = 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd4b75800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.612+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b199d0 con 0x7f1fc8076040 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.613+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.613+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619332353792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b199d0 con 0x7f1fc8076040 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.613+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1b290 con 0x560e47b0c7a0 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.614+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619332353792] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.614+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.614+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619332351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1b290 con 0x560e47b0c7a0 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.614+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1bc50 con 0x560e47b15b40 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.615+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619332351744] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.616+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.616+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619332357600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1b200 con 0x560e47b15b40 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.616+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1cb40 con 0x7f1fc8076040 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.617+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.617+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619332364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1d2e0 con 0x7f1fc8076040 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.617+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1ddd0 con 0x560e47b0c7a0 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.617+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619332357600] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.618+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619332364400] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.618+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.618+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619332368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1dd90 con 0x560e47b0c7a0 2024-04-26T12:32:17.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.618+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1e670 con 0x560e47b11190 2024-04-26T12:32:17.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.619+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.619+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619332370880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1dd90 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.619+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1f580 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.619+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619332368544] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.620+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619332370880] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.620+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.620+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619332362352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1f920 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.620+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b20170 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619332377344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b205a0 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619332362352] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=0 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=1 2024-04-26T12:32:17.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=2 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=3 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=4 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=5 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=6 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619332377344] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 20 add_watcher() i=7 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.622+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b205a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.623+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.623+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619332378592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b205a0 con 0x560e47b0c7a0 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.624+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619332378592] v32'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.624+0000 7f1e88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.624+0000 7f1fd4b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.624+0000 7f1fd4b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.624+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2c090 con 0x560e47b0c7a0 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.625+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.625+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2c6e0 con 0x560e47b11190 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.626+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.626+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2c6e0 con 0x560e47b15b40 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.627+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.627+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2d1c0 con 0x560e47b0c7a0 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.628+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.628+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b29ef0 con 0x7f1fc8076040 2024-04-26T12:32:17.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.629+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'76 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.629+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b29ef0 con 0x560e47b15b40 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.630+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.630+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2def0 con 0x560e47b0c7a0 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.631+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.631+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2df80 con 0x560e47b11190 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.632+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.632+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e010 con 0x7f1fc8076040 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.633+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.633+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e0a0 con 0x560e47b15b40 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.634+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.634+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e630 con 0x7f1fc8076040 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.635+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'77 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.635+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e610 con 0x560e47b11190 2024-04-26T12:32:17.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.636+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.636+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e5e0 con 0x7f1fc8076040 2024-04-26T12:32:17.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.637+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.637+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e5e0 con 0x560e47b11190 2024-04-26T12:32:17.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.638+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.638+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e5e0 con 0x560e47b0c7a0 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.639+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.639+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2e5e0 con 0x560e47b15b40 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.640+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.640+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ebb0 con 0x7f1fc8076040 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.641+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'78 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.641+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2eb50 con 0x560e47b15b40 2024-04-26T12:32:17.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.642+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.642+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2eb20 con 0x560e47b0c7a0 2024-04-26T12:32:17.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.643+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.643+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2eb20 con 0x560e47b0c7a0 2024-04-26T12:32:17.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.644+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.644+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2eb20 con 0x560e47b15b40 2024-04-26T12:32:17.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.645+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.645+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x7f1fc8076040 2024-04-26T12:32:17.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.646+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.646+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b15b40 2024-04-26T12:32:17.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.647+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.647+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b15b40 2024-04-26T12:32:17.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.648+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.648+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b15b40 2024-04-26T12:32:17.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.649+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.649+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b15b40 2024-04-26T12:32:17.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.650+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.650+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b11190 2024-04-26T12:32:17.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.651+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.651+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b15b40 2024-04-26T12:32:17.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.652+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.652+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b11190 2024-04-26T12:32:17.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.653+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.653+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b15b40 2024-04-26T12:32:17.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.654+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.654+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x560e47b11190 2024-04-26T12:32:17.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.655+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.655+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ea90 con 0x7f1fc8076040 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.656+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.656+0000 7f1e037fe640 20 reqs_thread_entry: start 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.656+0000 7f1fd4b75800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 20 Filter name: none 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1e017fa640 20 reqs_thread_entry: start 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b59760 con 0x560e47b0c7a0 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 20 rados_obj.operate() r=0 bl.length=391 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b59720 con 0x7f1fc8076040 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 : miss 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.657+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:96 8.14 8:2bbe4e3e:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5be10 con 0x560e47b15b40 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(96 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 20 rados_obj.operate() r=0 bl.length=379 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 info.flags=0x17 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 to cache LRU end 2024-04-26T12:32:17.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:17.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-26T12:32:17.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 2024-04-26T12:32:17.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:97 4.3e 4:7dd1d954:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9520 con 0x7f1fc8076040 2024-04-26T12:32:17.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(97 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.658+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:98 4.6 4:620cd1e1:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9520 con 0x560e47b15b40 2024-04-26T12:32:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.659+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(98 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.659+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:99 4.2a 4:57385c8c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9560 con 0x560e47b0c7a0 2024-04-26T12:32:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.659+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(99 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.659+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:100 4.3c 4:3d22e8a7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9560 con 0x560e47b0c7a0 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.659+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(100 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.659+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:101 4.11 4:8b18c9e9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9560 con 0x560e47b11190 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.660+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(101 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4 [call out=426b] v0'0 uv14 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.660+0000 7f1fd4b75800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.660+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:102 4.9 4:930276d3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9c00 con 0x560e47b0c7a0 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.660+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(102 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.660+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:103 4.11 4:88262bed:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9c00 con 0x560e47b11190 2024-04-26T12:32:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.660+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(103 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6 [call out=85b] v0'0 uv10 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.660+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:104 4.28 4:1556eb6a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9c00 con 0x560e47b0c7a0 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.661+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(104 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.661+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:105 4.16 4:6803f9f8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9c00 con 0x7f1fc8076040 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.661+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(105 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.661+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:106 4.3c 4:3c86c030:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9c00 con 0x560e47b0c7a0 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.661+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(106 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.661+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:107 4.1 4:83ab9dbe:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd9c00 con 0x7f1fc8076040 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(107 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 20 get_obj_state: octx=0x7f1fcc00aad0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x560e47bd75c8 s->prefetch_data=0 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:108 3.33s0 3:cd0e044c:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47bd83f0 con 0x560e47b11190 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(108 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 10 manifest: total_size = 6 2024-04-26T12:32:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 20 get_obj_state: setting s->obj_tag to 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.12804447253761698006 2024-04-26T12:32:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 20 get_obj_state: octx=0x7f1fcc00aad0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x560e47bd75c8 s->prefetch_data=0 2024-04-26T12:32:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 20 prepare_atomic_modification: state is not atomic. state=0x560e47bd75c8 2024-04-26T12:32:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 20 bucket index object: :.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4 2024-04-26T12:32:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.662+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:109 4.11 4:8b18c9e9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b60560 con 0x560e47b11190 2024-04-26T12:32:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.663+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(109 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4 [stat,call,call] v32'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.663+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:110 3.33s0 3:cd0e044c:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5e540 con 0x560e47b11190 2024-04-26T12:32:17.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(110 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:111 4.11 4:8b18c9e9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b60b40 con 0x560e47b11190 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 20 list_objects_ordered: starting attempt 1 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:112 4.3e 4:7dd1d954:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b60b20 con 0x7f1fc8076040 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:113 4.6 4:620cd1e1:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b64e70 con 0x560e47b15b40 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:114 4.2a 4:57385c8c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b60b20 con 0x560e47b0c7a0 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(113 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:115 4.3c 4:3d22e8a7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b67770 con 0x560e47b0c7a0 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:116 4.11 4:8b18c9e9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6a1c0 con 0x560e47b11190 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:117 4.9 4:930276d3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6cad0 con 0x560e47b0c7a0 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(114 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.665+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:118 4.11 4:88262bed:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f3c0 con 0x560e47b11190 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(112 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:119 4.28 4:1556eb6a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f3c0 con 0x560e47b0c7a0 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:120 4.16 4:6803f9f8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f880 con 0x7f1fc8076040 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:121 4.3c 4:3c86c030:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b72590 con 0x560e47b0c7a0 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:122 4.1 4:83ab9dbe:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b75010 con 0x7f1fc8076040 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(118 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6 [call out=85b] v0'0 uv10 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(115 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(117 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(119 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(121 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(120 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(111 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4 [stat,call,call] v32'16 uv16 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1eb5ffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(122 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(116 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4 [call out=124b] v0'0 uv16 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7])"; uploads.size()=0; is_truncated=0 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:123 4.3e 4:7dd1d954:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x7f1fc8076040 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:124 4.6 4:620cd1e1:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b75010 con 0x560e47b15b40 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:125 4.2a 4:57385c8c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b64ad0 con 0x560e47b0c7a0 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:126 4.3c 4:3d22e8a7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b68bd0 con 0x560e47b0c7a0 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:127 4.11 4:8b18c9e9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6b9e0 con 0x560e47b11190 2024-04-26T12:32:17.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.666+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:128 4.9 4:930276d3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b75010 con 0x560e47b0c7a0 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:129 4.11 4:88262bed:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b64ad0 con 0x560e47b11190 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:130 4.28 4:1556eb6a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6b9e0 con 0x560e47b0c7a0 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(127 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4 [call out=124b] v0'0 uv16 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(123 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(124 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(125 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(129 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6 [call out=85b] v0'0 uv10 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(126 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:131 4.16 4:6803f9f8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b75010 con 0x7f1fc8076040 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(128 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:132 4.3c 4:3c86c030:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b64ad0 con 0x560e47b0c7a0 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:133 4.1 4:83ab9dbe:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x7f1fc8076040 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== osd_op_reply(130 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== osd_op_reply(133 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(131 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(132 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.667+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.668+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(134 foo.buckets [call] v32'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.668+0000 7f1fd4b75800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.668+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.668+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b75010 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.669+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.669+0000 7f1fd4b75800 20 rados_obj.operate() r=0 bl.length=165 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.669+0000 7f1fd4b75800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.669+0000 7f1fd4b75800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.669+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(136 myfoo [call,call,delete] v32'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd4b75800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd4b75800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94619332676560 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x560e47b11190 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== watch-notify(notify (1) cookie 94619332362352 notify 137438953510 ret 0) ==== 191+0+0 (crc 0 0 0) 0x560e47b29a90 con 0x560e47b11190 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1eb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94619332362352 notifier 4789 bl.length()=149 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1eb57fa640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e080032c0 con 0x560e47b11190 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== osd_op_reply(137 notify.6 [notify cookie 94619332676560 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== watch-notify(notify_complete (2) cookie 94619332676560 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e47aed4b0 con 0x560e47b11190 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.670+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:139 8.14 8:2bbe4e3e:root::.bucket.meta.myfoo%3a1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x560e47b15b40 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.671+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(139 .bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.671+0000 7f1fd4b75800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 from cache 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.671+0000 7f1fd4b75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7, ofs0, ns] 2024-04-26T12:32:17.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.671+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94619332622048 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== watch-notify(notify (1) cookie 94619332368544 notify 137438953505 ret 0) ==== 248+0+0 (crc 0 0 0) 0x560e47b2e1e0 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1eb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94619332368544 notifier 4789 bl.length()=206 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1eb5ffb640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e98003d60 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(140 notify.4 [notify cookie 94619332622048 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== watch-notify(notify_complete (2) cookie 94619332622048 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e47b2a290 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:142 4.3e 4:7dd1d954:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x7f1fc8076040 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:143 4.6 4:620cd1e1:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5a7f0 con 0x560e47b15b40 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:144 4.2a 4:57385c8c:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b67b70 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:145 4.3c 4:3d22e8a7:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b68480 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:146 4.11 4:8b18c9e9:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b68d50 con 0x560e47b11190 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:147 4.9 4:930276d3:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x560e47b0c7a0 2024-04-26T12:32:17.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:148 4.11 4:88262bed:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5a7f0 con 0x560e47b11190 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:149 4.28 4:1556eb6a:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b67b70 con 0x560e47b0c7a0 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:150 4.16 4:6803f9f8:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5a7f0 con 0x7f1fc8076040 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:151 4.3c 4:3c86c030:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f860 con 0x560e47b0c7a0 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.672+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:152 4.1 4:83ab9dbe:::.dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b68480 con 0x7f1fc8076040 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(146 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.4 [delete] v32'17 uv17 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(143 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.1 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(145 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.3 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 48 ==== osd_op_reply(147 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(148 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.6 [delete] v32'18 uv18 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 49 ==== osd_op_reply(149 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.7 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 50 ==== osd_op_reply(151 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.9 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== osd_op_reply(152 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.10 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 34 ==== osd_op_reply(142 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.674+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 35 ==== osd_op_reply(150 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.8 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 51 ==== osd_op_reply(144 .dir.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7.2 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd4b75800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 : miss 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd4b75800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:153 6.a 6:561c45eb:::pubsub..bucket.myfoo%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b68d50 con 0x7f1fc8076040 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 36 ==== osd_op_reply(153 pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd4b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd4b75800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 info.flags=0x0 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd4b75800 10 adding default.rgw.log++pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 to cache LRU end 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.675+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:154 6.a 6:561c45eb:::pubsub..bucket.myfoo%2f1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b67b70 con 0x7f1fc8076040 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.676+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 37 ==== osd_op_reply(154 pubsub..bucket.myfoo/1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.7 [delete] v32'41 uv31 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.676+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b67b70 con 0x7f1fc8076040 2024-04-26T12:32:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.677+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 38 ==== osd_op_reply(155 foo.buckets [call] v32'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.677+0000 7f1fd4b75800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-26T12:32:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.677+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b67b70 con 0x560e47b11190 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.678+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.678+0000 7f1fd4b75800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.678+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94619332704192 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5acf0 con 0x7f1fc8076040 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.678+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 39 ==== watch-notify(notify (1) cookie 94619332364400 notify 137438953493 ret 0) ==== 212+0+0 (crc 0 0 0) 0x560e47b2a290 con 0x7f1fc8076040 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.678+0000 7f1eb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94619332364400 notifier 4789 bl.length()=170 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.678+0000 7f1eb57fa640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e080032a0 con 0x7f1fc8076040 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.679+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 40 ==== osd_op_reply(157 notify.3 [notify cookie 94619332704192 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.679+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 41 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.679+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 42 ==== watch-notify(notify_complete (2) cookie 94619332704192 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e47b29870 con 0x7f1fc8076040 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.679+0000 7f1fd4b75800 10 removing email index: foo@foo.com 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.679+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b67b70 con 0x560e47b0c7a0 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 52 ==== osd_op_reply(159 foo@foo.com [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd4b75800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94619332704192 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5acf0 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 43 ==== watch-notify(notify (1) cookie 94619332364400 notify 137438953494 ret 0) ==== 204+0+0 (crc 0 0 0) 0x560e47b29870 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1eb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94619332364400 notifier 4789 bl.length()=162 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1eb5ffb640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e98003d60 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 44 ==== osd_op_reply(160 notify.3 [notify cookie 94619332704192 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 45 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 46 ==== watch-notify(notify_complete (2) cookie 94619332704192 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e47b2bc30 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd4b75800 10 removing user buckets index 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.680+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b6f7c0 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 47 ==== osd_op_reply(162 foo.buckets [delete] v32'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1fd4b75800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94619332704192 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5acf0 con 0x560e47b11190 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== watch-notify(notify (1) cookie 94619332370880 notify 137438953511 ret 0) ==== 202+0+0 (crc 0 0 0) 0x560e47aed4b0 con 0x560e47b11190 2024-04-26T12:32:17.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1eb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94619332370880 notifier 4789 bl.length()=160 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== osd_op_reply(163 notify.5 [notify cookie 94619332704192 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1eb57fa640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e080032a0 con 0x560e47b11190 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.682+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.683+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== watch-notify(notify_complete (2) cookie 94619332704192 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e47acecd0 con 0x560e47b11190 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.683+0000 7f1fd4b75800 10 removing user index: foo 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.683+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5acf0 con 0x560e47b0c7a0 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.683+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 53 ==== osd_op_reply(165 foo [call,call,delete] v32'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.683+0000 7f1fd4b75800 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.683+0000 7f1fd4b75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.683+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94619332704192 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e47b5acf0 con 0x560e47b0c7a0 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.684+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 54 ==== watch-notify(notify (1) cookie 94619332368544 notify 137438953506 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560e47b2bc30 con 0x560e47b0c7a0 2024-04-26T12:32:17.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.684+0000 7f1eb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94619332368544 notifier 4789 bl.length()=152 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.684+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 55 ==== osd_op_reply(166 notify.4 [notify cookie 94619332704192 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.684+0000 7f1eb5ffb640 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1e98003d60 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.684+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 56 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.684+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 57 ==== watch-notify(notify_complete (2) cookie 94619332704192 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e47b2ba60 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.685+0000 7f1e88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.685+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619332378592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ad50 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.686+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 58 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94619332378592] v32'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.686+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619332353792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ad50 con 0x7f1fc8076040 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.687+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 48 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94619332353792] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.687+0000 7f1fd4b75800 20 remove_watcher() i=0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.687+0000 7f1fd4b75800 2 removed watcher, disabling cache 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.687+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619332351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ad50 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.688+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 59 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94619332351744] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.688+0000 7f1fd4b75800 20 remove_watcher() i=1 2024-04-26T12:32:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.688+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619332357600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ad50 con 0x560e47b15b40 2024-04-26T12:32:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.689+0000 7f1fd1e73640 1 -- 172.21.15.170:0/327546835 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94619332357600] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc8081070 con 0x560e47b15b40 2024-04-26T12:32:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.689+0000 7f1fd4b75800 20 remove_watcher() i=2 2024-04-26T12:32:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.689+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619332364400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ad50 con 0x7f1fc8076040 2024-04-26T12:32:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.690+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.2 v2:172.21.15.170:6800/1189813177 49 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94619332364400] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x7f1fc8076040 2024-04-26T12:32:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.690+0000 7f1fd4b75800 20 remove_watcher() i=3 2024-04-26T12:32:17.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.690+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619332368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1c870 con 0x560e47b0c7a0 2024-04-26T12:32:17.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.691+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 <== osd.1 v2:172.21.15.170:6808/2372702203 60 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94619332368544] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fcc033040 con 0x560e47b0c7a0 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.691+0000 7f1fd4b75800 20 remove_watcher() i=4 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.691+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619332370880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b2ad50 con 0x560e47b11190 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.692+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94619332370880] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.692+0000 7f1fd4b75800 20 remove_watcher() i=5 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.692+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619332362352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1d8a0 con 0x560e47b11190 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.694+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94619332362352] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.694+0000 7f1fd4b75800 20 remove_watcher() i=6 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.694+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619332377344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e47b1c870 con 0x560e47b11190 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd2674640 1 -- 172.21.15.170:0/327546835 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94619332377344] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4072030 con 0x560e47b11190 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 20 remove_watcher() i=7 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47b11190 msgr2=0x560e47b13580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47b11190 0x560e47b13580 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e47b0c7a0 msgr2=0x560e47b0ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e47b0c7a0 0x560e47b0ec60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1fc8076040 msgr2=0x7f1fc8083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f1fc8076040 0x7f1fc8083410 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560e47b15b40 msgr2=0x560e47b18000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x560e47b15b40 0x560e47b18000 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e9c036950 msgr2=0x7f1e9c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1e9c036950 0x7f1e9c038e10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8055040 tx=0x7f1fc804f000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 msgr2=0x560e47b010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47b010a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4036df0 tx=0x7f1fc40485a0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd2e75640 1 -- 172.21.15.170:0/327546835 reap_dead start 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 shutdown_connections 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/327546835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47af9ce0 0x560e47b010a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 >> 172.21.15.170:0/327546835 conn(0x560e47af5ff0 msgr2=0x560e47af3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 shutdown_connections 2024-04-26T12:32:17.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.695+0000 7f1fd4b75800 1 -- 172.21.15.170:0/327546835 wait complete. 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eac036900 msgr2=0x7f1eac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eac036900 0x7f1eac038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560e47ad6160 tx=0x7f1fc8005a00 comp rx=0 tx=0).stop 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47aecb50 msgr2=0x560e47aecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47aecb50 0x560e47aecf70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1fc404ab10 tx=0x7f1fc40177a0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 shutdown_connections 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eac036900 0x7f1eac038dc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/2324065299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e47aecb50 0x560e47aecf70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 >> 172.21.15.170:0/2324065299 conn(0x560e47ae0bf0 msgr2=0x560e47ae0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 shutdown_connections 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/2324065299 wait complete. 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47ad7bb0 msgr2=0x560e47ad9fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x560e47ad7bb0 0x560e47ad9fa0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e479d7aa0 msgr2=0x560e47ad52e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x560e479d7aa0 0x560e47ad52e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560e47adbb40 msgr2=0x560e47addf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x560e47adbb40 0x560e47addf90 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eb8036900 msgr2=0x7f1eb8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1eb8036900 0x7f1eb8038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8054000 tx=0x7f1fc804e000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 msgr2=0x560e47ace270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 --2- 172.21.15.170:0/505544251 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560e479d3f90 0x560e47ace270 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x560e479d2f00 tx=0x7f1fc4000bc0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd2e75640 1 -- 172.21.15.170:0/505544251 reap_dead start 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 shutdown_connections 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 >> 172.21.15.170:0/505544251 conn(0x560e479cda00 msgr2=0x560e47abfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 shutdown_connections 2024-04-26T12:32:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.696+0000 7f1fd4b75800 1 -- 172.21.15.170:0/505544251 wait complete. 2024-04-26T12:32:17.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-26T12:32:17.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-26T12:32:17.705 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-26T12:32:17.747 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:17.748 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:17.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.747+0000 7f260570c800 1 Processor -- start 2024-04-26T12:32:17.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.747+0000 7f260570c800 1 -- start start 2024-04-26T12:32:17.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.747+0000 7f260570c800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562b121e4e00 0x562b121e5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.747+0000 7f260570c800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b120930c0 con 0x562b121e5760 2024-04-26T12:32:17.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.747+0000 7f260570c800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x562b120774d0 con 0x562b121e4e00 2024-04-26T12:32:17.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.748+0000 7f260320b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562b121e4e00 0x562b121e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.748+0000 7f260320b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562b121e4e00 0x562b121e5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44580/0 (socket says 172.21.15.170:44580) 2024-04-26T12:32:17.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.748+0000 7f2602a0a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x562b121e5760 0x562b121e5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58748/0 (socket says 172.21.15.170:58748) 2024-04-26T12:32:17.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.748+0000 7f260320b640 1 -- 172.21.15.170:0/1247129169 learned_addr learned my addr 172.21.15.170:0/1247129169 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.748+0000 7f260320b640 1 -- 172.21.15.170:0/1247129169 >> v1:172.21.15.132:6789/0 conn(0x562b121e5760 legacy=0x562b121e5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.748+0000 7f2602209640 1 -- 172.21.15.170:0/1247129169 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803516493 0 0) 0x562b120930c0 con 0x562b121e5760 2024-04-26T12:32:17.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.748+0000 7f260320b640 1 -- 172.21.15.170:0/1247129169 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b120a4d40 con 0x562b121e4e00 2024-04-26T12:32:17.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.750+0000 7f260320b640 1 --2- 172.21.15.170:0/1247129169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b121e5220 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f25f400a520 tx=0x7f25f401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11672ba2d327599f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.750+0000 7f2602209640 1 -- 172.21.15.170:0/1247129169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4057070 con 0x562b121e4e00 2024-04-26T12:32:17.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.750+0000 7f2602209640 1 -- 172.21.15.170:0/1247129169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4052570 con 0x562b121e4e00 2024-04-26T12:32:17.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.750+0000 7f2602209640 1 -- 172.21.15.170:0/1247129169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4052870 con 0x562b121e4e00 2024-04-26T12:32:17.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.751+0000 7f260570c800 1 -- 172.21.15.170:0/1247129169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 msgr2=0x562b121e5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.751+0000 7f260570c800 1 --2- 172.21.15.170:0/1247129169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b121e5220 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f25f400a520 tx=0x7f25f401d010 comp rx=0 tx=0).stop 2024-04-26T12:32:17.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.751+0000 7f260570c800 1 -- 172.21.15.170:0/1247129169 shutdown_connections 2024-04-26T12:32:17.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.751+0000 7f260570c800 1 --2- 172.21.15.170:0/1247129169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b121e5220 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.751+0000 7f260570c800 1 -- 172.21.15.170:0/1247129169 >> 172.21.15.170:0/1247129169 conn(0x562b121e09e0 msgr2=0x562b121e2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.751+0000 7f260570c800 1 -- 172.21.15.170:0/1247129169 shutdown_connections 2024-04-26T12:32:17.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.751+0000 7f260570c800 1 -- 172.21.15.170:0/1247129169 wait complete. 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.762+0000 7f260570c800 1 Processor -- start 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.762+0000 7f260570c800 1 -- start start 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.762+0000 7f260570c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122d97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.762+0000 7f260570c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562b12131b40 con 0x562b121e4e00 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122d97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122d97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44584/0 (socket says 172.21.15.170:44584) 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f260320b640 1 -- 172.21.15.170:0/1810819019 learned_addr learned my addr 172.21.15.170:0/1810819019 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f260320b640 1 -- 172.21.15.170:0/1810819019 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b120a3590 con 0x562b121e4e00 2024-04-26T12:32:17.764 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f260320b640 1 --2- 172.21.15.170:0/1810819019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122d97b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f25f4055040 tx=0x7f25f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f800f7ac309fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f24f160a640 1 -- 172.21.15.170:0/1810819019 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4062070 con 0x562b121e4e00 2024-04-26T12:32:17.766 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f24f160a640 1 -- 172.21.15.170:0/1810819019 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4052720 con 0x562b121e4e00 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.763+0000 7f24f160a640 1 -- 172.21.15.170:0/1810819019 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4057040 con 0x562b121e4e00 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 -- 172.21.15.170:0/1810819019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 msgr2=0x562b122d97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 --2- 172.21.15.170:0/1810819019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122d97b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f25f4055040 tx=0x7f25f404c000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 -- 172.21.15.170:0/1810819019 shutdown_connections 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 --2- 172.21.15.170:0/1810819019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122d97b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 -- 172.21.15.170:0/1810819019 >> 172.21.15.170:0/1810819019 conn(0x562b121e09e0 msgr2=0x562b122d50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 -- 172.21.15.170:0/1810819019 shutdown_connections 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 -- 172.21.15.170:0/1810819019 wait complete. 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 Processor -- start 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 -- start start 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.764+0000 7f260570c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562b121e6620 con 0x562b121e4e00 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122e1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44594/0 (socket says 172.21.15.170:44594) 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f260320b640 1 -- 172.21.15.170:0/4244996325 learned_addr learned my addr 172.21.15.170:0/4244996325 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f260320b640 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b1209a8f0 con 0x562b121e4e00 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f260320b640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122e1060 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f25f4000c00 tx=0x7f25f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f24efe07640 1 -- 172.21.15.170:0/4244996325 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4057050 con 0x562b121e4e00 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f24efe07640 1 -- 172.21.15.170:0/4244996325 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4067580 con 0x562b121e4e00 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f24efe07640 1 -- 172.21.15.170:0/4244996325 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4062040 con 0x562b121e4e00 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b122e15a0 con 0x562b121e4e00 2024-04-26T12:32:17.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.765+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b122e1ac0 con 0x562b121e4e00 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.766+0000 7f24efe07640 1 -- 172.21.15.170:0/4244996325 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f25f4067860 con 0x562b121e4e00 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.766+0000 7f24efe07640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24e8036900 0x7f24e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.766+0000 7f24efe07640 1 -- 172.21.15.170:0/4244996325 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f25f408e3b0 con 0x562b121e4e00 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.766+0000 7f2602a0a640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24e8036900 0x7f24e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.767+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b121e5760 0x562b122e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.767+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b122e8610 con 0x562b121e5760 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.767+0000 7f2603a0c640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b121e5760 0x562b122e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.767+0000 7f2602a0a640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24e8036900 0x7f24e8038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f25f8000c00 tx=0x7f25f80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.767+0000 7f2603a0c640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b121e5760 0x562b122e80d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.767+0000 7f2603a0c640 1 -- 172.21.15.170:0/4244996325 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b121e5760 2024-04-26T12:32:17.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.767+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b122e5680 con 0x562b121e5760 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.768+0000 7f2603a0c640 1 -- 172.21.15.170:0/4244996325 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b121e5760 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.768+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b122ea900 0x562b122eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.768+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b122ed3c0 con 0x562b122ea900 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.768+0000 7f260320b640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b122ea900 0x562b122eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.768+0000 7f260320b640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b122ea900 0x562b122eccf0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.769+0000 7f260320b640 1 -- 172.21.15.170:0/4244996325 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25f4064070 con 0x562b122ea900 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.769+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b122e98b0 con 0x562b121e5760 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.769+0000 7f2603a0c640 1 -- 172.21.15.170:0/4244996325 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b121e5760 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.769+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562b122ee800 0x562b122f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.769+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b122f1450 con 0x562b122ee800 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.769+0000 7f2602a0a640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562b122ee800 0x562b122f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.769+0000 7f2602a0a640 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562b122ee800 0x562b122f0cc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f2602a0a640 1 -- 172.21.15.170:0/4244996325 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f25f800f670 con 0x562b122ee800 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f260570c800 1 Processor -- start 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f260570c800 1 -- start start 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f260570c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b122ff900 0x562b122ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f260570c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562b120d7e60 con 0x562b122ff900 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b122ff900 0x562b122ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b122ff900 0x562b122ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44602/0 (socket says 172.21.15.170:44602) 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.770+0000 7f260320b640 1 -- 172.21.15.170:0/1243650159 learned_addr learned my addr 172.21.15.170:0/1243650159 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.771+0000 7f260320b640 1 -- 172.21.15.170:0/1243650159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b12300260 con 0x562b122ff900 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.771+0000 7f260320b640 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b122ff900 0x562b122ffd20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f25f4006540 tx=0x7f25f4067f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.771+0000 7f24ed602640 1 -- 172.21.15.170:0/1243650159 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f407e070 con 0x562b122ff900 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.771+0000 7f24ed602640 1 -- 172.21.15.170:0/1243650159 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f407a0d0 con 0x562b122ff900 2024-04-26T12:32:17.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.771+0000 7f24ed602640 1 -- 172.21.15.170:0/1243650159 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f408b1a0 con 0x562b122ff900 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.771+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b12300cd0 con 0x562b122ff900 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.771+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b123011d0 con 0x562b122ff900 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f24ed602640 1 -- 172.21.15.170:0/1243650159 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f25f4077720 con 0x562b122ff900 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f24ed602640 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24dc036950 0x7f24dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f24ed602640 1 -- 172.21.15.170:0/1243650159 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f25f4082030 con 0x562b122ff900 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f2602a0a640 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24dc036950 0x7f24dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f260570c800 1 Processor -- start 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f260570c800 1 -- start start 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f2602a0a640 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24dc036950 0x7f24dc038e10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x562b122e8aa0 tx=0x7f25f8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f260570c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b1230ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.772+0000 7f260570c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562b122d9e70 con 0x562b1230cab0 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b1230ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b1230ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44608/0 (socket says 172.21.15.170:44608) 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260320b640 1 -- 172.21.15.170:0/3768875613 learned_addr learned my addr 172.21.15.170:0/3768875613 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260320b640 1 -- 172.21.15.170:0/3768875613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b1230d4a0 con 0x562b1230cab0 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260320b640 1 --2- 172.21.15.170:0/3768875613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b1230ced0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f25f4066e70 tx=0x7f25f407cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bae180356afb12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f24e6ffd640 1 -- 172.21.15.170:0/3768875613 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f40a6070 con 0x562b1230cab0 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f24e6ffd640 1 -- 172.21.15.170:0/3768875613 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f40864e0 con 0x562b1230cab0 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f24e6ffd640 1 -- 172.21.15.170:0/3768875613 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f40900c0 con 0x562b1230cab0 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260570c800 1 -- 172.21.15.170:0/3768875613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 msgr2=0x562b1230ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260570c800 1 --2- 172.21.15.170:0/3768875613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b1230ced0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f25f4066e70 tx=0x7f25f407cf80 comp rx=0 tx=0).stop 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260570c800 1 -- 172.21.15.170:0/3768875613 shutdown_connections 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260570c800 1 --2- 172.21.15.170:0/3768875613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b1230ced0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.773+0000 7f260570c800 1 -- 172.21.15.170:0/3768875613 >> 172.21.15.170:0/3768875613 conn(0x562b12308dc0 msgr2=0x562b12306e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260570c800 1 -- 172.21.15.170:0/3768875613 shutdown_connections 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260570c800 1 -- 172.21.15.170:0/3768875613 wait complete. 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260570c800 1 Processor -- start 2024-04-26T12:32:17.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260570c800 1 -- start start 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260570c800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b12313dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260570c800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562b1230db30 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b12313dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260320b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b12313dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44612/0 (socket says 172.21.15.170:44612) 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 learned_addr learned my addr 172.21.15.170:0/1910839744 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.774+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b12314300 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.775+0000 7f260320b640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b12313dc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f25f4086690 tx=0x7f25f4080eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.775+0000 7f24e57fa640 1 -- 172.21.15.170:0/1910839744 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f40900c0 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.775+0000 7f24e57fa640 1 -- 172.21.15.170:0/1910839744 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4077a10 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.775+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b12314300 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.775+0000 7f24e57fa640 1 -- 172.21.15.170:0/1910839744 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f405c8a0 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.775+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b12314300 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.775+0000 7f24e57fa640 1 -- 172.21.15.170:0/1910839744 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f25f407a910 con 0x562b1230cab0 2024-04-26T12:32:17.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f24e57fa640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24cc0368b0 0x7f24cc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f24e57fa640 1 -- 172.21.15.170:0/1910839744 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f25f40b6d90 con 0x562b1230cab0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f2602a0a640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24cc0368b0 0x7f24cc038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b1231f4e0 0x562b123219a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b123220f0 con 0x562b1231f4e0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f2603a0c640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b1231f4e0 0x562b123219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f2602a0a640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24cc0368b0 0x7f24cc038d70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562b122f1850 tx=0x7f25f8023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f2603a0c640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b1231f4e0 0x562b123219a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.776+0000 7f260570c800 20 realm 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b12322550 con 0x562b1231f4e0 2024-04-26T12:32:17.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b12322df0 con 0x562b1231f4e0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b12323ef0 0x562b123262e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b12326860 con 0x562b12323ef0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.777+0000 7f260320b640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b12323ef0 0x562b123262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f260320b640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b12323ef0 0x562b123262e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f260570c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f260570c800 20 searching for the correct realm 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562b123288b0 0x562b1232ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b1232b440 con 0x562b123288b0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f2602a0a640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562b123288b0 0x562b1232ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.778+0000 7f2602a0a640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562b123288b0 0x562b1232ad70 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.779+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.779+0000 7f2602a0a640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f25f803a3c0 0x7f25f803a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.779+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b1232b440 con 0x7f25f803a3c0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.779+0000 7f2603a0c640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f25f803a3c0 0x7f25f803a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.779+0000 7f2603a0c640 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f25f803a3c0 0x7f25f803a7e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.779+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f25fc00a4a0 con 0x7f25f803a3c0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.779+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.780+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.780+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.780+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.780+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.780+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.780+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.780+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x7f25f803a3c0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc00a4a0 con 0x7f25f803a3c0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.781+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x7f25f803a3c0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc00a4a0 con 0x7f25f803a3c0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc00a4a0 con 0x562b1231f4e0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x7f25f803a3c0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.782+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.783+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.783+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.783+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.783+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.783+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.783+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.784+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x7f25f803a3c0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.785+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x7f25f803a3c0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b123288b0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.786+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b12323ef0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x562b1231f4e0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b12323190 con 0x7f25f803a3c0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:17.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.787+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b123271b0 con 0x562b1231f4e0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b123271b0 con 0x562b1231f4e0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b12327180 con 0x7f25f803a3c0 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 zone default found 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 4 Realm: () 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 zonegroup default 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.788+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b123275a0 con 0x562b12323ef0 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b1232d2a0 con 0x562b123288b0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b1232d640 con 0x562b123288b0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 20 started sync module instance, tier type = 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.789+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232c740 con 0x7f25f803a3c0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.790+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.790+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94742988901216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232c740 con 0x7f25f803a3c0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.790+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232de90 con 0x562b1231f4e0 2024-04-26T12:32:17.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.791+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94742988901216] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.791+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.791+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94742988899440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232de90 con 0x562b1231f4e0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.791+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232e890 con 0x562b123288b0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.792+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94742988899440] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.793+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.793+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94742988904928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232de00 con 0x562b123288b0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.793+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232f750 con 0x7f25f803a3c0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.794+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94742988904928] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.794+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.794+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94742988911264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232fb70 con 0x7f25f803a3c0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.794+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12330530 con 0x562b1231f4e0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.795+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94742988911264] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.795+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.795+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94742988912800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12330530 con 0x562b1231f4e0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.795+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12330ef0 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.796+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.796+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94742988912800] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.796+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94742988917312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12331290 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.796+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12331c50 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.797+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94742988917312] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.797+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.797+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94742988920736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12332070 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.797+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12332a30 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94742988920736] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94742988922304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12332a30 con 0x562b12323ef0 2024-04-26T12:32:17.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 20 add_watcher() i=0 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 20 add_watcher() i=1 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 20 add_watcher() i=2 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 20 add_watcher() i=3 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 20 add_watcher() i=4 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 20 add_watcher() i=5 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.798+0000 7f260570c800 20 add_watcher() i=6 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.799+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94742988922304] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.799+0000 7f260570c800 20 add_watcher() i=7 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.799+0000 7f260570c800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.799+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b12335e30 con 0x562b1231f4e0 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.799+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.799+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94742988924752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12333350 con 0x562b1231f4e0 2024-04-26T12:32:17.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.800+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94742988924752] v32'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.800+0000 7f24b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.800+0000 7f260570c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.800+0000 7f260570c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f260570c800 5 note: GC not initialized 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f24b8fe1640 20 reqs_thread_entry: start 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f260570c800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f260570c800 20 Filter name: none 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f24327fc640 20 reqs_thread_entry: start 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f260570c800 20 rados->read ofs=0 len=0 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b12369030 con 0x562b1231f4e0 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.801+0000 7f260570c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:could not fetch user info: no user info saved 2024-04-26T12:32:17.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.802+0000 7f24b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.802+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94742988924752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12368ff0 con 0x562b1231f4e0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.803+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94742988924752] v32'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.803+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94742988901216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12368ff0 con 0x7f25f803a3c0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.804+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94742988901216] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.804+0000 7f260570c800 20 remove_watcher() i=0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.804+0000 7f260570c800 2 removed watcher, disabling cache 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.804+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94742988899440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12368ff0 con 0x562b1231f4e0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.805+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94742988899440] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.805+0000 7f260570c800 20 remove_watcher() i=1 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.805+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94742988904928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b12368ff0 con 0x562b123288b0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.806+0000 7f2602a0a640 1 -- 172.21.15.170:0/1910839744 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94742988904928] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f8037040 con 0x562b123288b0 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.806+0000 7f260570c800 20 remove_watcher() i=2 2024-04-26T12:32:17.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.806+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94742988911264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232d9e0 con 0x7f25f803a3c0 2024-04-26T12:32:17.824 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.807+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94742988911264] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x7f25f803a3c0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.807+0000 7f260570c800 20 remove_watcher() i=3 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.807+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94742988912800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232f2a0 con 0x562b1231f4e0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.808+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94742988912800] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25fc033040 con 0x562b1231f4e0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.808+0000 7f260570c800 20 remove_watcher() i=4 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.808+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94742988917312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232d9e0 con 0x562b12323ef0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.809+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94742988917312] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.809+0000 7f260570c800 20 remove_watcher() i=5 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.809+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94742988920736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232f8a0 con 0x562b12323ef0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.810+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94742988920736] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.810+0000 7f260570c800 20 remove_watcher() i=6 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.810+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94742988922304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b1232f2a0 con 0x562b12323ef0 2024-04-26T12:32:17.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260320b640 1 -- 172.21.15.170:0/1910839744 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94742988922304] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25f40a8070 con 0x562b12323ef0 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 20 remove_watcher() i=7 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b12323ef0 msgr2=0x562b123262e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b12323ef0 0x562b123262e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b1231f4e0 msgr2=0x562b123219a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b1231f4e0 0x562b123219a0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f25f803a3c0 msgr2=0x7f25f803a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f25f803a3c0 0x7f25f803a7e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562b123288b0 msgr2=0x562b1232ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562b123288b0 0x562b1232ad70 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24cc0368b0 msgr2=0x7f24cc038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24cc0368b0 0x7f24cc038d70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x562b122f1850 tx=0x7f25f8023040 comp rx=0 tx=0).stop 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 msgr2=0x562b12313dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f2603a0c640 1 -- 172.21.15.170:0/1910839744 reap_dead start 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b12313dc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f25f4086690 tx=0x7f25f4080eb0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 shutdown_connections 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 --2- 172.21.15.170:0/1910839744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b1230cab0 0x562b12313dc0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 >> 172.21.15.170:0/1910839744 conn(0x562b12308dc0 msgr2=0x562b12306420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 shutdown_connections 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.811+0000 7f260570c800 1 -- 172.21.15.170:0/1910839744 wait complete. 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24dc036950 msgr2=0x7f24dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24dc036950 0x7f24dc038e10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x562b122e8aa0 tx=0x7f25f8006000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b122ff900 msgr2=0x562b122ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b122ff900 0x562b122ffd20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f25f4006540 tx=0x7f25f4067f70 comp rx=0 tx=0).stop 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 shutdown_connections 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24dc036950 0x7f24dc038e10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/1243650159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b122ff900 0x562b122ffd20 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 >> 172.21.15.170:0/1243650159 conn(0x562b122f39a0 msgr2=0x562b122f3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 shutdown_connections 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/1243650159 wait complete. 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b122ea900 msgr2=0x562b122eccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562b122ea900 0x562b122eccf0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b121e5760 msgr2=0x562b122e80d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562b121e5760 0x562b122e80d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562b122ee800 msgr2=0x562b122f0cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562b122ee800 0x562b122f0cc0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24e8036900 msgr2=0x7f24e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f24e8036900 0x7f24e8038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f25f8000c00 tx=0x7f25f80013b0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 msgr2=0x562b122e1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 --2- 172.21.15.170:0/4244996325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562b121e4e00 0x562b122e1060 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f25f4000c00 tx=0x7f25f4002fb0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f2603a0c640 1 -- 172.21.15.170:0/4244996325 reap_dead start 2024-04-26T12:32:17.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 shutdown_connections 2024-04-26T12:32:17.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 >> 172.21.15.170:0/4244996325 conn(0x562b121e09e0 msgr2=0x562b122d81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 shutdown_connections 2024-04-26T12:32:17.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.812+0000 7f260570c800 1 -- 172.21.15.170:0/4244996325 wait complete. 2024-04-26T12:32:17.829 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-26T12:32:17.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-26T12:32:17.829 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.906+0000 7f42e0a13800 1 Processor -- start 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.906+0000 7f42e0a13800 1 -- start start 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.906+0000 7f42e0a13800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fb98702180 0x55fb98700780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.906+0000 7f42e0a13800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb986390c0 con 0x55fb98700cc0 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.906+0000 7f42e0a13800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55fb9861d4d0 con 0x55fb98702180 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.907+0000 7f42dc147640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fb98702180 0x55fb98700780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.907+0000 7f42dc147640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fb98702180 0x55fb98700780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44624/0 (socket says 172.21.15.170:44624) 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.907+0000 7f42d3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55fb98700cc0 0x55fb98794520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58756/0 (socket says 172.21.15.170:58756) 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.907+0000 7f42dc147640 1 -- 172.21.15.170:0/2594305743 learned_addr learned my addr 172.21.15.170:0/2594305743 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.907+0000 7f42dc147640 1 -- 172.21.15.170:0/2594305743 >> v1:172.21.15.132:6789/0 conn(0x55fb98700cc0 legacy=0x55fb98794520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.907+0000 7f42dc147640 1 -- 172.21.15.170:0/2594305743 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9864ad40 con 0x55fb98702180 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42dc147640 1 --2- 172.21.15.170:0/2594305743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98702180 0x55fb98700780 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a520 tx=0x7f42cc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c34c0cfa5ec97e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42db946640 1 -- 172.21.15.170:0/2594305743 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc057070 con 0x55fb98702180 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42db946640 1 -- 172.21.15.170:0/2594305743 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc052570 con 0x55fb98702180 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42db946640 1 -- 172.21.15.170:0/2594305743 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc04ae60 con 0x55fb98702180 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42e0a13800 1 -- 172.21.15.170:0/2594305743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98702180 msgr2=0x55fb98700780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2594305743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98702180 0x55fb98700780 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a520 tx=0x7f42cc01d010 comp rx=0 tx=0).stop 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42e0a13800 1 -- 172.21.15.170:0/2594305743 shutdown_connections 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2594305743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98702180 0x55fb98700780 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42e0a13800 1 -- 172.21.15.170:0/2594305743 >> 172.21.15.170:0/2594305743 conn(0x55fb98787c10 msgr2=0x55fb9878a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42e0a13800 1 -- 172.21.15.170:0/2594305743 shutdown_connections 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.909+0000 7f42e0a13800 1 -- 172.21.15.170:0/2594305743 wait complete. 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.921+0000 7f42e0a13800 1 Processor -- start 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.921+0000 7f42e0a13800 1 -- start start 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.921+0000 7f42e0a13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb9887ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.921+0000 7f42e0a13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fb986d7b40 con 0x55fb98700cc0 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f42dc147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb9887ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f42dc147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb9887ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44630/0 (socket says 172.21.15.170:44630) 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f42dc147640 1 -- 172.21.15.170:0/1074346403 learned_addr learned my addr 172.21.15.170:0/1074346403 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f42dc147640 1 -- 172.21.15.170:0/1074346403 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb98649590 con 0x55fb98700cc0 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f42dc147640 1 --2- 172.21.15.170:0/1074346403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb9887ffc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000c00 tx=0x7f42cc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5b3577f4bb3095 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f41ca60c640 1 -- 172.21.15.170:0/1074346403 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc057040 con 0x55fb98700cc0 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f41ca60c640 1 -- 172.21.15.170:0/1074346403 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc052720 con 0x55fb98700cc0 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.922+0000 7f41ca60c640 1 -- 172.21.15.170:0/1074346403 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc052a40 con 0x55fb98700cc0 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 -- 172.21.15.170:0/1074346403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 msgr2=0x55fb9887ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 --2- 172.21.15.170:0/1074346403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb9887ffc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f42cc000c00 tx=0x7f42cc04c000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 -- 172.21.15.170:0/1074346403 shutdown_connections 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 --2- 172.21.15.170:0/1074346403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb9887ffc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 -- 172.21.15.170:0/1074346403 >> 172.21.15.170:0/1074346403 conn(0x55fb98787c10 msgr2=0x55fb9887b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 -- 172.21.15.170:0/1074346403 shutdown_connections 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 -- 172.21.15.170:0/1074346403 wait complete. 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 Processor -- start 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 -- start start 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb98887860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.923+0000 7f42e0a13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fb98797ef0 con 0x55fb98700cc0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f42dc147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb98887860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f42dc147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb98887860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44644/0 (socket says 172.21.15.170:44644) 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f42dc147640 1 -- 172.21.15.170:0/354379526 learned_addr learned my addr 172.21.15.170:0/354379526 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f42dc147640 1 -- 172.21.15.170:0/354379526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb986408f0 con 0x55fb98700cc0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f42dc147640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb98887860 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f42cc052540 tx=0x7f42cc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f41c8e09640 1 -- 172.21.15.170:0/354379526 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc073070 con 0x55fb98700cc0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f41c8e09640 1 -- 172.21.15.170:0/354379526 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc052c80 con 0x55fb98700cc0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb98887da0 con 0x55fb98700cc0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f41c8e09640 1 -- 172.21.15.170:0/354379526 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc057070 con 0x55fb98700cc0 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.924+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb988882c0 con 0x55fb98700cc0 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42e0a13800 1 Processor -- start 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42e0a13800 1 -- start start 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f41c8e09640 1 -- 172.21.15.170:0/354379526 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42cc076070 con 0x55fb98700cc0 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42e0a13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb98895360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42e0a13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fb9867de60 con 0x55fb98894f40 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f41c8e09640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41c4036950 0x7f41c4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f41c8e09640 1 -- 172.21.15.170:0/354379526 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f42cc08da40 con 0x55fb98700cc0 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42dc147640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41c4036950 0x7f41c4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42dc948640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb98895360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42dc948640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb98895360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44652/0 (socket says 172.21.15.170:44652) 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.925+0000 7f42dc948640 1 -- 172.21.15.170:0/2982685618 learned_addr learned my addr 172.21.15.170:0/2982685618 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42dc147640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41c4036950 0x7f41c4038e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42cc08be80 tx=0x7f42cc066f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42dc948640 1 -- 172.21.15.170:0/2982685618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb988958a0 con 0x55fb98894f40 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42dc948640 1 --2- 172.21.15.170:0/2982685618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb98895360 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f42d400a430 tx=0x7f42d400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69de6f2e6d32a3c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f41c27fc640 1 -- 172.21.15.170:0/2982685618 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d4015070 con 0x55fb98894f40 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f41c27fc640 1 -- 172.21.15.170:0/2982685618 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d4001670 con 0x55fb98894f40 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f41c27fc640 1 -- 172.21.15.170:0/2982685618 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d4001990 con 0x55fb98894f40 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42e0a13800 1 -- 172.21.15.170:0/2982685618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 msgr2=0x55fb98895360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2982685618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb98895360 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f42d400a430 tx=0x7f42d400a8f0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42e0a13800 1 -- 172.21.15.170:0/2982685618 shutdown_connections 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2982685618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb98895360 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42e0a13800 1 -- 172.21.15.170:0/2982685618 >> 172.21.15.170:0/2982685618 conn(0x55fb98702180 msgr2=0x55fb988919e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42e0a13800 1 -- 172.21.15.170:0/2982685618 shutdown_connections 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.926+0000 7f42e0a13800 1 -- 172.21.15.170:0/2982685618 wait complete. 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.927+0000 7f42e0a13800 1 Processor -- start 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.927+0000 7f42e0a13800 1 -- start start 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.927+0000 7f42e0a13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb9889c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.927+0000 7f42e0a13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fb98896230 con 0x55fb98894f40 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.927+0000 7f42dc948640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb9889c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.927+0000 7f42dc948640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb9889c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44654/0 (socket says 172.21.15.170:44654) 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.927+0000 7f42dc948640 1 -- 172.21.15.170:0/752777249 learned_addr learned my addr 172.21.15.170:0/752777249 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.928+0000 7f42dc948640 1 -- 172.21.15.170:0/752777249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9889c9e0 con 0x55fb98894f40 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.928+0000 7f42dc948640 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb9889c4a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f42d400a930 tx=0x7f42d4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.928+0000 7f41c0ff9640 1 -- 172.21.15.170:0/752777249 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d4020020 con 0x55fb98894f40 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.928+0000 7f41c0ff9640 1 -- 172.21.15.170:0/752777249 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d40108b0 con 0x55fb98894f40 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.928+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb9889cc70 con 0x55fb98894f40 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.928+0000 7f41c0ff9640 1 -- 172.21.15.170:0/752777249 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42d4015040 con 0x55fb98894f40 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.928+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb9889f920 con 0x55fb98894f40 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f41c0ff9640 1 -- 172.21.15.170:0/752777249 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42d4023020 con 0x55fb98894f40 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f41c0ff9640 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41b4036900 0x7f41b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f42e0a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f41c0ff9640 1 -- 172.21.15.170:0/752777249 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f42d404c060 con 0x55fb98894f40 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f42e0a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f42d3fff640 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41b4036900 0x7f41b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f42e0a13800 1 Processor -- start 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f42e0a13800 1 -- start start 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.929+0000 7f42d3fff640 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41b4036900 0x7f41b4038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f42c4000f60 tx=0x7f42c40012f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42e0a13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb988b6bb0 0x55fb988b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42e0a13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fb98880680 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42dc147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb988b6bb0 0x55fb988b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42dc147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb988b6bb0 0x55fb988b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44660/0 (socket says 172.21.15.170:44660) 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42dc147640 1 -- 172.21.15.170:0/2447828999 learned_addr learned my addr 172.21.15.170:0/2447828999 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42dc147640 1 -- 172.21.15.170:0/2447828999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb988b7510 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42dc147640 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb988b6bb0 0x55fb988b6fd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f42cc08bdf0 tx=0x7f42cc0768f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f41a0fe1640 1 -- 172.21.15.170:0/2447828999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc091020 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f41a0fe1640 1 -- 172.21.15.170:0/2447828999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc0592d0 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb988b7f80 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f41a0fe1640 1 -- 172.21.15.170:0/2447828999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc05c6d0 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.930+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb988b8480 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.931+0000 7f41a0fe1640 1 -- 172.21.15.170:0/2447828999 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42cc094020 con 0x55fb988b6bb0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.931+0000 7f41a0fe1640 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4114036900 0x7f4114038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.931+0000 7f41a0fe1640 1 -- 172.21.15.170:0/2447828999 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f42cc0680b0 con 0x55fb988b6bb0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.931+0000 7f42d3fff640 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4114036900 0x7f4114038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f41427fc640 20 reqs_thread_entry: start 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42d3fff640 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4114036900 0x7f4114038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001ed0 tx=0x7f42c400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fb988c4670 0x55fb988c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb988c71e0 con 0x55fb988c4670 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42dc948640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fb988c4670 0x55fb988c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42dc948640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fb988c4670 0x55fb988c6b10 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42dc948640 1 -- 172.21.15.170:0/354379526 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42d400e070 con 0x55fb988c4670 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fb988c9050 0x55fb988cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:2 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb988cbb30 con 0x55fb988c9050 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.932+0000 7f42dc147640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fb988c9050 0x55fb988cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.933+0000 7f42dc147640 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fb988c9050 0x55fb988cb440 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.933+0000 7f42dc147640 1 -- 172.21.15.170:0/354379526 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(2 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42cc09d070 con 0x55fb988c9050 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41b4036900 msgr2=0x7f41b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41b4036900 0x7f41b4038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f42c4000f60 tx=0x7f42c40012f0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 msgr2=0x55fb9889c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb9889c4a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f42d400a930 tx=0x7f42d4003370 comp rx=0 tx=0).stop 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 shutdown_connections 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41b4036900 0x7f41b4038dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/752777249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98894f40 0x55fb9889c4a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 >> 172.21.15.170:0/752777249 conn(0x55fb98702180 msgr2=0x55fb9888f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 shutdown_connections 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/752777249 wait complete. 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4114036900 msgr2=0x7f4114038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4114036900 0x7f4114038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001ed0 tx=0x7f42c400f000 comp rx=0 tx=0).stop 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb988b6bb0 msgr2=0x55fb988b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb988b6bb0 0x55fb988b6fd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f42cc08bdf0 tx=0x7f42cc0768f0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 shutdown_connections 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4114036900 0x7f4114038dc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 --2- 172.21.15.170:0/2447828999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb988b6bb0 0x55fb988b6fd0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 >> 172.21.15.170:0/2447828999 conn(0x55fb988ab680 msgr2=0x55fb988ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 shutdown_connections 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.934+0000 7f42e0a13800 1 -- 172.21.15.170:0/2447828999 wait complete. 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fb988c9050 msgr2=0x55fb988cb440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fb988c9050 0x55fb988cb440 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fb988c4670 msgr2=0x55fb988c6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fb988c4670 0x55fb988c6b10 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41c4036950 msgr2=0x7f41c4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41c4036950 0x7f41c4038e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42cc08be80 tx=0x7f42cc066f50 comp rx=0 tx=0).stop 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 msgr2=0x55fb98887860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb98887860 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f42cc052540 tx=0x7f42cc003020 comp rx=0 tx=0).stop 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 shutdown_connections 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fb988c9050 0x55fb988cb440 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fb988c4670 0x55fb988c6b10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f41c4036950 0x7f41c4038e10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 --2- 172.21.15.170:0/354379526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fb98700cc0 0x55fb98887860 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 >> 172.21.15.170:0/354379526 conn(0x55fb98787c10 msgr2=0x55fb9887a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 shutdown_connections 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:17.935+0000 7f42e0a13800 1 -- 172.21.15.170:0/354379526 wait complete. 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T12:32:17.945 DEBUG:tasks.util.rgw: json result: {'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T12:32:17.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-26T12:32:17.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-26T12:32:17.946 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-26T12:32:18.028 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.028 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc31b725800 1 Processor -- start 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc31b725800 1 -- start start 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc31b725800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dfc98689b0 0x55dfc9868dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc31b725800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dfc97150c0 con 0x55dfc98676c0 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc31b725800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55dfc96f94d0 con 0x55dfc98689b0 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc3174b7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dfc98689b0 0x55dfc9868dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc316cb6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55dfc98676c0 0x55dfc9867b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58762/0 (socket says 172.21.15.170:58762) 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc3174b7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dfc98689b0 0x55dfc9868dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44670/0 (socket says 172.21.15.170:44670) 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.028+0000 7fc316cb6640 1 -- 172.21.15.170:0/3821720538 learned_addr learned my addr 172.21.15.170:0/3821720538 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.029+0000 7fc3174b7640 1 -- 172.21.15.170:0/3821720538 >> v1:172.21.15.132:6789/0 conn(0x55dfc98676c0 legacy=0x55dfc9867b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.029+0000 7fc3174b7640 1 -- 172.21.15.170:0/3821720538 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc9726d40 con 0x55dfc98689b0 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.030+0000 7fc3174b7640 1 --2- 172.21.15.170:0/3821720538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98689b0 0x55dfc9868dd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc30800a470 tx=0x7fc30801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644a45447eebc26b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc3164b5640 1 -- 172.21.15.170:0/3821720538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308057070 con 0x55dfc98689b0 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc3164b5640 1 -- 172.21.15.170:0/3821720538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30804adc0 con 0x55dfc98689b0 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc3164b5640 1 -- 172.21.15.170:0/3821720538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308052590 con 0x55dfc98689b0 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc31b725800 1 -- 172.21.15.170:0/3821720538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98689b0 msgr2=0x55dfc9868dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc31b725800 1 --2- 172.21.15.170:0/3821720538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98689b0 0x55dfc9868dd0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fc30800a470 tx=0x7fc30801ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc31b725800 1 -- 172.21.15.170:0/3821720538 shutdown_connections 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc31b725800 1 --2- 172.21.15.170:0/3821720538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98689b0 0x55dfc9868dd0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc31b725800 1 -- 172.21.15.170:0/3821720538 >> 172.21.15.170:0/3821720538 conn(0x55dfc9862150 msgr2=0x55dfc9864570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc31b725800 1 -- 172.21.15.170:0/3821720538 shutdown_connections 2024-04-26T12:32:18.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.031+0000 7fc31b725800 1 -- 172.21.15.170:0/3821720538 wait complete. 2024-04-26T12:32:18.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.043+0000 7fc31b725800 1 Processor -- start 2024-04-26T12:32:18.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.043+0000 7fc31b725800 1 -- start start 2024-04-26T12:32:18.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.043+0000 7fc31b725800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc9957aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.043+0000 7fc31b725800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dfc97b3b30 con 0x55dfc98676c0 2024-04-26T12:32:18.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.043+0000 7fc3174b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc9957aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.043+0000 7fc3174b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc9957aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44682/0 (socket says 172.21.15.170:44682) 2024-04-26T12:32:18.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.043+0000 7fc3174b7640 1 -- 172.21.15.170:0/3028001656 learned_addr learned my addr 172.21.15.170:0/3028001656 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.044+0000 7fc3174b7640 1 -- 172.21.15.170:0/3028001656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc9725590 con 0x55dfc98676c0 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.044+0000 7fc3174b7640 1 --2- 172.21.15.170:0/3028001656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc9957aa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc308000c00 tx=0x7fc30804c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a4338369d489e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.044+0000 7fc20560a640 1 -- 172.21.15.170:0/3028001656 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308057040 con 0x55dfc98676c0 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.044+0000 7fc20560a640 1 -- 172.21.15.170:0/3028001656 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc308063070 con 0x55dfc98676c0 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.044+0000 7fc20560a640 1 -- 172.21.15.170:0/3028001656 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30805d470 con 0x55dfc98676c0 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 -- 172.21.15.170:0/3028001656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 msgr2=0x55dfc9957aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 --2- 172.21.15.170:0/3028001656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc9957aa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc308000c00 tx=0x7fc30804c070 comp rx=0 tx=0).stop 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 -- 172.21.15.170:0/3028001656 shutdown_connections 2024-04-26T12:32:18.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 --2- 172.21.15.170:0/3028001656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc9957aa0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 -- 172.21.15.170:0/3028001656 >> 172.21.15.170:0/3028001656 conn(0x55dfc9862150 msgr2=0x55dfc99533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 -- 172.21.15.170:0/3028001656 shutdown_connections 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 -- 172.21.15.170:0/3028001656 wait complete. 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 Processor -- start 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 -- start start 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc995f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc31b725800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dfc98667f0 con 0x55dfc98676c0 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc3174b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc995f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc3174b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc995f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44698/0 (socket says 172.21.15.170:44698) 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.045+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 learned_addr learned my addr 172.21.15.170:0/1336074575 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.046+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc971c8f0 con 0x55dfc98676c0 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.046+0000 7fc3174b7640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc995f3c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc308060040 tx=0x55dfc9868660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.046+0000 7fc203e07640 1 -- 172.21.15.170:0/1336074575 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30806c070 con 0x55dfc98676c0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.046+0000 7fc203e07640 1 -- 172.21.15.170:0/1336074575 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30805d910 con 0x55dfc98676c0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.046+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dfc995f900 con 0x55dfc98676c0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.046+0000 7fc203e07640 1 -- 172.21.15.170:0/1336074575 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc308057070 con 0x55dfc98676c0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.046+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc995fe20 con 0x55dfc98676c0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc31b725800 1 Processor -- start 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc31b725800 1 -- start start 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc203e07640 1 -- 172.21.15.170:0/1336074575 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc30805dc30 con 0x55dfc98676c0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc31b725800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc996ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc31b725800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dfc9759e60 con 0x55dfc996ca50 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc203e07640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1fc036950 0x7fc1fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc203e07640 1 -- 172.21.15.170:0/1336074575 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fc30808e4b0 con 0x55dfc98676c0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc317cb8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc996ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc317cb8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc996ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44702/0 (socket says 172.21.15.170:44702) 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc317cb8640 1 -- 172.21.15.170:0/302779264 learned_addr learned my addr 172.21.15.170:0/302779264 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc3174b7640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1fc036950 0x7fc1fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc317cb8640 1 -- 172.21.15.170:0/302779264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc996d3b0 con 0x55dfc996ca50 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc3174b7640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1fc036950 0x7fc1fc038e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc30805e590 tx=0x7fc30808e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc317cb8640 1 --2- 172.21.15.170:0/302779264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc996ce70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc31000a430 tx=0x7fc31000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607252fe6185a298 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.047+0000 7fc201e03640 1 -- 172.21.15.170:0/302779264 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc310015070 con 0x55dfc996ca50 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc201e03640 1 -- 172.21.15.170:0/302779264 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc310001670 con 0x55dfc996ca50 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc201e03640 1 -- 172.21.15.170:0/302779264 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc310001990 con 0x55dfc996ca50 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 -- 172.21.15.170:0/302779264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 msgr2=0x55dfc996ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 --2- 172.21.15.170:0/302779264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc996ce70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc31000a430 tx=0x7fc31000a8f0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 -- 172.21.15.170:0/302779264 shutdown_connections 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 --2- 172.21.15.170:0/302779264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc996ce70 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 -- 172.21.15.170:0/302779264 >> 172.21.15.170:0/302779264 conn(0x55dfc98689b0 msgr2=0x55dfc99694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 -- 172.21.15.170:0/302779264 shutdown_connections 2024-04-26T12:32:18.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 -- 172.21.15.170:0/302779264 wait complete. 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 Processor -- start 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 -- start start 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc9973fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.048+0000 7fc31b725800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dfc996dd40 con 0x55dfc996ca50 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc317cb8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc9973fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc317cb8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc9973fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44710/0 (socket says 172.21.15.170:44710) 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc317cb8640 1 -- 172.21.15.170:0/3758569940 learned_addr learned my addr 172.21.15.170:0/3758569940 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc317cb8640 1 -- 172.21.15.170:0/3758569940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc99744e0 con 0x55dfc996ca50 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc317cb8640 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc9973fa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc31000a930 tx=0x7fc310003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc1f3fff640 1 -- 172.21.15.170:0/3758569940 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc310020020 con 0x55dfc996ca50 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc1f3fff640 1 -- 172.21.15.170:0/3758569940 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3100108b0 con 0x55dfc996ca50 2024-04-26T12:32:18.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc1f3fff640 1 -- 172.21.15.170:0/3758569940 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc310015040 con 0x55dfc996ca50 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dfc9974770 con 0x55dfc996ca50 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.049+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc9977420 con 0x55dfc996ca50 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.050+0000 7fc1f3fff640 1 -- 172.21.15.170:0/3758569940 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc310023020 con 0x55dfc996ca50 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.050+0000 7fc1f3fff640 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1f8036950 0x7fc1f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.050+0000 7fc1f3fff640 1 -- 172.21.15.170:0/3758569940 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fc31004bff0 con 0x55dfc996ca50 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.050+0000 7fc316cb6640 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1f8036950 0x7fc1f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.050+0000 7fc31b725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:18.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.050+0000 7fc31b725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:18.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc31b725800 1 Processor -- start 2024-04-26T12:32:18.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc316cb6640 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1f8036950 0x7fc1f8038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f60 tx=0x7fc30c001230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc31b725800 1 -- start start 2024-04-26T12:32:18.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc31b725800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc998e640 0x55dfc998ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc31b725800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dfc9958160 con 0x55dfc998e640 2024-04-26T12:32:18.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc3174b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc998e640 0x55dfc998ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc3174b7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc998e640 0x55dfc998ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44726/0 (socket says 172.21.15.170:44726) 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc3174b7640 1 -- 172.21.15.170:0/466067196 learned_addr learned my addr 172.21.15.170:0/466067196 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.051+0000 7fc3174b7640 1 -- 172.21.15.170:0/466067196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc998efa0 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.052+0000 7fc3174b7640 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc998e640 0x55dfc998ea60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc30808c7f0 tx=0x7fc30805e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.052+0000 7fc16ffff640 1 -- 172.21.15.170:0/466067196 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30808e0b0 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.052+0000 7fc16ffff640 1 -- 172.21.15.170:0/466067196 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc308093070 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.052+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dfc998fa10 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.052+0000 7fc16ffff640 1 -- 172.21.15.170:0/466067196 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3080095d0 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.052+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc998ff10 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.052+0000 7fc16ffff640 1 -- 172.21.15.170:0/466067196 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc308009770 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc16ffff640 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc150036950 0x7fc150038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc16ffff640 1 -- 172.21.15.170:0/466067196 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fc30806a0d0 con 0x55dfc998e640 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc316cb6640 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc150036950 0x7fc150038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc16dffb640 20 reqs_thread_entry: start 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc316cb6640 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc150036950 0x7fc150038e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc30c001ed0 tx=0x7fc30c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dfc999c040 0x55dfc999e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfc999eb30 con 0x55dfc999c040 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc317cb8640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dfc999c040 0x55dfc999e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.053+0000 7fc317cb8640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dfc999c040 0x55dfc999e4b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.054+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.054+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfc999f460 con 0x55dfc999c040 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.054+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.054+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dfc99a0d70 0x55dfc99a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.054+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99a3950 con 0x55dfc99a0d70 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.054+0000 7fc3174b7640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dfc99a0d70 0x55dfc99a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.054+0000 7fc3174b7640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dfc99a0d70 0x55dfc99a31c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.055+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.055+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0ca0 con 0x55dfc999c040 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.055+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:NOTICE: set zone's realm_id= 2024-04-26T12:32:18.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.055+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dfc99a80c0 0x55dfc99aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.055+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.055+0000 7fc316cb6640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dfc99a80c0 0x55dfc99aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.055+0000 7fc316cb6640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dfc99a80c0 0x55dfc99aa400 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.056+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c009050 con 0x55dfc99a80c0 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.056+0000 7fc316cb6640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc30c01d040 0x7fc30c01c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.056+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x7fc30c01d040 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.056+0000 7fc317cb8640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc30c01d040 0x7fc30c01c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.056+0000 7fc317cb8640 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc30c01d040 0x7fc30c01c980 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.056+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc310010d70 con 0x7fc30c01d040 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.056+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.057+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.057+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.057+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.057+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.057+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.057+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x7fc30c01d040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x7fc30c01d040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c009050 con 0x55dfc99a80c0 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.058+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x7fc30c01d040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x7fc30c01d040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x7fc30c01d040 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc310010d70 con 0x7fc30c01d040 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c02a040 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.059+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c02a040 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c02a040 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c02a040 con 0x55dfc99a80c0 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.060+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c02a040 con 0x55dfc99a80c0 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.061+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x7fc30c01d040 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x7fc30c01d040 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c02a040 con 0x55dfc99a80c0 2024-04-26T12:32:18.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.062+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x7fc30c01d040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x7fc30c01d040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a80c0 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c02a040 con 0x55dfc99a80c0 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc316cb6640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc99a0d70 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.063+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x55dfc999c040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.064+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.064+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99b0740 con 0x7fc30c01d040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.064+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc310010d70 con 0x7fc30c01d040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.064+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99aeb70 con 0x55dfc999c040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.064+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.064+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:38 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99ac140 con 0x55dfc99a0d70 2024-04-26T12:32:18.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.065+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(38 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.065+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:39 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99a96c0 con 0x55dfc99a0d70 2024-04-26T12:32:18.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.066+0000 7fc3174b7640 1 -- 172.21.15.170:0/1336074575 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(39 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [create,call,writefull 0~1155] v32'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fc30805a040 con 0x55dfc99a0d70 2024-04-26T12:32:18.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.066+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99a6ff0 con 0x55dfc999c040 2024-04-26T12:32:18.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.067+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.067+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfc99ac9c0 con 0x55dfc999c040 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.068+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fc310010d70 con 0x55dfc999c040 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1f8036950 msgr2=0x7fc1f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1f8036950 0x7fc1f8038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f60 tx=0x7fc30c001230 comp rx=0 tx=0).stop 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 msgr2=0x55dfc9973fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc9973fa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc31000a930 tx=0x7fc310003370 comp rx=0 tx=0).stop 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 shutdown_connections 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1f8036950 0x7fc1f8038e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/3758569940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc996ca50 0x55dfc9973fa0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 >> 172.21.15.170:0/3758569940 conn(0x55dfc98689b0 msgr2=0x55dfc9966b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 shutdown_connections 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/3758569940 wait complete. 2024-04-26T12:32:18.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc150036950 msgr2=0x7fc150038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc150036950 0x7fc150038e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc30c001ed0 tx=0x7fc30c00f000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc998e640 msgr2=0x55dfc998ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc998e640 0x55dfc998ea60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc30808c7f0 tx=0x7fc30805e420 comp rx=0 tx=0).stop 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 shutdown_connections 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc150036950 0x7fc150038e10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/466067196 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc998e640 0x55dfc998ea60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 >> 172.21.15.170:0/466067196 conn(0x55dfc99830f0 msgr2=0x55dfc9983b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 shutdown_connections 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/466067196 wait complete. 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dfc99a0d70 msgr2=0x55dfc99a31c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dfc99a0d70 0x55dfc99a31c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dfc999c040 msgr2=0x55dfc999e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dfc999c040 0x55dfc999e4b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc30c01d040 msgr2=0x7fc30c01c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fc30c01d040 0x7fc30c01c980 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dfc99a80c0 msgr2=0x55dfc99aa400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dfc99a80c0 0x55dfc99aa400 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1fc036950 msgr2=0x7fc1fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fc1fc036950 0x7fc1fc038e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc30805e590 tx=0x7fc30808e040 comp rx=0 tx=0).stop 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 msgr2=0x55dfc995f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc31b725800 1 --2- 172.21.15.170:0/1336074575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dfc98676c0 0x55dfc995f3c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc308060040 tx=0x55dfc9868660 comp rx=0 tx=0).stop 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 reap_dead start 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.069+0000 7fc317cb8640 1 -- 172.21.15.170:0/1336074575 reap_dead start 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.070+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 shutdown_connections 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.070+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 >> 172.21.15.170:0/1336074575 conn(0x55dfc9862150 msgr2=0x55dfc9956490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.070+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 shutdown_connections 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.070+0000 7fc31b725800 1 -- 172.21.15.170:0/1336074575 wait complete. 2024-04-26T12:32:18.081 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-26T12:32:18.081 DEBUG:tasks.util.rgw: json result: {'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-26T12:32:18.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-26T12:32:18.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-26T12:32:18.082 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-26T12:32:18.162 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.162 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.162+0000 7fb59ad2f800 1 Processor -- start 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.162+0000 7fb59ad2f800 1 -- start start 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.162+0000 7fb59ad2f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564d88c45950 0x564d88c47d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.162+0000 7fb59ad2f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d88aee0c0 con 0x564d88c415b0 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.162+0000 7fb59ad2f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x564d88ad24d0 con 0x564d88c45950 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.163+0000 7fb5962f1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564d88c45950 0x564d88c47d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.163+0000 7fb5962f1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x564d88c45950 0x564d88c47d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44738/0 (socket says 172.21.15.170:44738) 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.163+0000 7fb596af2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x564d88c415b0 0x564d88c419d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58776/0 (socket says 172.21.15.170:58776) 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.163+0000 7fb5962f1640 1 -- 172.21.15.170:0/1213854891 learned_addr learned my addr 172.21.15.170:0/1213854891 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.163+0000 7fb5962f1640 1 -- 172.21.15.170:0/1213854891 >> v1:172.21.15.132:6789/0 conn(0x564d88c415b0 legacy=0x564d88c419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.163+0000 7fb5962f1640 1 -- 172.21.15.170:0/1213854891 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88affd40 con 0x564d88c45950 2024-04-26T12:32:18.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb5962f1640 1 --2- 172.21.15.170:0/1213854891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c45950 0x564d88c47d40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00a520 tx=0x7fb58c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e16b902b36820b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb595af0640 1 -- 172.21.15.170:0/1213854891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58c057070 con 0x564d88c45950 2024-04-26T12:32:18.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb595af0640 1 -- 172.21.15.170:0/1213854891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c052570 con 0x564d88c45950 2024-04-26T12:32:18.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb595af0640 1 -- 172.21.15.170:0/1213854891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58c04ae60 con 0x564d88c45950 2024-04-26T12:32:18.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1213854891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c45950 msgr2=0x564d88c47d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/1213854891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c45950 0x564d88c47d40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00a520 tx=0x7fb58c01d010 comp rx=0 tx=0).stop 2024-04-26T12:32:18.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1213854891 shutdown_connections 2024-04-26T12:32:18.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/1213854891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c45950 0x564d88c47d40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1213854891 >> 172.21.15.170:0/1213854891 conn(0x564d88c3cb70 msgr2=0x564d88c3ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1213854891 shutdown_connections 2024-04-26T12:32:18.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.165+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1213854891 wait complete. 2024-04-26T12:32:18.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb59ad2f800 1 Processor -- start 2024-04-26T12:32:18.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb59ad2f800 1 -- start start 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb59ad2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d32720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb59ad2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564d88b8cb30 con 0x564d88c415b0 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb596af2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d32720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb596af2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d32720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44750/0 (socket says 172.21.15.170:44750) 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb596af2640 1 -- 172.21.15.170:0/2698241522 learned_addr learned my addr 172.21.15.170:0/2698241522 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.177+0000 7fb596af2640 1 -- 172.21.15.170:0/2698241522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88afe590 con 0x564d88c415b0 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.178+0000 7fb596af2640 1 --2- 172.21.15.170:0/2698241522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d32720 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb58800b230 tx=0x7fb58800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee39ebf1807e8ece server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.178+0000 7fb484e09640 1 -- 172.21.15.170:0/2698241522 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58800e5c0 con 0x564d88c415b0 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.178+0000 7fb484e09640 1 -- 172.21.15.170:0/2698241522 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb588006070 con 0x564d88c415b0 2024-04-26T12:32:18.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.178+0000 7fb484e09640 1 -- 172.21.15.170:0/2698241522 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58800e890 con 0x564d88c415b0 2024-04-26T12:32:18.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.178+0000 7fb59ad2f800 1 -- 172.21.15.170:0/2698241522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 msgr2=0x564d88d32720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.178+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/2698241522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d32720 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb58800b230 tx=0x7fb58800b6f0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 -- 172.21.15.170:0/2698241522 shutdown_connections 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/2698241522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d32720 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 -- 172.21.15.170:0/2698241522 >> 172.21.15.170:0/2698241522 conn(0x564d88c3cb70 msgr2=0x564d88d2e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 -- 172.21.15.170:0/2698241522 shutdown_connections 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 -- 172.21.15.170:0/2698241522 wait complete. 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 Processor -- start 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 -- start start 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d3a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb59ad2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564d88c48610 con 0x564d88c415b0 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb596af2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d3a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb596af2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d3a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44764/0 (socket says 172.21.15.170:44764) 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb596af2640 1 -- 172.21.15.170:0/74675773 learned_addr learned my addr 172.21.15.170:0/74675773 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.179+0000 7fb596af2640 1 -- 172.21.15.170:0/74675773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88af58f0 con 0x564d88c415b0 2024-04-26T12:32:18.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.180+0000 7fb596af2640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d3a170 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb588000fd0 tx=0x7fb588000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.180+0000 7fb483606640 1 -- 172.21.15.170:0/74675773 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58800f8d0 con 0x564d88c415b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.180+0000 7fb483606640 1 -- 172.21.15.170:0/74675773 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58800fa90 con 0x564d88c415b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.180+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d88d3a6b0 con 0x564d88c415b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.180+0000 7fb483606640 1 -- 172.21.15.170:0/74675773 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58800fdb0 con 0x564d88c415b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.180+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d88d3abd0 con 0x564d88c415b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.180+0000 7fb59ad2f800 1 Processor -- start 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb59ad2f800 1 -- start start 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb483606640 1 -- 172.21.15.170:0/74675773 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb588017070 con 0x564d88c415b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb59ad2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d47bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb59ad2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564d88b32e60 con 0x564d88d477b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb483606640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb47c036900 0x7fb47c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb5972f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d47bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb5972f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d47bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44772/0 (socket says 172.21.15.170:44772) 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb483606640 1 -- 172.21.15.170:0/74675773 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb588015020 con 0x564d88c415b0 2024-04-26T12:32:18.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb5972f3640 1 -- 172.21.15.170:0/185166421 learned_addr learned my addr 172.21.15.170:0/185166421 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb596af2640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb47c036900 0x7fb47c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb5972f3640 1 -- 172.21.15.170:0/185166421 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88d48110 con 0x564d88d477b0 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb5972f3640 1 --2- 172.21.15.170:0/185166421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d47bd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb59000a430 tx=0x7fb59000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca534d671cbba99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb596af2640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb47c036900 0x7fb47c038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb58801dfd0 tx=0x7fb588035040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.181+0000 7fb481602640 1 -- 172.21.15.170:0/185166421 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb590015070 con 0x564d88d477b0 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb481602640 1 -- 172.21.15.170:0/185166421 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb590001670 con 0x564d88d477b0 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb481602640 1 -- 172.21.15.170:0/185166421 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb590001990 con 0x564d88d477b0 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 -- 172.21.15.170:0/185166421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 msgr2=0x564d88d47bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/185166421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d47bd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb59000a430 tx=0x7fb59000a8f0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 -- 172.21.15.170:0/185166421 shutdown_connections 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/185166421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d47bd0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 -- 172.21.15.170:0/185166421 >> 172.21.15.170:0/185166421 conn(0x564d88c45950 msgr2=0x564d88d44250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 -- 172.21.15.170:0/185166421 shutdown_connections 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 -- 172.21.15.170:0/185166421 wait complete. 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 Processor -- start 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 -- start start 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d4ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.182+0000 7fb59ad2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564d88d48aa0 con 0x564d88d477b0 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb5972f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d4ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb5972f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d4ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44780/0 (socket says 172.21.15.170:44780) 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb5972f3640 1 -- 172.21.15.170:0/3052389356 learned_addr learned my addr 172.21.15.170:0/3052389356 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb5972f3640 1 -- 172.21.15.170:0/3052389356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88d4f230 con 0x564d88d477b0 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb5972f3640 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d4ecf0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb59000a930 tx=0x7fb590003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb47b7fe640 1 -- 172.21.15.170:0/3052389356 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb590020020 con 0x564d88d477b0 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb47b7fe640 1 -- 172.21.15.170:0/3052389356 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5900108b0 con 0x564d88d477b0 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d88d4f4c0 con 0x564d88d477b0 2024-04-26T12:32:18.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb47b7fe640 1 -- 172.21.15.170:0/3052389356 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb590015040 con 0x564d88d477b0 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.183+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d88d52170 con 0x564d88d477b0 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.184+0000 7fb47b7fe640 1 -- 172.21.15.170:0/3052389356 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb590023020 con 0x564d88d477b0 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.184+0000 7fb47b7fe640 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb470036950 0x7fb470038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.184+0000 7fb59ad2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.184+0000 7fb59ad2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.184+0000 7fb47b7fe640 1 -- 172.21.15.170:0/3052389356 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb59004bff0 con 0x564d88d477b0 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.184+0000 7fb5962f1640 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb470036950 0x7fb470038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.184+0000 7fb59ad2f800 1 Processor -- start 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb59ad2f800 1 -- start start 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb59ad2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88bb7250 0x564d88bb56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb59ad2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x564d88d32ea0 con 0x564d88bb7250 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb5962f1640 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb470036950 0x7fb470038e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb58c054000 tx=0x7fb58c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb596af2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88bb7250 0x564d88bb56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb596af2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88bb7250 0x564d88bb56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44784/0 (socket says 172.21.15.170:44784) 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb596af2640 1 -- 172.21.15.170:0/1680725269 learned_addr learned my addr 172.21.15.170:0/1680725269 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb596af2640 1 -- 172.21.15.170:0/1680725269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d88bb5c00 con 0x564d88bb7250 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb596af2640 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88bb7250 0x564d88bb56c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb58800ff70 tx=0x7fb58801a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb45b7e6640 1 -- 172.21.15.170:0/1680725269 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58801ce60 con 0x564d88bb7250 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb45b7e6640 1 -- 172.21.15.170:0/1680725269 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb588019dd0 con 0x564d88bb7250 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb45b7e6640 1 -- 172.21.15.170:0/1680725269 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb58801c620 con 0x564d88bb7250 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.185+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d88bb5e90 con 0x564d88bb7250 2024-04-26T12:32:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.186+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d88bb6390 con 0x564d88bb7250 2024-04-26T12:32:18.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.186+0000 7fb45b7e6640 1 -- 172.21.15.170:0/1680725269 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb58804c9b0 con 0x564d88bb7250 2024-04-26T12:32:18.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.186+0000 7fb45b7e6640 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3d8036950 0x7fb3d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.186+0000 7fb45b7e6640 1 -- 172.21.15.170:0/1680725269 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb588048d00 con 0x564d88bb7250 2024-04-26T12:32:18.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.186+0000 7fb5962f1640 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3d8036950 0x7fb3d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb4597e2640 20 reqs_thread_entry: start 2024-04-26T12:32:18.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564d88d78f80 0x564d88d7b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb5962f1640 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3d8036950 0x7fb3d8038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb58c04b010 tx=0x7fb58c005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d88d7ba70 con 0x564d88d78f80 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb5972f3640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564d88d78f80 0x564d88d7b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb5972f3640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564d88d78f80 0x564d88d7b3f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb5972f3640 1 -- 172.21.15.170:0/74675773 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb590010d70 con 0x564d88d78f80 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.187+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d88d7c350 con 0x564d88d78f80 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.188+0000 7fb5972f3640 1 -- 172.21.15.170:0/74675773 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb590010d70 con 0x564d88d78f80 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.188+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564d88d7dc60 0x564d88d800b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.188+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d88d80840 con 0x564d88d7dc60 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.188+0000 7fb596af2640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564d88d7dc60 0x564d88d800b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.188+0000 7fb596af2640 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564d88d7dc60 0x564d88d800b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.188+0000 7fb596af2640 1 -- 172.21.15.170:0/74675773 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fb588039070 con 0x564d88d7dc60 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb470036950 msgr2=0x7fb470038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb470036950 0x7fb470038e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb58c054000 tx=0x7fb58c04e000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 msgr2=0x564d88d4ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d4ecf0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb59000a930 tx=0x7fb590003370 comp rx=0 tx=0).stop 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 shutdown_connections 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb470036950 0x7fb470038e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/3052389356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88d477b0 0x564d88d4ecf0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 >> 172.21.15.170:0/3052389356 conn(0x564d88c45950 msgr2=0x564d88d41890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 shutdown_connections 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/3052389356 wait complete. 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3d8036950 msgr2=0x7fb3d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3d8036950 0x7fb3d8038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb58c04b010 tx=0x7fb58c005ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88bb7250 msgr2=0x564d88bb56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.189+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88bb7250 0x564d88bb56c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb58800ff70 tx=0x7fb58801a850 comp rx=0 tx=0).stop 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 shutdown_connections 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb3d8036950 0x7fb3d8038e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/1680725269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88bb7250 0x564d88bb56c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 >> 172.21.15.170:0/1680725269 conn(0x564d88d5ded0 msgr2=0x564d88d5e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 shutdown_connections 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/1680725269 wait complete. 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564d88d7dc60 msgr2=0x564d88d800b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564d88d7dc60 0x564d88d800b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564d88d78f80 msgr2=0x564d88d7b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564d88d78f80 0x564d88d7b3f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb47c036900 msgr2=0x7fb47c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb47c036900 0x7fb47c038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb58801dfd0 tx=0x7fb588035040 comp rx=0 tx=0).stop 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 msgr2=0x564d88d3a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d3a170 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb588000fd0 tx=0x7fb588000ed0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 shutdown_connections 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x564d88d7dc60 0x564d88d800b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x564d88d78f80 0x564d88d7b3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb47c036900 0x7fb47c038dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 --2- 172.21.15.170:0/74675773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x564d88c415b0 0x564d88d3a170 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 >> 172.21.15.170:0/74675773 conn(0x564d88c3cb70 msgr2=0x564d88d31110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 shutdown_connections 2024-04-26T12:32:18.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.190+0000 7fb59ad2f800 1 -- 172.21.15.170:0/74675773 wait complete. 2024-04-26T12:32:18.201 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-26T12:32:18.202 DEBUG:tasks.util.rgw: json result: {'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-26T12:32:18.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:32:18.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-26T12:32:18.202 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-26T12:32:18.286 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.287 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.286+0000 7f43f6813800 1 Processor -- start 2024-04-26T12:32:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.286+0000 7f43f6813800 1 -- start start 2024-04-26T12:32:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.286+0000 7f43f6813800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55e2c29d66b0 0x55e2c29d6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.286+0000 7f43f6813800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2c28830c0 con 0x55e2c29d77d0 2024-04-26T12:32:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.286+0000 7f43f6813800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55e2c28674d0 con 0x55e2c29d66b0 2024-04-26T12:32:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.287+0000 7f43f1e6e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55e2c29d66b0 0x55e2c29d6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.287+0000 7f43f1e6e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55e2c29d66b0 0x55e2c29d6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44792/0 (socket says 172.21.15.170:44792) 2024-04-26T12:32:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.287+0000 7f43f1e6e640 1 -- 172.21.15.170:0/262639098 learned_addr learned my addr 172.21.15.170:0/262639098 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.287+0000 7f43f166d640 1 --1- 172.21.15.170:0/262639098 >> v1:172.21.15.132:6789/0 conn(0x55e2c29d77d0 0x55e2c29d7c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58780/0 (socket says 172.21.15.170:58780) 2024-04-26T12:32:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.287+0000 7f43f1e6e640 1 -- 172.21.15.170:0/262639098 >> v1:172.21.15.132:6789/0 conn(0x55e2c29d77d0 legacy=0x55e2c29d7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.287+0000 7f43f1e6e640 1 -- 172.21.15.170:0/262639098 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c2894d40 con 0x55e2c29d66b0 2024-04-26T12:32:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/262639098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c29d6ad0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f43e400a520 tx=0x7f43e401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a7841b3b06fcc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f0e6c640 1 -- 172.21.15.170:0/262639098 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4057070 con 0x55e2c29d66b0 2024-04-26T12:32:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f0e6c640 1 -- 172.21.15.170:0/262639098 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4052570 con 0x55e2c29d66b0 2024-04-26T12:32:18.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f0e6c640 1 -- 172.21.15.170:0/262639098 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e404ae60 con 0x55e2c29d66b0 2024-04-26T12:32:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f6813800 1 -- 172.21.15.170:0/262639098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 msgr2=0x55e2c29d6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f6813800 1 --2- 172.21.15.170:0/262639098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c29d6ad0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f43e400a520 tx=0x7f43e401d010 comp rx=0 tx=0).stop 2024-04-26T12:32:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f6813800 1 -- 172.21.15.170:0/262639098 shutdown_connections 2024-04-26T12:32:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f6813800 1 --2- 172.21.15.170:0/262639098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c29d6ad0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.289+0000 7f43f6813800 1 -- 172.21.15.170:0/262639098 >> 172.21.15.170:0/262639098 conn(0x55e2c29d1c70 msgr2=0x55e2c29d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.290+0000 7f43f6813800 1 -- 172.21.15.170:0/262639098 shutdown_connections 2024-04-26T12:32:18.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.290+0000 7f43f6813800 1 -- 172.21.15.170:0/262639098 wait complete. 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.301+0000 7f43f6813800 1 Processor -- start 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.301+0000 7f43f6813800 1 -- start start 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.301+0000 7f43f6813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2ac7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f43f6813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e2c2921b60 con 0x55e2c29d66b0 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f43f1e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2ac7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f43f1e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2ac7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44798/0 (socket says 172.21.15.170:44798) 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f43f1e6e640 1 -- 172.21.15.170:0/1953574860 learned_addr learned my addr 172.21.15.170:0/1953574860 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f43f1e6e640 1 -- 172.21.15.170:0/1953574860 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c2893590 con 0x55e2c29d66b0 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/1953574860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2ac7cb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f43e4055040 tx=0x7f43e404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c52366c21d0974 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f42dfe07640 1 -- 172.21.15.170:0/1953574860 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4057040 con 0x55e2c29d66b0 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f42dfe07640 1 -- 172.21.15.170:0/1953574860 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4052720 con 0x55e2c29d66b0 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.302+0000 7f42dfe07640 1 -- 172.21.15.170:0/1953574860 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4052a40 con 0x55e2c29d66b0 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.303+0000 7f43f6813800 1 -- 172.21.15.170:0/1953574860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 msgr2=0x55e2c2ac7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.303+0000 7f43f6813800 1 --2- 172.21.15.170:0/1953574860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2ac7cb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f43e4055040 tx=0x7f43e404c000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.303+0000 7f43f6813800 1 -- 172.21.15.170:0/1953574860 shutdown_connections 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.303+0000 7f43f6813800 1 --2- 172.21.15.170:0/1953574860 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2ac7cb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.303+0000 7f43f6813800 1 -- 172.21.15.170:0/1953574860 >> 172.21.15.170:0/1953574860 conn(0x55e2c29d1c70 msgr2=0x55e2c2ac35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.303+0000 7f43f6813800 1 -- 172.21.15.170:0/1953574860 shutdown_connections 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.303+0000 7f43f6813800 1 -- 172.21.15.170:0/1953574860 wait complete. 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f6813800 1 Processor -- start 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f6813800 1 -- start start 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f6813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2acf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f6813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e2c29dfc40 con 0x55e2c29d66b0 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f1e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2acf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f1e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2acf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44814/0 (socket says 172.21.15.170:44814) 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f1e6e640 1 -- 172.21.15.170:0/24065324 learned_addr learned my addr 172.21.15.170:0/24065324 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f1e6e640 1 -- 172.21.15.170:0/24065324 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c288a8f0 con 0x55e2c29d66b0 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.304+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2acf570 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f43e4052540 tx=0x7f43e4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f42de604640 1 -- 172.21.15.170:0/24065324 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4073070 con 0x55e2c29d66b0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f42de604640 1 -- 172.21.15.170:0/24065324 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4052c90 con 0x55e2c29d66b0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f42de604640 1 -- 172.21.15.170:0/24065324 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4057070 con 0x55e2c29d66b0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c2acfab0 con 0x55e2c29d66b0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c2acffd0 con 0x55e2c29d66b0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f43f6813800 1 Processor -- start 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f43f6813800 1 -- start start 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.305+0000 7f42de604640 1 -- 172.21.15.170:0/24065324 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43e4076070 con 0x55e2c29d66b0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f6813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c2add020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f6813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e2c28c7e60 con 0x55e2c2adcc00 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f42de604640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42d8036950 0x7f42d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f42de604640 1 -- 172.21.15.170:0/24065324 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f43e408da80 con 0x55e2c29d66b0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42d8036950 0x7f42d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f266f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c2add020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f266f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c2add020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44826/0 (socket says 172.21.15.170:44826) 2024-04-26T12:32:18.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f266f640 1 -- 172.21.15.170:0/727341218 learned_addr learned my addr 172.21.15.170:0/727341218 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42d8036950 0x7f42d8038e10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43e4055040 tx=0x7f43e4076720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f266f640 1 -- 172.21.15.170:0/727341218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c2add560 con 0x55e2c2adcc00 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.306+0000 7f43f266f640 1 --2- 172.21.15.170:0/727341218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c2add020 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00a430 tx=0x7f43ec00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2accc225a689fe8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f42d7fff640 1 -- 172.21.15.170:0/727341218 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec015070 con 0x55e2c2adcc00 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f42d7fff640 1 -- 172.21.15.170:0/727341218 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec001670 con 0x55e2c2adcc00 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f42d7fff640 1 -- 172.21.15.170:0/727341218 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec001990 con 0x55e2c2adcc00 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 -- 172.21.15.170:0/727341218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 msgr2=0x55e2c2add020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 --2- 172.21.15.170:0/727341218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c2add020 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00a430 tx=0x7f43ec00a8f0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 -- 172.21.15.170:0/727341218 shutdown_connections 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 --2- 172.21.15.170:0/727341218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c2add020 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 -- 172.21.15.170:0/727341218 >> 172.21.15.170:0/727341218 conn(0x55e2c29d77d0 msgr2=0x55e2c2ad96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 -- 172.21.15.170:0/727341218 shutdown_connections 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 -- 172.21.15.170:0/727341218 wait complete. 2024-04-26T12:32:18.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.307+0000 7f43f6813800 1 Processor -- start 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f6813800 1 -- start start 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f6813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c294c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f6813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e2c2addef0 con 0x55e2c2adcc00 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f266f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c294c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f266f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c294c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44842/0 (socket says 172.21.15.170:44842) 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f266f640 1 -- 172.21.15.170:0/1228725732 learned_addr learned my addr 172.21.15.170:0/1228725732 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f266f640 1 -- 172.21.15.170:0/1228725732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c294a800 con 0x55e2c2adcc00 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f43f266f640 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c294c110 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00a930 tx=0x7f43ec003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f42d67fc640 1 -- 172.21.15.170:0/1228725732 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec020020 con 0x55e2c2adcc00 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.308+0000 7f42d67fc640 1 -- 172.21.15.170:0/1228725732 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0108b0 con 0x55e2c2adcc00 2024-04-26T12:32:18.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.309+0000 7f42d67fc640 1 -- 172.21.15.170:0/1228725732 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec015040 con 0x55e2c2adcc00 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.309+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c294aa90 con 0x55e2c2adcc00 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.309+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c294af30 con 0x55e2c2adcc00 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.309+0000 7f42d67fc640 1 -- 172.21.15.170:0/1228725732 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43ec023020 con 0x55e2c2adcc00 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.309+0000 7f42d67fc640 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42cc036950 0x7f42cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f42d67fc640 1 -- 172.21.15.170:0/1228725732 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f43ec04bfa0 con 0x55e2c2adcc00 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f166d640 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42cc036950 0x7f42cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f6813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f6813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f166d640 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42cc036950 0x7f42cc038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e2c2ad8b20 tx=0x7f43e8001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f6813800 1 Processor -- start 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f6813800 1 -- start start 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f6813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2b009e0 0x55e2c2b00e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.310+0000 7f43f6813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55e2c2ac8370 con 0x55e2c2b009e0 2024-04-26T12:32:18.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f43f1e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2b009e0 0x55e2c2b00e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f43f1e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2b009e0 0x55e2c2b00e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44856/0 (socket says 172.21.15.170:44856) 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f43f1e6e640 1 -- 172.21.15.170:0/2803603266 learned_addr learned my addr 172.21.15.170:0/2803603266 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f43f1e6e640 1 -- 172.21.15.170:0/2803603266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c2b01340 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2b009e0 0x55e2c2b00e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f43e4077570 tx=0x7f43e405d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f42b67e4640 1 -- 172.21.15.170:0/2803603266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4054df0 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f42b67e4640 1 -- 172.21.15.170:0/2803603266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4054080 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f42b67e4640 1 -- 172.21.15.170:0/2803603266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4054360 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.311+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2c2b01db0 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.312+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c2b022b0 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.312+0000 7f42b67e4640 1 -- 172.21.15.170:0/2803603266 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43e4084070 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.312+0000 7f42b67e4640 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4234036950 0x7f4234038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.312+0000 7f42b67e4640 1 -- 172.21.15.170:0/2803603266 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f43e4097d50 con 0x55e2c2b009e0 2024-04-26T12:32:18.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.312+0000 7f43f166d640 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4234036950 0x7f4234038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.313+0000 7f4227fff640 20 reqs_thread_entry: start 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.313+0000 7f43f166d640 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4234036950 0x7f4234038e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43e8000f60 tx=0x7f43e800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.313+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e2c2b0e3e0 0x55e2c2b10880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.313+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2c2b10f50 con 0x55e2c2b0e3e0 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.313+0000 7f43f266f640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e2c2b0e3e0 0x55e2c2b10880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.313+0000 7f43f266f640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e2c2b0e3e0 0x55e2c2b10880 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.314+0000 7f43f266f640 1 -- 172.21.15.170:0/24065324 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43ec010d70 con 0x55e2c2b0e3e0 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.314+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e2c2b12c10 0x55e2c2b150d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.314+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:2 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2c2b15860 con 0x55e2c2b12c10 2024-04-26T12:32:18.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.314+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e2c2b12c10 0x55e2c2b150d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.314+0000 7f43f1e6e640 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e2c2b12c10 0x55e2c2b150d0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.314+0000 7f43f1e6e640 1 -- 172.21.15.170:0/24065324 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(2 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f43e409c020 con 0x55e2c2b12c10 2024-04-26T12:32:18.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.315+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2c2b12050 con 0x55e2c2b12c10 2024-04-26T12:32:18.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.316+0000 7f43f1e6e640 1 -- 172.21.15.170:0/24065324 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [stat,call,call,writefull 0~993] v32'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f43e409c020 con 0x55e2c2b12c10 2024-04-26T12:32:18.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42cc036950 msgr2=0x7f42cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42cc036950 0x7f42cc038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55e2c2ad8b20 tx=0x7f43e8001320 comp rx=0 tx=0).stop 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 msgr2=0x55e2c294c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c294c110 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00a930 tx=0x7f43ec003370 comp rx=0 tx=0).stop 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 shutdown_connections 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42cc036950 0x7f42cc038e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/1228725732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2adcc00 0x55e2c294c110 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 >> 172.21.15.170:0/1228725732 conn(0x55e2c29d77d0 msgr2=0x55e2c2ad6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 shutdown_connections 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/1228725732 wait complete. 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4234036950 msgr2=0x7f4234038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4234036950 0x7f4234038e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43e8000f60 tx=0x7f43e800f000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2b009e0 msgr2=0x55e2c2b00e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2b009e0 0x55e2c2b00e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f43e4077570 tx=0x7f43e405d810 comp rx=0 tx=0).stop 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 shutdown_connections 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4234036950 0x7f4234038e10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 --2- 172.21.15.170:0/2803603266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c2b009e0 0x55e2c2b00e00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 >> 172.21.15.170:0/2803603266 conn(0x55e2c2af5470 msgr2=0x55e2c2af5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 shutdown_connections 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.317+0000 7f43f6813800 1 -- 172.21.15.170:0/2803603266 wait complete. 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e2c2b12c10 msgr2=0x55e2c2b150d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e2c2b12c10 0x55e2c2b150d0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e2c2b0e3e0 msgr2=0x55e2c2b10880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e2c2b0e3e0 0x55e2c2b10880 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42d8036950 msgr2=0x7f42d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42d8036950 0x7f42d8038e10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43e4055040 tx=0x7f43e4076720 comp rx=0 tx=0).stop 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 msgr2=0x55e2c2acf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2acf570 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f43e4052540 tx=0x7f43e4003020 comp rx=0 tx=0).stop 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 shutdown_connections 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55e2c2b12c10 0x55e2c2b150d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55e2c2b0e3e0 0x55e2c2b10880 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f42d8036950 0x7f42d8038e10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 --2- 172.21.15.170:0/24065324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e2c29d66b0 0x55e2c2acf570 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 >> 172.21.15.170:0/24065324 conn(0x55e2c29d1c70 msgr2=0x55e2c2ac66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 shutdown_connections 2024-04-26T12:32:18.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.318+0000 7f43f6813800 1 -- 172.21.15.170:0/24065324 wait complete. 2024-04-26T12:32:18.331 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-26T12:32:18.331 DEBUG:tasks.util.rgw: json result: {'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-26T12:32:18.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-26T12:32:18.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-26T12:32:18.332 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-26T12:32:18.372 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.372 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.372+0000 7fe3d79dc800 1 Processor -- start 2024-04-26T12:32:18.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.372+0000 7fe3d79dc800 1 -- start start 2024-04-26T12:32:18.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3d79dc800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x555f68c86b00 0x555f68c88ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3d79dc800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f68b2f0c0 con 0x555f68c82ff0 2024-04-26T12:32:18.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3d79dc800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x555f68b134d0 con 0x555f68c86b00 2024-04-26T12:32:18.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3cccda640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x555f68c86b00 0x555f68c88ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3cccda640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x555f68c86b00 0x555f68c88ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44866/0 (socket says 172.21.15.170:44866) 2024-04-26T12:32:18.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3d54db640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x555f68c82ff0 0x555f68c853e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58782/0 (socket says 172.21.15.170:58782) 2024-04-26T12:32:18.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3cccda640 1 -- 172.21.15.170:0/40286646 learned_addr learned my addr 172.21.15.170:0/40286646 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3cccda640 1 -- 172.21.15.170:0/40286646 >> v1:172.21.15.132:6789/0 conn(0x555f68c82ff0 legacy=0x555f68c853e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.373+0000 7fe3cccda640 1 -- 172.21.15.170:0/40286646 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f68b40d40 con 0x555f68c86b00 2024-04-26T12:32:18.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.375+0000 7fe3cccda640 1 --2- 172.21.15.170:0/40286646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c86b00 0x555f68c88ef0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000a520 tx=0x7fe3c001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d0e5fc56140c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.375+0000 7fe3d4cda640 1 -- 172.21.15.170:0/40286646 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c0057070 con 0x555f68c86b00 2024-04-26T12:32:18.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.375+0000 7fe3d4cda640 1 -- 172.21.15.170:0/40286646 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c0052570 con 0x555f68c86b00 2024-04-26T12:32:18.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.375+0000 7fe3d4cda640 1 -- 172.21.15.170:0/40286646 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c004ae60 con 0x555f68c86b00 2024-04-26T12:32:18.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.376+0000 7fe3d79dc800 1 -- 172.21.15.170:0/40286646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c86b00 msgr2=0x555f68c88ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.376+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/40286646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c86b00 0x555f68c88ef0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000a520 tx=0x7fe3c001d010 comp rx=0 tx=0).stop 2024-04-26T12:32:18.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.376+0000 7fe3d79dc800 1 -- 172.21.15.170:0/40286646 shutdown_connections 2024-04-26T12:32:18.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.376+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/40286646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c86b00 0x555f68c88ef0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.376+0000 7fe3d79dc800 1 -- 172.21.15.170:0/40286646 >> 172.21.15.170:0/40286646 conn(0x555f68c7c980 msgr2=0x555f68c7eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.376+0000 7fe3d79dc800 1 -- 172.21.15.170:0/40286646 shutdown_connections 2024-04-26T12:32:18.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.376+0000 7fe3d79dc800 1 -- 172.21.15.170:0/40286646 wait complete. 2024-04-26T12:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.387+0000 7fe3d79dc800 1 Processor -- start 2024-04-26T12:32:18.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.387+0000 7fe3d79dc800 1 -- start start 2024-04-26T12:32:18.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe3d79dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68d73740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe3d79dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555f68bcdb30 con 0x555f68c82ff0 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe3d54db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68d73740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe3d54db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68d73740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44880/0 (socket says 172.21.15.170:44880) 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe3d54db640 1 -- 172.21.15.170:0/3430294417 learned_addr learned my addr 172.21.15.170:0/3430294417 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe3d54db640 1 -- 172.21.15.170:0/3430294417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f68b3f590 con 0x555f68c82ff0 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe3d54db640 1 --2- 172.21.15.170:0/3430294417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68d73740 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001e90 tx=0x7fe3c800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de1939ad1bdbe94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe2c3606640 1 -- 172.21.15.170:0/3430294417 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c800e5c0 con 0x555f68c82ff0 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe2c3606640 1 -- 172.21.15.170:0/3430294417 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8006070 con 0x555f68c82ff0 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.388+0000 7fe2c3606640 1 -- 172.21.15.170:0/3430294417 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c800e890 con 0x555f68c82ff0 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.389+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3430294417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 msgr2=0x555f68d73740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.389+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/3430294417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68d73740 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001e90 tx=0x7fe3c800b6c0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.389+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3430294417 shutdown_connections 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.389+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/3430294417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68d73740 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.389+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3430294417 >> 172.21.15.170:0/3430294417 conn(0x555f68c7c980 msgr2=0x555f68d6f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.389+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3430294417 shutdown_connections 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.389+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3430294417 wait complete. 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d79dc800 1 Processor -- start 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d79dc800 1 -- start start 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d79dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68c82930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d79dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555f68c8b740 con 0x555f68c82ff0 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d54db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68c82930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d54db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68c82930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44886/0 (socket says 172.21.15.170:44886) 2024-04-26T12:32:18.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d54db640 1 -- 172.21.15.170:0/1963428623 learned_addr learned my addr 172.21.15.170:0/1963428623 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.390+0000 7fe3d54db640 1 -- 172.21.15.170:0/1963428623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f68b368f0 con 0x555f68c82ff0 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.391+0000 7fe3d54db640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68c82930 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001ed0 tx=0x7fe3c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.391+0000 7fe2c1e03640 1 -- 172.21.15.170:0/1963428623 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c801a880 con 0x555f68c82ff0 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.391+0000 7fe2c1e03640 1 -- 172.21.15.170:0/1963428623 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c801aa20 con 0x555f68c82ff0 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.391+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f68c81020 con 0x555f68c82ff0 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.391+0000 7fe2c1e03640 1 -- 172.21.15.170:0/1963428623 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c801ad40 con 0x555f68c82ff0 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.391+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f68c81540 con 0x555f68c82ff0 2024-04-26T12:32:18.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.391+0000 7fe3d79dc800 1 Processor -- start 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d79dc800 1 -- start start 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe2c1e03640 1 -- 172.21.15.170:0/1963428623 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe3c8017070 con 0x555f68c82ff0 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d79dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d8adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d79dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555f68b73e60 con 0x555f68d8a990 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe2c1e03640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2bc036950 0x7fe2bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe2c1e03640 1 -- 172.21.15.170:0/1963428623 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fe3c8015020 con 0x555f68c82ff0 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d5cdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d8adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d54db640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2bc036950 0x7fe2bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d5cdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d8adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44900/0 (socket says 172.21.15.170:44900) 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d5cdc640 1 -- 172.21.15.170:0/3760897291 learned_addr learned my addr 172.21.15.170:0/3760897291 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d5cdc640 1 -- 172.21.15.170:0/3760897291 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f68d8b2f0 con 0x555f68d8a990 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d54db640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2bc036950 0x7fe2bc038e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe3c801c5c0 tx=0x7fe3c801c550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe3d5cdc640 1 --2- 172.21.15.170:0/3760897291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d8adb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000a430 tx=0x7fe3d000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89adba44b28b3e11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe2bb7fe640 1 -- 172.21.15.170:0/3760897291 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d0015070 con 0x555f68d8a990 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.392+0000 7fe2bb7fe640 1 -- 172.21.15.170:0/3760897291 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d0001670 con 0x555f68d8a990 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe2bb7fe640 1 -- 172.21.15.170:0/3760897291 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d0001990 con 0x555f68d8a990 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3760897291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 msgr2=0x555f68d8adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/3760897291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d8adb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000a430 tx=0x7fe3d000a8f0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3760897291 shutdown_connections 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/3760897291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d8adb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3760897291 >> 172.21.15.170:0/3760897291 conn(0x555f68c86b00 msgr2=0x555f68d87430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3760897291 shutdown_connections 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 -- 172.21.15.170:0/3760897291 wait complete. 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 Processor -- start 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 -- start start 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d91e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d79dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555f68d8bc80 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.393+0000 7fe3d5cdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d91e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe3d5cdc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d91e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44908/0 (socket says 172.21.15.170:44908) 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe3d5cdc640 1 -- 172.21.15.170:0/342963386 learned_addr learned my addr 172.21.15.170:0/342963386 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe3d5cdc640 1 -- 172.21.15.170:0/342963386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f68d92390 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe3d5cdc640 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d91e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0013040 tx=0x7fe3d0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe2b9ffb640 1 -- 172.21.15.170:0/342963386 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d0020020 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe2b9ffb640 1 -- 172.21.15.170:0/342963386 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d00108e0 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f68d92620 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe2b9ffb640 1 -- 172.21.15.170:0/342963386 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d0015040 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.394+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f68d952d0 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.395+0000 7fe2b9ffb640 1 -- 172.21.15.170:0/342963386 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe3d0023020 con 0x555f68d8a990 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.395+0000 7fe2b9ffb640 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2ac036950 0x7fe2ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.395+0000 7fe2b9ffb640 1 -- 172.21.15.170:0/342963386 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fe3d004c130 con 0x555f68d8a990 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.395+0000 7fe3cccda640 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2ac036950 0x7fe2ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.395+0000 7fe3d79dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.395+0000 7fe3d79dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.395+0000 7fe3d79dc800 1 Processor -- start 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d79dc800 1 -- start start 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3cccda640 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2ac036950 0x7fe2ac038e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0054000 tx=0x7fe3c004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d79dc800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68dac560 0x555f68dac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d79dc800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x555f68d73ec0 con 0x555f68dac560 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d54db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68dac560 0x555f68dac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d54db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68dac560 0x555f68dac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44912/0 (socket says 172.21.15.170:44912) 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d54db640 1 -- 172.21.15.170:0/4250260227 learned_addr learned my addr 172.21.15.170:0/4250260227 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d54db640 1 -- 172.21.15.170:0/4250260227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f68dacec0 con 0x555f68dac560 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d54db640 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68dac560 0x555f68dac980 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001570 tx=0x7fe3c801b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe299fe3640 1 -- 172.21.15.170:0/4250260227 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c8028260 con 0x555f68dac560 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe299fe3640 1 -- 172.21.15.170:0/4250260227 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8028400 con 0x555f68dac560 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f68dad930 con 0x555f68dac560 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe299fe3640 1 -- 172.21.15.170:0/4250260227 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c80286e0 con 0x555f68dac560 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.396+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f68dade30 con 0x555f68dac560 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.397+0000 7fe299fe3640 1 -- 172.21.15.170:0/4250260227 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe3c800f5f0 con 0x555f68dac560 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.397+0000 7fe299fe3640 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe218036950 0x7fe218038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.397+0000 7fe299fe3640 1 -- 172.21.15.170:0/4250260227 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fe3c8045b00 con 0x555f68dac560 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.397+0000 7fe3cccda640 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe218036950 0x7fe218038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.397+0000 7fe2137fe640 20 reqs_thread_entry: start 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555f68dba020 0x555f68dbc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f68dbca70 con 0x555f68dba020 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3cccda640 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe218036950 0x7fe218038e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe3c004b010 tx=0x7fe3c0005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d5cdc640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555f68dba020 0x555f68dbc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d5cdc640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555f68dba020 0x555f68dbc410 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d5cdc640 1 -- 172.21.15.170:0/1963428623 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3d000e070 con 0x555f68dba020 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f68dbcfd0 con 0x555f68dba020 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d5cdc640 1 -- 172.21.15.170:0/1963428623 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3d000e070 con 0x555f68dba020 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555f68dbebf0 0x555f68dc1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.398+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:3 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555f68dc1810 con 0x555f68dbebf0 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.399+0000 7fe3d54db640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555f68dbebf0 0x555f68dc1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.399+0000 7fe3d54db640 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555f68dbebf0 0x555f68dc1080 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.399+0000 7fe3d54db640 1 -- 172.21.15.170:0/1963428623 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(3 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe3c802e070 con 0x555f68dbebf0 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2ac036950 msgr2=0x7fe2ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2ac036950 0x7fe2ac038e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0054000 tx=0x7fe3c004e000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 msgr2=0x555f68d91e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d91e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0013040 tx=0x7fe3d0003370 comp rx=0 tx=0).stop 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 shutdown_connections 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2ac036950 0x7fe2ac038e10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/342963386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68d8a990 0x555f68d91e50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 >> 172.21.15.170:0/342963386 conn(0x555f68c86b00 msgr2=0x555f68d84a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 shutdown_connections 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/342963386 wait complete. 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe218036950 msgr2=0x7fe218038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe218036950 0x7fe218038e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe3c004b010 tx=0x7fe3c0005ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68dac560 msgr2=0x555f68dac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68dac560 0x555f68dac980 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001570 tx=0x7fe3c801b500 comp rx=0 tx=0).stop 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 shutdown_connections 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe218036950 0x7fe218038e10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/4250260227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68dac560 0x555f68dac980 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 >> 172.21.15.170:0/4250260227 conn(0x555f68da1010 msgr2=0x555f68da1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 shutdown_connections 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/4250260227 wait complete. 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555f68dba020 msgr2=0x555f68dbc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555f68dba020 0x555f68dbc410 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555f68dbebf0 msgr2=0x555f68dc1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.400+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555f68dbebf0 0x555f68dc1080 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2bc036950 msgr2=0x7fe2bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2bc036950 0x7fe2bc038e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe3c801c5c0 tx=0x7fe3c801c550 comp rx=0 tx=0).stop 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 msgr2=0x555f68c82930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68c82930 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001ed0 tx=0x7fe3c8000ed0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 shutdown_connections 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x555f68dbebf0 0x555f68dc1080 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x555f68dba020 0x555f68dbc410 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe2bc036950 0x7fe2bc038e10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 --2- 172.21.15.170:0/1963428623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555f68c82ff0 0x555f68c82930 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 >> 172.21.15.170:0/1963428623 conn(0x555f68c7c980 msgr2=0x555f68d72130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 shutdown_connections 2024-04-26T12:32:18.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.401+0000 7fe3d79dc800 1 -- 172.21.15.170:0/1963428623 wait complete. 2024-04-26T12:32:18.412 INFO:teuthology.orchestra.run.smithi170.stdout:{"id":"533c183d-6c44-41ed-a056-8506aff12524","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae","zones":[{"id":"1c3ccbd9-cd62-4733-b75e-94c1e85d1aae","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-26T12:32:18.412 DEBUG:tasks.util.rgw: json result: {'id': '533c183d-6c44-41ed-a056-8506aff12524', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae', 'zones': [{'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-04-26T12:32:18.415 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-26T12:32:18.433 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-26T12:32:18.433 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-26T12:32:18.433 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-26T12:32:18.508 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.508 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.507+0000 7f09fe32f800 1 Processor -- start 2024-04-26T12:32:18.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.508+0000 7f09fe32f800 1 -- start start 2024-04-26T12:32:18.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.508+0000 7f09fe32f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x559eb9843ad0 0x559eb9845ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.508+0000 7f09fe32f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559eb96ec0c0 con 0x559eb983ffc0 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.508+0000 7f09fe32f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x559eb96d04d0 con 0x559eb9843ad0 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.508+0000 7f09f9fae640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x559eb983ffc0 0x559eb98423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58796/0 (socket says 172.21.15.170:58796) 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.508+0000 7f09f9fae640 1 -- 172.21.15.170:0/2879038660 learned_addr learned my addr 172.21.15.170:0/2879038660 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.508+0000 7f09f97ad640 1 --2- 172.21.15.170:0/2879038660 >> v2:172.21.15.132:3300/0 conn(0x559eb9843ad0 0x559eb9845ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.509+0000 7f09f8fac640 1 -- 172.21.15.170:0/2879038660 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420888939 0 0) 0x559eb96ec0c0 con 0x559eb983ffc0 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.509+0000 7f09f8fac640 1 -- 172.21.15.170:0/2879038660 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09e4001e10 con 0x559eb983ffc0 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.509+0000 7f09f97ad640 1 -- 172.21.15.170:0/2879038660 >> v1:172.21.15.132:6789/0 conn(0x559eb983ffc0 legacy=0x559eb98423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.509+0000 7f09f97ad640 1 -- 172.21.15.170:0/2879038660 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb96fdd40 con 0x559eb9843ad0 2024-04-26T12:32:18.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.511+0000 7f09f97ad640 1 --2- 172.21.15.170:0/2879038660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9843ad0 0x559eb9845ec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f09f000a470 tx=0x7f09f001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f00fdcdb86793d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.511+0000 7f09f8fac640 1 -- 172.21.15.170:0/2879038660 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0057070 con 0x559eb9843ad0 2024-04-26T12:32:18.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.511+0000 7f09f8fac640 1 -- 172.21.15.170:0/2879038660 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0052570 con 0x559eb9843ad0 2024-04-26T12:32:18.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.511+0000 7f09f8fac640 1 -- 172.21.15.170:0/2879038660 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0052870 con 0x559eb9843ad0 2024-04-26T12:32:18.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.512+0000 7f09fe32f800 1 -- 172.21.15.170:0/2879038660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9843ad0 msgr2=0x559eb9845ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.512+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2879038660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9843ad0 0x559eb9845ec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f09f000a470 tx=0x7f09f001cdb0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.512+0000 7f09fe32f800 1 -- 172.21.15.170:0/2879038660 shutdown_connections 2024-04-26T12:32:18.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.512+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2879038660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9843ad0 0x559eb9845ec0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.512+0000 7f09fe32f800 1 -- 172.21.15.170:0/2879038660 >> 172.21.15.170:0/2879038660 conn(0x559eb9839930 msgr2=0x559eb983bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.512+0000 7f09fe32f800 1 -- 172.21.15.170:0/2879038660 shutdown_connections 2024-04-26T12:32:18.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.512+0000 7f09fe32f800 1 -- 172.21.15.170:0/2879038660 wait complete. 2024-04-26T12:32:18.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.527+0000 7f09fe32f800 1 Processor -- start 2024-04-26T12:32:18.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.527+0000 7f09fe32f800 1 -- start start 2024-04-26T12:32:18.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.527+0000 7f09fe32f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb983f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.527+0000 7f09fe32f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559eb978aae0 con 0x559eb983ffc0 2024-04-26T12:32:18.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.527+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb983f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.528+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb983f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44932/0 (socket says 172.21.15.170:44932) 2024-04-26T12:32:18.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.528+0000 7f09f9fae640 1 -- 172.21.15.170:0/2209536574 learned_addr learned my addr 172.21.15.170:0/2209536574 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.528+0000 7f09f9fae640 1 -- 172.21.15.170:0/2209536574 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb96fc590 con 0x559eb983ffc0 2024-04-26T12:32:18.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.528+0000 7f09f9fae640 1 --2- 172.21.15.170:0/2209536574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb983f900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f09ec001de0 tx=0x7f09ec00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8339c2bb7d5a8ed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.528+0000 7f08e7e07640 1 -- 172.21.15.170:0/2209536574 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec012020 con 0x559eb983ffc0 2024-04-26T12:32:18.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.528+0000 7f08e7e07640 1 -- 172.21.15.170:0/2209536574 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec00e5a0 con 0x559eb983ffc0 2024-04-26T12:32:18.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.528+0000 7f08e7e07640 1 -- 172.21.15.170:0/2209536574 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec00e900 con 0x559eb983ffc0 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.529+0000 7f09fe32f800 1 -- 172.21.15.170:0/2209536574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 msgr2=0x559eb983f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.529+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2209536574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb983f900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f09ec001de0 tx=0x7f09ec00b6c0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.529+0000 7f09fe32f800 1 -- 172.21.15.170:0/2209536574 shutdown_connections 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.529+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2209536574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb983f900 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.529+0000 7f09fe32f800 1 -- 172.21.15.170:0/2209536574 >> 172.21.15.170:0/2209536574 conn(0x559eb9839930 msgr2=0x559eb992bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.529+0000 7f09fe32f800 1 -- 172.21.15.170:0/2209536574 shutdown_connections 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.529+0000 7f09fe32f800 1 -- 172.21.15.170:0/2209536574 wait complete. 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09fe32f800 1 Processor -- start 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09fe32f800 1 -- start start 2024-04-26T12:32:18.534 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09fe32f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb993a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09fe32f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559eb9848710 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb993a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb993a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44944/0 (socket says 172.21.15.170:44944) 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09f9fae640 1 -- 172.21.15.170:0/2883913041 learned_addr learned my addr 172.21.15.170:0/2883913041 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09f9fae640 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb96f38f0 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.530+0000 7f09f9fae640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb993a190 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c010 tx=0x7f09ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.531+0000 7f08e6604640 1 -- 172.21.15.170:0/2883913041 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec012030 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.531+0000 7f08e6604640 1 -- 172.21.15.170:0/2883913041 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec01a7a0 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.531+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559eb993a6d0 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.531+0000 7f08e6604640 1 -- 172.21.15.170:0/2883913041 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec01a950 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.531+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb993abf0 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.531+0000 7f08e6604640 1 -- 172.21.15.170:0/2883913041 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f09ec015020 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f08e6604640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08e0036950 0x7f08e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f08e6604640 1 -- 172.21.15.170:0/2883913041 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f09ec020030 con 0x559eb983ffc0 2024-04-26T12:32:18.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09f97ad640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08e0036950 0x7f08e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9843ad0 0x559eb9941200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb9941740 con 0x559eb9843ad0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09fa7af640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9843ad0 0x559eb9941200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09f97ad640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08e0036950 0x7f08e0038e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f09f0054000 tx=0x7f09f004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09fa7af640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9843ad0 0x559eb9941200 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09fa7af640 1 -- 172.21.15.170:0/2883913041 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9843ad0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.532+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb993e7d0 con 0x559eb9843ad0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.533+0000 7f09fa7af640 1 -- 172.21.15.170:0/2883913041 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9843ad0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.533+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb9943a90 0x559eb9945e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.533+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb9946570 con 0x559eb9943a90 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.533+0000 7f09f9fae640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb9943a90 0x559eb9945e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.533+0000 7f09f9fae640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb9943a90 0x559eb9945e80 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.534+0000 7f09f9fae640 1 -- 172.21.15.170:0/2883913041 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f09ec00dcd0 con 0x559eb9943a90 2024-04-26T12:32:18.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.534+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb9942a40 con 0x559eb9843ad0 2024-04-26T12:32:18.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.534+0000 7f09fa7af640 1 -- 172.21.15.170:0/2883913041 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9843ad0 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.534+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559eb99479d0 0x559eb9949e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.534+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb994a5f0 con 0x559eb99479d0 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.534+0000 7f09f97ad640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559eb99479d0 0x559eb9949e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.534+0000 7f09f97ad640 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559eb99479d0 0x559eb9949e60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09f97ad640 1 -- 172.21.15.170:0/2883913041 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f09f0052a40 con 0x559eb99479d0 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09fe32f800 1 Processor -- start 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09fe32f800 1 -- start start 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09fe32f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9958a50 0x559eb9958e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09fe32f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559eb9730e60 con 0x559eb9958a50 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9958a50 0x559eb9958e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9958a50 0x559eb9958e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44948/0 (socket says 172.21.15.170:44948) 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09f9fae640 1 -- 172.21.15.170:0/463007199 learned_addr learned my addr 172.21.15.170:0/463007199 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.535+0000 7f09f9fae640 1 -- 172.21.15.170:0/463007199 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb99593b0 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.536+0000 7f09f9fae640 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9958a50 0x559eb9958e70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b700 tx=0x7f09ec016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.536+0000 7f08df7fe640 1 -- 172.21.15.170:0/463007199 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec044db0 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.536+0000 7f08df7fe640 1 -- 172.21.15.170:0/463007199 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec040040 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.536+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559eb9959e20 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.536+0000 7f08df7fe640 1 -- 172.21.15.170:0/463007199 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec044480 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.536+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb995a320 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f08df7fe640 1 -- 172.21.15.170:0/463007199 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f09ec036020 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f08df7fe640 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08d4036900 0x7f08d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f08df7fe640 1 -- 172.21.15.170:0/463007199 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f09ec0462f0 con 0x559eb9958a50 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f09f97ad640 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08d4036900 0x7f08d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f09fe32f800 1 Processor -- start 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f09f97ad640 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08d4036900 0x7f08d4038dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x559eb9942040 tx=0x7f09f0005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f09fe32f800 1 -- start start 2024-04-26T12:32:18.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f09fe32f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb9965f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.537+0000 7f09fe32f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559eb983df80 con 0x559eb9965b70 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb9965f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb9965f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44954/0 (socket says 172.21.15.170:44954) 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f09f9fae640 1 -- 172.21.15.170:0/3199273072 learned_addr learned my addr 172.21.15.170:0/3199273072 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f09f9fae640 1 -- 172.21.15.170:0/3199273072 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb9966560 con 0x559eb9965b70 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f09f9fae640 1 --2- 172.21.15.170:0/3199273072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb9965f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f09ec039fb0 tx=0x7f09ec039cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb4b9d99d59bc18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f08dd7fa640 1 -- 172.21.15.170:0/3199273072 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec046110 con 0x559eb9965b70 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f08dd7fa640 1 -- 172.21.15.170:0/3199273072 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec05c030 con 0x559eb9965b70 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.538+0000 7f08dd7fa640 1 -- 172.21.15.170:0/3199273072 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec0497c0 con 0x559eb9965b70 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 -- 172.21.15.170:0/3199273072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 msgr2=0x559eb9965f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 --2- 172.21.15.170:0/3199273072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb9965f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f09ec039fb0 tx=0x7f09ec039cd0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 -- 172.21.15.170:0/3199273072 shutdown_connections 2024-04-26T12:32:18.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 --2- 172.21.15.170:0/3199273072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb9965f90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 -- 172.21.15.170:0/3199273072 >> 172.21.15.170:0/3199273072 conn(0x559eb9961e30 msgr2=0x559eb995fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 -- 172.21.15.170:0/3199273072 shutdown_connections 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 -- 172.21.15.170:0/3199273072 wait complete. 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 Processor -- start 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 -- start start 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb996cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.539+0000 7f09fe32f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x559eb9966c20 con 0x559eb9965b70 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb996cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f09f9fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb996cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44956/0 (socket says 172.21.15.170:44956) 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 learned_addr learned my addr 172.21.15.170:0/52342560 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb996d4f0 con 0x559eb9965b70 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f09f9fae640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb996cfb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f09ec039fb0 tx=0x7f09ec046050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f08cb7fe640 1 -- 172.21.15.170:0/52342560 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec071070 con 0x559eb9965b70 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f08cb7fe640 1 -- 172.21.15.170:0/52342560 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec00c6a0 con 0x559eb9965b70 2024-04-26T12:32:18.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559eb996d4f0 con 0x559eb9965b70 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f08cb7fe640 1 -- 172.21.15.170:0/52342560 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ec04cbf0 con 0x559eb9965b70 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.540+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb996d4f0 con 0x559eb9965b70 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.541+0000 7f08cb7fe640 1 -- 172.21.15.170:0/52342560 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f09ec074070 con 0x559eb9965b70 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.541+0000 7f08cb7fe640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c40368b0 0x7f08c4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.541+0000 7f08cb7fe640 1 -- 172.21.15.170:0/52342560 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f09ec01fab0 con 0x559eb9965b70 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.541+0000 7f09f97ad640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c40368b0 0x7f08c4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09f97ad640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c40368b0 0x7f08c4038d70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x559eb994a9f0 tx=0x7f09f004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9978590 0x559eb997aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb997b1a0 con 0x559eb9978590 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fa7af640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9978590 0x559eb997aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fa7af640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9978590 0x559eb997aa50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fe32f800 20 realm 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.542+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb997b5b0 con 0x559eb9978590 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb997be80 con 0x559eb9978590 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb9978590 2024-04-26T12:32:18.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb997cf80 0x559eb997f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb997f930 con 0x559eb997cf80 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.543+0000 7f09f9fae640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb997cf80 0x559eb997f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.544+0000 7f09f9fae640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb997cf80 0x559eb997f370 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.544+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.544+0000 7f09fe32f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.544+0000 7f09fe32f800 20 searching for the correct realm 2024-04-26T12:32:18.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.544+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559eb99818e0 0x559eb9983da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.544+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb9984470 con 0x559eb99818e0 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.544+0000 7f09f97ad640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559eb99818e0 0x559eb9983da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09f97ad640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559eb99818e0 0x559eb9983da0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09f97ad640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f09f0076040 0x7f09f0083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb9984470 con 0x7f09f0076040 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09fa7af640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f09f0076040 0x7f09f0083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09fa7af640 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f09f0076040 0x7f09f0083410 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f09f400a4a0 con 0x7f09f0076040 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.545+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb997cf80 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.546+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.546+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb9978590 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.546+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.546+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb9978590 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.546+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.546+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb997cf80 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb997cf80 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x7f09f0076040 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f400a4a0 con 0x7f09f0076040 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb99818e0 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb9978590 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.547+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x7f09f0076040 2024-04-26T12:32:18.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f400a4a0 con 0x7f09f0076040 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb9978590 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f400a4a0 con 0x559eb9978590 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x7f09f0076040 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559eb997c220 con 0x559eb99818e0 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb99818e0 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb997cf80 2024-04-26T12:32:18.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb99818e0 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb99818e0 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.548+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb9978590 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.549+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.549+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb9978590 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.549+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.549+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb997cf80 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.549+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.549+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb99818e0 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.550+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.550+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x7f09f0076040 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.550+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.550+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb9978590 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.550+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.550+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb997cf80 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb99818e0 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb997cf80 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x7f09f0076040 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.551+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb99818e0 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb997cf80 2024-04-26T12:32:18.574 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x559eb9978590 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f09f0090040 con 0x7f09f0076040 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.552+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99801f0 con 0x559eb9978590 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99801f0 con 0x559eb9978590 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99801f0 con 0x7f09f0076040 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 zone default found 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 4 Realm: () 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:18.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 zonegroup default 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.553+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb9980a90 con 0x559eb997cf80 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99862d0 con 0x559eb99818e0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb9986670 con 0x559eb99818e0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 20 started sync module instance, tier type = 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:18.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.554+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9985770 con 0x7f09f0076040 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.555+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.555+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94140206963872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9985770 con 0x7f09f0076040 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.555+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9987030 con 0x559eb9978590 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.556+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94140206963872] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.557+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.557+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94140206961824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9987030 con 0x559eb9978590 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.557+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb99879f0 con 0x559eb99818e0 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.558+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94140206961824] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.558+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.558+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94140206967680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9986fa0 con 0x559eb99818e0 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.558+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb99888e0 con 0x7f09f0076040 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.559+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.559+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94140206974480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9989080 con 0x7f09f0076040 2024-04-26T12:32:18.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.559+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9989b80 con 0x559eb9978590 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.559+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94140206967680] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.560+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94140206974480] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.560+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.560+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94140206978672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9989b40 con 0x559eb9978590 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.560+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998a450 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.561+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.561+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94140206981024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9989b40 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.561+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998b360 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.561+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94140206978672] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.562+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94140206981024] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.562+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.562+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94140206972432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998b700 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.563+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998bf90 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94140206972432] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94140206984768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998c1d0 con 0x559eb997cf80 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 20 add_watcher() i=0 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 20 add_watcher() i=1 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 20 add_watcher() i=2 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 20 add_watcher() i=3 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 20 add_watcher() i=4 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 20 add_watcher() i=5 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.564+0000 7f09fe32f800 20 add_watcher() i=6 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.565+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94140206984768] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.565+0000 7f09fe32f800 20 add_watcher() i=7 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.565+0000 7f09fe32f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.565+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb998f740 con 0x559eb9978590 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.565+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.565+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94140206987936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998cc30 con 0x559eb9978590 2024-04-26T12:32:18.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94140206987936] v32'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f08ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 5 note: GC not initialized 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f08aa7fc640 20 reqs_thread_entry: start 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 20 Filter name: none 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f081ffff640 20 reqs_thread_entry: start 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.567+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99c2f00 con 0x559eb997cf80 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99c1540 con 0x559eb9978590 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.568+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb99c1f60 con 0x559eb997cf80 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.569+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fe32f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fe32f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fe32f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94140207208832 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99c69a0 con 0x559eb9978590 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== watch-notify(notify (1) cookie 94140206978672 notify 137438953507 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f09f4018a50 con 0x559eb9978590 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f08dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94140206978672 notifier 4838 bl.length()=649 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f08dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f08dd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f08dd7fa640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f08bc003ea0 con 0x559eb9978590 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify cookie 94140207208832 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== watch-notify(notify_complete (2) cookie 94140207208832 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f09f4018cf0 con 0x559eb9978590 2024-04-26T12:32:18.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.570+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb99c1980 con 0x559eb9978590 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.571+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.571+0000 7f09fe32f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.571+0000 7f09fe32f800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.571+0000 7f09fe32f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.571+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94140207208832 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559eb99c69a0 con 0x559eb99818e0 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.571+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== watch-notify(notify (1) cookie 94140206967680 notify 137438953480 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f09f008a040 con 0x559eb99818e0 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.572+0000 7f08dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94140206967680 notifier 4838 bl.length()=177 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.572+0000 7f08dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-26T12:32:18.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.572+0000 7f08dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-26T12:32:18.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.572+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(68 notify.2 [notify cookie 94140207208832 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.572+0000 7f08dcff9640 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f082c003400 con 0x559eb99818e0 2024-04-26T12:32:18.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.572+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.572+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== watch-notify(notify_complete (2) cookie 94140207208832 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559eb96fdd40 con 0x559eb99818e0 2024-04-26T12:32:18.586 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:18.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.573+0000 7f08ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:18.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.573+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94140206987936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb99c53f0 con 0x559eb9978590 2024-04-26T12:32:18.591 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.574+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94140206987936] v32'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.574+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94140206963872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998baa0 con 0x7f09f0076040 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.575+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94140206963872] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.575+0000 7f09fe32f800 20 remove_watcher() i=0 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.575+0000 7f09fe32f800 2 removed watcher, disabling cache 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.575+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94140206961824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998baa0 con 0x559eb9978590 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.576+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94140206961824] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.576+0000 7f09fe32f800 20 remove_watcher() i=1 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.576+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94140206967680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb99854a0 con 0x559eb99818e0 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.577+0000 7f09f97ad640 1 -- 172.21.15.170:0/52342560 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94140206967680] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0081070 con 0x559eb99818e0 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.577+0000 7f09fe32f800 20 remove_watcher() i=2 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.577+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94140206974480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998baa0 con 0x7f09f0076040 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.578+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94140206974480] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x7f09f0076040 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.578+0000 7f09fe32f800 20 remove_watcher() i=3 2024-04-26T12:32:18.592 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.578+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94140206978672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998baa0 con 0x559eb9978590 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.579+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94140206978672] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f4033040 con 0x559eb9978590 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.579+0000 7f09fe32f800 20 remove_watcher() i=4 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.579+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94140206981024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998baa0 con 0x559eb997cf80 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.580+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94140206981024] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.580+0000 7f09fe32f800 20 remove_watcher() i=5 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.580+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94140206972432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb998baa0 con 0x559eb997cf80 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.581+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94140206972432] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.581+0000 7f09fe32f800 20 remove_watcher() i=6 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.581+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94140206984768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559eb9987e10 con 0x559eb997cf80 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09f9fae640 1 -- 172.21.15.170:0/52342560 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94140206984768] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09ec073030 con 0x559eb997cf80 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 20 remove_watcher() i=7 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb997cf80 msgr2=0x559eb997f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb997cf80 0x559eb997f370 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.593 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9978590 msgr2=0x559eb997aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9978590 0x559eb997aa50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f09f0076040 msgr2=0x7f09f0083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f09f0076040 0x7f09f0083410 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559eb99818e0 msgr2=0x559eb9983da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x559eb99818e0 0x559eb9983da0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c40368b0 msgr2=0x7f08c4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c40368b0 0x7f08c4038d70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x559eb994a9f0 tx=0x7f09f004f000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fa7af640 1 -- 172.21.15.170:0/52342560 reap_dead start 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 msgr2=0x559eb996cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb996cfb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f09ec039fb0 tx=0x7f09ec046050 comp rx=0 tx=0).stop 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 shutdown_connections 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 --2- 172.21.15.170:0/52342560 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9965b70 0x559eb996cfb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 >> 172.21.15.170:0/52342560 conn(0x559eb9961e30 msgr2=0x559eb995f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 shutdown_connections 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.582+0000 7f09fe32f800 1 -- 172.21.15.170:0/52342560 wait complete. 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08d4036900 msgr2=0x7f08d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08d4036900 0x7f08d4038dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x559eb9942040 tx=0x7f09f0005a00 comp rx=0 tx=0).stop 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9958a50 msgr2=0x559eb9958e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9958a50 0x559eb9958e70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b700 tx=0x7f09ec016b00 comp rx=0 tx=0).stop 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 shutdown_connections 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08d4036900 0x7f08d4038dc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/463007199 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb9958a50 0x559eb9958e70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 >> 172.21.15.170:0/463007199 conn(0x559eb994caf0 msgr2=0x559eb994cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 shutdown_connections 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/463007199 wait complete. 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb9943a90 msgr2=0x559eb9945e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.595 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x559eb9943a90 0x559eb9945e80 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9843ad0 msgr2=0x559eb9941200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x559eb9843ad0 0x559eb9941200 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559eb99479d0 msgr2=0x559eb9949e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x559eb99479d0 0x559eb9949e60 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08e0036950 msgr2=0x7f08e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08e0036950 0x7f08e0038e10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f09f0054000 tx=0x7f09f004e000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 msgr2=0x559eb993a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 --2- 172.21.15.170:0/2883913041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559eb983ffc0 0x559eb993a190 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c010 tx=0x7f09ec000ed0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fa7af640 1 -- 172.21.15.170:0/2883913041 reap_dead start 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 shutdown_connections 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 >> 172.21.15.170:0/2883913041 conn(0x559eb9839930 msgr2=0x559eb992bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 shutdown_connections 2024-04-26T12:32:18.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.583+0000 7f09fe32f800 1 -- 172.21.15.170:0/2883913041 wait complete. 2024-04-26T12:32:18.597 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:18.597 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:18.597 ERROR:root:0 2024-04-26T12:32:18.598 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:18.605 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000092578c239a070e69-00662b9ed2-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:32:18.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-26T12:32:18.615 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:18.615 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-26T12:32:18.627 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-26T12:32:18.628 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-26T12:32:18.643 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-26T12:32:18.643 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-26T12:32:18.652 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-26T12:32:18.652 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:18.656 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:18.656 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-26T12:32:18.660 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:18.661 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:18.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:18.661 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-04-26T12:32:18.705 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.705 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.704+0000 7fcba2430800 1 Processor -- start 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.704+0000 7fcba2430800 1 -- start start 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.704+0000 7fcba2430800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dad57ca400 0x55dad57ca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.704+0000 7fcba2430800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dad56780c0 con 0x55dad57cb660 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.704+0000 7fcba2430800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55dad565c4d0 con 0x55dad57ca400 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.705+0000 7fcb9d655640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dad57ca400 0x55dad57ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.705+0000 7fcb9d655640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55dad57ca400 0x55dad57ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44962/0 (socket says 172.21.15.170:44962) 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.705+0000 7fcb9d655640 1 -- 172.21.15.170:0/876839604 learned_addr learned my addr 172.21.15.170:0/876839604 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.705+0000 7fcb9ce54640 1 --1- 172.21.15.170:0/876839604 >> v1:172.21.15.132:6789/0 conn(0x55dad57cb660 0x55dad57cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58808/0 (socket says 172.21.15.170:58808) 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.705+0000 7fcb9d655640 1 -- 172.21.15.170:0/876839604 >> v1:172.21.15.132:6789/0 conn(0x55dad57cb660 legacy=0x55dad57cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.705+0000 7fcb9d655640 1 -- 172.21.15.170:0/876839604 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad5689d40 con 0x55dad57ca400 2024-04-26T12:32:18.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcb9d655640 1 --2- 172.21.15.170:0/876839604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad57ca820 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000a520 tx=0x7fcb9001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c64c0aee3df1f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcb8ffff640 1 -- 172.21.15.170:0/876839604 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90057070 con 0x55dad57ca400 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcb8ffff640 1 -- 172.21.15.170:0/876839604 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb90052570 con 0x55dad57ca400 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcb8ffff640 1 -- 172.21.15.170:0/876839604 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90052870 con 0x55dad57ca400 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcba2430800 1 -- 172.21.15.170:0/876839604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 msgr2=0x55dad57ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcba2430800 1 --2- 172.21.15.170:0/876839604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad57ca820 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000a520 tx=0x7fcb9001d010 comp rx=0 tx=0).stop 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcba2430800 1 -- 172.21.15.170:0/876839604 shutdown_connections 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcba2430800 1 --2- 172.21.15.170:0/876839604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad57ca820 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcba2430800 1 -- 172.21.15.170:0/876839604 >> 172.21.15.170:0/876839604 conn(0x55dad57c5a00 msgr2=0x55dad57c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcba2430800 1 -- 172.21.15.170:0/876839604 shutdown_connections 2024-04-26T12:32:18.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.707+0000 7fcba2430800 1 -- 172.21.15.170:0/876839604 wait complete. 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.719+0000 7fcba2430800 1 Processor -- start 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.719+0000 7fcba2430800 1 -- start start 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.719+0000 7fcba2430800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58bab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.719+0000 7fcba2430800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dad5716b70 con 0x55dad57ca400 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58bab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58bab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44972/0 (socket says 172.21.15.170:44972) 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fcb9d655640 1 -- 172.21.15.170:0/4113098701 learned_addr learned my addr 172.21.15.170:0/4113098701 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fcb9d655640 1 -- 172.21.15.170:0/4113098701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad5688590 con 0x55dad57ca400 2024-04-26T12:32:18.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fcb9d655640 1 --2- 172.21.15.170:0/4113098701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58bab30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb90055040 tx=0x7fcb9004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3895c9a101a4774 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fca8b606640 1 -- 172.21.15.170:0/4113098701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90057040 con 0x55dad57ca400 2024-04-26T12:32:18.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fca8b606640 1 -- 172.21.15.170:0/4113098701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb90052870 con 0x55dad57ca400 2024-04-26T12:32:18.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.720+0000 7fca8b606640 1 -- 172.21.15.170:0/4113098701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90052b90 con 0x55dad57ca400 2024-04-26T12:32:18.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 -- 172.21.15.170:0/4113098701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 msgr2=0x55dad58bab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 --2- 172.21.15.170:0/4113098701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58bab30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb90055040 tx=0x7fcb9004c000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 -- 172.21.15.170:0/4113098701 shutdown_connections 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 --2- 172.21.15.170:0/4113098701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58bab30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 -- 172.21.15.170:0/4113098701 >> 172.21.15.170:0/4113098701 conn(0x55dad57c5a00 msgr2=0x55dad58b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 -- 172.21.15.170:0/4113098701 shutdown_connections 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 -- 172.21.15.170:0/4113098701 wait complete. 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 Processor -- start 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 -- start start 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcba2430800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dad573dd70 con 0x55dad57ca400 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.721+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44976/0 (socket says 172.21.15.170:44976) 2024-04-26T12:32:18.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fcb9d655640 1 -- 172.21.15.170:0/2505375441 learned_addr learned my addr 172.21.15.170:0/2505375441 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fcb9d655640 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad567f8f0 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fcb9d655640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58c6800 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb90052540 tx=0x7fcb90003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fca89e03640 1 -- 172.21.15.170:0/2505375441 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90073070 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fca89e03640 1 -- 172.21.15.170:0/2505375441 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9005d440 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dad58c6d40 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fca89e03640 1 -- 172.21.15.170:0/2505375441 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90057070 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.722+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad58c7260 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fca89e03640 1 -- 172.21.15.170:0/2505375441 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb90076070 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fca89e03640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca84036950 0x7fca84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fca89e03640 1 -- 172.21.15.170:0/2505375441 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fcb9008db70 con 0x55dad57ca400 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca84036950 0x7fca84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad57cb660 0x55dad58cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad58cddb0 con 0x55dad57cb660 2024-04-26T12:32:18.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fcb9de56640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad57cb660 0x55dad58cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.723+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca84036950 0x7fca84038e10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb94000f60 tx=0x7fcb94006390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.724+0000 7fcb9de56640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad57cb660 0x55dad58cd870 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.724+0000 7fcb9de56640 1 -- 172.21.15.170:0/2505375441 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad57cb660 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.724+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad58cae40 con 0x55dad57cb660 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.724+0000 7fcb9de56640 1 -- 172.21.15.170:0/2505375441 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad57cb660 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.724+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad58d00a0 0x55dad58d2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.724+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad58d2b80 con 0x55dad58d00a0 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.724+0000 7fcb9d655640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad58d00a0 0x55dad58d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.725+0000 7fcb9d655640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad58d00a0 0x55dad58d2490 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.725+0000 7fcb9d655640 1 -- 172.21.15.170:0/2505375441 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb90075030 con 0x55dad58d00a0 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.725+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad58cf050 con 0x55dad57cb660 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.725+0000 7fcb9de56640 1 -- 172.21.15.170:0/2505375441 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad57cb660 2024-04-26T12:32:18.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.725+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dad58d4030 0x55dad58d6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.725+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad58d6be0 con 0x55dad58d4030 2024-04-26T12:32:18.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.725+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dad58d4030 0x55dad58d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.726+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dad58d4030 0x55dad58d6480 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.726+0000 7fcb9ce54640 1 -- 172.21.15.170:0/2505375441 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb9400bbf0 con 0x55dad58d4030 2024-04-26T12:32:18.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.726+0000 7fcba2430800 1 Processor -- start 2024-04-26T12:32:18.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.726+0000 7fcba2430800 1 -- start start 2024-04-26T12:32:18.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.726+0000 7fcba2430800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58e5060 0x55dad58e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.726+0000 7fcba2430800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dad56bce60 con 0x55dad58e5060 2024-04-26T12:32:18.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58e5060 0x55dad58e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58e5060 0x55dad58e5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44988/0 (socket says 172.21.15.170:44988) 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fcb9d655640 1 -- 172.21.15.170:0/4256846518 learned_addr learned my addr 172.21.15.170:0/4256846518 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fcb9d655640 1 -- 172.21.15.170:0/4256846518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad58e59c0 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fcb9d655640 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58e5060 0x55dad58e5480 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcb90006950 tx=0x7fcb90076ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fca82ffd640 1 -- 172.21.15.170:0/4256846518 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9005d980 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fca82ffd640 1 -- 172.21.15.170:0/4256846518 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb900069c0 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dad58e6430 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fca82ffd640 1 -- 172.21.15.170:0/4256846518 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90006ca0 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.727+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad58e6930 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.728+0000 7fca82ffd640 1 -- 172.21.15.170:0/4256846518 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb90076360 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.728+0000 7fca82ffd640 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca74036860 0x7fca74038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.728+0000 7fca82ffd640 1 -- 172.21.15.170:0/4256846518 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fcb9004b100 con 0x55dad58e5060 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.728+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca74036860 0x7fca74038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.728+0000 7fcba2430800 1 Processor -- start 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.728+0000 7fcba2430800 1 -- start start 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.728+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca74036860 0x7fca74038d20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400bfd0 tx=0x7fcb9400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fcba2430800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fcba2430800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dad58bb1f0 con 0x55dad58f21e0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:44992/0 (socket says 172.21.15.170:44992) 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fcb9d655640 1 -- 172.21.15.170:0/2620647265 learned_addr learned my addr 172.21.15.170:0/2620647265 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fcb9d655640 1 -- 172.21.15.170:0/2620647265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad58f2bd0 con 0x55dad58f21e0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fcb9d655640 1 --2- 172.21.15.170:0/2620647265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f2600 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcb90078700 tx=0x7fcb90089d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b924b8e5cf3def96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fca80ff9640 1 -- 172.21.15.170:0/2620647265 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90096400 con 0x55dad58f21e0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fca80ff9640 1 -- 172.21.15.170:0/2620647265 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb900a6030 con 0x55dad58f21e0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.729+0000 7fca80ff9640 1 -- 172.21.15.170:0/2620647265 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb90077d00 con 0x55dad58f21e0 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 -- 172.21.15.170:0/2620647265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 msgr2=0x55dad58f2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 --2- 172.21.15.170:0/2620647265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f2600 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcb90078700 tx=0x7fcb90089d10 comp rx=0 tx=0).stop 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 -- 172.21.15.170:0/2620647265 shutdown_connections 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 --2- 172.21.15.170:0/2620647265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f2600 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 -- 172.21.15.170:0/2620647265 >> 172.21.15.170:0/2620647265 conn(0x55dad58ee500 msgr2=0x55dad58ec560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 -- 172.21.15.170:0/2620647265 shutdown_connections 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 -- 172.21.15.170:0/2620647265 wait complete. 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 Processor -- start 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 -- start start 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcba2430800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55dad58f32f0 con 0x55dad58f21e0 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcb9d655640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45004/0 (socket says 172.21.15.170:45004) 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.730+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 learned_addr learned my addr 172.21.15.170:0/1448120962 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.731+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad58f9b70 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.731+0000 7fcb9d655640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f9630 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcb9008ad70 tx=0x7fcb90072f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.731+0000 7fca72ffd640 1 -- 172.21.15.170:0/1448120962 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb900ba070 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.731+0000 7fca72ffd640 1 -- 172.21.15.170:0/1448120962 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb90089480 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.731+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dad58f9b70 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.731+0000 7fca72ffd640 1 -- 172.21.15.170:0/1448120962 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9005ca90 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.731+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad58fa010 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fca72ffd640 1 -- 172.21.15.170:0/1448120962 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb900bd070 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fca72ffd640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fca72ffd640 1 -- 172.21.15.170:0/1448120962 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fcb900b2070 con 0x55dad58f21e0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca68036950 0x7fca68038e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400cfd0 tx=0x7fcb94010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad5904cf0 0x55dad59071b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad5907900 con 0x55dad5904cf0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.732+0000 7fcb9de56640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad5904cf0 0x55dad59071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcb9de56640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad5904cf0 0x55dad59071b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 20 realm 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad5907d10 con 0x55dad5904cf0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad59085e0 con 0x55dad5904cf0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad5904cf0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.733+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad59096e0 0x55dad590bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad590c0e0 con 0x55dad59096e0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcb9d655640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad59096e0 0x55dad590bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcb9d655640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad59096e0 0x55dad590bad0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 20 searching for the correct realm 2024-04-26T12:32:18.754 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dad590e090 0x55dad5910550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.734+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5910c20 con 0x55dad590e090 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.735+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dad590e090 0x55dad5910550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.735+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dad590e090 0x55dad5910550 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.735+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.735+0000 7fcb9ce54640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcb94032040 0x7fcb94009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.735+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5910c20 con 0x7fcb94032040 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.735+0000 7fcb9de56640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcb94032040 0x7fcb94009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.736+0000 7fcb9de56640 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcb94032040 0x7fcb94009410 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.736+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb9800a4a0 con 0x7fcb94032040 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.736+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad59096e0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.736+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.736+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad5904cf0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.755 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad5904cf0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad59096e0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad59096e0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.737+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x7fcb94032040 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9800a4a0 con 0x7fcb94032040 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad590e090 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad5904cf0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x7fcb94032040 2024-04-26T12:32:18.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9800a4a0 con 0x7fcb94032040 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad5904cf0 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9800a4a0 con 0x55dad5904cf0 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.738+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x7fcb94032040 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.739+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.739+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dad5908980 con 0x55dad590e090 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.739+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.739+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad590e090 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.739+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.739+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad59096e0 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.740+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.740+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad590e090 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.740+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.740+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad590e090 2024-04-26T12:32:18.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.740+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad5904cf0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad5904cf0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad59096e0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad590e090 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.741+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x7fcb94032040 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.742+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.742+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad5904cf0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.742+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.742+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad59096e0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.742+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.742+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad590e090 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad59096e0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x7fcb94032040 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad590e090 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.743+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad59096e0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x55dad5904cf0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb94040040 con 0x7fcb94032040 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad590c9a0 con 0x55dad5904cf0 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.744+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad590c9a0 con 0x55dad5904cf0 2024-04-26T12:32:18.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad590c9a0 con 0x7fcb94032040 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 zone default found 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 4 Realm: () 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 zonegroup default 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad590d240 con 0x55dad59096e0 2024-04-26T12:32:18.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.745+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad5912a80 con 0x55dad590e090 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcba2430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad5912e20 con 0x55dad590e090 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcba2430800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcba2430800 20 started sync module instance, tier type = 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcba2430800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:18.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.746+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5911f20 con 0x7fcb94032040 2024-04-26T12:32:18.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.747+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.747+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94398374290496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5911f20 con 0x7fcb94032040 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.747+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59137e0 con 0x55dad5904cf0 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.748+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94398374290496] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.748+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.748+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94398374288464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59137e0 con 0x55dad5904cf0 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.748+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59141a0 con 0x55dad590e090 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.749+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94398374288464] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.749+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.749+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94398374294320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5913750 con 0x55dad590e090 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.749+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5914f30 con 0x7fcb94032040 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.750+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.750+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94398374294320] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.750+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94398374300224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59157d0 con 0x7fcb94032040 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.750+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59157d0 con 0x55dad5904cf0 2024-04-26T12:32:18.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.751+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94398374300224] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.751+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.751+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94398374302288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5915c20 con 0x55dad5904cf0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.752+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5916710 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.752+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94398374302288] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.752+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.752+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94398374306272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5916b30 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.753+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59174f0 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.753+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.753+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94398374310496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5917cd0 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.753+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59187f0 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94398374306272] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94398374310496] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94398374314688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5917720 con 0x55dad59096e0 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 20 add_watcher() i=0 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 20 add_watcher() i=1 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 20 add_watcher() i=2 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 20 add_watcher() i=3 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 20 add_watcher() i=4 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 20 add_watcher() i=5 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.754+0000 7fcba2430800 20 add_watcher() i=6 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.755+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94398374314688] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.755+0000 7fcba2430800 20 add_watcher() i=7 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.755+0000 7fcba2430800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.755+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad591b7e0 con 0x55dad5904cf0 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.756+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.756+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94398374303344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5918c90 con 0x55dad5904cf0 2024-04-26T12:32:18.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94398374303344] v32'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fca53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fcba2430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fcba2430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fcba2430800 5 note: GC not initialized 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fca52fe5640 20 reqs_thread_entry: start 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fcba2430800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fcba2430800 20 Filter name: none 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fca50fe1640 20 reqs_thread_entry: start 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.757+0000 7fcba2430800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcba2430800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad594ee40 con 0x55dad59096e0 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcba2430800 20 rados_obj.operate() r=0 bl.length=473 2024-04-26T12:32:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcba2430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcba2430800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcba2430800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.758+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5955740 con 0x55dad59096e0 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.759+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.759+0000 7fcba2430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.759+0000 7fcba2430800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.759+0000 7fcba2430800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.759+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94398374564272 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dad5950e50 con 0x55dad5904cf0 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94398374302288 notify 137438953509 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fcb98018c90 con 0x55dad5904cf0 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fca80ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94398374302288 notifier 4845 bl.length()=636 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94398374564272 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fca80ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fca80ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fca80ff9640 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fca60003ea0 con 0x55dad5904cf0 2024-04-26T12:32:18.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.760+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94398374564272 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcb98046440 con 0x55dad5904cf0 2024-04-26T12:32:18.774 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.761+0000 7fca53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.761+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94398374303344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59546a0 con 0x55dad5904cf0 2024-04-26T12:32:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.762+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94398374303344] v32'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.762+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94398374290496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5915670 con 0x7fcb94032040 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.763+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94398374290496] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.763+0000 7fcba2430800 20 remove_watcher() i=0 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.763+0000 7fcba2430800 2 removed watcher, disabling cache 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.763+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94398374288464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5915670 con 0x55dad5904cf0 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.764+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94398374288464] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.764+0000 7fcba2430800 20 remove_watcher() i=1 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.764+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94398374294320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5915670 con 0x55dad590e090 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.765+0000 7fcb9ce54640 1 -- 172.21.15.170:0/1448120962 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94398374294320] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9402e030 con 0x55dad590e090 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.765+0000 7fcba2430800 20 remove_watcher() i=2 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.765+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94398374300224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5913330 con 0x7fcb94032040 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.766+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94398374300224] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x7fcb94032040 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.766+0000 7fcba2430800 20 remove_watcher() i=3 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.766+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94398374302288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5913330 con 0x55dad5904cf0 2024-04-26T12:32:18.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.767+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94398374302288] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb98033040 con 0x55dad5904cf0 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.767+0000 7fcba2430800 20 remove_watcher() i=4 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.767+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94398374306272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5915250 con 0x55dad59096e0 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.768+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94398374306272] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.768+0000 7fcba2430800 20 remove_watcher() i=5 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.768+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94398374310496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad5913330 con 0x55dad59096e0 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.769+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94398374310496] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.769+0000 7fcba2430800 20 remove_watcher() i=6 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.769+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94398374314688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dad59161e0 con 0x55dad59096e0 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcb9d655640 1 -- 172.21.15.170:0/1448120962 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94398374314688] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb900bc030 con 0x55dad59096e0 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 20 remove_watcher() i=7 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad59096e0 msgr2=0x55dad590bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad59096e0 0x55dad590bad0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad5904cf0 msgr2=0x55dad59071b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad5904cf0 0x55dad59071b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcb94032040 msgr2=0x7fcb94009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fcb94032040 0x7fcb94009410 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dad590e090 msgr2=0x55dad5910550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55dad590e090 0x55dad5910550 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca68036950 msgr2=0x7fca68038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca68036950 0x7fca68038e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400cfd0 tx=0x7fcb94010000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 msgr2=0x55dad58f9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcb9de56640 1 -- 172.21.15.170:0/1448120962 reap_dead start 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f9630 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcb9008ad70 tx=0x7fcb90072f10 comp rx=0 tx=0).stop 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 shutdown_connections 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 --2- 172.21.15.170:0/1448120962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58f21e0 0x55dad58f9630 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 >> 172.21.15.170:0/1448120962 conn(0x55dad58ee500 msgr2=0x55dad58ebb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 shutdown_connections 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.770+0000 7fcba2430800 1 -- 172.21.15.170:0/1448120962 wait complete. 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca74036860 msgr2=0x7fca74038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca74036860 0x7fca74038d20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400bfd0 tx=0x7fcb9400f000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58e5060 msgr2=0x55dad58e5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58e5060 0x55dad58e5480 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcb90006950 tx=0x7fcb90076ee0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 shutdown_connections 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca74036860 0x7fca74038d20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/4256846518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad58e5060 0x55dad58e5480 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 >> 172.21.15.170:0/4256846518 conn(0x55dad58d9100 msgr2=0x55dad58d9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 shutdown_connections 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/4256846518 wait complete. 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad58d00a0 msgr2=0x55dad58d2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55dad58d00a0 0x55dad58d2490 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad57cb660 msgr2=0x55dad58cd870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55dad57cb660 0x55dad58cd870 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dad58d4030 msgr2=0x55dad58d6480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55dad58d4030 0x55dad58d6480 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca84036950 msgr2=0x7fca84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fca84036950 0x7fca84038e10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcb94000f60 tx=0x7fcb94006390 comp rx=0 tx=0).stop 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 msgr2=0x55dad58c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 --2- 172.21.15.170:0/2505375441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55dad57ca400 0x55dad58c6800 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb90052540 tx=0x7fcb90003020 comp rx=0 tx=0).stop 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcb9de56640 1 -- 172.21.15.170:0/2505375441 reap_dead start 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 shutdown_connections 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 >> 172.21.15.170:0/2505375441 conn(0x55dad57c5a00 msgr2=0x55dad58b9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 shutdown_connections 2024-04-26T12:32:18.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.771+0000 7fcba2430800 1 -- 172.21.15.170:0/2505375441 wait complete. 2024-04-26T12:32:18.785 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:18.785 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:18.786 ERROR:root:0 2024-04-26T12:32:18.786 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-26T12:32:18.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-26T12:32:18.786 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-04-26T12:32:18.837 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.838 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.836+0000 7ffb75931800 1 Processor -- start 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.836+0000 7ffb75931800 1 -- start start 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.836+0000 7ffb75931800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x557c48559990 0x557c4855bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.836+0000 7ffb75931800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557c484020c0 con 0x557c48553770 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.836+0000 7ffb75931800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x557c483e64d0 con 0x557c48559990 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.837+0000 7ffb70e2e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x557c48559990 0x557c4855bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.837+0000 7ffb7162f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x557c48553770 0x557c48553b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58814/0 (socket says 172.21.15.170:58814) 2024-04-26T12:32:18.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.837+0000 7ffb7162f640 1 -- 172.21.15.170:0/2742864984 learned_addr learned my addr 172.21.15.170:0/2742864984 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:18.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.837+0000 7ffb70e2e640 1 -- 172.21.15.170:0/2742864984 >> v1:172.21.15.132:6789/0 conn(0x557c48553770 legacy=0x557c48553b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.837+0000 7ffb70e2e640 1 -- 172.21.15.170:0/2742864984 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c48413d40 con 0x557c48559990 2024-04-26T12:32:18.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.837+0000 7ffb63fff640 1 -- 172.21.15.170:0/2742864984 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89122779 0 0) 0x557c484020c0 con 0x557c48553770 2024-04-26T12:32:18.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.839+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/2742864984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c4855bd80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800a470 tx=0x7ffb6801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6363a6f0b991a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.839+0000 7ffb63fff640 1 -- 172.21.15.170:0/2742864984 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb68057070 con 0x557c48559990 2024-04-26T12:32:18.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.839+0000 7ffb63fff640 1 -- 172.21.15.170:0/2742864984 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb68052570 con 0x557c48559990 2024-04-26T12:32:18.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.839+0000 7ffb63fff640 1 -- 172.21.15.170:0/2742864984 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb68052870 con 0x557c48559990 2024-04-26T12:32:18.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.840+0000 7ffb75931800 1 -- 172.21.15.170:0/2742864984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 msgr2=0x557c4855bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.840+0000 7ffb75931800 1 --2- 172.21.15.170:0/2742864984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c4855bd80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800a470 tx=0x7ffb6801ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:18.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.840+0000 7ffb75931800 1 -- 172.21.15.170:0/2742864984 shutdown_connections 2024-04-26T12:32:18.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.840+0000 7ffb75931800 1 --2- 172.21.15.170:0/2742864984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c4855bd80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.840+0000 7ffb75931800 1 -- 172.21.15.170:0/2742864984 >> 172.21.15.170:0/2742864984 conn(0x557c4854f100 msgr2=0x557c48551520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.840+0000 7ffb75931800 1 -- 172.21.15.170:0/2742864984 shutdown_connections 2024-04-26T12:32:18.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.840+0000 7ffb75931800 1 -- 172.21.15.170:0/2742864984 wait complete. 2024-04-26T12:32:18.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.851+0000 7ffb75931800 1 Processor -- start 2024-04-26T12:32:18.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.851+0000 7ffb75931800 1 -- start start 2024-04-26T12:32:18.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.851+0000 7ffb75931800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48553770 0x557c485560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.851+0000 7ffb75931800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557c484a0ae0 con 0x557c48553770 2024-04-26T12:32:18.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48553770 0x557c485560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48553770 0x557c485560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45012/0 (socket says 172.21.15.170:45012) 2024-04-26T12:32:18.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffb7162f640 1 -- 172.21.15.170:0/3090578424 learned_addr learned my addr 172.21.15.170:0/3090578424 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffb7162f640 1 -- 172.21.15.170:0/3090578424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c48412590 con 0x557c48553770 2024-04-26T12:32:18.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffb7162f640 1 --2- 172.21.15.170:0/3090578424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48553770 0x557c485560a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b210 tx=0x7ffb6400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b0004fa90cd754 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffa5f606640 1 -- 172.21.15.170:0/3090578424 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64008070 con 0x557c48553770 2024-04-26T12:32:18.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffa5f606640 1 -- 172.21.15.170:0/3090578424 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6400d500 con 0x557c48553770 2024-04-26T12:32:18.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.852+0000 7ffa5f606640 1 -- 172.21.15.170:0/3090578424 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6400d840 con 0x557c48553770 2024-04-26T12:32:18.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 -- 172.21.15.170:0/3090578424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48553770 msgr2=0x557c485560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 --2- 172.21.15.170:0/3090578424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48553770 0x557c485560a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b210 tx=0x7ffb6400b6d0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 -- 172.21.15.170:0/3090578424 shutdown_connections 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 --2- 172.21.15.170:0/3090578424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48553770 0x557c485560a0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 -- 172.21.15.170:0/3090578424 >> 172.21.15.170:0/3090578424 conn(0x557c4854f100 msgr2=0x557c48641e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 -- 172.21.15.170:0/3090578424 shutdown_connections 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 -- 172.21.15.170:0/3090578424 wait complete. 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 Processor -- start 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.853+0000 7ffb75931800 1 -- start start 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb75931800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c48650320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb75931800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557c4855c620 con 0x557c48559990 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c48650320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c48650320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45020/0 (socket says 172.21.15.170:45020) 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb7162f640 1 -- 172.21.15.170:0/1698005522 learned_addr learned my addr 172.21.15.170:0/1698005522 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb7162f640 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c484098f0 con 0x557c48559990 2024-04-26T12:32:18.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb7162f640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c48650320 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b210 tx=0x7ffb64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffa5de03640 1 -- 172.21.15.170:0/1698005522 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6400f8b0 con 0x557c48559990 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffa5de03640 1 -- 172.21.15.170:0/1698005522 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6400fa50 con 0x557c48559990 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c48650860 con 0x557c48559990 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffa5de03640 1 -- 172.21.15.170:0/1698005522 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6400fd90 con 0x557c48559990 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.854+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c48650d80 con 0x557c48559990 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.855+0000 7ffa5de03640 1 -- 172.21.15.170:0/1698005522 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb64017040 con 0x557c48559990 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.855+0000 7ffa5de03640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa58036900 0x7ffa58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.855+0000 7ffa5de03640 1 -- 172.21.15.170:0/1698005522 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7ffb64015020 con 0x557c48559990 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.855+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa58036900 0x7ffa58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.855+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c48655380 0x557c48657770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.855+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48657cf0 con 0x557c48655380 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb71e30640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c48655380 0x557c48657770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa58036900 0x7ffa58038dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffb68054000 tx=0x7ffb6804e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb71e30640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c48655380 0x557c48657770 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb71e30640 1 -- 172.21.15.170:0/1698005522 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c48655380 2024-04-26T12:32:18.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48654960 con 0x557c48655380 2024-04-26T12:32:18.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb71e30640 1 -- 172.21.15.170:0/1698005522 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c48655380 2024-04-26T12:32:18.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c4865a040 0x557c4865c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.856+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c4865cad0 con 0x557c4865a040 2024-04-26T12:32:18.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.857+0000 7ffb7162f640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c4865a040 0x557c4865c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.857+0000 7ffb7162f640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c4865a040 0x557c4865c430 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.857+0000 7ffb7162f640 1 -- 172.21.15.170:0/1698005522 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb6402d070 con 0x557c4865a040 2024-04-26T12:32:18.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.857+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48658ff0 con 0x557c48655380 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.858+0000 7ffb71e30640 1 -- 172.21.15.170:0/1698005522 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c48655380 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.858+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557c4865df80 0x557c486603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.858+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48660b50 con 0x557c4865df80 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.858+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557c4865df80 0x557c486603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.858+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557c4865df80 0x557c486603f0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.858+0000 7ffb70e2e640 1 -- 172.21.15.170:0/1698005522 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb68052940 con 0x557c4865df80 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb75931800 1 Processor -- start 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb75931800 1 -- start start 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb75931800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4866ef80 0x557c4866f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb75931800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557c48446e60 con 0x557c4866ef80 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4866ef80 0x557c4866f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4866ef80 0x557c4866f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45034/0 (socket says 172.21.15.170:45034) 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb7162f640 1 -- 172.21.15.170:0/2685467665 learned_addr learned my addr 172.21.15.170:0/2685467665 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb7162f640 1 -- 172.21.15.170:0/2685467665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4866f8e0 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.859+0000 7ffb7162f640 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4866ef80 0x557c4866f3a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffb6404b2c0 tx=0x7ffb64019840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffa56ffd640 1 -- 172.21.15.170:0/2685467665 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64044340 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffa56ffd640 1 -- 172.21.15.170:0/2685467665 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb640444e0 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c48670350 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffa56ffd640 1 -- 172.21.15.170:0/2685467665 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64044890 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c48670850 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffa56ffd640 1 -- 172.21.15.170:0/2685467665 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb6403f200 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffa56ffd640 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa48036900 0x7ffa48038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffa56ffd640 1 -- 172.21.15.170:0/2685467665 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7ffb6403bd40 con 0x557c4866ef80 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.860+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa48036900 0x7ffa48038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb75931800 1 Processor -- start 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb75931800 1 -- start start 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa48036900 0x7ffa48038dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x557c48654880 tx=0x7ffb68005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb75931800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c4867c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb75931800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557c48554720 con 0x557c4867c300 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c4867c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c4867c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45038/0 (socket says 172.21.15.170:45038) 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb7162f640 1 -- 172.21.15.170:0/2029393555 learned_addr learned my addr 172.21.15.170:0/2029393555 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb7162f640 1 -- 172.21.15.170:0/2029393555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4867ccf0 con 0x557c4867c300 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.861+0000 7ffb7162f640 1 --2- 172.21.15.170:0/2029393555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c4867c720 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffb6404ce30 tx=0x7ffb64039c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72954dcc85f9e064 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffa54ff9640 1 -- 172.21.15.170:0/2029393555 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64030d50 con 0x557c4867c300 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffa54ff9640 1 -- 172.21.15.170:0/2029393555 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6405d070 con 0x557c4867c300 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffa54ff9640 1 -- 172.21.15.170:0/2029393555 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64026d30 con 0x557c4867c300 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 -- 172.21.15.170:0/2029393555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 msgr2=0x557c4867c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 --2- 172.21.15.170:0/2029393555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c4867c720 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffb6404ce30 tx=0x7ffb64039c70 comp rx=0 tx=0).stop 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 -- 172.21.15.170:0/2029393555 shutdown_connections 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 --2- 172.21.15.170:0/2029393555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c4867c720 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 -- 172.21.15.170:0/2029393555 >> 172.21.15.170:0/2029393555 conn(0x557c48678620 msgr2=0x557c48676680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 -- 172.21.15.170:0/2029393555 shutdown_connections 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 -- 172.21.15.170:0/2029393555 wait complete. 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 Processor -- start 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 -- start start 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c48683750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.862+0000 7ffb75931800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557c4867d410 con 0x557c4867c300 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c48683750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffb7162f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c48683750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45054/0 (socket says 172.21.15.170:45054) 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 learned_addr learned my addr 172.21.15.170:0/923945531 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c48683c90 con 0x557c4867c300 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffb7162f640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c48683750 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ffb6405a040 tx=0x7ffb64004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffa46ffd640 1 -- 172.21.15.170:0/923945531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb64038340 con 0x557c4867c300 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffa46ffd640 1 -- 172.21.15.170:0/923945531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb640384e0 con 0x557c4867c300 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c48683c90 con 0x557c4867c300 2024-04-26T12:32:18.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffa46ffd640 1 -- 172.21.15.170:0/923945531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb640186c0 con 0x557c4867c300 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.863+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c48684130 con 0x557c4867c300 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.864+0000 7ffa46ffd640 1 -- 172.21.15.170:0/923945531 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb64072060 con 0x557c4867c300 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.864+0000 7ffa46ffd640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa3c036950 0x7ffa3c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.864+0000 7ffa46ffd640 1 -- 172.21.15.170:0/923945531 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7ffb6406cd00 con 0x557c4867c300 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.864+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa3c036950 0x7ffa3c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa3c036950 0x7ffa3c038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffb68052fd0 tx=0x7ffb6804f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c4868ed90 0x557c48691250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486919a0 con 0x557c4868ed90 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb71e30640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c4868ed90 0x557c48691250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb71e30640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c4868ed90 0x557c48691250 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb75931800 20 realm 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.865+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48691db0 con 0x557c4868ed90 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48692680 con 0x557c4868ed90 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c4868ed90 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c48693780 0x557c48695b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.866+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c48696180 con 0x557c48693780 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb7162f640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c48693780 0x557c48695b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb7162f640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c48693780 0x557c48695b70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb75931800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb75931800 20 searching for the correct realm 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557c486980c0 0x557c4869a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c4869ac00 con 0x557c486980c0 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.867+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557c486980c0 0x557c4869a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.868+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557c486980c0 0x557c4869a580 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.868+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.868+0000 7ffb70e2e640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffb68076040 0x7ffb68083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.868+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c4869ac00 con 0x7ffb68076040 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.868+0000 7ffb71e30640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffb68076040 0x7ffb68083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.868+0000 7ffb71e30640 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffb68076040 0x7ffb68083410 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x7ffb68076040 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c48693780 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c4868ed90 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c4868ed90 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.869+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c48693780 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c48693780 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x7ffb68076040 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x7ffb68076040 2024-04-26T12:32:18.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c486980c0 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.870+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c4868ed90 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x7ffb68076040 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x7ffb68076040 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c4868ed90 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c00a4a0 con 0x557c4868ed90 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x7ffb68076040 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557c48692a20 con 0x557c486980c0 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.871+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c486980c0 2024-04-26T12:32:18.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c48693780 2024-04-26T12:32:18.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c486980c0 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c486980c0 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.872+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c4868ed90 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c4868ed90 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c48693780 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c486980c0 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.873+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x7ffb68076040 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c4868ed90 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c48693780 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c486980c0 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.874+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c48693780 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x7ffb68076040 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c486980c0 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c48693780 2024-04-26T12:32:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.875+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x557c4868ed90 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ffb68090040 con 0x7ffb68076040 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486969d0 con 0x557c4868ed90 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486969d0 con 0x557c4868ed90 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.876+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486969d0 con 0x7ffb68076040 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 zone default found 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 4 Realm: () 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 zonegroup default 2024-04-26T12:32:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486972c0 con 0x557c48693780 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c4869ca60 con 0x557c486980c0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.877+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c4869ce00 con 0x557c486980c0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.878+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.878+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.878+0000 7ffb75931800 20 started sync module instance, tier type = 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.878+0000 7ffb75931800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.878+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869bf00 con 0x7ffb68076040 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.879+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.879+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93992279196704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869bf00 con 0x7ffb68076040 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.879+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869d7c0 con 0x557c4868ed90 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.880+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93992279196704] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.880+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.880+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93992279194672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869d7c0 con 0x557c4868ed90 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.880+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869e1c0 con 0x557c486980c0 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.881+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.881+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93992279203024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869ea60 con 0x557c486980c0 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.881+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869f520 con 0x7ffb68076040 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.881+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93992279194672] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.882+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93992279203024] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.882+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.882+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93992279205296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869d310 con 0x7ffb68076040 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.882+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869fdc0 con 0x557c4868ed90 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.883+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93992279205296] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.884+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.884+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93992279207920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869fd40 con 0x557c4868ed90 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.884+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a07d0 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.885+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.885+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93992279207920] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.885+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93992279212832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a1020 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.885+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a1560 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.886+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93992279212832] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.886+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.886+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93992279214960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a1e00 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.886+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a26b0 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93992279214960] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93992279220640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a28f0 con 0x557c48693780 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=0 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=1 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=2 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=3 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=4 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=5 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=6 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93992279220640] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 20 add_watcher() i=7 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.887+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486a5e60 con 0x557c4868ed90 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.888+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.888+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93992279218512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a3380 con 0x557c4868ed90 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93992279218512] v32'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffa27fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffb75931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffb75931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffb75931800 5 note: GC not initialized 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffa26fe5640 20 reqs_thread_entry: start 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffb75931800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.889+0000 7ffb75931800 20 Filter name: none 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffa24fe1640 20 reqs_thread_entry: start 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486d95c0 con 0x557c48693780 2024-04-26T12:32:18.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 20 rados->read ofs=0 len=0 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486d7c00 con 0x557c486980c0 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-26T12:32:18.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.890+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486d86c0 con 0x557c48693780 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb75931800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb75931800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb75931800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93992279443072 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486dd060 con 0x7ffb68076040 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== watch-notify(notify (1) cookie 93992279196704 notify 137438953497 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7ffb6c018cd0 con 0x7ffb68076040 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffa54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 93992279196704 notifier 4852 bl.length()=533 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(65 notify.0 [notify cookie 93992279443072 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffa54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffa54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffa54ff9640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ffa34003ea0 con 0x7ffb68076040 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== watch-notify(notify_complete (2) cookie 93992279443072 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffb6c046440 con 0x7ffb68076040 2024-04-26T12:32:18.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.892+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486d8680 con 0x557c486980c0 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.893+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v32'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.893+0000 7ffb75931800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.893+0000 7ffb75931800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.893+0000 7ffb75931800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.893+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93992279443072 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557c486dd060 con 0x557c4868ed90 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 93992279194672 notify 137438953510 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7ffb6c046440 con 0x557c4868ed90 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffa54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 93992279194672 notifier 4852 bl.length()=176 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffa54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffa54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffa54ff9640 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ffa34003ea0 con 0x557c4868ed90 2024-04-26T12:32:18.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(68 notify.1 [notify cookie 93992279443072 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.894+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 93992279443072 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffb6c0467b0 con 0x557c4868ed90 2024-04-26T12:32:18.908 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-04-26T12:32:18.892573Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.892555Z","tags":[],"group_ids":[]} 2024-04-26T12:32:18.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.895+0000 7ffa27fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:18.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.895+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93992279218512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c48688720 con 0x557c4868ed90 2024-04-26T12:32:18.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.896+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93992279218512] v32'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.896+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93992279196704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a1950 con 0x7ffb68076040 2024-04-26T12:32:18.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.897+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93992279196704] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.897+0000 7ffb75931800 20 remove_watcher() i=0 2024-04-26T12:32:18.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.897+0000 7ffb75931800 2 removed watcher, disabling cache 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.897+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93992279194672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869c400 con 0x557c4868ed90 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.898+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93992279194672] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.898+0000 7ffb75931800 20 remove_watcher() i=1 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.898+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93992279203024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869bc30 con 0x557c486980c0 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.899+0000 7ffb70e2e640 1 -- 172.21.15.170:0/923945531 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93992279203024] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb68081070 con 0x557c486980c0 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.899+0000 7ffb75931800 20 remove_watcher() i=2 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.899+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93992279205296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869bc30 con 0x7ffb68076040 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.900+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93992279205296] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x7ffb68076040 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.900+0000 7ffb75931800 20 remove_watcher() i=3 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.900+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93992279207920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869bc30 con 0x557c4868ed90 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.901+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93992279207920] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6c033040 con 0x557c4868ed90 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.901+0000 7ffb75931800 20 remove_watcher() i=4 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.901+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93992279212832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869bc30 con 0x557c48693780 2024-04-26T12:32:18.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.902+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93992279212832] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.902+0000 7ffb75931800 20 remove_watcher() i=5 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.902+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93992279214960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c486a0320 con 0x557c48693780 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.903+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93992279214960] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.903+0000 7ffb75931800 20 remove_watcher() i=6 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.903+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93992279220640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557c4869bc30 con 0x557c48693780 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb7162f640 1 -- 172.21.15.170:0/923945531 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93992279220640] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6402d070 con 0x557c48693780 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 20 remove_watcher() i=7 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c48693780 msgr2=0x557c48695b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c48693780 0x557c48695b70 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c4868ed90 msgr2=0x557c48691250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c4868ed90 0x557c48691250 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffb68076040 msgr2=0x7ffb68083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffb68076040 0x7ffb68083410 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557c486980c0 msgr2=0x557c4869a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557c486980c0 0x557c4869a580 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa3c036950 msgr2=0x7ffa3c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa3c036950 0x7ffa3c038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffb68052fd0 tx=0x7ffb6804f000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 msgr2=0x557c48683750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 --2- 172.21.15.170:0/923945531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4867c300 0x557c48683750 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ffb6405a040 tx=0x7ffb64004ee0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 reap_dead start 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb71e30640 1 -- 172.21.15.170:0/923945531 reap_dead start 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 shutdown_connections 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 >> 172.21.15.170:0/923945531 conn(0x557c48678620 msgr2=0x557c48675c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.904+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 shutdown_connections 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/923945531 wait complete. 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa48036900 msgr2=0x7ffa48038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa48036900 0x7ffa48038dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x557c48654880 tx=0x7ffb68005a00 comp rx=0 tx=0).stop 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4866ef80 msgr2=0x557c4866f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4866ef80 0x557c4866f3a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffb6404b2c0 tx=0x7ffb64019840 comp rx=0 tx=0).stop 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 shutdown_connections 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa48036900 0x7ffa48038dc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/2685467665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c4866ef80 0x557c4866f3a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 >> 172.21.15.170:0/2685467665 conn(0x557c48663020 msgr2=0x557c48663420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 shutdown_connections 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/2685467665 wait complete. 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c4865a040 msgr2=0x557c4865c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557c4865a040 0x557c4865c430 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c48655380 msgr2=0x557c48657770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557c48655380 0x557c48657770 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557c4865df80 msgr2=0x557c486603f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557c4865df80 0x557c486603f0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa58036900 msgr2=0x7ffa58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffa58036900 0x7ffa58038dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffb68054000 tx=0x7ffb6804e000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 msgr2=0x557c48650320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 --2- 172.21.15.170:0/1698005522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557c48559990 0x557c48650320 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b210 tx=0x7ffb64000ed0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb71e30640 1 -- 172.21.15.170:0/1698005522 reap_dead start 2024-04-26T12:32:18.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 shutdown_connections 2024-04-26T12:32:18.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 >> 172.21.15.170:0/1698005522 conn(0x557c4854f100 msgr2=0x557c48641a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 shutdown_connections 2024-04-26T12:32:18.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.905+0000 7ffb75931800 1 -- 172.21.15.170:0/1698005522 wait complete. 2024-04-26T12:32:18.919 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-26T12:32:18.892573Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.892555Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:18.919 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-26T12:32:18.892573Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.892555Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:18.919 ERROR:root:0 2024-04-26T12:32:18.920 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:18.924 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:18.924 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-04-26T12:32:18.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-04-26T12:32:18.925 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-04-26T12:32:18.967 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:18.968 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.966+0000 7f333e333800 1 Processor -- start 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.966+0000 7f333e333800 1 -- start start 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.966+0000 7f333e333800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562e374375c0 0x562e374379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.966+0000 7f333e333800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e372e40c0 con 0x562e37438730 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.966+0000 7f333e333800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x562e372c84d0 con 0x562e374375c0 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.967+0000 7f3339fd1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562e374375c0 0x562e374379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.967+0000 7f3339fd1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562e374375c0 0x562e374379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45070/0 (socket says 172.21.15.170:45070) 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.967+0000 7f3339fd1640 1 -- 172.21.15.170:0/2098680308 learned_addr learned my addr 172.21.15.170:0/2098680308 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.967+0000 7f3339fd1640 1 -- 172.21.15.170:0/2098680308 >> v1:172.21.15.132:6789/0 conn(0x562e37438730 legacy=0x562e37438bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.967+0000 7f3339fd1640 1 -- 172.21.15.170:0/2098680308 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e372f5d40 con 0x562e374375c0 2024-04-26T12:32:18.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f3339fd1640 1 --2- 172.21.15.170:0/2098680308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e374379e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f332c00a520 tx=0x7f332c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8fb69641ff292 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f3338fcf640 1 -- 172.21.15.170:0/2098680308 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c057070 con 0x562e374375c0 2024-04-26T12:32:18.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f3338fcf640 1 -- 172.21.15.170:0/2098680308 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c052570 con 0x562e374375c0 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f3338fcf640 1 -- 172.21.15.170:0/2098680308 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c04ae60 con 0x562e374375c0 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f333e333800 1 -- 172.21.15.170:0/2098680308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 msgr2=0x562e374379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f333e333800 1 --2- 172.21.15.170:0/2098680308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e374379e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f332c00a520 tx=0x7f332c01d010 comp rx=0 tx=0).stop 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f333e333800 1 -- 172.21.15.170:0/2098680308 shutdown_connections 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f333e333800 1 --2- 172.21.15.170:0/2098680308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e374379e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f333e333800 1 -- 172.21.15.170:0/2098680308 >> 172.21.15.170:0/2098680308 conn(0x562e37432b80 msgr2=0x562e37434fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f333e333800 1 -- 172.21.15.170:0/2098680308 shutdown_connections 2024-04-26T12:32:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.969+0000 7f333e333800 1 -- 172.21.15.170:0/2098680308 wait complete. 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.981+0000 7f333e333800 1 Processor -- start 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.981+0000 7f333e333800 1 -- start start 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.981+0000 7f333e333800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e37528bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.981+0000 7f333e333800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562e37382b40 con 0x562e374375c0 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.981+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e37528bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.981+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e37528bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45078/0 (socket says 172.21.15.170:45078) 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.981+0000 7f3339fd1640 1 -- 172.21.15.170:0/1620616475 learned_addr learned my addr 172.21.15.170:0/1620616475 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.982+0000 7f3339fd1640 1 -- 172.21.15.170:0/1620616475 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e372f4590 con 0x562e374375c0 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.982+0000 7f3339fd1640 1 --2- 172.21.15.170:0/1620616475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e37528bc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f332c055040 tx=0x7f332c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b125e2579830d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.982+0000 7f3227e07640 1 -- 172.21.15.170:0/1620616475 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c057040 con 0x562e374375c0 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.982+0000 7f3227e07640 1 -- 172.21.15.170:0/1620616475 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c052720 con 0x562e374375c0 2024-04-26T12:32:18.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.982+0000 7f3227e07640 1 -- 172.21.15.170:0/1620616475 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c052a40 con 0x562e374375c0 2024-04-26T12:32:18.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 -- 172.21.15.170:0/1620616475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 msgr2=0x562e37528bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:18.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 --2- 172.21.15.170:0/1620616475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e37528bc0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f332c055040 tx=0x7f332c04c000 comp rx=0 tx=0).stop 2024-04-26T12:32:18.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 -- 172.21.15.170:0/1620616475 shutdown_connections 2024-04-26T12:32:18.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 --2- 172.21.15.170:0/1620616475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e37528bc0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:18.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 -- 172.21.15.170:0/1620616475 >> 172.21.15.170:0/1620616475 conn(0x562e37432b80 msgr2=0x562e375244e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 -- 172.21.15.170:0/1620616475 shutdown_connections 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 -- 172.21.15.170:0/1620616475 wait complete. 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 Processor -- start 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 -- start start 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e375304a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f333e333800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562e37440ba0 con 0x562e374375c0 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e375304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e375304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45084/0 (socket says 172.21.15.170:45084) 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f3339fd1640 1 -- 172.21.15.170:0/641859776 learned_addr learned my addr 172.21.15.170:0/641859776 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.983+0000 7f3339fd1640 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e372eb8f0 con 0x562e374375c0 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.984+0000 7f3339fd1640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e375304a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f332c052540 tx=0x7f332c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.984+0000 7f3226604640 1 -- 172.21.15.170:0/641859776 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c073070 con 0x562e374375c0 2024-04-26T12:32:18.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.984+0000 7f3226604640 1 -- 172.21.15.170:0/641859776 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c052c90 con 0x562e374375c0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.984+0000 7f3226604640 1 -- 172.21.15.170:0/641859776 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c057070 con 0x562e374375c0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.984+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e375309e0 con 0x562e374375c0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.984+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e37530f00 con 0x562e374375c0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f3226604640 1 -- 172.21.15.170:0/641859776 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f332c076070 con 0x562e374375c0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f3226604640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3220036900 0x7f3220038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f3226604640 1 -- 172.21.15.170:0/641859776 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f332c08da50 con 0x562e374375c0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f33397d0640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3220036900 0x7f3220038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37438730 0x562e37537510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37537a50 con 0x562e37438730 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f333a7d2640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37438730 0x562e37537510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f33397d0640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3220036900 0x7f3220038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3330001e10 tx=0x7f3330001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.985+0000 7f333a7d2640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37438730 0x562e37537510 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.986+0000 7f333a7d2640 1 -- 172.21.15.170:0/641859776 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37438730 2024-04-26T12:32:18.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.986+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37538330 con 0x562e37438730 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.986+0000 7f333a7d2640 1 -- 172.21.15.170:0/641859776 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37438730 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.986+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37539c40 0x562e3753c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.986+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e3753c860 con 0x562e37539c40 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.986+0000 7f3339fd1640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37539c40 0x562e3753c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.986+0000 7f3339fd1640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37539c40 0x562e3753c0d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.987+0000 7f3339fd1640 1 -- 172.21.15.170:0/641859776 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f332c075030 con 0x562e37539c40 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.987+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37538bb0 con 0x562e37438730 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.987+0000 7f333a7d2640 1 -- 172.21.15.170:0/641859776 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37438730 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.987+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562e3753dd10 0x562e37540180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.987+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375408e0 con 0x562e3753dd10 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.987+0000 7f33397d0640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562e3753dd10 0x562e37540180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.987+0000 7f33397d0640 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562e3753dd10 0x562e37540180 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:18.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f33397d0640 1 -- 172.21.15.170:0/641859776 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33300106a0 con 0x562e3753dd10 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f333e333800 1 Processor -- start 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f333e333800 1 -- start start 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f333e333800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e3754ed40 0x562e3754f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f333e333800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562e37328e60 con 0x562e3754ed40 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e3754ed40 0x562e3754f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e3754ed40 0x562e3754f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45090/0 (socket says 172.21.15.170:45090) 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.988+0000 7f3339fd1640 1 -- 172.21.15.170:0/2727384432 learned_addr learned my addr 172.21.15.170:0/2727384432 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.989+0000 7f3339fd1640 1 -- 172.21.15.170:0/2727384432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e3754f6a0 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.989+0000 7f3339fd1640 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e3754ed40 0x562e3754f160 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f332c08be30 tx=0x7f332c077e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.989+0000 7f321f7fe640 1 -- 172.21.15.170:0/2727384432 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c083040 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.989+0000 7f321f7fe640 1 -- 172.21.15.170:0/2727384432 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c091070 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.989+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e37550110 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.989+0000 7f321f7fe640 1 -- 172.21.15.170:0/2727384432 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c05d570 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.989+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e37550110 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f321f7fe640 1 -- 172.21.15.170:0/2727384432 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f332c093020 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f321f7fe640 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3214036900 0x7f3214038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f321f7fe640 1 -- 172.21.15.170:0/2727384432 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f332c096d20 con 0x562e3754ed40 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f33397d0640 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3214036900 0x7f3214038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f333e333800 1 Processor -- start 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f333e333800 1 -- start start 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f33397d0640 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3214036900 0x7f3214038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x562e37534a00 tx=0x7f3330006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f333e333800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e373ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f333e333800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562e37529280 con 0x562e373accb0 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.990+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e373ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e373ad0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45098/0 (socket says 172.21.15.170:45098) 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f3339fd1640 1 -- 172.21.15.170:0/2629082042 learned_addr learned my addr 172.21.15.170:0/2629082042 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f3339fd1640 1 -- 172.21.15.170:0/2629082042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e373ab4b0 con 0x562e373accb0 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f3339fd1640 1 --2- 172.21.15.170:0/2629082042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e373ad0d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f332c09e5b0 tx=0x7f332c09e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363eebdf60e4480c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f321d7fa640 1 -- 172.21.15.170:0/2629082042 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c08d0b0 con 0x562e373accb0 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f321d7fa640 1 -- 172.21.15.170:0/2629082042 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c08d790 con 0x562e373accb0 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f321d7fa640 1 -- 172.21.15.170:0/2629082042 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c076e20 con 0x562e373accb0 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f333e333800 1 -- 172.21.15.170:0/2629082042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 msgr2=0x562e373ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f333e333800 1 --2- 172.21.15.170:0/2629082042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e373ad0d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f332c09e5b0 tx=0x7f332c09e4b0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f333e333800 1 -- 172.21.15.170:0/2629082042 shutdown_connections 2024-04-26T12:32:19.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f333e333800 1 --2- 172.21.15.170:0/2629082042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e373ad0d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.991+0000 7f333e333800 1 -- 172.21.15.170:0/2629082042 >> 172.21.15.170:0/2629082042 conn(0x562e37558010 msgr2=0x562e37556070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f333e333800 1 -- 172.21.15.170:0/2629082042 shutdown_connections 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f333e333800 1 -- 172.21.15.170:0/2629082042 wait complete. 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f333e333800 1 Processor -- start 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f333e333800 1 -- start start 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f333e333800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e375652a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f333e333800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562e373ab8c0 con 0x562e373accb0 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e375652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f3339fd1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e375652a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45108/0 (socket says 172.21.15.170:45108) 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 learned_addr learned my addr 172.21.15.170:0/811197573 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.992+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e375657e0 con 0x562e373accb0 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.993+0000 7f3339fd1640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e375652a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f332c081010 tx=0x7f332c06df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.993+0000 7f320b7fe640 1 -- 172.21.15.170:0/811197573 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c076e20 con 0x562e373accb0 2024-04-26T12:32:19.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.993+0000 7f320b7fe640 1 -- 172.21.15.170:0/811197573 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c080530 con 0x562e373accb0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.993+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e375657e0 con 0x562e373accb0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.993+0000 7f320b7fe640 1 -- 172.21.15.170:0/811197573 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f332c080850 con 0x562e373accb0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.993+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e375657e0 con 0x562e373accb0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.993+0000 7f320b7fe640 1 -- 172.21.15.170:0/811197573 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f332c0ae040 con 0x562e373accb0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f320b7fe640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3204036950 0x7f3204038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f320b7fe640 1 -- 172.21.15.170:0/811197573 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f332c0ac020 con 0x562e373accb0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f33397d0640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3204036950 0x7f3204038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f33397d0640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3204036950 0x7f3204038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x562e37540ce0 tx=0x7f3330011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37570a40 0x562e37572f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37573650 con 0x562e37570a40 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.994+0000 7f333a7d2640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37570a40 0x562e37572f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333a7d2640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37570a40 0x562e37572f00 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 realm 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37573a60 con 0x562e37570a40 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37574330 con 0x562e37570a40 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37575430 0x562e37577820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.995+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37577e30 con 0x562e37575430 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f3339fd1640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37575430 0x562e37577820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f3339fd1640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37575430 0x562e37577820 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f333e333800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f333e333800 20 searching for the correct realm 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562e37579dc0 0x562e3757c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e3757c950 con 0x562e37579dc0 2024-04-26T12:32:19.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.996+0000 7f33397d0640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562e37579dc0 0x562e3757c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.997+0000 7f33397d0640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562e37579dc0 0x562e3757c280 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.997+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.997+0000 7f33397d0640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33300393c0 0x7f3330039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.997+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e3757c950 con 0x7f33300393c0 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.997+0000 7f333a7d2640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33300393c0 0x7f3330039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.997+0000 7f333a7d2640 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33300393c0 0x7f3330039810 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f333400a4a0 con 0x7f33300393c0 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.998+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x7f33300393c0 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f333400a4a0 con 0x7f33300393c0 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:18.999+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x7f33300393c0 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f333400a4a0 con 0x7f33300393c0 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f333400a4a0 con 0x562e37570a40 2024-04-26T12:32:19.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x7f33300393c0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.000+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.001+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.002+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x7f33300393c0 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.003+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x7f33300393c0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37579dc0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37575430 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.004+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x562e37570a40 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562e375746d0 con 0x7f33300393c0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375786f0 con 0x562e37570a40 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375786f0 con 0x562e37570a40 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.005+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375786f0 con 0x7f33300393c0 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 zone default found 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 4 Realm: () 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 zonegroup default 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e37578f90 con 0x562e37575430 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e3757e7b0 con 0x562e37579dc0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.006+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e3757eb50 con 0x562e37579dc0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.007+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.007+0000 7f333e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.007+0000 7f333e333800 20 started sync module instance, tier type = 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.007+0000 7f333e333800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.007+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3757dc50 con 0x7f33300393c0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.008+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.008+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756496990512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3757dc50 con 0x7f33300393c0 2024-04-26T12:32:19.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.008+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3757f510 con 0x562e37570a40 2024-04-26T12:32:19.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.009+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756496990512] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.009+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.009+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756496988544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3757f510 con 0x562e37570a40 2024-04-26T12:32:19.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.009+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3757ff10 con 0x562e37579dc0 2024-04-26T12:32:19.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.010+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.010+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756496996896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375807e0 con 0x562e37579dc0 2024-04-26T12:32:19.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.010+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37581280 con 0x7f33300393c0 2024-04-26T12:32:19.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.010+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756496988544] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.011+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756496996896] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.011+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.011+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756496999216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3757f060 con 0x7f33300393c0 2024-04-26T12:32:19.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.011+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37581b60 con 0x562e37570a40 2024-04-26T12:32:19.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.012+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756496999216] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.012+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.012+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756497001808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37581aa0 con 0x562e37570a40 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.012+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37582570 con 0x562e37575430 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.013+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.013+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756497006784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37582dc0 con 0x562e37575430 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.013+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375838b0 con 0x562e37575430 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.013+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756497001808] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.014+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756497006784] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.014+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.014+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756497011584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37583c50 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.014+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375844a0 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756497011584] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756497013840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37584890 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 20 add_watcher() i=0 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 20 add_watcher() i=1 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 20 add_watcher() i=2 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 20 add_watcher() i=3 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 20 add_watcher() i=4 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 20 add_watcher() i=5 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.015+0000 7f333e333800 20 add_watcher() i=6 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.016+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756497013840] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.016+0000 7f333e333800 20 add_watcher() i=7 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.016+0000 7f333e333800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.016+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375878c0 con 0x562e37570a40 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.017+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.017+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756497015360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37584d80 con 0x562e37570a40 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.017+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756497015360] v32'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.018+0000 7f31eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.018+0000 7f333e333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.018+0000 7f333e333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.018+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37587740 con 0x562e37570a40 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.019+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.019+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37590ae0 con 0x562e37575430 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.020+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.020+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37590ae0 con 0x562e37579dc0 2024-04-26T12:32:19.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.021+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.021+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37591500 con 0x562e37570a40 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.022+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.022+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3758ff80 con 0x7f33300393c0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.023+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'79 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.023+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e3758ff80 con 0x562e37579dc0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.024+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.024+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592230 con 0x562e37570a40 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.025+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.025+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592230 con 0x562e37575430 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.026+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.026+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375922c0 con 0x7f33300393c0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.027+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.027+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592350 con 0x562e37579dc0 2024-04-26T12:32:19.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.028+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.028+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592980 con 0x7f33300393c0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.029+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'80 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.029+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592960 con 0x562e37575430 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.030+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.030+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592960 con 0x7f33300393c0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.031+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.031+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592960 con 0x562e37575430 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.032+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.032+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592960 con 0x562e37570a40 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.033+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.033+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592b30 con 0x562e37579dc0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.034+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.034+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592fb0 con 0x7f33300393c0 2024-04-26T12:32:19.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.035+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'81 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.035+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37579dc0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.036+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.036+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37570a40 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.037+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.037+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592b30 con 0x562e37570a40 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.038+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.038+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592b30 con 0x562e37579dc0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.039+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.039+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x7f33300393c0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.040+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.040+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37579dc0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.041+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.041+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37579dc0 2024-04-26T12:32:19.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.042+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.042+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37579dc0 2024-04-26T12:32:19.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.043+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.043+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37579dc0 2024-04-26T12:32:19.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.044+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.044+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37575430 2024-04-26T12:32:19.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.045+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.045+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37579dc0 2024-04-26T12:32:19.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.046+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.046+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37575430 2024-04-26T12:32:19.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.047+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.047+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37579dc0 2024-04-26T12:32:19.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.048+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.050 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.048+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x562e37575430 2024-04-26T12:32:19.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.049+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.049+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e37592f30 con 0x7f33300393c0 2024-04-26T12:32:19.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.050+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.050+0000 7f31ea7fc640 20 reqs_thread_entry: start 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.050+0000 7f333e333800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.050+0000 7f333e333800 20 Filter name: none 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f315bfff640 20 reqs_thread_entry: start 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375bde80 con 0x562e37575430 2024-04-26T12:32:19.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 20 rados_obj.operate() r=0 bl.length=349 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.051+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375c0910 con 0x562e37575430 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.052+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.052+0000 7f333e333800 10 removing key index: system_akey 2024-04-26T12:32:19.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.052+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375bd940 con 0x562e37579dc0 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(96 system_akey [delete] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333e333800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94756497257552 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375c0d30 con 0x562e37570a40 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== watch-notify(notify (1) cookie 94756496988544 notify 137438953511 ret 0) ==== 203+0+0 (crc 0 0 0) 0x562e37587700 con 0x562e37570a40 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f321d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94756496988544 notifier 4859 bl.length()=161 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f321d7fa640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f31fc003d60 con 0x562e37570a40 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(97 notify.1 [notify cookie 94756497257552 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== watch-notify(notify_complete (2) cookie 94756497257552 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e37590320 con 0x562e37570a40 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333e333800 10 removing email index: 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333e333800 10 removing user buckets index 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.053+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375be8f0 con 0x562e37575430 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.055+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(99 system_user.buckets [delete] v32'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.055+0000 7f333e333800 10 removing user index: system_user 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.055+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37575430 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.055+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(100 system_user [call,call,delete] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.055+0000 7f333e333800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.055+0000 7f333e333800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.056+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94756497253360 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x7f33300393c0 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.056+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== watch-notify(notify (1) cookie 94756496990512 notify 137438953498 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562e37590320 con 0x7f33300393c0 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.056+0000 7f321cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94756496990512 notifier 4859 bl.length()=160 2024-04-26T12:32:19.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.056+0000 7f321cff9640 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f31640032c0 con 0x7f33300393c0 2024-04-26T12:32:19.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.056+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(101 notify.0 [notify cookie 94756497253360 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.056+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== watch-notify(notify_complete (2) cookie 94756497253360 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e3758f900 con 0x7f33300393c0 2024-04-26T12:32:19.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.056+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.057+0000 7f31eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.057+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756497015360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37570a40 2024-04-26T12:32:19.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.058+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94756497015360] v32'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.058+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756496990512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x7f33300393c0 2024-04-26T12:32:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.059+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94756496990512] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.059+0000 7f333e333800 20 remove_watcher() i=0 2024-04-26T12:32:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.059+0000 7f333e333800 2 removed watcher, disabling cache 2024-04-26T12:32:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.059+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756496988544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37570a40 2024-04-26T12:32:19.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.060+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94756496988544] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.060+0000 7f333e333800 20 remove_watcher() i=1 2024-04-26T12:32:19.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.060+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756496996896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37579dc0 2024-04-26T12:32:19.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.061+0000 7f33397d0640 1 -- 172.21.15.170:0/811197573 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94756496996896] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3330036040 con 0x562e37579dc0 2024-04-26T12:32:19.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.061+0000 7f333e333800 20 remove_watcher() i=2 2024-04-26T12:32:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.061+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756496999216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x7f33300393c0 2024-04-26T12:32:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.062+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94756496999216] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x7f33300393c0 2024-04-26T12:32:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.062+0000 7f333e333800 20 remove_watcher() i=3 2024-04-26T12:32:19.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.062+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756497001808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37570a40 2024-04-26T12:32:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.063+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94756497001808] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3334033040 con 0x562e37570a40 2024-04-26T12:32:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.063+0000 7f333e333800 20 remove_watcher() i=4 2024-04-26T12:32:19.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.063+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756497006784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37575430 2024-04-26T12:32:19.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.064+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94756497006784] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.064+0000 7f333e333800 20 remove_watcher() i=5 2024-04-26T12:32:19.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.064+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756497011584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37575430 2024-04-26T12:32:19.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.065+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94756497011584] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.065+0000 7f333e333800 20 remove_watcher() i=6 2024-04-26T12:32:19.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.065+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756497013840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562e375c2950 con 0x562e37575430 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.066+0000 7f3339fd1640 1 -- 172.21.15.170:0/811197573 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94756497013840] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f332c0c1020 con 0x562e37575430 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.066+0000 7f333e333800 20 remove_watcher() i=7 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.066+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37575430 msgr2=0x562e37577820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.066+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37575430 0x562e37577820 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37570a40 msgr2=0x562e37572f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37570a40 0x562e37572f00 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33300393c0 msgr2=0x7f3330039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f33300393c0 0x7f3330039810 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562e37579dc0 msgr2=0x562e3757c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562e37579dc0 0x562e3757c280 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3204036950 msgr2=0x7f3204038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3204036950 0x7f3204038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x562e37540ce0 tx=0x7f3330011000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333a7d2640 1 -- 172.21.15.170:0/811197573 reap_dead start 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 msgr2=0x562e375652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e375652a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f332c081010 tx=0x7f332c06df70 comp rx=0 tx=0).stop 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 shutdown_connections 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/811197573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e373accb0 0x562e375652a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 >> 172.21.15.170:0/811197573 conn(0x562e37558010 msgr2=0x562e37555670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 shutdown_connections 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/811197573 wait complete. 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3214036900 msgr2=0x7f3214038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3214036900 0x7f3214038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x562e37534a00 tx=0x7f3330006000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e3754ed40 msgr2=0x562e3754f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e3754ed40 0x562e3754f160 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f332c08be30 tx=0x7f332c077e60 comp rx=0 tx=0).stop 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 shutdown_connections 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3214036900 0x7f3214038dc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/2727384432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e3754ed40 0x562e3754f160 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 >> 172.21.15.170:0/2727384432 conn(0x562e37542de0 msgr2=0x562e375431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 shutdown_connections 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/2727384432 wait complete. 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37539c40 msgr2=0x562e3753c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562e37539c40 0x562e3753c0d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37438730 msgr2=0x562e37537510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562e37438730 0x562e37537510 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.067+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562e3753dd10 msgr2=0x562e37540180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562e3753dd10 0x562e37540180 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3220036900 msgr2=0x7f3220038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f3220036900 0x7f3220038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3330001e10 tx=0x7f3330001390 comp rx=0 tx=0).stop 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 msgr2=0x562e375304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 --2- 172.21.15.170:0/641859776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562e374375c0 0x562e375304a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f332c052540 tx=0x7f332c003020 comp rx=0 tx=0).stop 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333a7d2640 1 -- 172.21.15.170:0/641859776 reap_dead start 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 shutdown_connections 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 >> 172.21.15.170:0/641859776 conn(0x562e37432b80 msgr2=0x562e375275b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 shutdown_connections 2024-04-26T12:32:19.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.068+0000 7f333e333800 1 -- 172.21.15.170:0/641859776 wait complete. 2024-04-26T12:32:19.078 ERROR:root:None 2024-04-26T12:32:19.078 ERROR:root:0 2024-04-26T12:32:19.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-26T12:32:19.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-26T12:32:19.078 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-04-26T12:32:19.169 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:19.169 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.168+0000 7f9ceb92f800 1 Processor -- start 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.168+0000 7f9ceb92f800 1 -- start start 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.168+0000 7f9ceb92f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5583407abf10 0x5583407ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.168+0000 7f9ceb92f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583406580c0 con 0x5583407ae840 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.168+0000 7f9ceb92f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55834063c4d0 con 0x5583407abf10 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.169+0000 7f9ce75ae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5583407abf10 0x5583407ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.169+0000 7f9ce6dad640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5583407ae840 0x5583407b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58834/0 (socket says 172.21.15.170:58834) 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.169+0000 7f9ce6dad640 1 -- 172.21.15.170:0/2266175284 learned_addr learned my addr 172.21.15.170:0/2266175284 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.169+0000 7f9ce75ae640 1 -- 172.21.15.170:0/2266175284 >> v1:172.21.15.132:6789/0 conn(0x5583407ae840 legacy=0x5583407b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.169+0000 7f9ce75ae640 1 -- 172.21.15.170:0/2266175284 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558340669d40 con 0x5583407abf10 2024-04-26T12:32:19.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/2266175284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ae300 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800a470 tx=0x7f9cd801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8a5082b13069f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ce65ac640 1 -- 172.21.15.170:0/2266175284 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8057070 con 0x5583407abf10 2024-04-26T12:32:19.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ce65ac640 1 -- 172.21.15.170:0/2266175284 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8052570 con 0x5583407abf10 2024-04-26T12:32:19.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ce65ac640 1 -- 172.21.15.170:0/2266175284 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8052870 con 0x5583407abf10 2024-04-26T12:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ceb92f800 1 -- 172.21.15.170:0/2266175284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 msgr2=0x5583407ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/2266175284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ae300 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800a470 tx=0x7f9cd801ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ceb92f800 1 -- 172.21.15.170:0/2266175284 shutdown_connections 2024-04-26T12:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/2266175284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ae300 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.171+0000 7f9ceb92f800 1 -- 172.21.15.170:0/2266175284 >> 172.21.15.170:0/2266175284 conn(0x5583407a5980 msgr2=0x5583407a7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.172+0000 7f9ceb92f800 1 -- 172.21.15.170:0/2266175284 shutdown_connections 2024-04-26T12:32:19.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.172+0000 7f9ceb92f800 1 -- 172.21.15.170:0/2266175284 wait complete. 2024-04-26T12:32:19.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.183+0000 7f9ceb92f800 1 Processor -- start 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.183+0000 7f9ceb92f800 1 -- start start 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.183+0000 7f9ceb92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ab850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.183+0000 7f9ceb92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5583406f6ae0 con 0x5583407abf10 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45128/0 (socket says 172.21.15.170:45128) 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9ce75ae640 1 -- 172.21.15.170:0/3184468154 learned_addr learned my addr 172.21.15.170:0/3184468154 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9ce75ae640 1 -- 172.21.15.170:0/3184468154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558340668590 con 0x5583407abf10 2024-04-26T12:32:19.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/3184468154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ab850 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8055040 tx=0x7f9cd804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c2dab3aa3e6191 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9bd560a640 1 -- 172.21.15.170:0/3184468154 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8057070 con 0x5583407abf10 2024-04-26T12:32:19.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9bd560a640 1 -- 172.21.15.170:0/3184468154 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8063070 con 0x5583407abf10 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.184+0000 7f9bd560a640 1 -- 172.21.15.170:0/3184468154 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8052720 con 0x5583407abf10 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3184468154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 msgr2=0x5583407ab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/3184468154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ab850 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8055040 tx=0x7f9cd804c000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3184468154 shutdown_connections 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/3184468154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583407ab850 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3184468154 >> 172.21.15.170:0/3184468154 conn(0x5583407a5980 msgr2=0x558340898030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3184468154 shutdown_connections 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3184468154 wait complete. 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 Processor -- start 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.185+0000 7f9ceb92f800 1 -- start start 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ceb92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583408a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ceb92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5583407b25f0 con 0x5583407abf10 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583408a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583408a61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45138/0 (socket says 172.21.15.170:45138) 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ce75ae640 1 -- 172.21.15.170:0/405687271 learned_addr learned my addr 172.21.15.170:0/405687271 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ce75ae640 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55834065f8f0 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583408a61d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8060040 tx=0x7f9cd8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9bd3e07640 1 -- 172.21.15.170:0/405687271 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8052e30 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9bd3e07640 1 -- 172.21.15.170:0/405687271 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd806c070 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9bd3e07640 1 -- 172.21.15.170:0/405687271 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd805e5f0 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583408a6710 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.186+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583408a6c90 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.187+0000 7f9bd3e07640 1 -- 172.21.15.170:0/405687271 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9cd805e790 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.187+0000 7f9bd3e07640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bcc036950 0x7f9bcc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.187+0000 7f9bd3e07640 1 -- 172.21.15.170:0/405687271 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9cd808e9b0 con 0x5583407abf10 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.187+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bcc036950 0x7f9bcc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.187+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583407ae840 0x5583408ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.187+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408ad780 con 0x5583407ae840 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ce7daf640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583407ae840 0x5583408ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bcc036950 0x7f9bcc038e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc000f60 tx=0x7f9cdc0012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ce7daf640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583407ae840 0x5583408ad240 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ce7daf640 1 -- 172.21.15.170:0/405687271 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583407ae840 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408aa810 con 0x5583407ae840 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ce7daf640 1 -- 172.21.15.170:0/405687271 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583407ae840 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408afad0 0x5583408b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.188+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408b25b0 con 0x5583408afad0 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.189+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408afad0 0x5583408b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.189+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408afad0 0x5583408b1ec0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.189+0000 7f9ce75ae640 1 -- 172.21.15.170:0/405687271 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408afad0 2024-04-26T12:32:19.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.189+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408aea80 con 0x5583407ae840 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.190+0000 7f9ce7daf640 1 -- 172.21.15.170:0/405687271 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583407ae840 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.190+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5583408b3a60 0x5583408b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.190+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408b6610 con 0x5583408b3a60 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.190+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5583408b3a60 0x5583408b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.190+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5583408b3a60 0x5583408b5eb0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.190+0000 7f9ce6dad640 1 -- 172.21.15.170:0/405687271 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408b3a60 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ceb92f800 1 Processor -- start 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ceb92f800 1 -- start start 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ceb92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408c4a70 0x5583408c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ceb92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55834069ce60 con 0x5583408c4a70 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408c4a70 0x5583408c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408c4a70 0x5583408c4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45154/0 (socket says 172.21.15.170:45154) 2024-04-26T12:32:19.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ce75ae640 1 -- 172.21.15.170:0/3442777314 learned_addr learned my addr 172.21.15.170:0/3442777314 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ce75ae640 1 -- 172.21.15.170:0/3442777314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583408c53d0 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408c4a70 0x5583408c4e90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9cd808cd50 tx=0x7f9cd8068e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9bd1602640 1 -- 172.21.15.170:0/3442777314 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8092020 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9bd1602640 1 -- 172.21.15.170:0/3442777314 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8058040 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.191+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583408c5e40 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.192+0000 7f9bd1602640 1 -- 172.21.15.170:0/3442777314 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8002a70 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.192+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583408c5e40 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.192+0000 7f9bd1602640 1 -- 172.21.15.170:0/3442777314 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9cd8095020 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.192+0000 7f9bd1602640 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bc0036900 0x7f9bc0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.192+0000 7f9bd1602640 1 -- 172.21.15.170:0/3442777314 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9cd8098d10 con 0x5583408c4a70 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.192+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bc0036900 0x7f9bc0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ceb92f800 1 Processor -- start 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ceb92f800 1 -- start start 2024-04-26T12:32:19.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bc0036900 0x7f9bc0038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00bf50 tx=0x7f9cdc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ceb92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ceb92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5583407a9e10 con 0x5583408d1a10 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45160/0 (socket says 172.21.15.170:45160) 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ce75ae640 1 -- 172.21.15.170:0/695580937 learned_addr learned my addr 172.21.15.170:0/695580937 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.193+0000 7f9ce75ae640 1 -- 172.21.15.170:0/695580937 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583408d2400 con 0x5583408d1a10 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/695580937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d1e30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009ff0 tx=0x7f9cd8084ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a97f2b1f14bc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9bcaffd640 1 -- 172.21.15.170:0/695580937 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8084e00 con 0x5583408d1a10 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9bcaffd640 1 -- 172.21.15.170:0/695580937 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8004280 con 0x5583408d1a10 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9bcaffd640 1 -- 172.21.15.170:0/695580937 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8067a60 con 0x5583408d1a10 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ceb92f800 1 -- 172.21.15.170:0/695580937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 msgr2=0x5583408d1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/695580937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d1e30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009ff0 tx=0x7f9cd8084ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ceb92f800 1 -- 172.21.15.170:0/695580937 shutdown_connections 2024-04-26T12:32:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/695580937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d1e30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ceb92f800 1 -- 172.21.15.170:0/695580937 >> 172.21.15.170:0/695580937 conn(0x5583408cdce0 msgr2=0x5583408cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ceb92f800 1 -- 172.21.15.170:0/695580937 shutdown_connections 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.194+0000 7f9ceb92f800 1 -- 172.21.15.170:0/695580937 wait complete. 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ceb92f800 1 Processor -- start 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ceb92f800 1 -- start start 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ceb92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ceb92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5583408d2a60 con 0x5583408d1a10 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ce75ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45168/0 (socket says 172.21.15.170:45168) 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 learned_addr learned my addr 172.21.15.170:0/1557722057 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583408d92d0 con 0x5583408d1a10 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d8d90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8067a10 tx=0x7f9cd809df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.195+0000 7f9bc97fa640 1 -- 172.21.15.170:0/1557722057 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8084bf0 con 0x5583408d1a10 2024-04-26T12:32:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.196+0000 7f9bc97fa640 1 -- 172.21.15.170:0/1557722057 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd80890c0 con 0x5583408d1a10 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.196+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583408d92d0 con 0x5583408d1a10 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.196+0000 7f9bc97fa640 1 -- 172.21.15.170:0/1557722057 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd8002610 con 0x5583408d1a10 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.196+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583408d97d0 con 0x5583408d1a10 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.196+0000 7f9bc97fa640 1 -- 172.21.15.170:0/1557722057 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9cd80bd030 con 0x5583408d1a10 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.196+0000 7f9bc97fa640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bb0036950 0x7f9bb0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.197+0000 7f9bc97fa640 1 -- 172.21.15.170:0/1557722057 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9cd80bb070 con 0x5583408d1a10 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.197+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bb0036950 0x7f9bb0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.197+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bb0036950 0x7f9bb0038e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc001b60 tx=0x7f9cdc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.197+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.197+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583408e4490 0x5583408e6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.197+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408e70a0 con 0x5583408e4490 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.197+0000 7f9ce7daf640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583408e4490 0x5583408e6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ce7daf640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583408e4490 0x5583408e6950 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 realm 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408e74b0 con 0x5583408e4490 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408e7d80 con 0x5583408e4490 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.198+0000 7f9ceb92f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408e8e80 0x5583408eb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408eb880 con 0x5583408e8e80 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408e8e80 0x5583408eb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ce75ae640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408e8e80 0x5583408eb270 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ceb92f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ceb92f800 20 searching for the correct realm 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5583408ed830 0x5583408efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408f03c0 con 0x5583408ed830 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.199+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5583408ed830 0x5583408efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.200+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5583408ed830 0x5583408efcf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.200+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.200+0000 7f9ce6dad640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9cdc038040 0x7f9cdc01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.200+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408f03c0 con 0x7f9cdc038040 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.200+0000 7f9ce7daf640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9cdc038040 0x7f9cdc01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.200+0000 7f9ce7daf640 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9cdc038040 0x7f9cdc01bab0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ce000a4a0 con 0x7f9cdc038040 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.201+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x7f9cdc038040 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce000a4a0 con 0x7f9cdc038040 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.202+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x7f9cdc038040 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce000a4a0 con 0x7f9cdc038040 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce000a4a0 con 0x5583408e4490 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x7f9cdc038040 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.203+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.204+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.205+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x7f9cdc038040 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.206+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.206+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.206+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.206+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.206+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.206+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x7f9cdc038040 2024-04-26T12:32:19.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408ed830 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.207+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e8e80 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x5583408e4490 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583408e8120 con 0x7f9cdc038040 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:19.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408ec140 con 0x5583408e4490 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.208+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408ec140 con 0x5583408e4490 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408ec140 con 0x7f9cdc038040 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 20 zone default found 2024-04-26T12:32:19.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 4 Realm: () 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 20 zonegroup default 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408ec9e0 con 0x5583408e8e80 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.209+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408f2220 con 0x5583408ed830 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408f25c0 con 0x5583408ed830 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 20 started sync module instance, tier type = 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.210+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f16c0 con 0x7f9cdc038040 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.211+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.211+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94022212197088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f16c0 con 0x7f9cdc038040 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.211+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f2e50 con 0x5583408e4490 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.212+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94022212197088] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.212+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.212+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94022212200800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f16c0 con 0x5583408e4490 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.212+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f38e0 con 0x5583408ed830 2024-04-26T12:32:19.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.213+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94022212200800] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.214+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.214+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94022212194832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f1630 con 0x5583408ed830 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.214+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f4670 con 0x7f9cdc038040 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.215+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94022212194832] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.215+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.215+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94022212205776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f4a90 con 0x7f9cdc038040 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.215+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f5490 con 0x5583408e4490 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.216+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.216+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94022212210592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f53c0 con 0x5583408e4490 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.216+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f63c0 con 0x5583408e8e80 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.216+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94022212205776] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.217+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94022212210592] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.217+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.217+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94022212212864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f5ed0 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.217+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f6c60 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.218+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94022212212864] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.218+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.218+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94022212206832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f74b0 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.218+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f7e70 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94022212206832] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94022212219360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f7e70 con 0x5583408e8e80 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 20 add_watcher() i=0 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 20 add_watcher() i=1 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 20 add_watcher() i=2 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 20 add_watcher() i=3 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 20 add_watcher() i=4 2024-04-26T12:32:19.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 20 add_watcher() i=5 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.219+0000 7f9ceb92f800 20 add_watcher() i=6 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.220+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94022212219360] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.220+0000 7f9ceb92f800 20 add_watcher() i=7 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.220+0000 7f9ceb92f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.220+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583408fb1a0 con 0x5583408e4490 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.220+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.220+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94022212221744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f8400 con 0x5583408e4490 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.221+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94022212221744] v32'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.221+0000 7f9b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.221+0000 7f9ceb92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.221+0000 7f9ceb92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.221+0000 7f9ceb92f800 5 note: GC not initialized 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9b9cfe1640 20 reqs_thread_entry: start 2024-04-26T12:32:19.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 20 Filter name: none 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9b167fc640 20 reqs_thread_entry: start 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55834092e940 con 0x5583408ed830 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.222+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55834092d430 con 0x5583408ed830 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.223+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.223+0000 7f9ceb92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.223+0000 7f9ceb92f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.223+0000 7f9ceb92f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.223+0000 7f9ceb92f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.223+0000 7f9ceb92f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.223+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558340931f30 con 0x5583408ed830 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v32'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ceb92f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ceb92f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ceb92f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94022212456224 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558340931850 con 0x5583408ed830 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== watch-notify(notify (1) cookie 94022212194832 notify 137438953481 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5583409322d0 con 0x5583408ed830 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9bcaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94022212194832 notifier 4866 bl.length()=542 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9bcaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-26T12:32:19.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9bcaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9bcaffd640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9bac003ea0 con 0x5583408ed830 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(65 notify.2 [notify cookie 94022212456224 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.224+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.225+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== watch-notify(notify_complete (2) cookie 94022212456224 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55834092d1b0 con 0x5583408ed830 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.225+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55834092ff10 con 0x5583408ed830 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v32'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ceb92f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ceb92f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ceb92f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94022212459680 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55834092ff10 con 0x5583408e8e80 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== watch-notify(notify (1) cookie 94022212212864 notify 137438953512 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5583408c53d0 con 0x5583408e8e80 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9bca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94022212212864 notifier 4866 bl.length()=175 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9bca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-26T12:32:19.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9bca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-26T12:32:19.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9bca7fc640 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9b1c003400 con 0x5583408e8e80 2024-04-26T12:32:19.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(68 notify.5 [notify cookie 94022212459680 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.226+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== watch-notify(notify_complete (2) cookie 94022212459680 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9cd808ce30 con 0x5583408e8e80 2024-04-26T12:32:19.245 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-04-26T12:32:19.224890Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:19.224871Z","tags":[],"group_ids":[]} 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.227+0000 7f9b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.227+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94022212221744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55834092f630 con 0x5583408e4490 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.228+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94022212221744] v32'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.228+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94022212197088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f7b30 con 0x7f9cdc038040 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.229+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94022212197088] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.229+0000 7f9ceb92f800 20 remove_watcher() i=0 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.229+0000 7f9ceb92f800 2 removed watcher, disabling cache 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.229+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94022212200800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f7b30 con 0x5583408e4490 2024-04-26T12:32:19.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.230+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94022212200800] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.231+0000 7f9ceb92f800 20 remove_watcher() i=1 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.231+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94022212194832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f2960 con 0x5583408ed830 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.232+0000 7f9ce6dad640 1 -- 172.21.15.170:0/1557722057 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94022212194832] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc009050 con 0x5583408ed830 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.232+0000 7f9ceb92f800 20 remove_watcher() i=2 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.232+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94022212205776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f1210 con 0x7f9cdc038040 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.233+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94022212205776] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x7f9cdc038040 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.233+0000 7f9ceb92f800 20 remove_watcher() i=3 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.233+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94022212210592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f2960 con 0x5583408e4490 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.234+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94022212210592] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0033040 con 0x5583408e4490 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.234+0000 7f9ceb92f800 20 remove_watcher() i=4 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.234+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94022212212864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f3cd0 con 0x5583408e8e80 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.235+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94022212212864] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.235+0000 7f9ceb92f800 20 remove_watcher() i=5 2024-04-26T12:32:19.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.235+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94022212206832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f1210 con 0x5583408e8e80 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.236+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94022212206832] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.236+0000 7f9ceb92f800 20 remove_watcher() i=6 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.236+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94022212219360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583408f4fa0 con 0x5583408e8e80 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ce75ae640 1 -- 172.21.15.170:0/1557722057 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94022212219360] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd8071990 con 0x5583408e8e80 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 20 remove_watcher() i=7 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408e8e80 msgr2=0x5583408eb270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408e8e80 0x5583408eb270 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583408e4490 msgr2=0x5583408e6950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583408e4490 0x5583408e6950 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9cdc038040 msgr2=0x7f9cdc01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9cdc038040 0x7f9cdc01bab0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5583408ed830 msgr2=0x5583408efcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5583408ed830 0x5583408efcf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bb0036950 msgr2=0x7f9bb0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bb0036950 0x7f9bb0038e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc001b60 tx=0x7f9cdc010000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ce7daf640 1 -- 172.21.15.170:0/1557722057 reap_dead start 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 msgr2=0x5583408d8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d8d90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8067a10 tx=0x7f9cd809df70 comp rx=0 tx=0).stop 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 shutdown_connections 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/1557722057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408d1a10 0x5583408d8d90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 >> 172.21.15.170:0/1557722057 conn(0x5583408cdce0 msgr2=0x5583408cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 shutdown_connections 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/1557722057 wait complete. 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bc0036900 msgr2=0x7f9bc0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bc0036900 0x7f9bc0038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00bf50 tx=0x7f9cdc00f000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408c4a70 msgr2=0x5583408c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408c4a70 0x5583408c4e90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9cd808cd50 tx=0x7f9cd8068e30 comp rx=0 tx=0).stop 2024-04-26T12:32:19.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 shutdown_connections 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bc0036900 0x7f9bc0038dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/3442777314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583408c4a70 0x5583408c4e90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 >> 172.21.15.170:0/3442777314 conn(0x5583408b8b10 msgr2=0x5583408b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 shutdown_connections 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.237+0000 7f9ceb92f800 1 -- 172.21.15.170:0/3442777314 wait complete. 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408afad0 msgr2=0x5583408b1ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5583408afad0 0x5583408b1ec0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583407ae840 msgr2=0x5583408ad240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5583407ae840 0x5583408ad240 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5583408b3a60 msgr2=0x5583408b5eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5583408b3a60 0x5583408b5eb0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bcc036950 msgr2=0x7f9bcc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9bcc036950 0x7f9bcc038e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc000f60 tx=0x7f9cdc0012b0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 msgr2=0x5583408a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 --2- 172.21.15.170:0/405687271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5583407abf10 0x5583408a61d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8060040 tx=0x7f9cd8002fb0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ce7daf640 1 -- 172.21.15.170:0/405687271 reap_dead start 2024-04-26T12:32:19.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 shutdown_connections 2024-04-26T12:32:19.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 >> 172.21.15.170:0/405687271 conn(0x5583407a5980 msgr2=0x5583407aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 shutdown_connections 2024-04-26T12:32:19.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.238+0000 7f9ceb92f800 1 -- 172.21.15.170:0/405687271 wait complete. 2024-04-26T12:32:19.256 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-26T12:32:19.224890Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:19.224871Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.256 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-26T12:32:19.224890Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:19.224871Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.256 ERROR:root:0 2024-04-26T12:32:19.257 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:19.261 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:19.261 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-04-26T12:32:19.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-04-26T12:32:19.262 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-04-26T12:32:19.304 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:19.304 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.303+0000 7f868e813800 1 Processor -- start 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.303+0000 7f868e813800 1 -- start start 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868e813800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562523960a80 0x562523962e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868e813800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625238090c0 con 0x56252395cf70 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868e813800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5625237ed4d0 con 0x562523960a80 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868166d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562523960a80 0x562523962e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f8689e6e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x56252395cf70 0x56252395f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58846/0 (socket says 172.21.15.170:58846) 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868166d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x562523960a80 0x562523962e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45172/0 (socket says 172.21.15.170:45172) 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f8689e6e640 1 -- 172.21.15.170:0/1114410892 learned_addr learned my addr 172.21.15.170:0/1114410892 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868166d640 1 -- 172.21.15.170:0/1114410892 >> v1:172.21.15.132:6789/0 conn(0x56252395cf70 legacy=0x56252395f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868966d640 1 -- 172.21.15.170:0/1114410892 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262880891 0 0) 0x5625238090c0 con 0x56252395cf70 2024-04-26T12:32:19.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.304+0000 7f868166d640 1 -- 172.21.15.170:0/1114410892 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252381ad40 con 0x562523960a80 2024-04-26T12:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.306+0000 7f868166d640 1 --2- 172.21.15.170:0/1114410892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523960a80 0x562523962e70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f867400a470 tx=0x7f867401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7de1a712dbe310b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.306+0000 7f868966d640 1 -- 172.21.15.170:0/1114410892 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8674057070 con 0x562523960a80 2024-04-26T12:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.306+0000 7f868966d640 1 -- 172.21.15.170:0/1114410892 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8674052570 con 0x562523960a80 2024-04-26T12:32:19.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.306+0000 7f868966d640 1 -- 172.21.15.170:0/1114410892 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8674052870 con 0x562523960a80 2024-04-26T12:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.307+0000 7f868e813800 1 -- 172.21.15.170:0/1114410892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523960a80 msgr2=0x562523962e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.307+0000 7f868e813800 1 --2- 172.21.15.170:0/1114410892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523960a80 0x562523962e70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f867400a470 tx=0x7f867401ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.307+0000 7f868e813800 1 -- 172.21.15.170:0/1114410892 shutdown_connections 2024-04-26T12:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.307+0000 7f868e813800 1 --2- 172.21.15.170:0/1114410892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523960a80 0x562523962e70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.307+0000 7f868e813800 1 -- 172.21.15.170:0/1114410892 >> 172.21.15.170:0/1114410892 conn(0x5625239569e0 msgr2=0x562523958e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.307+0000 7f868e813800 1 -- 172.21.15.170:0/1114410892 shutdown_connections 2024-04-26T12:32:19.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.307+0000 7f868e813800 1 -- 172.21.15.170:0/1114410892 wait complete. 2024-04-26T12:32:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.318+0000 7f868e813800 1 Processor -- start 2024-04-26T12:32:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.318+0000 7f868e813800 1 -- start start 2024-04-26T12:32:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f868e813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x56252395c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f868e813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5625238a7b40 con 0x56252395cf70 2024-04-26T12:32:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x56252395c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x56252395c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45184/0 (socket says 172.21.15.170:45184) 2024-04-26T12:32:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8689e6e640 1 -- 172.21.15.170:0/3331307973 learned_addr learned my addr 172.21.15.170:0/3331307973 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8689e6e640 1 -- 172.21.15.170:0/3331307973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562523819590 con 0x56252395cf70 2024-04-26T12:32:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8689e6e640 1 --2- 172.21.15.170:0/3331307973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x56252395c8b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b210 tx=0x7f867c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d715ce0054bb3ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8577e07640 1 -- 172.21.15.170:0/3331307973 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c008070 con 0x56252395cf70 2024-04-26T12:32:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8577e07640 1 -- 172.21.15.170:0/3331307973 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c00d500 con 0x56252395cf70 2024-04-26T12:32:19.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.319+0000 7f8577e07640 1 -- 172.21.15.170:0/3331307973 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c00d840 con 0x56252395cf70 2024-04-26T12:32:19.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 -- 172.21.15.170:0/3331307973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 msgr2=0x56252395c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 --2- 172.21.15.170:0/3331307973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x56252395c8b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b210 tx=0x7f867c00b6d0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 -- 172.21.15.170:0/3331307973 shutdown_connections 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 --2- 172.21.15.170:0/3331307973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x56252395c8b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 -- 172.21.15.170:0/3331307973 >> 172.21.15.170:0/3331307973 conn(0x5625239569e0 msgr2=0x562523a48e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 -- 172.21.15.170:0/3331307973 shutdown_connections 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 -- 172.21.15.170:0/3331307973 wait complete. 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.320+0000 7f868e813800 1 Processor -- start 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f868e813800 1 -- start start 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f868e813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x562523a570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f868e813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5625239636b0 con 0x56252395cf70 2024-04-26T12:32:19.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x562523a570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x562523a570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45196/0 (socket says 172.21.15.170:45196) 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8689e6e640 1 -- 172.21.15.170:0/2057052065 learned_addr learned my addr 172.21.15.170:0/2057052065 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8689e6e640 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625238108f0 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8689e6e640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x562523a570f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b210 tx=0x7f867c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8576604640 1 -- 172.21.15.170:0/2057052065 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c00f950 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8576604640 1 -- 172.21.15.170:0/2057052065 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c00faf0 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562523a57630 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f8576604640 1 -- 172.21.15.170:0/2057052065 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c00fdd0 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.321+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562523a57b50 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.322+0000 7f8576604640 1 -- 172.21.15.170:0/2057052065 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f867c017040 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.322+0000 7f8576604640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8570036900 0x7f8570038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.322+0000 7f8576604640 1 -- 172.21.15.170:0/2057052065 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f867c015020 con 0x56252395cf70 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.322+0000 7f868166d640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8570036900 0x7f8570038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.323+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523960a80 0x562523a5e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.323+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a5e6a0 con 0x562523960a80 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.323+0000 7f868a66f640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523960a80 0x562523a5e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.323+0000 7f868166d640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8570036900 0x7f8570038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8674054000 tx=0x7f867404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.323+0000 7f868a66f640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523960a80 0x562523a5e160 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.323+0000 7f868a66f640 1 -- 172.21.15.170:0/2057052065 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f868400a4a0 con 0x562523960a80 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.323+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a5b730 con 0x562523960a80 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.324+0000 7f868a66f640 1 -- 172.21.15.170:0/2057052065 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f868400a4a0 con 0x562523960a80 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.324+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a609b0 0x562523a62da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.324+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a63440 con 0x562523a609b0 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.324+0000 7f8689e6e640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a609b0 0x562523a62da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.324+0000 7f8689e6e640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a609b0 0x562523a62da0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.324+0000 7f8689e6e640 1 -- 172.21.15.170:0/2057052065 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f867c02d070 con 0x562523a609b0 2024-04-26T12:32:19.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.324+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a5f960 con 0x562523960a80 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.325+0000 7f868a66f640 1 -- 172.21.15.170:0/2057052065 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f868400a4a0 con 0x562523960a80 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.325+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562523a648f0 0x562523a66d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.325+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a674a0 con 0x562523a648f0 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.325+0000 7f868166d640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562523a648f0 0x562523a66d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.325+0000 7f868166d640 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562523a648f0 0x562523a66d40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.325+0000 7f868166d640 1 -- 172.21.15.170:0/2057052065 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8674052940 con 0x562523a648f0 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f868e813800 1 Processor -- start 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f868e813800 1 -- start start 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f868e813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a75900 0x562523a75d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f868e813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56252384de60 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a75900 0x562523a75d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a75900 0x562523a75d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45212/0 (socket says 172.21.15.170:45212) 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f8689e6e640 1 -- 172.21.15.170:0/1648857110 learned_addr learned my addr 172.21.15.170:0/1648857110 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f8689e6e640 1 -- 172.21.15.170:0/1648857110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562523a76260 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.326+0000 7f8689e6e640 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a75900 0x562523a75d20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f867c04b4b0 tx=0x7f867c01aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f856f7fe640 1 -- 172.21.15.170:0/1648857110 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c019470 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f856f7fe640 1 -- 172.21.15.170:0/1648857110 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c019610 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562523a76cd0 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f856f7fe640 1 -- 172.21.15.170:0/1648857110 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c0198f0 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562523a771d0 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f856f7fe640 1 -- 172.21.15.170:0/1648857110 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f867c03f250 con 0x562523a75900 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f856f7fe640 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f85640368b0 0x7f8564038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.327+0000 7f856f7fe640 1 -- 172.21.15.170:0/1648857110 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f867c03ad40 con 0x562523a75900 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f868166d640 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f85640368b0 0x7f8564038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f868e813800 1 Processor -- start 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f868e813800 1 -- start start 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f868166d640 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f85640368b0 0x7f8564038d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x562523a5b650 tx=0x7f8674005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f868e813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a83040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f868e813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x56252395af30 con 0x562523a82c20 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a83040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a83040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45218/0 (socket says 172.21.15.170:45218) 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f8689e6e640 1 -- 172.21.15.170:0/690393257 learned_addr learned my addr 172.21.15.170:0/690393257 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.328+0000 7f8689e6e640 1 -- 172.21.15.170:0/690393257 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562523a83610 con 0x562523a82c20 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f8689e6e640 1 --2- 172.21.15.170:0/690393257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a83040 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f867c01a6d0 tx=0x7f867c040e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32511a740c295de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f856d7fa640 1 -- 172.21.15.170:0/690393257 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c055030 con 0x562523a82c20 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f856d7fa640 1 -- 172.21.15.170:0/690393257 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c040900 con 0x562523a82c20 2024-04-26T12:32:19.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f856d7fa640 1 -- 172.21.15.170:0/690393257 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c026430 con 0x562523a82c20 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 -- 172.21.15.170:0/690393257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 msgr2=0x562523a83040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 --2- 172.21.15.170:0/690393257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a83040 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f867c01a6d0 tx=0x7f867c040e20 comp rx=0 tx=0).stop 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 -- 172.21.15.170:0/690393257 shutdown_connections 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 --2- 172.21.15.170:0/690393257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a83040 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 -- 172.21.15.170:0/690393257 >> 172.21.15.170:0/690393257 conn(0x562523a7ef80 msgr2=0x562523a7cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 -- 172.21.15.170:0/690393257 shutdown_connections 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 -- 172.21.15.170:0/690393257 wait complete. 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.329+0000 7f868e813800 1 Processor -- start 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f868e813800 1 -- start start 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f868e813800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a8a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f868e813800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562523a83cc0 con 0x562523a82c20 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a8a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f8689e6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a8a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45228/0 (socket says 172.21.15.170:45228) 2024-04-26T12:32:19.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 learned_addr learned my addr 172.21.15.170:0/4001044320 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562523a8a5c0 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f8689e6e640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a8a080 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f867c026b50 tx=0x7f867c041ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f855b7fe640 1 -- 172.21.15.170:0/4001044320 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c03f540 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f855b7fe640 1 -- 172.21.15.170:0/4001044320 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c03f6e0 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562523a8a5c0 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.330+0000 7f855b7fe640 1 -- 172.21.15.170:0/4001044320 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f867c01c710 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.331+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562523a8a5c0 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.331+0000 7f855b7fe640 1 -- 172.21.15.170:0/4001044320 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f867c068070 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.331+0000 7f855b7fe640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8554036900 0x7f8554038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.331+0000 7f855b7fe640 1 -- 172.21.15.170:0/4001044320 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f867c059070 con 0x562523a82c20 2024-04-26T12:32:19.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.331+0000 7f868166d640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8554036900 0x7f8554038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.332+0000 7f868166d640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8554036900 0x7f8554038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8674052fd0 tx=0x7f867404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.332+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.332+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523a95670 0x562523a97b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.332+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a98280 con 0x562523a95670 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.332+0000 7f868a66f640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523a95670 0x562523a97b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.332+0000 7f868a66f640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523a95670 0x562523a97b30 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 realm 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a98690 con 0x562523a95670 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a98f60 con 0x562523a95670 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a95670 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a9a060 0x562523a9c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a9ca60 con 0x562523a9a060 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.333+0000 7f8689e6e640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a9a060 0x562523a9c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f8689e6e640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a9a060 0x562523a9c450 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f868e813800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f868e813800 20 searching for the correct realm 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562523a9e9f0 0x562523aa0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523aa1580 con 0x562523a9e9f0 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f868166d640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562523a9e9f0 0x562523aa0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.334+0000 7f868166d640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562523a9e9f0 0x562523aa0eb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.335+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.335+0000 7f868166d640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8674076040 0x7f8674083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.335+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523aa1580 con 0x7f8674076040 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.335+0000 7f868a66f640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8674076040 0x7f8674083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.335+0000 7f868a66f640 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8674076040 0x7f8674083410 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.335+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f868400a4a0 con 0x7f8674076040 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.335+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a9a060 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a95670 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a95670 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a9a060 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.336+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a9a060 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x7f8674076040 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868400a4a0 con 0x7f8674076040 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a9e9f0 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a95670 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x7f8674076040 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868400a4a0 con 0x7f8674076040 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.337+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a95670 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f868400a4a0 con 0x562523a95670 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x7f8674076040 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562523a99300 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.338+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9a060 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a95670 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.339+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a95670 2024-04-26T12:32:19.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9a060 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9e9f0 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x7f8674076040 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.340+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a95670 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9a060 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9e9f0 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9a060 2024-04-26T12:32:19.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.341+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x7f8674076040 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9e9f0 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a9a060 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x562523a95670 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.342+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8674090040 con 0x7f8674076040 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:19.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a9d320 con 0x562523a95670 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a9d320 con 0x562523a95670 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a9d320 con 0x7f8674076040 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 zone default found 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 4 Realm: () 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 zonegroup default 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.343+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523a9dbc0 con 0x562523a9a060 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523aa33e0 con 0x562523a9e9f0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523aa3780 con 0x562523a9e9f0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 20 started sync module instance, tier type = 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.344+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa2880 con 0x7f8674076040 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.345+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.345+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94717512134048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa2880 con 0x7f8674076040 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.345+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa4140 con 0x562523a95670 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.346+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94717512134048] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.346+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.347+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94717512132016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa4140 con 0x562523a95670 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.347+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa4b00 con 0x562523a9e9f0 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.348+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.348+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94717512140368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa53a0 con 0x562523a9e9f0 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.348+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa5e20 con 0x7f8674076040 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.348+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94717512132016] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.348+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94717512140368] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.349+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.349+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94717512142576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa3c90 con 0x7f8674076040 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.349+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa66c0 con 0x562523a95670 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.350+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94717512142576] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.350+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.350+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94717512145168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa6670 con 0x562523a95670 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.350+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa70d0 con 0x562523a9a060 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.351+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94717512145168] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.351+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.351+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94717512147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa65e0 con 0x562523a9a060 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.351+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa7e90 con 0x562523a9a060 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.352+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94717512147392] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.352+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.352+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94717512152256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa86e0 con 0x562523a9a060 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.352+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa90a0 con 0x562523a9a060 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.353+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94717512152256] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94717512156176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa90a0 con 0x562523a9a060 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 20 add_watcher() i=0 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 20 add_watcher() i=1 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 20 add_watcher() i=2 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 20 add_watcher() i=3 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 20 add_watcher() i=4 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 20 add_watcher() i=5 2024-04-26T12:32:19.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.355+0000 7f868e813800 20 add_watcher() i=6 2024-04-26T12:32:19.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.356+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94717512156176] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.356+0000 7f868e813800 20 add_watcher() i=7 2024-04-26T12:32:19.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.356+0000 7f868e813800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:19.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.356+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523aac3d0 con 0x562523a95670 2024-04-26T12:32:19.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.356+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.356+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94717512158560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa9630 con 0x562523a95670 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.357+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94717512158560] v32'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.357+0000 7f853b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.357+0000 7f868e813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.357+0000 7f868e813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.357+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aabd00 con 0x562523a95670 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.358+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.359+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab5660 con 0x562523a9a060 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.359+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.359+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab5660 con 0x562523a9e9f0 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.360+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.360+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aab7f0 con 0x562523a95670 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.361+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.376 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.361+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab6270 con 0x7f8674076040 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.362+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'82 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.362+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab67e0 con 0x562523a9e9f0 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.363+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.363+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab6ce0 con 0x562523a95670 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.365+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.365+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab6d70 con 0x562523a9a060 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.365+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.365+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab6d70 con 0x7f8674076040 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.366+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.366+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab6e00 con 0x562523a9e9f0 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.367+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.367+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x7f8674076040 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.368+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'83 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.368+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9a060 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.369+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.369+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x7f8674076040 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.370+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.370+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9a060 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.371+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.371+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a95670 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.372+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.372+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.373+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.373+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x7f8674076040 2024-04-26T12:32:19.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.374+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'84 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.374+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.375+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.375+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a95670 2024-04-26T12:32:19.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.377+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.377+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7a00 con 0x562523a95670 2024-04-26T12:32:19.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.377+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.377+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab79c0 con 0x562523a9e9f0 2024-04-26T12:32:19.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.379+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.379+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x7f8674076040 2024-04-26T12:32:19.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.380+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'43 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.380+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.380+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.380+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.381+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.381+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.382+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.382+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.383+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.383+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9a060 2024-04-26T12:32:19.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.385+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.385+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.386+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.386+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9a060 2024-04-26T12:32:19.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.387+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.387+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9e9f0 2024-04-26T12:32:19.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.388+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.388+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x562523a9a060 2024-04-26T12:32:19.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.389+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.389+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ab7380 con 0x7f8674076040 2024-04-26T12:32:19.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f853a7fc640 20 reqs_thread_entry: start 2024-04-26T12:32:19.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f868e813800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:19.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f868e813800 20 Filter name: none 2024-04-26T12:32:19.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f84affff640 20 reqs_thread_entry: start 2024-04-26T12:32:19.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f868e813800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-26T12:32:19.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f868e813800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.390+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523ae25f0 con 0x562523a9e9f0 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868e813800 20 rados_obj.operate() r=0 bl.length=363 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868e813800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868e813800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868e813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523ae5080 con 0x562523a9e9f0 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f8674081070 con 0x562523a9e9f0 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868e813800 10 removing key index: true_admin_akey 2024-04-26T12:32:19.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.391+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ae3060 con 0x562523a9e9f0 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(96 true_admin_akey [delete] v32'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f8674095040 con 0x562523a9e9f0 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f868e813800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94717512399728 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523ae55b0 con 0x562523a9a060 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== watch-notify(notify (1) cookie 94717512147392 notify 137438953513 ret 0) ==== 207+0+0 (crc 0 0 0) 0x562523ab6d70 con 0x562523a9a060 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f856d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94717512147392 notifier 4873 bl.length()=165 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(97 notify.5 [notify cookie 94717512399728 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f856d7fa640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f854c003d60 con 0x562523a9a060 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.392+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== watch-notify(notify_complete (2) cookie 94717512399728 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562523a76cd0 con 0x562523a9a060 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.393+0000 7f868e813800 10 removing email index: 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.393+0000 7f868e813800 10 removing user buckets index 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.393+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ae5530 con 0x562523a9e9f0 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.393+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(99 a_user.buckets [delete] v32'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f8674095040 con 0x562523a9e9f0 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.393+0000 7f868e813800 10 removing user index: a_user 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.393+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ae5530 con 0x562523a9e9f0 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.394+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(100 a_user [call,call,delete] v32'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f8674095040 con 0x562523a9e9f0 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.394+0000 7f868e813800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.394+0000 7f868e813800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.394+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94717512406320 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562523ae3b70 con 0x562523a9e9f0 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.395+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== watch-notify(notify (1) cookie 94717512140368 notify 137438953482 ret 0) ==== 197+0+0 (crc 0 0 0) 0x562523aabcc0 con 0x562523a9e9f0 2024-04-26T12:32:19.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.395+0000 7f856cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94717512140368 notifier 4873 bl.length()=155 2024-04-26T12:32:19.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.395+0000 7f856cff9640 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f84bc0032c0 con 0x562523a9e9f0 2024-04-26T12:32:19.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.395+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(101 notify.2 [notify cookie 94717512406320 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8674095040 con 0x562523a9e9f0 2024-04-26T12:32:19.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.395+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8674095040 con 0x562523a9e9f0 2024-04-26T12:32:19.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.395+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== watch-notify(notify_complete (2) cookie 94717512406320 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562523ab6440 con 0x562523a9e9f0 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.396+0000 7f853b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.396+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94717512158560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ae5530 con 0x562523a95670 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.397+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94717512158560] v32'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.397+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94717512134048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ae5530 con 0x7f8674076040 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.398+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94717512134048] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.398+0000 7f868e813800 20 remove_watcher() i=0 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.398+0000 7f868e813800 2 removed watcher, disabling cache 2024-04-26T12:32:19.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.398+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94717512132016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa2da0 con 0x562523a95670 2024-04-26T12:32:19.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.399+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94717512132016] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.399+0000 7f868e813800 20 remove_watcher() i=1 2024-04-26T12:32:19.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.399+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94717512140368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523ae5530 con 0x562523a9e9f0 2024-04-26T12:32:19.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.400+0000 7f868166d640 1 -- 172.21.15.170:0/4001044320 <== osd.3 v2:172.21.15.170:6816/2349137764 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94717512140368] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8674095040 con 0x562523a9e9f0 2024-04-26T12:32:19.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.400+0000 7f868e813800 20 remove_watcher() i=2 2024-04-26T12:32:19.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.400+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94717512142576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa25b0 con 0x7f8674076040 2024-04-26T12:32:19.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.401+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94717512142576] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x7f8674076040 2024-04-26T12:32:19.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.401+0000 7f868e813800 20 remove_watcher() i=3 2024-04-26T12:32:19.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.401+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94717512145168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa2da0 con 0x562523a95670 2024-04-26T12:32:19.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.402+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94717512145168] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8684033040 con 0x562523a95670 2024-04-26T12:32:19.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.402+0000 7f868e813800 20 remove_watcher() i=4 2024-04-26T12:32:19.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.402+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94717512147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa4650 con 0x562523a9a060 2024-04-26T12:32:19.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.403+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94717512147392] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.403+0000 7f868e813800 20 remove_watcher() i=5 2024-04-26T12:32:19.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.403+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94717512152256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa25b0 con 0x562523a9a060 2024-04-26T12:32:19.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.404+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94717512152256] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.404+0000 7f868e813800 20 remove_watcher() i=6 2024-04-26T12:32:19.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.404+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94717512156176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562523aa2da0 con 0x562523a9a060 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f8689e6e640 1 -- 172.21.15.170:0/4001044320 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94717512156176] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867c07d040 con 0x562523a9a060 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 20 remove_watcher() i=7 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a9a060 msgr2=0x562523a9c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a9a060 0x562523a9c450 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523a95670 msgr2=0x562523a97b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523a95670 0x562523a97b30 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8674076040 msgr2=0x7f8674083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f8674076040 0x7f8674083410 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562523a9e9f0 msgr2=0x562523aa0eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x562523a9e9f0 0x562523aa0eb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8554036900 msgr2=0x7f8554038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8554036900 0x7f8554038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8674052fd0 tx=0x7f867404f000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 msgr2=0x562523a8a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/4001044320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a82c20 0x562523a8a080 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f867c026b50 tx=0x7f867c041ea0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 reap_dead start 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868a66f640 1 -- 172.21.15.170:0/4001044320 reap_dead start 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 shutdown_connections 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 >> 172.21.15.170:0/4001044320 conn(0x562523a7ef80 msgr2=0x562523a7c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 shutdown_connections 2024-04-26T12:32:19.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/4001044320 wait complete. 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f85640368b0 msgr2=0x7f8564038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f85640368b0 0x7f8564038d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x562523a5b650 tx=0x7f8674005a00 comp rx=0 tx=0).stop 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a75900 msgr2=0x562523a75d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a75900 0x562523a75d20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f867c04b4b0 tx=0x7f867c01aaf0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 shutdown_connections 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f85640368b0 0x7f8564038d70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 --2- 172.21.15.170:0/1648857110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562523a75900 0x562523a75d20 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 >> 172.21.15.170:0/1648857110 conn(0x562523a699a0 msgr2=0x562523a69da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 shutdown_connections 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.405+0000 7f868e813800 1 -- 172.21.15.170:0/1648857110 wait complete. 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a609b0 msgr2=0x562523a62da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x562523a609b0 0x562523a62da0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523960a80 msgr2=0x562523a5e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x562523960a80 0x562523a5e160 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562523a648f0 msgr2=0x562523a66d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x562523a648f0 0x562523a66d40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8570036900 msgr2=0x7f8570038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f8570036900 0x7f8570038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8674054000 tx=0x7f867404e000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 msgr2=0x562523a570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 --2- 172.21.15.170:0/2057052065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56252395cf70 0x562523a570f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b210 tx=0x7f867c000ed0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868a66f640 1 -- 172.21.15.170:0/2057052065 reap_dead start 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 shutdown_connections 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 >> 172.21.15.170:0/2057052065 conn(0x5625239569e0 msgr2=0x562523a48a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 shutdown_connections 2024-04-26T12:32:19.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.406+0000 7f868e813800 1 -- 172.21.15.170:0/2057052065 wait complete. 2024-04-26T12:32:19.416 ERROR:root:None 2024-04-26T12:32:19.416 ERROR:root:0 2024-04-26T12:32:19.416 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-26T12:32:19.416 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-26T12:32:19.416 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-04-26T12:32:19.502 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:19.503 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.501+0000 7f2f15edf800 1 Processor -- start 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.501+0000 7f2f15edf800 1 -- start start 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.501+0000 7f2f15edf800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5628f693f140 0x5628f693d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f15edf800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628f68760c0 con 0x5628f693dc30 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f15edf800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5628f685a4d0 con 0x5628f693f140 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f139de640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5628f693f140 0x5628f693d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f0bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x5628f693dc30 0x5628f69d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58860/0 (socket says 172.21.15.170:58860) 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f0bfff640 1 -- 172.21.15.170:0/3975615587 learned_addr learned my addr 172.21.15.170:0/3975615587 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f139de640 1 -- 172.21.15.170:0/3975615587 >> v1:172.21.15.132:6789/0 conn(0x5628f693dc30 legacy=0x5628f69d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f131dd640 1 -- 172.21.15.170:0/3975615587 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276248560 0 0) 0x5628f68760c0 con 0x5628f693dc30 2024-04-26T12:32:19.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.502+0000 7f2f139de640 1 -- 172.21.15.170:0/3975615587 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f6887d40 con 0x5628f693f140 2024-04-26T12:32:19.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.504+0000 7f2f139de640 1 --2- 172.21.15.170:0/3975615587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693f140 0x5628f693d6f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400a470 tx=0x7f2f0401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb86fee2e97c58e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.504+0000 7f2f131dd640 1 -- 172.21.15.170:0/3975615587 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04057070 con 0x5628f693f140 2024-04-26T12:32:19.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.504+0000 7f2f131dd640 1 -- 172.21.15.170:0/3975615587 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f04052570 con 0x5628f693f140 2024-04-26T12:32:19.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.504+0000 7f2f131dd640 1 -- 172.21.15.170:0/3975615587 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04052870 con 0x5628f693f140 2024-04-26T12:32:19.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.504+0000 7f2f15edf800 1 -- 172.21.15.170:0/3975615587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693f140 msgr2=0x5628f693d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.504+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3975615587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693f140 0x5628f693d6f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400a470 tx=0x7f2f0401ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:19.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.505+0000 7f2f15edf800 1 -- 172.21.15.170:0/3975615587 shutdown_connections 2024-04-26T12:32:19.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.505+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3975615587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693f140 0x5628f693d6f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.505+0000 7f2f15edf800 1 -- 172.21.15.170:0/3975615587 >> 172.21.15.170:0/3975615587 conn(0x5628f69c4ba0 msgr2=0x5628f69c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.505+0000 7f2f15edf800 1 -- 172.21.15.170:0/3975615587 shutdown_connections 2024-04-26T12:32:19.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.505+0000 7f2f15edf800 1 -- 172.21.15.170:0/3975615587 wait complete. 2024-04-26T12:32:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.516+0000 7f2f15edf800 1 Processor -- start 2024-04-26T12:32:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.516+0000 7f2f15edf800 1 -- start start 2024-04-26T12:32:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.516+0000 7f2f15edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6abcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.516+0000 7f2f15edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5628f6914b70 con 0x5628f693dc30 2024-04-26T12:32:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6abcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6abcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45242/0 (socket says 172.21.15.170:45242) 2024-04-26T12:32:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2f139de640 1 -- 172.21.15.170:0/1012468288 learned_addr learned my addr 172.21.15.170:0/1012468288 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2f139de640 1 -- 172.21.15.170:0/1012468288 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f6886590 con 0x5628f693dc30 2024-04-26T12:32:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2f139de640 1 --2- 172.21.15.170:0/1012468288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6abcd20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2f04000c00 tx=0x7f2f0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894cdaec04406499 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2e01e0b640 1 -- 172.21.15.170:0/1012468288 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04057070 con 0x5628f693dc30 2024-04-26T12:32:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2e01e0b640 1 -- 172.21.15.170:0/1012468288 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f04063070 con 0x5628f693dc30 2024-04-26T12:32:19.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.517+0000 7f2e01e0b640 1 -- 172.21.15.170:0/1012468288 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04052720 con 0x5628f693dc30 2024-04-26T12:32:19.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 -- 172.21.15.170:0/1012468288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 msgr2=0x5628f6abcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 --2- 172.21.15.170:0/1012468288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6abcd20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2f04000c00 tx=0x7f2f0404c000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 -- 172.21.15.170:0/1012468288 shutdown_connections 2024-04-26T12:32:19.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 --2- 172.21.15.170:0/1012468288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6abcd20 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 -- 172.21.15.170:0/1012468288 >> 172.21.15.170:0/1012468288 conn(0x5628f69c4ba0 msgr2=0x5628f6ab8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 -- 172.21.15.170:0/1012468288 shutdown_connections 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 -- 172.21.15.170:0/1012468288 wait complete. 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 Processor -- start 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.518+0000 7f2f15edf800 1 -- start start 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f15edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6ac45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f15edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5628f69d4ea0 con 0x5628f693dc30 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6ac45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6ac45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45258/0 (socket says 172.21.15.170:45258) 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f139de640 1 -- 172.21.15.170:0/3125196561 learned_addr learned my addr 172.21.15.170:0/3125196561 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f139de640 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f687d8f0 con 0x5628f693dc30 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f139de640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6ac45a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2f04000c00 tx=0x7f2f04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2dfbfff640 1 -- 172.21.15.170:0/3125196561 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04052c70 con 0x5628f693dc30 2024-04-26T12:32:19.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2dfbfff640 1 -- 172.21.15.170:0/3125196561 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0406c070 con 0x5628f693dc30 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628f6ac4ae0 con 0x5628f693dc30 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2dfbfff640 1 -- 172.21.15.170:0/3125196561 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0405e480 con 0x5628f693dc30 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.519+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f6ac4fa0 con 0x5628f693dc30 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.520+0000 7f2dfbfff640 1 -- 172.21.15.170:0/3125196561 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2f0406e030 con 0x5628f693dc30 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.520+0000 7f2dfbfff640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dfc036950 0x7f2dfc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.520+0000 7f2dfbfff640 1 -- 172.21.15.170:0/3125196561 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f2f0408e360 con 0x5628f693dc30 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.520+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dfc036950 0x7f2dfc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.520+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f693f140 0x5628f6acb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.520+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6acbb50 con 0x5628f693f140 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.520+0000 7f2f141df640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f693f140 0x5628f6acb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.521+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dfc036950 0x7f2dfc038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2efc000c00 tx=0x7f2efc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.521+0000 7f2f141df640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f693f140 0x5628f6acb610 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.521+0000 7f2f141df640 1 -- 172.21.15.170:0/3125196561 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f693f140 2024-04-26T12:32:19.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.521+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6ac8bc0 con 0x5628f693f140 2024-04-26T12:32:19.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.521+0000 7f2f141df640 1 -- 172.21.15.170:0/3125196561 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f693f140 2024-04-26T12:32:19.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.521+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6acde50 0x5628f6ad0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.521+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6ad0910 con 0x5628f6acde50 2024-04-26T12:32:19.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.522+0000 7f2f139de640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6acde50 0x5628f6ad0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.522+0000 7f2f139de640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6acde50 0x5628f6ad0240 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.522+0000 7f2f139de640 1 -- 172.21.15.170:0/3125196561 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f0408e0b0 con 0x5628f6acde50 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.522+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6acce00 con 0x5628f693f140 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.523+0000 7f2f141df640 1 -- 172.21.15.170:0/3125196561 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f693f140 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.523+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5628f6ad1d50 0x5628f6ad41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.523+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6ad4970 con 0x5628f6ad1d50 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.523+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5628f6ad1d50 0x5628f6ad41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.523+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5628f6ad1d50 0x5628f6ad41e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.523+0000 7f2f0bfff640 1 -- 172.21.15.170:0/3125196561 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2efc00f670 con 0x5628f6ad1d50 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f15edf800 1 Processor -- start 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f15edf800 1 -- start start 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f15edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6ae2dd0 0x5628f6ae31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f15edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5628f68bae60 con 0x5628f6ae2dd0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6ae2dd0 0x5628f6ae31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6ae2dd0 0x5628f6ae31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45264/0 (socket says 172.21.15.170:45264) 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f139de640 1 -- 172.21.15.170:0/621881419 learned_addr learned my addr 172.21.15.170:0/621881419 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f139de640 1 -- 172.21.15.170:0/621881419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f6ae3730 con 0x5628f6ae2dd0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f139de640 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6ae2dd0 0x5628f6ae31f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2f0408c680 tx=0x7f2f040099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2df97fa640 1 -- 172.21.15.170:0/621881419 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04084040 con 0x5628f6ae2dd0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2df97fa640 1 -- 172.21.15.170:0/621881419 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f04058040 con 0x5628f6ae2dd0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628f6ae41a0 con 0x5628f6ae2dd0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.524+0000 7f2df97fa640 1 -- 172.21.15.170:0/621881419 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04067890 con 0x5628f6ae2dd0 2024-04-26T12:32:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.525+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f6ae46a0 con 0x5628f6ae2dd0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.525+0000 7f2df97fa640 1 -- 172.21.15.170:0/621881419 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2f04009af0 con 0x5628f6ae2dd0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.525+0000 7f2df97fa640 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dec036950 0x7f2dec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.525+0000 7f2df97fa640 1 -- 172.21.15.170:0/621881419 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f2f0409caf0 con 0x5628f6ae2dd0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.525+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dec036950 0x7f2dec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f15edf800 1 Processor -- start 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f15edf800 1 -- start start 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dec036950 0x7f2dec038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5628f6acbff0 tx=0x7f2efc006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f15edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f15edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5628f6abd3e0 con 0x5628f6aeffd0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45272/0 (socket says 172.21.15.170:45272) 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f139de640 1 -- 172.21.15.170:0/1511363545 learned_addr learned my addr 172.21.15.170:0/1511363545 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f139de640 1 -- 172.21.15.170:0/1511363545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f6af09c0 con 0x5628f6aeffd0 2024-04-26T12:32:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2f139de640 1 --2- 172.21.15.170:0/1511363545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af03f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2f04068fb0 tx=0x7f2f040794b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ed55767f58bc0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2df2ffd640 1 -- 172.21.15.170:0/1511363545 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04067a30 con 0x5628f6aeffd0 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.526+0000 7f2df2ffd640 1 -- 172.21.15.170:0/1511363545 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0409cd90 con 0x5628f6aeffd0 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2df2ffd640 1 -- 172.21.15.170:0/1511363545 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f04097cd0 con 0x5628f6aeffd0 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 -- 172.21.15.170:0/1511363545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 msgr2=0x5628f6af03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 --2- 172.21.15.170:0/1511363545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af03f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2f04068fb0 tx=0x7f2f040794b0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 -- 172.21.15.170:0/1511363545 shutdown_connections 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 --2- 172.21.15.170:0/1511363545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af03f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 -- 172.21.15.170:0/1511363545 >> 172.21.15.170:0/1511363545 conn(0x5628f6aec2e0 msgr2=0x5628f6aea340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 -- 172.21.15.170:0/1511363545 shutdown_connections 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 -- 172.21.15.170:0/1511363545 wait complete. 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 Processor -- start 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 -- start start 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.527+0000 7f2f15edf800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5628f6af1050 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2f139de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45282/0 (socket says 172.21.15.170:45282) 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 learned_addr learned my addr 172.21.15.170:0/855792156 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f6af7920 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2f139de640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af73e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400a010 tx=0x7f2f04002520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2df17fa640 1 -- 172.21.15.170:0/855792156 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0408ca30 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2df17fa640 1 -- 172.21.15.170:0/855792156 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f040b7070 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2df17fa640 1 -- 172.21.15.170:0/855792156 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f0404eb80 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628f6af7920 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.528+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f6af7920 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.529+0000 7f2df17fa640 1 -- 172.21.15.170:0/855792156 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2f040ae040 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.529+0000 7f2df17fa640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2ddc036950 0x7f2ddc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.529+0000 7f2df17fa640 1 -- 172.21.15.170:0/855792156 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f2f040ac020 con 0x5628f6aeffd0 2024-04-26T12:32:19.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.529+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2ddc036950 0x7f2ddc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.529+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2ddc036950 0x7f2ddc038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00ffd0 tx=0x7f2efc023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f6b02ac0 0x5628f6b04f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b056d0 con 0x5628f6b02ac0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f141df640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f6b02ac0 0x5628f6b04f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f141df640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f6b02ac0 0x5628f6b04f80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 20 realm 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b05ae0 con 0x5628f6b02ac0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:19.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.530+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b063b0 con 0x5628f6b02ac0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f15edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f15edf800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6b074b0 0x5628f6b098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b09e60 con 0x5628f6b074b0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f139de640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6b074b0 0x5628f6b098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.531+0000 7f2f139de640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6b074b0 0x5628f6b098a0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f15edf800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:19.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f15edf800 20 searching for the correct realm 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5628f6b0be10 0x5628f6b0e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0e9a0 con 0x5628f6b0be10 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5628f6b0be10 0x5628f6b0e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5628f6b0be10 0x5628f6b0e2d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f0bfff640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2efc02e910 0x7f2efc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.532+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0e9a0 con 0x7f2efc02e910 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.533+0000 7f2f141df640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2efc02e910 0x7f2efc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.533+0000 7f2f141df640 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2efc02e910 0x7f2efc03a3c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.533+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x7f2efc02e910 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.533+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.533+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.533+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x7f2efc02e910 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.534+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x7f2efc02e910 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x7f2efc02e910 2024-04-26T12:32:19.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x7f2efc02e910 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c00a4a0 con 0x5628f6b02ac0 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.535+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x7f2efc02e910 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.536+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.537+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x7f2efc02e910 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.538+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x7f2efc02e910 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.539+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b0be10 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b074b0 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x5628f6b02ac0 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b06750 con 0x7f2efc02e910 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:19.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.540+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0a720 con 0x5628f6b02ac0 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0a720 con 0x5628f6b02ac0 2024-04-26T12:32:19.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0a720 con 0x7f2efc02e910 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 zone default found 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 4 Realm: () 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 zonegroup default 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0afc0 con 0x5628f6b074b0 2024-04-26T12:32:19.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.541+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b10800 con 0x5628f6b0be10 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f15edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b10ba0 con 0x5628f6b0be10 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f15edf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f15edf800 20 started sync module instance, tier type = 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f15edf800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:19.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.542+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0fca0 con 0x7f2efc02e910 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.543+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.543+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94733937476080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b0fca0 con 0x7f2efc02e910 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.543+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b11560 con 0x5628f6b02ac0 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.544+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94733937476080] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.544+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.544+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94733937474032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b11560 con 0x5628f6b02ac0 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.544+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b11f60 con 0x5628f6b0be10 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.545+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94733937474032] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.545+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.546+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94733937479856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b114d0 con 0x5628f6b0be10 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.546+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b12e20 con 0x7f2efc02e910 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.547+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.547+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94733937479856] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.565 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.547+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94733937486672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b135c0 con 0x7f2efc02e910 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.547+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b12390 con 0x5628f6b02ac0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.547+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.548+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94733937490864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b12390 con 0x5628f6b02ac0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.548+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b14ae0 con 0x5628f6b074b0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.548+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94733937486672] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.549+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.549+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94733937487888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b14ed0 con 0x5628f6b074b0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.549+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b15890 con 0x5628f6b074b0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.549+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94733937490864] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.550+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94733937487888] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.550+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.550+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94733937497056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b15c80 con 0x5628f6b074b0 2024-04-26T12:32:19.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.550+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b164d0 con 0x5628f6b074b0 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.550+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94733937497056] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94733937499264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b16550 con 0x5628f6b074b0 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 20 add_watcher() i=0 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 20 add_watcher() i=1 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 20 add_watcher() i=2 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 20 add_watcher() i=3 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 20 add_watcher() i=4 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 20 add_watcher() i=5 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.551+0000 7f2f15edf800 20 add_watcher() i=6 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.552+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94733937499264] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.552+0000 7f2f15edf800 20 add_watcher() i=7 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.552+0000 7f2f15edf800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.552+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b198b0 con 0x5628f6b02ac0 2024-04-26T12:32:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.552+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.552+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94733937500688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b16ae0 con 0x5628f6b02ac0 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.553+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94733937500688] v32'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.553+0000 7f2dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.553+0000 7f2f15edf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.553+0000 7f2f15edf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.553+0000 7f2f15edf800 5 note: GC not initialized 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.553+0000 7f2dc8fe1640 20 reqs_thread_entry: start 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.553+0000 7f2f15edf800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 20 Filter name: none 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2d427fc640 20 reqs_thread_entry: start 2024-04-26T12:32:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b4d040 con 0x5628f6b074b0 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.554+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b53600 con 0x5628f6b074b0 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2f15edf800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2f15edf800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2f15edf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94733937750128 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b4ed10 con 0x5628f6b02ac0 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94733937490864 notify 137438953512 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f2f0c018cf0 con 0x5628f6b02ac0 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2df2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94733937490864 notifier 4880 bl.length()=666 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2df2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2df2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2df2ffd640 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2dd8003ea0 con 0x5628f6b02ac0 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.556+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94733937750128 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.557+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.557+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94733937750128 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2f0c005040 con 0x5628f6b02ac0 2024-04-26T12:32:19.571 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.557+0000 7f2dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.557+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94733937500688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b4e860 con 0x5628f6b02ac0 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.558+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94733937500688] v32'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.558+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94733937476080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b16210 con 0x7f2efc02e910 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.559+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94733937476080] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.559+0000 7f2f15edf800 20 remove_watcher() i=0 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.559+0000 7f2f15edf800 2 removed watcher, disabling cache 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.559+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94733937474032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b16210 con 0x5628f6b02ac0 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.561+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94733937474032] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.561+0000 7f2f15edf800 20 remove_watcher() i=1 2024-04-26T12:32:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.561+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94733937479856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b16210 con 0x5628f6b0be10 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.561+0000 7f2f0bfff640 1 -- 172.21.15.170:0/855792156 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94733937479856] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2efc037040 con 0x5628f6b0be10 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.562+0000 7f2f15edf800 20 remove_watcher() i=2 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.562+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94733937486672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b110b0 con 0x7f2efc02e910 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.563+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94733937486672] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x7f2efc02e910 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.563+0000 7f2f15edf800 20 remove_watcher() i=3 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.563+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94733937490864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b110b0 con 0x5628f6b02ac0 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.564+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94733937490864] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0c033040 con 0x5628f6b02ac0 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.564+0000 7f2f15edf800 20 remove_watcher() i=4 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.564+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94733937487888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b13bb0 con 0x5628f6b074b0 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.565+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94733937487888] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.565+0000 7f2f15edf800 20 remove_watcher() i=5 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.565+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94733937497056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b110b0 con 0x5628f6b074b0 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.566+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94733937497056] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.566+0000 7f2f15edf800 20 remove_watcher() i=6 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.566+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94733937499264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5628f6b13bb0 con 0x5628f6b074b0 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f139de640 1 -- 172.21.15.170:0/855792156 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94733937499264] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f04094020 con 0x5628f6b074b0 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 20 remove_watcher() i=7 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6b074b0 msgr2=0x5628f6b098a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6b074b0 0x5628f6b098a0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f6b02ac0 msgr2=0x5628f6b04f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f6b02ac0 0x5628f6b04f80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2efc02e910 msgr2=0x7f2efc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f2efc02e910 0x7f2efc03a3c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5628f6b0be10 msgr2=0x5628f6b0e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5628f6b0be10 0x5628f6b0e2d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2ddc036950 msgr2=0x7f2ddc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2ddc036950 0x7f2ddc038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00ffd0 tx=0x7f2efc023040 comp rx=0 tx=0).stop 2024-04-26T12:32:19.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 msgr2=0x5628f6af73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af73e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400a010 tx=0x7f2f04002520 comp rx=0 tx=0).stop 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f141df640 1 -- 172.21.15.170:0/855792156 reap_dead start 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 shutdown_connections 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 --2- 172.21.15.170:0/855792156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6aeffd0 0x5628f6af73e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 >> 172.21.15.170:0/855792156 conn(0x5628f6aec2e0 msgr2=0x5628f6ae9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 shutdown_connections 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.567+0000 7f2f15edf800 1 -- 172.21.15.170:0/855792156 wait complete. 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dec036950 msgr2=0x7f2dec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dec036950 0x7f2dec038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5628f6acbff0 tx=0x7f2efc006000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6ae2dd0 msgr2=0x5628f6ae31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6ae2dd0 0x5628f6ae31f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2f0408c680 tx=0x7f2f040099e0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 shutdown_connections 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dec036950 0x7f2dec038e10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.579 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/621881419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f6ae2dd0 0x5628f6ae31f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 >> 172.21.15.170:0/621881419 conn(0x5628f6ad6e70 msgr2=0x5628f6ad7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 shutdown_connections 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/621881419 wait complete. 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6acde50 msgr2=0x5628f6ad0240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5628f6acde50 0x5628f6ad0240 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f693f140 msgr2=0x5628f6acb610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5628f693f140 0x5628f6acb610 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5628f6ad1d50 msgr2=0x5628f6ad41e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5628f6ad1d50 0x5628f6ad41e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dfc036950 msgr2=0x7f2dfc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f2dfc036950 0x7f2dfc038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2efc000c00 tx=0x7f2efc0013b0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 msgr2=0x5628f6ac45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 --2- 172.21.15.170:0/3125196561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5628f693dc30 0x5628f6ac45a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2f04000c00 tx=0x7f2f04002fb0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f141df640 1 -- 172.21.15.170:0/3125196561 reap_dead start 2024-04-26T12:32:19.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 shutdown_connections 2024-04-26T12:32:19.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 >> 172.21.15.170:0/3125196561 conn(0x5628f69c4ba0 msgr2=0x5628f6abb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 shutdown_connections 2024-04-26T12:32:19.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.568+0000 7f2f15edf800 1 -- 172.21.15.170:0/3125196561 wait complete. 2024-04-26T12:32:19.582 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.582 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.582 ERROR:root:0 2024-04-26T12:32:19.582 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:19.586 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:19.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-26T12:32:19.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-26T12:32:19.587 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-04-26T12:32:19.632 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:19.632 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.630+0000 7f6025e13800 1 Processor -- start 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6025e13800 1 -- start start 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6025e13800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fe3ed5daa0 0x55fe3ed5fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6025e13800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe3ec060c0 con 0x55fe3ed59f90 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6025e13800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55fe3ebea4d0 con 0x55fe3ed5daa0 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6020d46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fe3ed5daa0 0x55fe3ed5fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6021547640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55fe3ed59f90 0x55fe3ed5c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58870/0 (socket says 172.21.15.170:58870) 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6020d46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fe3ed5daa0 0x55fe3ed5fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45298/0 (socket says 172.21.15.170:45298) 2024-04-26T12:32:19.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6021547640 1 -- 172.21.15.170:0/4278414907 learned_addr learned my addr 172.21.15.170:0/4278414907 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:19.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6020d46640 1 -- 172.21.15.170:0/4278414907 >> v1:172.21.15.132:6789/0 conn(0x55fe3ed59f90 legacy=0x55fe3ed5c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.631+0000 7f6020d46640 1 -- 172.21.15.170:0/4278414907 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3ec17d40 con 0x55fe3ed5daa0 2024-04-26T12:32:19.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.633+0000 7f6020d46640 1 --2- 172.21.15.170:0/4278414907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed5daa0 0x55fe3ed5fe90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f600c00a470 tx=0x7f600c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9644d468aa6af7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.633+0000 7f601bfff640 1 -- 172.21.15.170:0/4278414907 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600c057070 con 0x55fe3ed5daa0 2024-04-26T12:32:19.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.633+0000 7f601bfff640 1 -- 172.21.15.170:0/4278414907 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600c052570 con 0x55fe3ed5daa0 2024-04-26T12:32:19.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.633+0000 7f601bfff640 1 -- 172.21.15.170:0/4278414907 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600c052870 con 0x55fe3ed5daa0 2024-04-26T12:32:19.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.634+0000 7f6025e13800 1 -- 172.21.15.170:0/4278414907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed5daa0 msgr2=0x55fe3ed5fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.634+0000 7f6025e13800 1 --2- 172.21.15.170:0/4278414907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed5daa0 0x55fe3ed5fe90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f600c00a470 tx=0x7f600c01ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:19.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.634+0000 7f6025e13800 1 -- 172.21.15.170:0/4278414907 shutdown_connections 2024-04-26T12:32:19.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.634+0000 7f6025e13800 1 --2- 172.21.15.170:0/4278414907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed5daa0 0x55fe3ed5fe90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.634+0000 7f6025e13800 1 -- 172.21.15.170:0/4278414907 >> 172.21.15.170:0/4278414907 conn(0x55fe3ed53a00 msgr2=0x55fe3ed55e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.634+0000 7f6025e13800 1 -- 172.21.15.170:0/4278414907 shutdown_connections 2024-04-26T12:32:19.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.634+0000 7f6025e13800 1 -- 172.21.15.170:0/4278414907 wait complete. 2024-04-26T12:32:19.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.645+0000 7f6025e13800 1 Processor -- start 2024-04-26T12:32:19.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.645+0000 7f6025e13800 1 -- start start 2024-04-26T12:32:19.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f6025e13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee4a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f6025e13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fe3eca4b70 con 0x55fe3ed59f90 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee4a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee4a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45304/0 (socket says 172.21.15.170:45304) 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f6021547640 1 -- 172.21.15.170:0/2717311644 learned_addr learned my addr 172.21.15.170:0/2717311644 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f6021547640 1 -- 172.21.15.170:0/2717311644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3ec16590 con 0x55fe3ed59f90 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f6021547640 1 --2- 172.21.15.170:0/2717311644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee4a7d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f601c0017a0 tx=0x7f601c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb031180a343de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f5f0f606640 1 -- 172.21.15.170:0/2717311644 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c004520 con 0x55fe3ed59f90 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f5f0f606640 1 -- 172.21.15.170:0/2717311644 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c0046c0 con 0x55fe3ed59f90 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.646+0000 7f5f0f606640 1 -- 172.21.15.170:0/2717311644 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c004a00 con 0x55fe3ed59f90 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 -- 172.21.15.170:0/2717311644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 msgr2=0x55fe3ee4a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 --2- 172.21.15.170:0/2717311644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee4a7d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f601c0017a0 tx=0x7f601c001c60 comp rx=0 tx=0).stop 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 -- 172.21.15.170:0/2717311644 shutdown_connections 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 --2- 172.21.15.170:0/2717311644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee4a7d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 -- 172.21.15.170:0/2717311644 >> 172.21.15.170:0/2717311644 conn(0x55fe3ed53a00 msgr2=0x55fe3ee460f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 -- 172.21.15.170:0/2717311644 shutdown_connections 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 -- 172.21.15.170:0/2717311644 wait complete. 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.647+0000 7f6025e13800 1 Processor -- start 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6025e13800 1 -- start start 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6025e13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee52140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6025e13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fe3ed606d0 con 0x55fe3ed59f90 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee52140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee52140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45310/0 (socket says 172.21.15.170:45310) 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6021547640 1 -- 172.21.15.170:0/3801671601 learned_addr learned my addr 172.21.15.170:0/3801671601 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6021547640 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3ec0d8f0 con 0x55fe3ed59f90 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6021547640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee52140 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f601c000f80 tx=0x7f601c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f5f0de03640 1 -- 172.21.15.170:0/3801671601 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c022020 con 0x55fe3ed59f90 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f5f0de03640 1 -- 172.21.15.170:0/3801671601 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c014870 con 0x55fe3ed59f90 2024-04-26T12:32:19.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe3ee52680 con 0x55fe3ed59f90 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f5f0de03640 1 -- 172.21.15.170:0/3801671601 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c014bb0 con 0x55fe3ed59f90 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.648+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3ee52ba0 con 0x55fe3ed59f90 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.649+0000 7f5f0de03640 1 -- 172.21.15.170:0/3801671601 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f601c025020 con 0x55fe3ed59f90 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.649+0000 7f5f0de03640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5f08036950 0x7f5f08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.649+0000 7f5f0de03640 1 -- 172.21.15.170:0/3801671601 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f601c018030 con 0x55fe3ed59f90 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6020d46640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5f08036950 0x7f5f08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ed5daa0 0x55fe3ee591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee59780 con 0x55fe3ed5daa0 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6021d48640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ed5daa0 0x55fe3ee591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6020d46640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5f08036950 0x7f5f08038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f600c054000 tx=0x7f600c04e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6021d48640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ed5daa0 0x55fe3ee591b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6021d48640 1 -- 172.21.15.170:0/3801671601 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ed5daa0 2024-04-26T12:32:19.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.650+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee56760 con 0x55fe3ed5daa0 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.651+0000 7f6021d48640 1 -- 172.21.15.170:0/3801671601 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ed5daa0 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.651+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee5ba60 0x55fe3ee5de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.651+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee5e540 con 0x55fe3ee5ba60 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.651+0000 7f6021547640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee5ba60 0x55fe3ee5de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.651+0000 7f6021547640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee5ba60 0x55fe3ee5de50 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.652+0000 7f6021547640 1 -- 172.21.15.170:0/3801671601 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f601c01b070 con 0x55fe3ee5ba60 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.652+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee5aa10 con 0x55fe3ed5daa0 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.652+0000 7f6021d48640 1 -- 172.21.15.170:0/3801671601 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ed5daa0 2024-04-26T12:32:19.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.652+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fe3ee5f9f0 0x55fe3ee61e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.652+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee625b0 con 0x55fe3ee5f9f0 2024-04-26T12:32:19.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.652+0000 7f6020d46640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fe3ee5f9f0 0x55fe3ee61e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.652+0000 7f6020d46640 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fe3ee5f9f0 0x55fe3ee61e20 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6020d46640 1 -- 172.21.15.170:0/3801671601 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f600c052a40 con 0x55fe3ee5f9f0 2024-04-26T12:32:19.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6025e13800 1 Processor -- start 2024-04-26T12:32:19.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6025e13800 1 -- start start 2024-04-26T12:32:19.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6025e13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee709d0 0x55fe3ee70df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6025e13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fe3ec4ae60 con 0x55fe3ee709d0 2024-04-26T12:32:19.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee709d0 0x55fe3ee70df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee709d0 0x55fe3ee70df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45322/0 (socket says 172.21.15.170:45322) 2024-04-26T12:32:19.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.653+0000 7f6021547640 1 -- 172.21.15.170:0/2390672690 learned_addr learned my addr 172.21.15.170:0/2390672690 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.654+0000 7f6021547640 1 -- 172.21.15.170:0/2390672690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3ee71330 con 0x55fe3ee709d0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.654+0000 7f6021547640 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee709d0 0x55fe3ee70df0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f601c04aca0 tx=0x7f601c0108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.654+0000 7f5f06ffd640 1 -- 172.21.15.170:0/2390672690 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c044c40 con 0x55fe3ee709d0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.654+0000 7f5f06ffd640 1 -- 172.21.15.170:0/2390672690 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c044de0 con 0x55fe3ee709d0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.654+0000 7f5f06ffd640 1 -- 172.21.15.170:0/2390672690 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c01da80 con 0x55fe3ee709d0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.654+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe3ee71da0 con 0x55fe3ee709d0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.654+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3ee722a0 con 0x55fe3ee709d0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f5f06ffd640 1 -- 172.21.15.170:0/2390672690 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f601c010070 con 0x55fe3ee709d0 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f5f06ffd640 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5ef8036950 0x7f5ef8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f5f06ffd640 1 -- 172.21.15.170:0/2390672690 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f601c0330b0 con 0x55fe3ee709d0 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6020d46640 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5ef8036950 0x7f5ef8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6025e13800 1 Processor -- start 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6025e13800 1 -- start start 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6020d46640 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5ef8036950 0x7f5ef8038e10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55fe3ee59c00 tx=0x7f600c005a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6025e13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee7df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6025e13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fe3ee4af50 con 0x55fe3ee7db60 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee7df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee7df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45326/0 (socket says 172.21.15.170:45326) 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.655+0000 7f6021547640 1 -- 172.21.15.170:0/1313921295 learned_addr learned my addr 172.21.15.170:0/1313921295 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6021547640 1 -- 172.21.15.170:0/1313921295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3ee7e550 con 0x55fe3ee7db60 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6021547640 1 --2- 172.21.15.170:0/1313921295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee7df80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f601c010a40 tx=0x7f601c01dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98657e967d2002de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f5f04ff9640 1 -- 172.21.15.170:0/1313921295 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c0128d0 con 0x55fe3ee7db60 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f5f04ff9640 1 -- 172.21.15.170:0/1313921295 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c05c070 con 0x55fe3ee7db60 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f5f04ff9640 1 -- 172.21.15.170:0/1313921295 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c04c070 con 0x55fe3ee7db60 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6025e13800 1 -- 172.21.15.170:0/1313921295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 msgr2=0x55fe3ee7df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6025e13800 1 --2- 172.21.15.170:0/1313921295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee7df80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f601c010a40 tx=0x7f601c01dc20 comp rx=0 tx=0).stop 2024-04-26T12:32:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6025e13800 1 -- 172.21.15.170:0/1313921295 shutdown_connections 2024-04-26T12:32:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6025e13800 1 --2- 172.21.15.170:0/1313921295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee7df80 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6025e13800 1 -- 172.21.15.170:0/1313921295 >> 172.21.15.170:0/1313921295 conn(0x55fe3ee79e30 msgr2=0x55fe3ee77e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6025e13800 1 -- 172.21.15.170:0/1313921295 shutdown_connections 2024-04-26T12:32:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.656+0000 7f6025e13800 1 -- 172.21.15.170:0/1313921295 wait complete. 2024-04-26T12:32:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6025e13800 1 Processor -- start 2024-04-26T12:32:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6025e13800 1 -- start start 2024-04-26T12:32:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6025e13800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee84f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6025e13800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fe3ee7ec20 con 0x55fe3ee7db60 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee84f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6021547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee84f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45336/0 (socket says 172.21.15.170:45336) 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 learned_addr learned my addr 172.21.15.170:0/4109764801 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.657+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3ee85450 con 0x55fe3ee7db60 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f6021547640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee84f10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f601c00fe50 tx=0x7f601c05a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f5ef6ffd640 1 -- 172.21.15.170:0/4109764801 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c06c070 con 0x55fe3ee7db60 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f5ef6ffd640 1 -- 172.21.15.170:0/4109764801 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c00fea0 con 0x55fe3ee7db60 2024-04-26T12:32:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe3ee85450 con 0x55fe3ee7db60 2024-04-26T12:32:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f5ef6ffd640 1 -- 172.21.15.170:0/4109764801 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f601c04c070 con 0x55fe3ee7db60 2024-04-26T12:32:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3ee858f0 con 0x55fe3ee7db60 2024-04-26T12:32:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f5ef6ffd640 1 -- 172.21.15.170:0/4109764801 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f601c00f8b0 con 0x55fe3ee7db60 2024-04-26T12:32:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.658+0000 7f5ef6ffd640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5eec036950 0x7f5eec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.659+0000 7f5ef6ffd640 1 -- 172.21.15.170:0/4109764801 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f601c062d80 con 0x55fe3ee7db60 2024-04-26T12:32:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.659+0000 7f6020d46640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5eec036950 0x7f5eec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.659+0000 7f6020d46640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5eec036950 0x7f5eec038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f600c052fd0 tx=0x7f600c04f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.659+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.659+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ee905a0 0x55fe3ee92a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.659+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee931b0 con 0x55fe3ee905a0 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.659+0000 7f6021d48640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ee905a0 0x55fe3ee92a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6021d48640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ee905a0 0x55fe3ee92a60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ee905a0 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 realm 2024-04-26T12:32:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee935c0 con 0x55fe3ee905a0 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ee905a0 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee905a0 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ee905a0 2024-04-26T12:32:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee94230 con 0x55fe3ee905a0 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ee905a0 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee94bf0 0x55fe3ee96fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.660+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee97630 con 0x55fe3ee94bf0 2024-04-26T12:32:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6021547640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee94bf0 0x55fe3ee96fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6021547640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee94bf0 0x55fe3ee96fe0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6025e13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6025e13800 20 searching for the correct realm 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fe3ee995a0 0x55fe3ee9ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9c130 con 0x55fe3ee995a0 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.661+0000 7f6020d46640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fe3ee995a0 0x55fe3ee9ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.662+0000 7f6020d46640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fe3ee995a0 0x55fe3ee9ba60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.662+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.662+0000 7f6020d46640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f600c076040 0x7f600c083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.662+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9c130 con 0x7f600c076040 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.662+0000 7f6021d48640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f600c076040 0x7f600c083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.662+0000 7f6021d48640 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f600c076040 0x7f600c083410 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f60140083e0 con 0x7f600c076040 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee94bf0 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee905a0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60140083e0 con 0x55fe3ee905a0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee905a0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.663+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee94bf0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee94bf0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x7f600c076040 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee995a0 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.664+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee905a0 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x7f600c076040 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee905a0 2024-04-26T12:32:19.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x7f600c076040 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.665+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee93e90 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee94bf0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.666+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee905a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee905a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee94bf0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.667+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee995a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x7f600c076040 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee905a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee94bf0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.668+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee995a0 2024-04-26T12:32:19.705 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee94bf0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x7f600c076040 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee995a0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.669+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee94bf0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x55fe3ee905a0 2024-04-26T12:32:19.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f600c090040 con 0x7f600c076040 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee979d0 con 0x55fe3ee905a0 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.670+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee979d0 con 0x55fe3ee905a0 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee979d0 con 0x7f600c076040 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 20 zone default found 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 4 Realm: () 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 20 zonegroup default 2024-04-26T12:32:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.671+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee98270 con 0x55fe3ee94bf0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9df90 con 0x55fe3ee995a0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9e330 con 0x55fe3ee995a0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 20 started sync module instance, tier type = 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.672+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9d430 con 0x7f600c076040 2024-04-26T12:32:19.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.673+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.673+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94550465566800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9d430 con 0x7f600c076040 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.673+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9eb80 con 0x55fe3ee905a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.674+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94550465566800] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.674+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.674+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94550465570992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9d430 con 0x55fe3ee905a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.674+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9f5d0 con 0x55fe3ee995a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.675+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94550465570992] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.675+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.675+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94550465564544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9d3a0 con 0x55fe3ee995a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.676+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea0390 con 0x7f600c076040 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.676+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94550465564544] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.677+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.677+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94550465575408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea0780 con 0x7f600c076040 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.677+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea11c0 con 0x55fe3ee905a0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.678+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94550465575408] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.678+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.678+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94550465580176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea1180 con 0x55fe3ee905a0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.678+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea1bd0 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.679+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94550465580176] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.679+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.679+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94550465582880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea1ff0 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.679+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea29b0 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.680+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.680+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94550465586976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea3170 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.680+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea3c70 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.680+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94550465582880] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94550465586976] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94550465591136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9fe10 con 0x55fe3ee94bf0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 20 add_watcher() i=0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 20 add_watcher() i=1 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 20 add_watcher() i=2 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 20 add_watcher() i=3 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 20 add_watcher() i=4 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 20 add_watcher() i=5 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.681+0000 7f6025e13800 20 add_watcher() i=6 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.682+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94550465591136] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.682+0000 7f6025e13800 20 add_watcher() i=7 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.682+0000 7f6025e13800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.682+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea6c60 con 0x55fe3ee905a0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.682+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.682+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94550465588224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea4110 con 0x55fe3ee905a0 2024-04-26T12:32:19.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.683+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94550465588224] v32'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.683+0000 7f5ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.683+0000 7f6025e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.683+0000 7f6025e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.683+0000 7f6025e13800 5 note: GC not initialized 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f5ed67e4640 20 reqs_thread_entry: start 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f6025e13800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f6025e13800 20 Filter name: none 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f5e47fff640 20 reqs_thread_entry: start 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f6025e13800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f6025e13800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eeda2b0 con 0x55fe3ee94bf0 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.684+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.685+0000 7f6025e13800 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.685+0000 7f6025e13800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.685+0000 7f6025e13800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.685+0000 7f6025e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.685+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eee0c20 con 0x55fe3ee94bf0 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6025e13800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6025e13800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6025e13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94550465840784 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eedc2f0 con 0x55fe3ee905a0 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94550465580176 notify 137438953513 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f6014010040 con 0x55fe3ee905a0 2024-04-26T12:32:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f5f04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94550465580176 notifier 4887 bl.length()=666 2024-04-26T12:32:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94550465840784 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f5f04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f5f04ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f5f04ff9640 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5ee4003ea0 con 0x55fe3ee905a0 2024-04-26T12:32:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.686+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94550465840784 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f601400ad80 con 0x55fe3ee905a0 2024-04-26T12:32:19.715 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.687+0000 7f5ed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.687+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94550465588224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eedbe40 con 0x55fe3ee905a0 2024-04-26T12:32:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.688+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94550465588224] v32'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.688+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94550465566800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eedfa90 con 0x7f600c076040 2024-04-26T12:32:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.689+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94550465566800] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.689+0000 7f6025e13800 20 remove_watcher() i=0 2024-04-26T12:32:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.689+0000 7f6025e13800 2 removed watcher, disabling cache 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.689+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94550465570992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9d850 con 0x55fe3ee905a0 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.690+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94550465570992] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.690+0000 7f6025e13800 20 remove_watcher() i=1 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.690+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94550465564544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9d850 con 0x55fe3ee995a0 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.691+0000 7f6020d46640 1 -- 172.21.15.170:0/4109764801 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94550465564544] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f600c081070 con 0x55fe3ee995a0 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.691+0000 7f6025e13800 20 remove_watcher() i=2 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.691+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94550465575408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9cf80 con 0x7f600c076040 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.692+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94550465575408] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x7f600c076040 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.692+0000 7f6025e13800 20 remove_watcher() i=3 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.692+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94550465580176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9f9f0 con 0x55fe3ee905a0 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.693+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94550465580176] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6014026040 con 0x55fe3ee905a0 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.693+0000 7f6025e13800 20 remove_watcher() i=4 2024-04-26T12:32:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.693+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94550465582880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9cf80 con 0x55fe3ee94bf0 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.694+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94550465582880] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.694+0000 7f6025e13800 20 remove_watcher() i=5 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.694+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94550465586976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3ee9f9f0 con 0x55fe3ee94bf0 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.695+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94550465586976] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.695+0000 7f6025e13800 20 remove_watcher() i=6 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.695+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94550465591136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fe3eea1720 con 0x55fe3ee94bf0 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6021547640 1 -- 172.21.15.170:0/4109764801 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94550465591136] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f601c06e070 con 0x55fe3ee94bf0 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 20 remove_watcher() i=7 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee94bf0 msgr2=0x55fe3ee96fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee94bf0 0x55fe3ee96fe0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ee905a0 msgr2=0x55fe3ee92a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ee905a0 0x55fe3ee92a60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f600c076040 msgr2=0x7f600c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f600c076040 0x7f600c083410 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fe3ee995a0 msgr2=0x55fe3ee9ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fe3ee995a0 0x55fe3ee9ba60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5eec036950 msgr2=0x7f5eec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5eec036950 0x7f5eec038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f600c052fd0 tx=0x7f600c04f000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 msgr2=0x55fe3ee84f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6021d48640 1 -- 172.21.15.170:0/4109764801 reap_dead start 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.696+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee84f10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f601c00fe50 tx=0x7f601c05a070 comp rx=0 tx=0).stop 2024-04-26T12:32:19.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 shutdown_connections 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/4109764801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee7db60 0x55fe3ee84f10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 >> 172.21.15.170:0/4109764801 conn(0x55fe3ee79e30 msgr2=0x55fe3ee77490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 shutdown_connections 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/4109764801 wait complete. 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5ef8036950 msgr2=0x7f5ef8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5ef8036950 0x7f5ef8038e10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55fe3ee59c00 tx=0x7f600c005a00 comp rx=0 tx=0).stop 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee709d0 msgr2=0x55fe3ee70df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee709d0 0x55fe3ee70df0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f601c04aca0 tx=0x7f601c0108f0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 shutdown_connections 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5ef8036950 0x7f5ef8038e10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/2390672690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ee709d0 0x55fe3ee70df0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 >> 172.21.15.170:0/2390672690 conn(0x55fe3ee64a70 msgr2=0x55fe3ee64e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 shutdown_connections 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/2390672690 wait complete. 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee5ba60 msgr2=0x55fe3ee5de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fe3ee5ba60 0x55fe3ee5de50 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ed5daa0 msgr2=0x55fe3ee591b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fe3ed5daa0 0x55fe3ee591b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fe3ee5f9f0 msgr2=0x55fe3ee61e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fe3ee5f9f0 0x55fe3ee61e20 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5f08036950 msgr2=0x7f5f08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5f08036950 0x7f5f08038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f600c054000 tx=0x7f600c04e000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 msgr2=0x55fe3ee52140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 --2- 172.21.15.170:0/3801671601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fe3ed59f90 0x55fe3ee52140 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f601c000f80 tx=0x7f601c001250 comp rx=0 tx=0).stop 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6021d48640 1 -- 172.21.15.170:0/3801671601 reap_dead start 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 shutdown_connections 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.697+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 >> 172.21.15.170:0/3801671601 conn(0x55fe3ed53a00 msgr2=0x55fe3ee491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.698+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 shutdown_connections 2024-04-26T12:32:19.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.698+0000 7f6025e13800 1 -- 172.21.15.170:0/3801671601 wait complete. 2024-04-26T12:32:19.727 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.727 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.728 ERROR:root:0 2024-04-26T12:32:19.728 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:19.732 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:19.733 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:19.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:19.733 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T12:32:19.777 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:19.777 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:19.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0ed535800 1 Processor -- start 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0ed535800 1 -- start start 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0ed535800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55eeb2a7be00 0x55eeb2b10480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0ed535800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eeb29b40c0 con 0x55eeb2a7d140 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0ed535800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55eeb29984d0 con 0x55eeb2a7be00 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0e8af8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55eeb2a7be00 0x55eeb2b10480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0e8af8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55eeb2a7be00 0x55eeb2b10480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45342/0 (socket says 172.21.15.170:45342) 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0e8af8640 1 -- 172.21.15.170:0/4157793455 learned_addr learned my addr 172.21.15.170:0/4157793455 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.776+0000 7fd0e92f9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55eeb2a7d140 0x55eeb2a7b6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58872/0 (socket says 172.21.15.170:58872) 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.777+0000 7fd0e8af8640 1 -- 172.21.15.170:0/4157793455 >> v1:172.21.15.132:6789/0 conn(0x55eeb2a7d140 legacy=0x55eeb2a7b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.777+0000 7fd0e8af8640 1 -- 172.21.15.170:0/4157793455 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb29c5d40 con 0x55eeb2a7be00 2024-04-26T12:32:19.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.777+0000 7fd0dbfff640 1 -- 172.21.15.170:0/4157793455 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767937119 0 0) 0x55eeb29b40c0 con 0x55eeb2a7d140 2024-04-26T12:32:19.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.778+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/4157793455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2b10480 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000a520 tx=0x7fd0e001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464e0dfe43ba5422 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0dbfff640 1 -- 172.21.15.170:0/4157793455 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0057070 con 0x55eeb2a7be00 2024-04-26T12:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0dbfff640 1 -- 172.21.15.170:0/4157793455 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0052570 con 0x55eeb2a7be00 2024-04-26T12:32:19.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0dbfff640 1 -- 172.21.15.170:0/4157793455 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e004ae60 con 0x55eeb2a7be00 2024-04-26T12:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0ed535800 1 -- 172.21.15.170:0/4157793455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 msgr2=0x55eeb2b10480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0ed535800 1 --2- 172.21.15.170:0/4157793455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2b10480 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000a520 tx=0x7fd0e001d010 comp rx=0 tx=0).stop 2024-04-26T12:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0ed535800 1 -- 172.21.15.170:0/4157793455 shutdown_connections 2024-04-26T12:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0ed535800 1 --2- 172.21.15.170:0/4157793455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2b10480 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0ed535800 1 -- 172.21.15.170:0/4157793455 >> 172.21.15.170:0/4157793455 conn(0x55eeb2b02ba0 msgr2=0x55eeb2b04fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0ed535800 1 -- 172.21.15.170:0/4157793455 shutdown_connections 2024-04-26T12:32:19.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.779+0000 7fd0ed535800 1 -- 172.21.15.170:0/4157793455 wait complete. 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.791+0000 7fd0ed535800 1 Processor -- start 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.791+0000 7fd0ed535800 1 -- start start 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.791+0000 7fd0ed535800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2bfab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.791+0000 7fd0ed535800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eeb2a52b70 con 0x55eeb2a7be00 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.791+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2bfab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.791+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2bfab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45356/0 (socket says 172.21.15.170:45356) 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.791+0000 7fd0e92f9640 1 -- 172.21.15.170:0/4120719234 learned_addr learned my addr 172.21.15.170:0/4120719234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.792+0000 7fd0e92f9640 1 -- 172.21.15.170:0/4120719234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb29c4590 con 0x55eeb2a7be00 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.792+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/4120719234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2bfab60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc001660 tx=0x7fd0dc001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bbbc152185d85d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.794 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.792+0000 7fcfd7606640 1 -- 172.21.15.170:0/4120719234 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc004480 con 0x55eeb2a7be00 2024-04-26T12:32:19.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.792+0000 7fcfd7606640 1 -- 172.21.15.170:0/4120719234 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc004640 con 0x55eeb2a7be00 2024-04-26T12:32:19.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.792+0000 7fcfd7606640 1 -- 172.21.15.170:0/4120719234 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc0049e0 con 0x55eeb2a7be00 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 -- 172.21.15.170:0/4120719234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 msgr2=0x55eeb2bfab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 --2- 172.21.15.170:0/4120719234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2bfab60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc001660 tx=0x7fd0dc001b20 comp rx=0 tx=0).stop 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 -- 172.21.15.170:0/4120719234 shutdown_connections 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 --2- 172.21.15.170:0/4120719234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2bfab60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 -- 172.21.15.170:0/4120719234 >> 172.21.15.170:0/4120719234 conn(0x55eeb2b02ba0 msgr2=0x55eeb2bf6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 -- 172.21.15.170:0/4120719234 shutdown_connections 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 -- 172.21.15.170:0/4120719234 wait complete. 2024-04-26T12:32:19.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 Processor -- start 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 -- start start 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2c02490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0ed535800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eeb2b12cd0 con 0x55eeb2a7be00 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2c02490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2c02490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45362/0 (socket says 172.21.15.170:45362) 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2512946661 learned_addr learned my addr 172.21.15.170:0/2512946661 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.793+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb29bb8f0 con 0x55eeb2a7be00 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.794+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2c02490 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x55eeb2bfb8f0 tx=0x7fd0dc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.794+0000 7fcfd5e03640 1 -- 172.21.15.170:0/2512946661 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc004260 con 0x55eeb2a7be00 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.794+0000 7fcfd5e03640 1 -- 172.21.15.170:0/2512946661 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc014800 con 0x55eeb2a7be00 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.794+0000 7fcfd5e03640 1 -- 172.21.15.170:0/2512946661 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc014ae0 con 0x55eeb2a7be00 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.794+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb2c029d0 con 0x55eeb2a7be00 2024-04-26T12:32:19.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.794+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb2c02ef0 con 0x55eeb2a7be00 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fcfd5e03640 1 -- 172.21.15.170:0/2512946661 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd0dc010070 con 0x55eeb2a7be00 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fcfd5e03640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfd0036900 0x7fcfd0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fcfd5e03640 1 -- 172.21.15.170:0/2512946661 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fd0dc018070 con 0x55eeb2a7be00 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfd0036900 0x7fcfd0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2a7d140 0x55eeb2c094b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c09a30 con 0x55eeb2a7d140 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fd0e9afa640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2a7d140 0x55eeb2c094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfd0036900 0x7fcfd0038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0054000 tx=0x7fd0e004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.795+0000 7fd0e9afa640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2a7d140 0x55eeb2c094b0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.796+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2512946661 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2a7d140 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.796+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c06a60 con 0x55eeb2a7d140 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.796+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2512946661 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2a7d140 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.796+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c0bd40 0x55eeb2c0e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.796+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c0e820 con 0x55eeb2c0bd40 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.796+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c0bd40 0x55eeb2c0e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.796+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c0bd40 0x55eeb2c0e130 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.797+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2512946661 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd0dc01b030 con 0x55eeb2c0bd40 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.797+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c0acf0 con 0x55eeb2a7d140 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.797+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2512946661 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2a7d140 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.797+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55eeb2c0fc80 0x55eeb2c120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.797+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c12850 con 0x55eeb2c0fc80 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.797+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55eeb2c0fc80 0x55eeb2c120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.797+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55eeb2c0fc80 0x55eeb2c120f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2512946661 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd0e005a040 con 0x55eeb2c0fc80 2024-04-26T12:32:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0ed535800 1 Processor -- start 2024-04-26T12:32:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0ed535800 1 -- start start 2024-04-26T12:32:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0ed535800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c20cb0 0x55eeb2c210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0ed535800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eeb29f8e60 con 0x55eeb2c20cb0 2024-04-26T12:32:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c20cb0 0x55eeb2c210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c20cb0 0x55eeb2c210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45366/0 (socket says 172.21.15.170:45366) 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.798+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2408060690 learned_addr learned my addr 172.21.15.170:0/2408060690 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.799+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2408060690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb2c21610 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.799+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c20cb0 0x55eeb2c210d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc012720 tx=0x7fd0dc011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.799+0000 7fcfceffd640 1 -- 172.21.15.170:0/2408060690 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc038020 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.799+0000 7fcfceffd640 1 -- 172.21.15.170:0/2408060690 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc029680 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.799+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb2c22080 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.799+0000 7fcfceffd640 1 -- 172.21.15.170:0/2408060690 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc028940 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.799+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb2c22580 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fcfceffd640 1 -- 172.21.15.170:0/2408060690 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd0dc03b020 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fcfceffd640 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfc4036970 0x7fcfc4038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fcfceffd640 1 -- 172.21.15.170:0/2408060690 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fd0dc03ed10 con 0x55eeb2c20cb0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfc4036970 0x7fcfc4038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0ed535800 1 Processor -- start 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0ed535800 1 -- start start 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0ed535800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c2e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfc4036970 0x7fcfc4038e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55eeb2c0a2f0 tx=0x7fd0e0005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0ed535800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eeb2bfb280 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c2e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c2e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45370/0 (socket says 172.21.15.170:45370) 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.800+0000 7fd0e92f9640 1 -- 172.21.15.170:0/474562714 learned_addr learned my addr 172.21.15.170:0/474562714 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0e92f9640 1 -- 172.21.15.170:0/474562714 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb2c2e970 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/474562714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c2e3a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc021010 tx=0x7fd0dc034470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a24568a26ca4001 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fcfccff9640 1 -- 172.21.15.170:0/474562714 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc05c070 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fcfccff9640 1 -- 172.21.15.170:0/474562714 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc034830 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fcfccff9640 1 -- 172.21.15.170:0/474562714 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc03f070 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0ed535800 1 -- 172.21.15.170:0/474562714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 msgr2=0x55eeb2c2e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0ed535800 1 --2- 172.21.15.170:0/474562714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c2e3a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc021010 tx=0x7fd0dc034470 comp rx=0 tx=0).stop 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0ed535800 1 -- 172.21.15.170:0/474562714 shutdown_connections 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0ed535800 1 --2- 172.21.15.170:0/474562714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c2e3a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0ed535800 1 -- 172.21.15.170:0/474562714 >> 172.21.15.170:0/474562714 conn(0x55eeb2c2a290 msgr2=0x55eeb2c282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0ed535800 1 -- 172.21.15.170:0/474562714 shutdown_connections 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.801+0000 7fd0ed535800 1 -- 172.21.15.170:0/474562714 wait complete. 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0ed535800 1 Processor -- start 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0ed535800 1 -- start start 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0ed535800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c35400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0ed535800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55eeb2c2f080 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c35400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0e92f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c35400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45382/0 (socket says 172.21.15.170:45382) 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 learned_addr learned my addr 172.21.15.170:0/2257148966 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb2c35940 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c35400 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc04c440 tx=0x7fd0dc038f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fcfbaffd640 1 -- 172.21.15.170:0/2257148966 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc071070 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fcfbaffd640 1 -- 172.21.15.170:0/2257148966 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc049130 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeb2c35940 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fcfbaffd640 1 -- 172.21.15.170:0/2257148966 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc034c70 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.802+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb2c35940 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.803+0000 7fcfbaffd640 1 -- 172.21.15.170:0/2257148966 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd0dc074070 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.803+0000 7fcfbaffd640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfb4036950 0x7fcfb4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.803+0000 7fcfbaffd640 1 -- 172.21.15.170:0/2257148966 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fd0dc077d50 con 0x55eeb2c2dfc0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.803+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfb4036950 0x7fcfb4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfb4036950 0x7fcfb4038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0000c00 tx=0x7fd0e004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2c40a60 0x55eeb2c42f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c43670 con 0x55eeb2c40a60 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0e9afa640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2c40a60 0x55eeb2c42f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0e9afa640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2c40a60 0x55eeb2c42f20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2c40a60 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.804+0000 7fd0ed535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 realm 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c43aa0 con 0x55eeb2c40a60 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2c40a60 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c40a60 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2c40a60 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44710 con 0x55eeb2c40a60 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2c40a60 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c450d0 0x55eeb2c474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c47ad0 con 0x55eeb2c450d0 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.805+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c450d0 0x55eeb2c474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0e92f9640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c450d0 0x55eeb2c474c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0ed535800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0ed535800 20 searching for the correct realm 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55eeb2c49a60 0x55eeb2c4bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4c5f0 con 0x55eeb2c49a60 2024-04-26T12:32:19.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55eeb2c49a60 0x55eeb2c4bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.806+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55eeb2c49a60 0x55eeb2c4bf20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.807+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.807+0000 7fd0e8af8640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd0e0074040 0x7fd0e0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.807+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4c5f0 con 0x7fd0e0074040 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.807+0000 7fd0e9afa640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd0e0074040 0x7fd0e0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.807+0000 7fd0e9afa640 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd0e0074040 0x7fd0e0081410 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.807+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd0e40083e0 con 0x7fd0e0074040 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.807+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c450d0 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c40a60 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e40083e0 con 0x55eeb2c40a60 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c40a60 2024-04-26T12:32:19.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c450d0 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.808+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c450d0 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x7fd0e0074040 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c49a60 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c40a60 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.809+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x7fd0e0074040 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c40a60 2024-04-26T12:32:19.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x7fd0e0074040 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c44370 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.810+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c450d0 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c40a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.811+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c40a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c450d0 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c49a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x7fd0e0074040 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.812+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c40a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.813+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.813+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c450d0 2024-04-26T12:32:19.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.813+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.813+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c49a60 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.813+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.813+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c450d0 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x7fd0e0074040 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c49a60 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c450d0 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.814+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x55eeb2c40a60 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd0e008e040 con 0x7fd0e0074040 2024-04-26T12:32:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c47e70 con 0x55eeb2c40a60 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c47e70 con 0x55eeb2c40a60 2024-04-26T12:32:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.815+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c47e70 con 0x7fd0e0074040 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 zone default found 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 4 Realm: () 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 zonegroup default 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c48710 con 0x55eeb2c450d0 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4e450 con 0x55eeb2c49a60 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4e7f0 con 0x55eeb2c49a60 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 started sync module instance, tier type = 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.816+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4d8f0 con 0x7fd0e0074040 2024-04-26T12:32:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.817+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.818+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483689823456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4d8f0 con 0x7fd0e0074040 2024-04-26T12:32:19.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.818+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4f040 con 0x55eeb2c40a60 2024-04-26T12:32:19.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.818+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483689823456] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.819+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.819+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483689827696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4d8f0 con 0x55eeb2c40a60 2024-04-26T12:32:19.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.819+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4fab0 con 0x55eeb2c49a60 2024-04-26T12:32:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.820+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483689827696] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.820+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.820+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483689821248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4d860 con 0x55eeb2c49a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.820+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c50970 con 0x7fd0e0074040 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.821+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.821+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483689821248] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.821+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483689834144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c51110 con 0x7fd0e0074040 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.821+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4fee0 con 0x55eeb2c40a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.822+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483689834144] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.822+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.822+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483689832160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c51700 con 0x55eeb2c40a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.822+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c51700 con 0x55eeb2c450d0 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.823+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483689832160] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.823+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.823+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483689835360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c52380 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.823+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c52e80 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.824+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483689835360] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.824+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.824+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483689843056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c53100 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.824+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c53c20 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483689843056] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483689846512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c53be0 con 0x55eeb2c450d0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 20 add_watcher() i=0 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 20 add_watcher() i=1 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 20 add_watcher() i=2 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 20 add_watcher() i=3 2024-04-26T12:32:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 20 add_watcher() i=4 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 20 add_watcher() i=5 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.827+0000 7fd0ed535800 20 add_watcher() i=6 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.828+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483689846512] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.828+0000 7fd0ed535800 20 add_watcher() i=7 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.828+0000 7fd0ed535800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.828+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c570a0 con 0x55eeb2c40a60 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.828+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.828+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483689840112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c54560 con 0x55eeb2c40a60 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.829+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483689840112] v32'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.829+0000 7fcf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.829+0000 7fd0ed535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.829+0000 7fd0ed535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.829+0000 7fd0ed535800 5 note: GC not initialized 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.830+0000 7fcf9e7e4640 20 reqs_thread_entry: start 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.830+0000 7fd0ed535800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.830+0000 7fd0ed535800 20 Filter name: none 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.830+0000 7fcf0ffff640 20 reqs_thread_entry: start 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.830+0000 7fd0ed535800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.830+0000 7fd0ed535800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.830+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c8a790 con 0x55eeb2c450d0 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.831+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.831+0000 7fd0ed535800 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.831+0000 7fd0ed535800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.831+0000 7fd0ed535800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.831+0000 7fd0ed535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.831+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c910c0 con 0x55eeb2c450d0 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fd0ed535800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fd0ed535800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fd0ed535800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94483690097456 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c8c790 con 0x55eeb2c40a60 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94483689832160 notify 137438953514 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7fd0e4010040 con 0x55eeb2c40a60 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fcfccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94483689832160 notifier 4894 bl.length()=679 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fcfccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fcfccff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fcfccff9640 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcfac003ea0 con 0x55eeb2c40a60 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.832+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94483690097456 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.833+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.833+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94483690097456 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd0e402c450 con 0x55eeb2c40a60 2024-04-26T12:32:19.851 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:19.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.834+0000 7fcf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.834+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483689840112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c8c2e0 con 0x55eeb2c40a60 2024-04-26T12:32:19.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.835+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94483689840112] v32'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.835+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483689823456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c51df0 con 0x7fd0e0074040 2024-04-26T12:32:19.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.836+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94483689823456] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.836+0000 7fd0ed535800 20 remove_watcher() i=0 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.836+0000 7fd0ed535800 2 removed watcher, disabling cache 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.836+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483689827696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c51df0 con 0x55eeb2c40a60 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.837+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94483689827696] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.837+0000 7fd0ed535800 20 remove_watcher() i=1 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.837+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483689821248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4ed70 con 0x55eeb2c49a60 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.838+0000 7fd0e8af8640 1 -- 172.21.15.170:0/2257148966 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94483689821248] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e007f070 con 0x55eeb2c49a60 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.838+0000 7fd0ed535800 20 remove_watcher() i=2 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.838+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483689834144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c51df0 con 0x7fd0e0074040 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.839+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94483689834144] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x7fd0e0074040 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.839+0000 7fd0ed535800 20 remove_watcher() i=3 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.839+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483689832160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4d440 con 0x55eeb2c40a60 2024-04-26T12:32:19.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.840+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94483689832160] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e4026040 con 0x55eeb2c40a60 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.840+0000 7fd0ed535800 20 remove_watcher() i=4 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.840+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483689835360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c506a0 con 0x55eeb2c450d0 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.841+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94483689835360] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.841+0000 7fd0ed535800 20 remove_watcher() i=5 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.841+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483689843056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c51df0 con 0x55eeb2c450d0 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.842+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94483689843056] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.842+0000 7fd0ed535800 20 remove_watcher() i=6 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.842+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483689846512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55eeb2c4d440 con 0x55eeb2c450d0 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0e92f9640 1 -- 172.21.15.170:0/2257148966 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94483689846512] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc073030 con 0x55eeb2c450d0 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 20 remove_watcher() i=7 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c450d0 msgr2=0x55eeb2c474c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c450d0 0x55eeb2c474c0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2c40a60 msgr2=0x55eeb2c42f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2c40a60 0x55eeb2c42f20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd0e0074040 msgr2=0x7fd0e0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fd0e0074040 0x7fd0e0081410 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55eeb2c49a60 msgr2=0x55eeb2c4bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55eeb2c49a60 0x55eeb2c4bf20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfb4036950 msgr2=0x7fcfb4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfb4036950 0x7fcfb4038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0000c00 tx=0x7fd0e004f000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 msgr2=0x55eeb2c35400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2257148966 reap_dead start 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c35400 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc04c440 tx=0x7fd0dc038f10 comp rx=0 tx=0).stop 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 shutdown_connections 2024-04-26T12:32:19.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2257148966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c2dfc0 0x55eeb2c35400 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 >> 172.21.15.170:0/2257148966 conn(0x55eeb2c2a290 msgr2=0x55eeb2c278f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 shutdown_connections 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.843+0000 7fd0ed535800 1 -- 172.21.15.170:0/2257148966 wait complete. 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfc4036970 msgr2=0x7fcfc4038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfc4036970 0x7fcfc4038e30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55eeb2c0a2f0 tx=0x7fd0e0005ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c20cb0 msgr2=0x55eeb2c210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c20cb0 0x55eeb2c210d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc012720 tx=0x7fd0dc011770 comp rx=0 tx=0).stop 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 shutdown_connections 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfc4036970 0x7fcfc4038e30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2408060690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2c20cb0 0x55eeb2c210d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 >> 172.21.15.170:0/2408060690 conn(0x55eeb2c14d50 msgr2=0x55eeb2c15150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 shutdown_connections 2024-04-26T12:32:19.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2408060690 wait complete. 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c0bd40 msgr2=0x55eeb2c0e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55eeb2c0bd40 0x55eeb2c0e130 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2a7d140 msgr2=0x55eeb2c094b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55eeb2a7d140 0x55eeb2c094b0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55eeb2c0fc80 msgr2=0x55eeb2c120f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55eeb2c0fc80 0x55eeb2c120f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfd0036900 msgr2=0x7fcfd0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcfd0036900 0x7fcfd0038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0054000 tx=0x7fd0e004e000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 msgr2=0x55eeb2c02490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 --2- 172.21.15.170:0/2512946661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55eeb2a7be00 0x55eeb2c02490 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x55eeb2bfb8f0 tx=0x7fd0dc001250 comp rx=0 tx=0).stop 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0e9afa640 1 -- 172.21.15.170:0/2512946661 reap_dead start 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 shutdown_connections 2024-04-26T12:32:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.844+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 >> 172.21.15.170:0/2512946661 conn(0x55eeb2b02ba0 msgr2=0x55eeb2bf9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.845+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 shutdown_connections 2024-04-26T12:32:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.845+0000 7fd0ed535800 1 -- 172.21.15.170:0/2512946661 wait complete. 2024-04-26T12:32:19.862 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.862 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.862 ERROR:root:0 2024-04-26T12:32:19.862 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:19.867 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:19.868 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-26T12:32:19.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-26T12:32:19.868 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-04-26T12:32:19.913 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:19.914 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:19.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.912+0000 7fb149b2f800 1 Processor -- start 2024-04-26T12:32:19.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb149b2f800 1 -- start start 2024-04-26T12:32:19.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb149b2f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561fb6cea5e0 0x561fb6ceaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb149b2f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561fb6b970c0 con 0x561fb6ceb750 2024-04-26T12:32:19.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb149b2f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x561fb6b7b4d0 con 0x561fb6cea5e0 2024-04-26T12:32:19.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb1457ae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561fb6cea5e0 0x561fb6ceaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb1457ae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x561fb6cea5e0 0x561fb6ceaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45394/0 (socket says 172.21.15.170:45394) 2024-04-26T12:32:19.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb1457ae640 1 -- 172.21.15.170:0/2812132381 learned_addr learned my addr 172.21.15.170:0/2812132381 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb1457ae640 1 -- 172.21.15.170:0/2812132381 >> v1:172.21.15.132:6789/0 conn(0x561fb6ceb750 legacy=0x561fb6cebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.913+0000 7fb1457ae640 1 -- 172.21.15.170:0/2812132381 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb6ba8d40 con 0x561fb6cea5e0 2024-04-26T12:32:19.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.915+0000 7fb1457ae640 1 --2- 172.21.15.170:0/2812132381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ceaa00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb13800a520 tx=0x7fb13801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f407b8e47df6d77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.915+0000 7fb144fad640 1 -- 172.21.15.170:0/2812132381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138057070 con 0x561fb6cea5e0 2024-04-26T12:32:19.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.915+0000 7fb144fad640 1 -- 172.21.15.170:0/2812132381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb138052570 con 0x561fb6cea5e0 2024-04-26T12:32:19.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.915+0000 7fb144fad640 1 -- 172.21.15.170:0/2812132381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb13804ae60 con 0x561fb6cea5e0 2024-04-26T12:32:19.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.916+0000 7fb149b2f800 1 -- 172.21.15.170:0/2812132381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 msgr2=0x561fb6ceaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.916+0000 7fb149b2f800 1 --2- 172.21.15.170:0/2812132381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ceaa00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb13800a520 tx=0x7fb13801d010 comp rx=0 tx=0).stop 2024-04-26T12:32:19.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.916+0000 7fb149b2f800 1 -- 172.21.15.170:0/2812132381 shutdown_connections 2024-04-26T12:32:19.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.916+0000 7fb149b2f800 1 --2- 172.21.15.170:0/2812132381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ceaa00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.916+0000 7fb149b2f800 1 -- 172.21.15.170:0/2812132381 >> 172.21.15.170:0/2812132381 conn(0x561fb6ce5ba0 msgr2=0x561fb6ce7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.916+0000 7fb149b2f800 1 -- 172.21.15.170:0/2812132381 shutdown_connections 2024-04-26T12:32:19.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.916+0000 7fb149b2f800 1 -- 172.21.15.170:0/2812132381 wait complete. 2024-04-26T12:32:19.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb149b2f800 1 Processor -- start 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb149b2f800 1 -- start start 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb149b2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ddbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb149b2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561fb6c35b70 con 0x561fb6cea5e0 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ddbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ddbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45402/0 (socket says 172.21.15.170:45402) 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb1457ae640 1 -- 172.21.15.170:0/1008176705 learned_addr learned my addr 172.21.15.170:0/1008176705 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.928+0000 7fb1457ae640 1 -- 172.21.15.170:0/1008176705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb6ba7590 con 0x561fb6cea5e0 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb1457ae640 1 --2- 172.21.15.170:0/1008176705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ddbc40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb13801d050 tx=0x7fb13804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dceed12e14be05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb033606640 1 -- 172.21.15.170:0/1008176705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138057040 con 0x561fb6cea5e0 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb033606640 1 -- 172.21.15.170:0/1008176705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb138052720 con 0x561fb6cea5e0 2024-04-26T12:32:19.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb033606640 1 -- 172.21.15.170:0/1008176705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138052a40 con 0x561fb6cea5e0 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb149b2f800 1 -- 172.21.15.170:0/1008176705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 msgr2=0x561fb6ddbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb149b2f800 1 --2- 172.21.15.170:0/1008176705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ddbc40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb13801d050 tx=0x7fb13804c000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb149b2f800 1 -- 172.21.15.170:0/1008176705 shutdown_connections 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb149b2f800 1 --2- 172.21.15.170:0/1008176705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6ddbc40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb149b2f800 1 -- 172.21.15.170:0/1008176705 >> 172.21.15.170:0/1008176705 conn(0x561fb6ce5ba0 msgr2=0x561fb6dd7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb149b2f800 1 -- 172.21.15.170:0/1008176705 shutdown_connections 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.929+0000 7fb149b2f800 1 -- 172.21.15.170:0/1008176705 wait complete. 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb149b2f800 1 Processor -- start 2024-04-26T12:32:19.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb149b2f800 1 -- start start 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb149b2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6de34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb149b2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561fb6cf3bc0 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6de34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6de34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45418/0 (socket says 172.21.15.170:45418) 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb1457ae640 1 -- 172.21.15.170:0/3172735376 learned_addr learned my addr 172.21.15.170:0/3172735376 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb1457ae640 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb6b9e8f0 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.930+0000 7fb1457ae640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6de34f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb13801cfe0 tx=0x7fb138003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb031e03640 1 -- 172.21.15.170:0/3172735376 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138073070 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb031e03640 1 -- 172.21.15.170:0/3172735376 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb138052d50 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fb6de3a30 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb031e03640 1 -- 172.21.15.170:0/3172735376 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138057070 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb6de3f50 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb031e03640 1 -- 172.21.15.170:0/3172735376 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb138076070 con 0x561fb6cea5e0 2024-04-26T12:32:19.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb031e03640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb02c036900 0x7fb02c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.931+0000 7fb031e03640 1 -- 172.21.15.170:0/3172735376 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb13808dbb0 con 0x561fb6cea5e0 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb02c036900 0x7fb02c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6ceb750 0x561fb6dea560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6deaaf0 con 0x561fb6ceb750 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb145faf640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6ceb750 0x561fb6dea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb02c036900 0x7fb02c038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb130001e10 tx=0x7fb130001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb145faf640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6ceb750 0x561fb6dea560 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb145faf640 1 -- 172.21.15.170:0/3172735376 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6ceb750 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.932+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6deb3d0 con 0x561fb6ceb750 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.933+0000 7fb145faf640 1 -- 172.21.15.170:0/3172735376 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6ceb750 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.933+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6decce0 0x561fb6def170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.933+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6def900 con 0x561fb6decce0 2024-04-26T12:32:19.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.933+0000 7fb1457ae640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6decce0 0x561fb6def170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.933+0000 7fb1457ae640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6decce0 0x561fb6def170 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.933+0000 7fb1457ae640 1 -- 172.21.15.170:0/3172735376 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb138075030 con 0x561fb6decce0 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.933+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6debc20 con 0x561fb6ceb750 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.934+0000 7fb145faf640 1 -- 172.21.15.170:0/3172735376 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6ceb750 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.934+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561fb6df0d60 0x561fb6df31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.934+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6df3930 con 0x561fb6df0d60 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.934+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561fb6df0d60 0x561fb6df31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.934+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561fb6df0d60 0x561fb6df31d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.934+0000 7fb13cfad640 1 -- 172.21.15.170:0/3172735376 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1300106a0 con 0x561fb6df0d60 2024-04-26T12:32:19.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb149b2f800 1 Processor -- start 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb149b2f800 1 -- start start 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb149b2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6e01d90 0x561fb6e021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb149b2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561fb6bdbe60 con 0x561fb6e01d90 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6e01d90 0x561fb6e021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6e01d90 0x561fb6e021b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45420/0 (socket says 172.21.15.170:45420) 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb1457ae640 1 -- 172.21.15.170:0/3624909576 learned_addr learned my addr 172.21.15.170:0/3624909576 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.935+0000 7fb1457ae640 1 -- 172.21.15.170:0/3624909576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb6e026f0 con 0x561fb6e01d90 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.936+0000 7fb1457ae640 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6e01d90 0x561fb6e021b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb138060040 tx=0x7fb138076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.936+0000 7fb02affd640 1 -- 172.21.15.170:0/3624909576 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138091070 con 0x561fb6e01d90 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.936+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fb6e03160 con 0x561fb6e01d90 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.936+0000 7fb02affd640 1 -- 172.21.15.170:0/3624909576 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13805d5b0 con 0x561fb6e01d90 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.936+0000 7fb02affd640 1 -- 172.21.15.170:0/3624909576 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb13805d890 con 0x561fb6e01d90 2024-04-26T12:32:19.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.936+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb6e03660 con 0x561fb6e01d90 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb02affd640 1 -- 172.21.15.170:0/3624909576 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb138076900 con 0x561fb6e01d90 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb02affd640 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb01c0368b0 0x7fb01c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb02affd640 1 -- 172.21.15.170:0/3624909576 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb138089050 con 0x561fb6e01d90 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb01c0368b0 0x7fb01c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb149b2f800 1 Processor -- start 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb149b2f800 1 -- start start 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb01c0368b0 0x7fb01c038d70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x561fb6de7a50 tx=0x7fb130006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb149b2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6c600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.937+0000 7fb149b2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561fb6ddc300 con 0x561fb6c5fcd0 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6c600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6c600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45428/0 (socket says 172.21.15.170:45428) 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb1457ae640 1 -- 172.21.15.170:0/169479411 learned_addr learned my addr 172.21.15.170:0/169479411 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb1457ae640 1 -- 172.21.15.170:0/169479411 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb6c5e4d0 con 0x561fb6c5fcd0 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb1457ae640 1 --2- 172.21.15.170:0/169479411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6c600f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb13809cfd0 tx=0x7fb138078c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365ecd423a7117cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb028ff9640 1 -- 172.21.15.170:0/169479411 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138077a70 con 0x561fb6c5fcd0 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb028ff9640 1 -- 172.21.15.170:0/169479411 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb138078440 con 0x561fb6c5fcd0 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb028ff9640 1 -- 172.21.15.170:0/169479411 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138077c10 con 0x561fb6c5fcd0 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb149b2f800 1 -- 172.21.15.170:0/169479411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 msgr2=0x561fb6c600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.938+0000 7fb149b2f800 1 --2- 172.21.15.170:0/169479411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6c600f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb13809cfd0 tx=0x7fb138078c20 comp rx=0 tx=0).stop 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 -- 172.21.15.170:0/169479411 shutdown_connections 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 --2- 172.21.15.170:0/169479411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6c600f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 -- 172.21.15.170:0/169479411 >> 172.21.15.170:0/169479411 conn(0x561fb6e0b210 msgr2=0x561fb6e09270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 -- 172.21.15.170:0/169479411 shutdown_connections 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 -- 172.21.15.170:0/169479411 wait complete. 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 Processor -- start 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 -- start start 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6e184c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb149b2f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561fb6c5e8e0 con 0x561fb6c5fcd0 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6e184c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb1457ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6e184c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45436/0 (socket says 172.21.15.170:45436) 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.939+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 learned_addr learned my addr 172.21.15.170:0/3002238492 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.940+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb6e18a00 con 0x561fb6c5fcd0 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.940+0000 7fb1457ae640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6e184c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb13808dea0 tx=0x7fb13804c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.940+0000 7fb01affd640 1 -- 172.21.15.170:0/3002238492 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb13808a500 con 0x561fb6c5fcd0 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.940+0000 7fb01affd640 1 -- 172.21.15.170:0/3002238492 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13808a6a0 con 0x561fb6c5fcd0 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.940+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561fb6e18a00 con 0x561fb6c5fcd0 2024-04-26T12:32:19.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.940+0000 7fb01affd640 1 -- 172.21.15.170:0/3002238492 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb13805c750 con 0x561fb6c5fcd0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.940+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb6e18a00 con 0x561fb6c5fcd0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.941+0000 7fb01affd640 1 -- 172.21.15.170:0/3002238492 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb1380bd060 con 0x561fb6c5fcd0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.941+0000 7fb01affd640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb010036950 0x7fb010038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.941+0000 7fb01affd640 1 -- 172.21.15.170:0/3002238492 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fb1380c0d10 con 0x561fb6c5fcd0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.941+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb010036950 0x7fb010038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb010036950 0x7fb010038e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x561fb6df3d30 tx=0x7fb130011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6e23c10 0x561fb6e260d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e26820 con 0x561fb6e23c10 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb145faf640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6e23c10 0x561fb6e260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb145faf640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6e23c10 0x561fb6e260d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb149b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb149b2f800 20 realm 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.942+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e26c30 con 0x561fb6e23c10 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e27500 con 0x561fb6e23c10 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6e28600 0x561fb6e2a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e2b000 con 0x561fb6e28600 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.943+0000 7fb1457ae640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6e28600 0x561fb6e2a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb1457ae640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6e28600 0x561fb6e2a9f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb149b2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb149b2f800 20 searching for the correct realm 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561fb6e2cfb0 0x561fb6e2f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e2fb40 con 0x561fb6e2cfb0 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561fb6e2cfb0 0x561fb6e2f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.944+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561fb6e2cfb0 0x561fb6e2f470 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.945+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.945+0000 7fb13cfad640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb1300393c0 0x7fb130039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:19.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.945+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e2fb40 con 0x7fb1300393c0 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.945+0000 7fb145faf640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb1300393c0 0x7fb130039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.945+0000 7fb145faf640 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb1300393c0 0x7fb130039810 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.945+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb14000a4a0 con 0x7fb1300393c0 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.945+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.946+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x7fb1300393c0 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14000a4a0 con 0x7fb1300393c0 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.947+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x7fb1300393c0 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14000a4a0 con 0x7fb1300393c0 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14000a4a0 con 0x561fb6e23c10 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x7fb1300393c0 2024-04-26T12:32:19.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.948+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.949+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.949+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.949+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.949+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.949+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.949+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.949+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x7fb1300393c0 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.950+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.951+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.951+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.951+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.951+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.951+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.951+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x7fb1300393c0 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e28600 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.952+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x561fb6e23c10 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e278a0 con 0x7fb1300393c0 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e2b8c0 con 0x561fb6e23c10 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e2b8c0 con 0x561fb6e23c10 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.953+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e2b8c0 con 0x7fb1300393c0 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 zone default found 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 4 Realm: () 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 zonegroup default 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e2c160 con 0x561fb6e28600 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e319a0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.954+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e31d40 con 0x561fb6e2cfb0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.955+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.955+0000 7fb149b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.955+0000 7fb149b2f800 20 started sync module instance, tier type = 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.955+0000 7fb149b2f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.955+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e30e40 con 0x7fb1300393c0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.956+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.956+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94694212309872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e30e40 con 0x7fb1300393c0 2024-04-26T12:32:19.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.956+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e32700 con 0x561fb6e23c10 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.957+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94694212309872] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.957+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.957+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94694212314160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e30e40 con 0x561fb6e23c10 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.957+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e33150 con 0x561fb6e2cfb0 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.958+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94694212314160] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.958+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.958+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94694212307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e30db0 con 0x561fb6e2cfb0 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.958+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e33f10 con 0x7fb1300393c0 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.959+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94694212307344] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.960+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.960+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94694212318576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e34330 con 0x7fb1300393c0 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.960+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e34d30 con 0x561fb6e23c10 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.961+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94694212318576] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.961+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.961+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94694212319632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e34cf0 con 0x561fb6e23c10 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.961+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e35740 con 0x561fb6e28600 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.962+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.962+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94694212326032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e35fe0 con 0x561fb6e28600 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.962+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e36a60 con 0x561fb6e28600 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.962+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94694212319632] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.963+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94694212326032] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.963+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.963+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94694212330832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e36e00 con 0x561fb6e28600 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.963+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e37690 con 0x561fb6e28600 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94694212330832] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94694212323392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e37930 con 0x561fb6e28600 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 20 add_watcher() i=0 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 20 add_watcher() i=1 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 20 add_watcher() i=2 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 20 add_watcher() i=3 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 20 add_watcher() i=4 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 20 add_watcher() i=5 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.964+0000 7fb149b2f800 20 add_watcher() i=6 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.965+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94694212323392] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.965+0000 7fb149b2f800 20 add_watcher() i=7 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.965+0000 7fb149b2f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.965+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e3ae40 con 0x561fb6e23c10 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.965+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.965+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94694212334048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e38360 con 0x561fb6e23c10 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.966+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94694212334048] v32'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.966+0000 7faffb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.966+0000 7fb149b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.966+0000 7fb149b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.966+0000 7fb149b2f800 5 note: GC not initialized 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7faffa7e4640 20 reqs_thread_entry: start 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 20 Filter name: none 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7faf6bfff640 20 reqs_thread_entry: start 2024-04-26T12:32:19.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e6e560 con 0x561fb6e28600 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 20 rados_obj.operate() r=0 bl.length=503 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.967+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e74f20 con 0x561fb6e28600 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb149b2f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb149b2f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb149b2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94694212585872 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e705f0 con 0x561fb6e23c10 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94694212319632 notify 137438953515 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fb140018d80 con 0x561fb6e23c10 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb028ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94694212319632 notifier 4901 bl.length()=636 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb028ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb028ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb028ff9640 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb008003ea0 con 0x561fb6e23c10 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94694212585872 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.969+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94694212585872 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb1400050f0 con 0x561fb6e23c10 2024-04-26T12:32:19.984 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.970+0000 7faffb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.970+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94694212334048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e73e80 con 0x561fb6e23c10 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.971+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94694212334048] v32'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.971+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94694212309872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e739d0 con 0x7fb1300393c0 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.972+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94694212309872] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.972+0000 7fb149b2f800 20 remove_watcher() i=0 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.972+0000 7fb149b2f800 2 removed watcher, disabling cache 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.972+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94694212314160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e31370 con 0x561fb6e23c10 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.973+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94694212314160] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.973+0000 7fb149b2f800 20 remove_watcher() i=1 2024-04-26T12:32:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.973+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94694212307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e31370 con 0x561fb6e2cfb0 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.974+0000 7fb13cfad640 1 -- 172.21.15.170:0/3002238492 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94694212307344] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb130036040 con 0x561fb6e2cfb0 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.974+0000 7fb149b2f800 20 remove_watcher() i=2 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.974+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94694212318576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e30990 con 0x7fb1300393c0 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.975+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94694212318576] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x7fb1300393c0 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.975+0000 7fb149b2f800 20 remove_watcher() i=3 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.975+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94694212319632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e33570 con 0x561fb6e23c10 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.976+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94694212319632] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140033040 con 0x561fb6e23c10 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.976+0000 7fb149b2f800 20 remove_watcher() i=4 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.976+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94694212326032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e30990 con 0x561fb6e28600 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.977+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94694212326032] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.977+0000 7fb149b2f800 20 remove_watcher() i=5 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.977+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94694212330832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e30990 con 0x561fb6e28600 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.978+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94694212330832] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.978+0000 7fb149b2f800 20 remove_watcher() i=6 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.978+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94694212323392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561fb6e36550 con 0x561fb6e28600 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb1457ae640 1 -- 172.21.15.170:0/3002238492 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94694212323392] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb138093070 con 0x561fb6e28600 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 20 remove_watcher() i=7 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6e28600 msgr2=0x561fb6e2a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6e28600 0x561fb6e2a9f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6e23c10 msgr2=0x561fb6e260d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6e23c10 0x561fb6e260d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb1300393c0 msgr2=0x7fb130039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fb1300393c0 0x7fb130039810 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561fb6e2cfb0 msgr2=0x561fb6e2f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x561fb6e2cfb0 0x561fb6e2f470 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb010036950 msgr2=0x7fb010038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.979+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb010036950 0x7fb010038e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x561fb6df3d30 tx=0x7fb130011000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 msgr2=0x561fb6e184c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3002238492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6c5fcd0 0x561fb6e184c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb13808dea0 tx=0x7fb13804c190 comp rx=0 tx=0).stop 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 reap_dead start 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb145faf640 1 -- 172.21.15.170:0/3002238492 reap_dead start 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 shutdown_connections 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 >> 172.21.15.170:0/3002238492 conn(0x561fb6e0b210 msgr2=0x561fb6e08870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 shutdown_connections 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3002238492 wait complete. 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb01c0368b0 msgr2=0x7fb01c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb01c0368b0 0x7fb01c038d70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x561fb6de7a50 tx=0x7fb130006000 comp rx=0 tx=0).stop 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6e01d90 msgr2=0x561fb6e021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6e01d90 0x561fb6e021b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb138060040 tx=0x7fb138076650 comp rx=0 tx=0).stop 2024-04-26T12:32:19.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 shutdown_connections 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb01c0368b0 0x7fb01c038d70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3624909576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6e01d90 0x561fb6e021b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 >> 172.21.15.170:0/3624909576 conn(0x561fb6df5e30 msgr2=0x561fb6df6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 shutdown_connections 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3624909576 wait complete. 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6decce0 msgr2=0x561fb6def170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x561fb6decce0 0x561fb6def170 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6ceb750 msgr2=0x561fb6dea560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x561fb6ceb750 0x561fb6dea560 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561fb6df0d60 msgr2=0x561fb6df31d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x561fb6df0d60 0x561fb6df31d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb02c036900 msgr2=0x7fb02c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fb02c036900 0x7fb02c038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb130001e10 tx=0x7fb130001390 comp rx=0 tx=0).stop 2024-04-26T12:32:19.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 msgr2=0x561fb6de34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb149b2f800 1 --2- 172.21.15.170:0/3172735376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561fb6cea5e0 0x561fb6de34f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb13801cfe0 tx=0x7fb138003020 comp rx=0 tx=0).stop 2024-04-26T12:32:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.980+0000 7fb145faf640 1 -- 172.21.15.170:0/3172735376 reap_dead start 2024-04-26T12:32:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.981+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 shutdown_connections 2024-04-26T12:32:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.981+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 >> 172.21.15.170:0/3172735376 conn(0x561fb6ce5ba0 msgr2=0x561fb6dda630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.981+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 shutdown_connections 2024-04-26T12:32:19.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:19.981+0000 7fb149b2f800 1 -- 172.21.15.170:0/3172735376 wait complete. 2024-04-26T12:32:19.996 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.996 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:19.996 ERROR:root:0 2024-04-26T12:32:19.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:32:19.997 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:32:19.997 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-04-26T12:32:20.041 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:20.041 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:20.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.040+0000 7f0c4fb33800 1 Processor -- start 2024-04-26T12:32:20.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.040+0000 7f0c4fb33800 1 -- start start 2024-04-26T12:32:20.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.040+0000 7f0c4fb33800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x563e97b37980 0x563e97b39d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.040+0000 7f0c4fb33800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e979e00c0 con 0x563e97b335e0 2024-04-26T12:32:20.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.040+0000 7f0c4fb33800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x563e979c44d0 con 0x563e97b37980 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.040+0000 7f0c4aff4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x563e97b37980 0x563e97b39d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.040+0000 7f0c4aff4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x563e97b37980 0x563e97b39d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45444/0 (socket says 172.21.15.170:45444) 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.041+0000 7f0c4aff4640 1 -- 172.21.15.170:0/3509281571 learned_addr learned my addr 172.21.15.170:0/3509281571 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.041+0000 7f0c4aff4640 1 -- 172.21.15.170:0/3509281571 >> v1:172.21.15.132:6789/0 conn(0x563e97b335e0 legacy=0x563e97b33a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.041+0000 7f0c4aff4640 1 -- 172.21.15.170:0/3509281571 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e979f1d40 con 0x563e97b37980 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/3509281571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b37980 0x563e97b39d70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000a520 tx=0x7f0c4001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ff17030285fad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4a7f3640 1 -- 172.21.15.170:0/3509281571 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c40057070 con 0x563e97b37980 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4a7f3640 1 -- 172.21.15.170:0/3509281571 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c40052570 con 0x563e97b37980 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4a7f3640 1 -- 172.21.15.170:0/3509281571 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c4004ae60 con 0x563e97b37980 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3509281571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b37980 msgr2=0x563e97b39d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3509281571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b37980 0x563e97b39d70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000a520 tx=0x7f0c4001d010 comp rx=0 tx=0).stop 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3509281571 shutdown_connections 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3509281571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b37980 0x563e97b39d70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3509281571 >> 172.21.15.170:0/3509281571 conn(0x563e97b2eba0 msgr2=0x563e97b30fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3509281571 shutdown_connections 2024-04-26T12:32:20.049 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.043+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3509281571 wait complete. 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.055+0000 7f0c4fb33800 1 Processor -- start 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.055+0000 7f0c4fb33800 1 -- start start 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.055+0000 7f0c4fb33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c24910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.055+0000 7f0c4fb33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e97a7eb70 con 0x563e97b335e0 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.055+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c24910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.055+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c24910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45452/0 (socket says 172.21.15.170:45452) 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.055+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1850554111 learned_addr learned my addr 172.21.15.170:0/1850554111 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.056+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1850554111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e979f0590 con 0x563e97b335e0 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.056+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/1850554111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c24910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c001d80 tx=0x7f0c3c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf72f21fc95cb08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.056+0000 7f0b3960a640 1 -- 172.21.15.170:0/1850554111 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c00f400 con 0x563e97b335e0 2024-04-26T12:32:20.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.056+0000 7f0b3960a640 1 -- 172.21.15.170:0/1850554111 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00f5c0 con 0x563e97b335e0 2024-04-26T12:32:20.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.056+0000 7f0b3960a640 1 -- 172.21.15.170:0/1850554111 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c00f920 con 0x563e97b335e0 2024-04-26T12:32:20.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1850554111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 msgr2=0x563e97c24910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1850554111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c24910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c001d80 tx=0x7f0c3c001e70 comp rx=0 tx=0).stop 2024-04-26T12:32:20.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1850554111 shutdown_connections 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1850554111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c24910 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1850554111 >> 172.21.15.170:0/1850554111 conn(0x563e97b2eba0 msgr2=0x563e97c20190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1850554111 shutdown_connections 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1850554111 wait complete. 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 Processor -- start 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 -- start start 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c2c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4fb33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e97b3a640 con 0x563e97b335e0 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c2c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c2c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45466/0 (socket says 172.21.15.170:45466) 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.057+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/3147541873 learned_addr learned my addr 172.21.15.170:0/3147541873 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.058+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e979e78f0 con 0x563e97b335e0 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.058+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c2c2a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x563e97c256a0 tx=0x7f0c3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.058+0000 7f0b37e07640 1 -- 172.21.15.170:0/3147541873 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c01a690 con 0x563e97b335e0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.058+0000 7f0b37e07640 1 -- 172.21.15.170:0/3147541873 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c01a850 con 0x563e97b335e0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.058+0000 7f0b37e07640 1 -- 172.21.15.170:0/3147541873 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c01ab70 con 0x563e97b335e0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.058+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e97c2c7e0 con 0x563e97b335e0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.058+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e97c2cd60 con 0x563e97b335e0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0b37e07640 1 -- 172.21.15.170:0/3147541873 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c3c017070 con 0x563e97b335e0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0b37e07640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b30036950 0x7f0b30038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0b37e07640 1 -- 172.21.15.170:0/3147541873 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c3c015020 con 0x563e97b335e0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b30036950 0x7f0b30038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c31300 0x563e97c336f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c33c30 con 0x563e97c31300 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0c4bff6640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c31300 0x563e97c336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b30036950 0x7f0b30038e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c40054000 tx=0x7f0c4004e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.059+0000 7f0c4bff6640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c31300 0x563e97c336f0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.060+0000 7f0c4bff6640 1 -- 172.21.15.170:0/3147541873 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c31300 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.060+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c308e0 con 0x563e97c31300 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.060+0000 7f0c4bff6640 1 -- 172.21.15.170:0/3147541873 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c31300 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.060+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c35f60 0x563e97c38350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.060+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c38a40 con 0x563e97c35f60 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.060+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c35f60 0x563e97c38350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.061+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c35f60 0x563e97c38350 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.061+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/3147541873 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c35f60 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.061+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c34ee0 con 0x563e97c31300 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.061+0000 7f0c4bff6640 1 -- 172.21.15.170:0/3147541873 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c31300 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.061+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e97c39ea0 0x563e97c3c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.061+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c3ca70 con 0x563e97c39ea0 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.061+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e97c39ea0 0x563e97c3c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.062+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e97c39ea0 0x563e97c3c310 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.062+0000 7f0c4aff4640 1 -- 172.21.15.170:0/3147541873 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c4005a040 con 0x563e97c39ea0 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.062+0000 7f0c4fb33800 1 Processor -- start 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.062+0000 7f0c4fb33800 1 -- start start 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.062+0000 7f0c4fb33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c4aed0 0x563e97c4b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.062+0000 7f0c4fb33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e97a24e60 con 0x563e97c4aed0 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c4aed0 0x563e97c4b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c4aed0 0x563e97c4b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45478/0 (socket says 172.21.15.170:45478) 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/3777133423 learned_addr learned my addr 172.21.15.170:0/3777133423 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/3777133423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e97c4b830 con 0x563e97c4aed0 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c4aed0 0x563e97c4b2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c04ad70 tx=0x7f0c3c046f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0b35602640 1 -- 172.21.15.170:0/3777133423 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c02c040 con 0x563e97c4aed0 2024-04-26T12:32:20.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0b35602640 1 -- 172.21.15.170:0/3777133423 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c035070 con 0x563e97c4aed0 2024-04-26T12:32:20.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e97c4c2a0 con 0x563e97c4aed0 2024-04-26T12:32:20.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0b35602640 1 -- 172.21.15.170:0/3777133423 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c0443d0 con 0x563e97c4aed0 2024-04-26T12:32:20.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.063+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e97c4c2a0 con 0x563e97c4aed0 2024-04-26T12:32:20.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.064+0000 7f0b35602640 1 -- 172.21.15.170:0/3777133423 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c3c00e070 con 0x563e97c4aed0 2024-04-26T12:32:20.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.064+0000 7f0b35602640 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b24036900 0x7f0b24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.064+0000 7f0b35602640 1 -- 172.21.15.170:0/3777133423 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c3c048050 con 0x563e97c4aed0 2024-04-26T12:32:20.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.064+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b24036900 0x7f0b24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.064+0000 7f0c4fb33800 1 Processor -- start 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.064+0000 7f0c4fb33800 1 -- start start 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.064+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b24036900 0x7f0b24038dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x563e97c34510 tx=0x7f0c40005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0c4fb33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c58310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0c4fb33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e97c25090 con 0x563e97c57ef0 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c58310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c58310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45494/0 (socket says 172.21.15.170:45494) 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/4247317728 learned_addr learned my addr 172.21.15.170:0/4247317728 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/4247317728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e97c588e0 con 0x563e97c57ef0 2024-04-26T12:32:20.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/4247317728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c58310 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c03f1d0 tx=0x7f0c3c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de575d8efa24ace4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0b2effd640 1 -- 172.21.15.170:0/4247317728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c0319f0 con 0x563e97c57ef0 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0b2effd640 1 -- 172.21.15.170:0/4247317728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00ee00 con 0x563e97c57ef0 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.065+0000 7f0b2effd640 1 -- 172.21.15.170:0/4247317728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c03ad90 con 0x563e97c57ef0 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 -- 172.21.15.170:0/4247317728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 msgr2=0x563e97c58310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/4247317728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c58310 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c03f1d0 tx=0x7f0c3c0316f0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 -- 172.21.15.170:0/4247317728 shutdown_connections 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/4247317728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c58310 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 -- 172.21.15.170:0/4247317728 >> 172.21.15.170:0/4247317728 conn(0x563e97c541c0 msgr2=0x563e97c52220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 -- 172.21.15.170:0/4247317728 shutdown_connections 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 -- 172.21.15.170:0/4247317728 wait complete. 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 Processor -- start 2024-04-26T12:32:20.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 -- start start 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c5f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4fb33800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x563e97c58f40 con 0x563e97c57ef0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c5f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4b7f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c5f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45496/0 (socket says 172.21.15.170:45496) 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.066+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 learned_addr learned my addr 172.21.15.170:0/1632064941 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.067+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e97c5f770 con 0x563e97c57ef0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.067+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c5f230 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00efd0 tx=0x7f0c3c039fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.067+0000 7f0b2d7fa640 1 -- 172.21.15.170:0/1632064941 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c06e020 con 0x563e97c57ef0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.067+0000 7f0b2d7fa640 1 -- 172.21.15.170:0/1632064941 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c04c0c0 con 0x563e97c57ef0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.067+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e97c5f770 con 0x563e97c57ef0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.067+0000 7f0b2d7fa640 1 -- 172.21.15.170:0/1632064941 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c066040 con 0x563e97c57ef0 2024-04-26T12:32:20.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.067+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e97c5f770 con 0x563e97c57ef0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0b2d7fa640 1 -- 172.21.15.170:0/1632064941 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c3c071020 con 0x563e97c57ef0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0b2d7fa640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b14036900 0x7f0b14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0b2d7fa640 1 -- 172.21.15.170:0/1632064941 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f0c3c074d10 con 0x563e97c57ef0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b14036900 0x7f0b14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b14036900 0x7f0b14038dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0c40044940 tx=0x7f0c4004f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c6a9c0 0x563e97c6ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6d5d0 con 0x563e97c6a9c0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.068+0000 7f0c4bff6640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c6a9c0 0x563e97c6ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4bff6640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c6a9c0 0x563e97c6ce80 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 20 realm 2024-04-26T12:32:20.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6d9e0 con 0x563e97c6a9c0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e2b0 con 0x563e97c6a9c0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.069+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6a9c0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c6f3b0 0x563e97c717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c71db0 con 0x563e97c6f3b0 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c6f3b0 0x563e97c717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4b7f5640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c6f3b0 0x563e97c717a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 20 searching for the correct realm 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e97c73d60 0x563e97c76220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.070+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c768f0 con 0x563e97c73d60 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.071+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e97c73d60 0x563e97c76220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.071+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e97c73d60 0x563e97c76220 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.071+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.071+0000 7f0c4aff4640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c40074040 0x7f0c40081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.071+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c768f0 con 0x7f0c40074040 2024-04-26T12:32:20.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.071+0000 7f0c4bff6640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c40074040 0x7f0c40081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.072+0000 7f0c4bff6640 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c40074040 0x7f0c40081410 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.072+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c4400a4a0 con 0x7f0c40074040 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.072+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6f3b0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.072+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.072+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6a9c0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.072+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.072+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6a9c0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6f3b0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6f3b0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x7f0c40074040 2024-04-26T12:32:20.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4400a4a0 con 0x7f0c40074040 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.073+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c73d60 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6a9c0 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x7f0c40074040 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4400a4a0 con 0x7f0c40074040 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c6a9c0 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4400a4a0 con 0x563e97c6a9c0 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x7f0c40074040 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.074+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e97c6e650 con 0x563e97c73d60 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c73d60 2024-04-26T12:32:20.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6f3b0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c73d60 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.075+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c73d60 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.076+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.076+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6a9c0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.076+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.076+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6a9c0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.076+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.076+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6f3b0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c73d60 2024-04-26T12:32:20.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x7f0c40074040 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6a9c0 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.077+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6f3b0 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c73d60 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6f3b0 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x7f0c40074040 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.078+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c73d60 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6f3b0 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x563e97c6a9c0 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0c4008e040 con 0x7f0c40074040 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.079+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c72670 con 0x563e97c6a9c0 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c72670 con 0x563e97c6a9c0 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c72670 con 0x7f0c40074040 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:20.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 zone default found 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 4 Realm: () 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 zonegroup default 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.080+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c72f10 con 0x563e97c6f3b0 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c78750 con 0x563e97c73d60 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c78af0 con 0x563e97c73d60 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 20 started sync module instance, tier type = 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.081+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c77bf0 con 0x7f0c40074040 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.082+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.082+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94826834395104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c77bf0 con 0x7f0c40074040 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.082+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c79380 con 0x563e97c6a9c0 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.083+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94826834395104] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.083+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.083+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94826834398864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c77bf0 con 0x563e97c6a9c0 2024-04-26T12:32:20.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.083+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c79e40 con 0x563e97c73d60 2024-04-26T12:32:20.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.084+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94826834398864] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.085+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.085+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94826834392896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c77b60 con 0x563e97c73d60 2024-04-26T12:32:20.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.085+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7ad00 con 0x7f0c40074040 2024-04-26T12:32:20.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.085+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94826834392896] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.086+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.086+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94826834405456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7b120 con 0x7f0c40074040 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.086+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7bae0 con 0x563e97c6a9c0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.087+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94826834405456] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.087+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.087+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94826834406992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7bae0 con 0x563e97c6a9c0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.087+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7c4a0 con 0x563e97c6f3b0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.088+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.088+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94826834406992] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.088+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94826834409008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7ba50 con 0x563e97c6f3b0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.088+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7d1c0 con 0x563e97c6f3b0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.090+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94826834409008] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.090+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.090+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94826834414144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7da10 con 0x563e97c6f3b0 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.090+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7e3d0 con 0x563e97c6f3b0 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.091+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94826834414144] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94826834417472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7e3d0 con 0x563e97c6f3b0 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 20 add_watcher() i=0 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 20 add_watcher() i=1 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 20 add_watcher() i=2 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 20 add_watcher() i=3 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 20 add_watcher() i=4 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 20 add_watcher() i=5 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.093+0000 7f0c4fb33800 20 add_watcher() i=6 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.094+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94826834417472] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.094+0000 7f0c4fb33800 20 add_watcher() i=7 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.094+0000 7f0c4fb33800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:20.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.094+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97c816e0 con 0x563e97c6a9c0 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.094+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.094+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94826834419856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7e960 con 0x563e97c6a9c0 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.095+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94826834419856] v32'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.095+0000 7f0b01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.095+0000 7f0c4fb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.095+0000 7f0c4fb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0c4fb33800 5 note: GC not initialized 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0b00fe1640 20 reqs_thread_entry: start 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0c4fb33800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0c4fb33800 20 Filter name: none 2024-04-26T12:32:20.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0a7a7fc640 20 reqs_thread_entry: start 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0c4fb33800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0c4fb33800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.096+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97cb4e60 con 0x563e97c6f3b0 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.097+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.097+0000 7f0c4fb33800 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.097+0000 7f0c4fb33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.097+0000 7f0c4fb33800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.097+0000 7f0c4fb33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.097+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97cbb480 con 0x563e97c6f3b0 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4fb33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4fb33800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4fb33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:20.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94826834669296 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e97cb6b50 con 0x563e97c6a9c0 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94826834406992 notify 137438953516 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f0c44018da0 con 0x563e97c6a9c0 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0b2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 94826834406992 notifier 4908 bl.length()=666 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94826834669296 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0b2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0b2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0b2effd640 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b10003ea0 con 0x563e97c6a9c0 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.098+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94826834669296 notify 137438953516 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c44046510 con 0x563e97c6a9c0 2024-04-26T12:32:20.114 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:20.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.099+0000 7f0b01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.099+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94826834419856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c66700 con 0x563e97c6a9c0 2024-04-26T12:32:20.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.100+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94826834419856] v32'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.100+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94826834395104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7e090 con 0x7f0c40074040 2024-04-26T12:32:20.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.101+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94826834395104] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.101+0000 7f0c4fb33800 20 remove_watcher() i=0 2024-04-26T12:32:20.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.101+0000 7f0c4fb33800 2 removed watcher, disabling cache 2024-04-26T12:32:20.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.101+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94826834398864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7e090 con 0x563e97c6a9c0 2024-04-26T12:32:20.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.102+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94826834398864] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.102+0000 7f0c4fb33800 20 remove_watcher() i=1 2024-04-26T12:32:20.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.102+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94826834392896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c78e90 con 0x563e97c73d60 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.103+0000 7f0c4aff4640 1 -- 172.21.15.170:0/1632064941 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94826834392896] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c4007f070 con 0x563e97c73d60 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.103+0000 7f0c4fb33800 20 remove_watcher() i=2 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.103+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94826834405456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c77740 con 0x7f0c40074040 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.104+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94826834405456] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x7f0c40074040 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.104+0000 7f0c4fb33800 20 remove_watcher() i=3 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.104+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94826834406992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7a850 con 0x563e97c6a9c0 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.105+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94826834406992] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c44033040 con 0x563e97c6a9c0 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.105+0000 7f0c4fb33800 20 remove_watcher() i=4 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.105+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94826834409008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c77740 con 0x563e97c6f3b0 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.106+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94826834409008] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.106+0000 7f0c4fb33800 20 remove_watcher() i=5 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.106+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94826834414144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7a850 con 0x563e97c6f3b0 2024-04-26T12:32:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.107+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94826834414144] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.107+0000 7f0c4fb33800 20 remove_watcher() i=6 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.107+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94826834417472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e97c7b630 con 0x563e97c6f3b0 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4b7f5640 1 -- 172.21.15.170:0/1632064941 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94826834417472] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c3c02e070 con 0x563e97c6f3b0 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 20 remove_watcher() i=7 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c6f3b0 msgr2=0x563e97c717a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c6f3b0 0x563e97c717a0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c6a9c0 msgr2=0x563e97c6ce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c6a9c0 0x563e97c6ce80 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c40074040 msgr2=0x7f0c40081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f0c40074040 0x7f0c40081410 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e97c73d60 msgr2=0x563e97c76220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x563e97c73d60 0x563e97c76220 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b14036900 msgr2=0x7f0b14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b14036900 0x7f0b14038dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0c40044940 tx=0x7f0c4004f000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 msgr2=0x563e97c5f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4bff6640 1 -- 172.21.15.170:0/1632064941 reap_dead start 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c5f230 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00efd0 tx=0x7f0c3c039fa0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 shutdown_connections 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/1632064941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c57ef0 0x563e97c5f230 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.108+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 >> 172.21.15.170:0/1632064941 conn(0x563e97c541c0 msgr2=0x563e97c51820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 shutdown_connections 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/1632064941 wait complete. 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b24036900 msgr2=0x7f0b24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b24036900 0x7f0b24038dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x563e97c34510 tx=0x7f0c40005ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c4aed0 msgr2=0x563e97c4b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c4aed0 0x563e97c4b2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c04ad70 tx=0x7f0c3c046f20 comp rx=0 tx=0).stop 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 shutdown_connections 2024-04-26T12:32:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b24036900 0x7f0b24038dc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3777133423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97c4aed0 0x563e97c4b2f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 >> 172.21.15.170:0/3777133423 conn(0x563e97c3ef70 msgr2=0x563e97c3f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 shutdown_connections 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3777133423 wait complete. 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c35f60 msgr2=0x563e97c38350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x563e97c35f60 0x563e97c38350 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c31300 msgr2=0x563e97c336f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x563e97c31300 0x563e97c336f0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e97c39ea0 msgr2=0x563e97c3c310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x563e97c39ea0 0x563e97c3c310 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b30036950 msgr2=0x7f0b30038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0b30036950 0x7f0b30038e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0c40054000 tx=0x7f0c4004e000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 msgr2=0x563e97c2c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 --2- 172.21.15.170:0/3147541873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563e97b335e0 0x563e97c2c2a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x563e97c256a0 tx=0x7f0c3c000ed0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4bff6640 1 -- 172.21.15.170:0/3147541873 reap_dead start 2024-04-26T12:32:20.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 shutdown_connections 2024-04-26T12:32:20.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 >> 172.21.15.170:0/3147541873 conn(0x563e97b2eba0 msgr2=0x563e97c23300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 shutdown_connections 2024-04-26T12:32:20.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.109+0000 7f0c4fb33800 1 -- 172.21.15.170:0/3147541873 wait complete. 2024-04-26T12:32:20.126 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.126 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.126 ERROR:root:0 2024-04-26T12:32:20.126 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.131 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000af37f24dc72cb577-00662b9ed4-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:32:20.131 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:32:20.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-26T12:32:20.132 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-04-26T12:32:20.176 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:20.176 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.175+0000 7fce74d2e800 1 Processor -- start 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.175+0000 7fce74d2e800 1 -- start start 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.175+0000 7fce74d2e800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x557d9adfd980 0x557d9adffd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.175+0000 7fce74d2e800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d9aca60c0 con 0x557d9adf95e0 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.175+0000 7fce74d2e800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x557d9ac8a4d0 con 0x557d9adfd980 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.175+0000 7fce70266640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x557d9adfd980 0x557d9adffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.176+0000 7fce70266640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x557d9adfd980 0x557d9adffd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45500/0 (socket says 172.21.15.170:45500) 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.176+0000 7fce70a67640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x557d9adf95e0 0x557d9adf9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58886/0 (socket says 172.21.15.170:58886) 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.176+0000 7fce70266640 1 -- 172.21.15.170:0/3832217161 learned_addr learned my addr 172.21.15.170:0/3832217161 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.176+0000 7fce70266640 1 -- 172.21.15.170:0/3832217161 >> v1:172.21.15.132:6789/0 conn(0x557d9adf95e0 legacy=0x557d9adf9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.176+0000 7fce70266640 1 -- 172.21.15.170:0/3832217161 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9acb7d40 con 0x557d9adfd980 2024-04-26T12:32:20.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce70266640 1 --2- 172.21.15.170:0/3832217161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adfd980 0x557d9adffd70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce6400a520 tx=0x7fce6401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8426751a610c7a9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce6fa65640 1 -- 172.21.15.170:0/3832217161 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce64057070 con 0x557d9adfd980 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce6fa65640 1 -- 172.21.15.170:0/3832217161 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce64052570 con 0x557d9adfd980 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce6fa65640 1 -- 172.21.15.170:0/3832217161 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6404ae60 con 0x557d9adfd980 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce74d2e800 1 -- 172.21.15.170:0/3832217161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adfd980 msgr2=0x557d9adffd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3832217161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adfd980 0x557d9adffd70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce6400a520 tx=0x7fce6401d010 comp rx=0 tx=0).stop 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce74d2e800 1 -- 172.21.15.170:0/3832217161 shutdown_connections 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3832217161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adfd980 0x557d9adffd70 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce74d2e800 1 -- 172.21.15.170:0/3832217161 >> 172.21.15.170:0/3832217161 conn(0x557d9adf4ba0 msgr2=0x557d9adf6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce74d2e800 1 -- 172.21.15.170:0/3832217161 shutdown_connections 2024-04-26T12:32:20.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.178+0000 7fce74d2e800 1 -- 172.21.15.170:0/3832217161 wait complete. 2024-04-26T12:32:20.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.190+0000 7fce74d2e800 1 Processor -- start 2024-04-26T12:32:20.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.190+0000 7fce74d2e800 1 -- start start 2024-04-26T12:32:20.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.190+0000 7fce74d2e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aeea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.190+0000 7fce74d2e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557d9ad44b70 con 0x557d9adf95e0 2024-04-26T12:32:20.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.190+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aeea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.190+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aeea7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45514/0 (socket says 172.21.15.170:45514) 2024-04-26T12:32:20.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.190+0000 7fce70a67640 1 -- 172.21.15.170:0/3073423641 learned_addr learned my addr 172.21.15.170:0/3073423641 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.191+0000 7fce70a67640 1 -- 172.21.15.170:0/3073423641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9acb6590 con 0x557d9adf95e0 2024-04-26T12:32:20.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.191+0000 7fce70a67640 1 --2- 172.21.15.170:0/3073423641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aeea7e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b230 tx=0x7fce6000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce5df0c7b984b98 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.191+0000 7fcd5ee0d640 1 -- 172.21.15.170:0/3073423641 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6000e5c0 con 0x557d9adf95e0 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.191+0000 7fcd5ee0d640 1 -- 172.21.15.170:0/3073423641 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60006070 con 0x557d9adf95e0 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.191+0000 7fcd5ee0d640 1 -- 172.21.15.170:0/3073423641 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6000e890 con 0x557d9adf95e0 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 -- 172.21.15.170:0/3073423641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 msgr2=0x557d9aeea7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3073423641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aeea7e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fce6000b230 tx=0x7fce6000b6f0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 -- 172.21.15.170:0/3073423641 shutdown_connections 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3073423641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aeea7e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 -- 172.21.15.170:0/3073423641 >> 172.21.15.170:0/3073423641 conn(0x557d9adf4ba0 msgr2=0x557d9aee6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 -- 172.21.15.170:0/3073423641 shutdown_connections 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 -- 172.21.15.170:0/3073423641 wait complete. 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 Processor -- start 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 -- start start 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aef21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce74d2e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557d9ae00640 con 0x557d9adf95e0 2024-04-26T12:32:20.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aef21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aef21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45518/0 (socket says 172.21.15.170:45518) 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.192+0000 7fce70a67640 1 -- 172.21.15.170:0/612351044 learned_addr learned my addr 172.21.15.170:0/612351044 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.193+0000 7fce70a67640 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9acad8f0 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.193+0000 7fce70a67640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aef21a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fce60000fd0 tx=0x7fce60000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.193+0000 7fcd5d60a640 1 -- 172.21.15.170:0/612351044 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6000f8d0 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.193+0000 7fcd5d60a640 1 -- 172.21.15.170:0/612351044 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6000fa90 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.193+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9aef26e0 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.193+0000 7fcd5d60a640 1 -- 172.21.15.170:0/612351044 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6000fdb0 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.193+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9aef2c00 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fcd5d60a640 1 -- 172.21.15.170:0/612351044 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce60017070 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fcd5d60a640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd58036950 0x7fcd58038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fcd5d60a640 1 -- 172.21.15.170:0/612351044 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fce60015020 con 0x557d9adf95e0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fce70266640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd58036950 0x7fcd58038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9adfd980 0x557d9aef9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9aef9790 con 0x557d9adfd980 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fce71268640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9adfd980 0x557d9aef9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fce70266640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd58036950 0x7fcd58038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce64054000 tx=0x7fce6404e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.194+0000 7fce71268640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9adfd980 0x557d9aef9210 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.195+0000 7fce71268640 1 -- 172.21.15.170:0/612351044 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9adfd980 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.195+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9aef67e0 con 0x557d9adfd980 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.195+0000 7fce71268640 1 -- 172.21.15.170:0/612351044 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9adfd980 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.195+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9aefbac0 0x557d9aefdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.195+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9aefe550 con 0x557d9aefbac0 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.195+0000 7fce70a67640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9aefbac0 0x557d9aefdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce70a67640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9aefbac0 0x557d9aefdeb0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce70a67640 1 -- 172.21.15.170:0/612351044 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce6002e070 con 0x557d9aefbac0 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9aefaa40 con 0x557d9adfd980 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce71268640 1 -- 172.21.15.170:0/612351044 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9adfd980 2024-04-26T12:32:20.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557d9aeff9b0 0x557d9af01e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af02580 con 0x557d9aeff9b0 2024-04-26T12:32:20.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce70266640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557d9aeff9b0 0x557d9af01e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.196+0000 7fce70266640 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557d9aeff9b0 0x557d9af01e20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce70266640 1 -- 172.21.15.170:0/612351044 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce6405a040 con 0x557d9aeff9b0 2024-04-26T12:32:20.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce74d2e800 1 Processor -- start 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce74d2e800 1 -- start start 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce74d2e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af109e0 0x557d9af10e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce74d2e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557d9aceae60 con 0x557d9af109e0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af109e0 0x557d9af10e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af109e0 0x557d9af10e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45530/0 (socket says 172.21.15.170:45530) 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.197+0000 7fce70a67640 1 -- 172.21.15.170:0/2309008307 learned_addr learned my addr 172.21.15.170:0/2309008307 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.198+0000 7fce70a67640 1 -- 172.21.15.170:0/2309008307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9af11340 con 0x557d9af109e0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.198+0000 7fce70a67640 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af109e0 0x557d9af10e00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fce6001d5c0 tx=0x7fce60017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.198+0000 7fcd567fc640 1 -- 172.21.15.170:0/2309008307 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6001bc80 con 0x557d9af109e0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.198+0000 7fcd567fc640 1 -- 172.21.15.170:0/2309008307 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60044c60 con 0x557d9af109e0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.198+0000 7fcd567fc640 1 -- 172.21.15.170:0/2309008307 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60044f60 con 0x557d9af109e0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.198+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9af11db0 con 0x557d9af109e0 2024-04-26T12:32:20.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.198+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9af122b0 con 0x557d9af109e0 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fcd567fc640 1 -- 172.21.15.170:0/2309008307 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce6003f200 con 0x557d9af109e0 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fcd567fc640 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd480368b0 0x7fcd48038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fcd567fc640 1 -- 172.21.15.170:0/2309008307 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fce6003bd40 con 0x557d9af109e0 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fce70266640 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd480368b0 0x7fcd48038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fce74d2e800 1 Processor -- start 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fce70266640 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd480368b0 0x7fcd48038d70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x557d9aef6700 tx=0x7fce64005ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fce74d2e800 1 -- start start 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fce74d2e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af1e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.199+0000 7fce74d2e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557d9aeeaf60 con 0x557d9af1dbf0 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af1e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af1e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45536/0 (socket says 172.21.15.170:45536) 2024-04-26T12:32:20.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fce70a67640 1 -- 172.21.15.170:0/3210331785 learned_addr learned my addr 172.21.15.170:0/3210331785 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fce70a67640 1 -- 172.21.15.170:0/3210331785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9af1e5e0 con 0x557d9af1dbf0 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fce70a67640 1 --2- 172.21.15.170:0/3210331785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af1e010 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fce60008fd0 tx=0x7fce60027610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d99ff36dc49e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fcd47fff640 1 -- 172.21.15.170:0/3210331785 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60056030 con 0x557d9af1dbf0 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fcd47fff640 1 -- 172.21.15.170:0/3210331785 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60040df0 con 0x557d9af1dbf0 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fcd47fff640 1 -- 172.21.15.170:0/3210331785 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce600447b0 con 0x557d9af1dbf0 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fce74d2e800 1 -- 172.21.15.170:0/3210331785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 msgr2=0x557d9af1e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.200+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3210331785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af1e010 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fce60008fd0 tx=0x7fce60027610 comp rx=0 tx=0).stop 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 -- 172.21.15.170:0/3210331785 shutdown_connections 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3210331785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af1e010 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 -- 172.21.15.170:0/3210331785 >> 172.21.15.170:0/3210331785 conn(0x557d9af19ec0 msgr2=0x557d9af17f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 -- 172.21.15.170:0/3210331785 shutdown_connections 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 -- 172.21.15.170:0/3210331785 wait complete. 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 Processor -- start 2024-04-26T12:32:20.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 -- start start 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af24f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce74d2e800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x557d9af1ec40 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af24f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce70a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af24f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45540/0 (socket says 172.21.15.170:45540) 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 learned_addr learned my addr 172.21.15.170:0/3153888725 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.201+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9af25480 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.202+0000 7fce70a67640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af24f40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fce6003f1d0 tx=0x7fce60042ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.202+0000 7fcd467fc640 1 -- 172.21.15.170:0/3153888725 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6003f4f0 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.202+0000 7fcd467fc640 1 -- 172.21.15.170:0/3153888725 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6003f690 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.202+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9af25480 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.202+0000 7fcd467fc640 1 -- 172.21.15.170:0/3153888725 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60026680 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.202+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9af25480 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.202+0000 7fcd467fc640 1 -- 172.21.15.170:0/3153888725 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fce60069070 con 0x557d9af1dbf0 2024-04-26T12:32:20.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fcd467fc640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd3c036900 0x7fcd3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fcd467fc640 1 -- 172.21.15.170:0/3153888725 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fce6005a070 con 0x557d9af1dbf0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fce70266640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd3c036900 0x7fcd3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fce70266640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd3c036900 0x7fcd3c038dc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x557d9af02980 tx=0x7fce6404f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9af30630 0x557d9af32af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af33240 con 0x557d9af30630 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.203+0000 7fce71268640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9af30630 0x557d9af32af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce71268640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9af30630 0x557d9af32af0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 realm 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af33650 con 0x557d9af30630 2024-04-26T12:32:20.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af33f20 con 0x557d9af30630 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af30630 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.204+0000 7fce74d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9af35020 0x557d9af37410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af37a20 con 0x557d9af35020 2024-04-26T12:32:20.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce70a67640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9af35020 0x557d9af37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce70a67640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9af35020 0x557d9af37410 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce74d2e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce74d2e800 20 searching for the correct realm 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557d9af399d0 0x557d9af3be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3c560 con 0x557d9af399d0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.205+0000 7fce70266640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557d9af399d0 0x557d9af3be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.206+0000 7fce70266640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557d9af399d0 0x557d9af3be90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.206+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.206+0000 7fce70266640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fce64074040 0x7fce64081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.206+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3c560 con 0x7fce64074040 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.206+0000 7fce71268640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fce64074040 0x7fce64081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.206+0000 7fce71268640 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fce64074040 0x7fce64081410 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce6800a4a0 con 0x7fce64074040 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af35020 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af30630 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af30630 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.207+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af35020 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af35020 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x7fce64074040 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6800a4a0 con 0x7fce64074040 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af399d0 2024-04-26T12:32:20.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.208+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af30630 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x7fce64074040 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6800a4a0 con 0x7fce64074040 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af30630 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6800a4a0 con 0x557d9af30630 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x7fce64074040 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.209+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d9af342c0 con 0x557d9af399d0 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af399d0 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af35020 2024-04-26T12:32:20.229 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af399d0 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af399d0 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.210+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af30630 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af30630 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af35020 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af399d0 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.230 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.211+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x7fce64074040 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af30630 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af35020 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af399d0 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.212+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af35020 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x7fce64074040 2024-04-26T12:32:20.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af399d0 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af35020 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.213+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x557d9af30630 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fce6408e040 con 0x7fce64074040 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:20.232 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af382e0 con 0x557d9af30630 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af382e0 con 0x557d9af30630 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.214+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af382e0 con 0x7fce64074040 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 zone default found 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 4 Realm: () 2024-04-26T12:32:20.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 zonegroup default 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af38b80 con 0x557d9af35020 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3e3c0 con 0x557d9af399d0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3e760 con 0x557d9af399d0 2024-04-26T12:32:20.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 started sync module instance, tier type = 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.215+0000 7fce74d2e800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.216+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d860 con 0x7fce64074040 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.217+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.217+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93997958945872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d860 con 0x7fce64074040 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.217+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3efb0 con 0x557d9af30630 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.218+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93997958945872] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.218+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.218+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93997958950112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d860 con 0x557d9af30630 2024-04-26T12:32:20.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.218+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3fa20 con 0x557d9af399d0 2024-04-26T12:32:20.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.219+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93997958950112] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.219+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.219+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93997958943664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d7d0 con 0x557d9af399d0 2024-04-26T12:32:20.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.219+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af407e0 con 0x7fce64074040 2024-04-26T12:32:20.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.220+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93997958943664] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.220+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.221+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93997958954512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af40bd0 con 0x7fce64074040 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.221+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af41590 con 0x557d9af30630 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.221+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93997958954512] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.222+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.222+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93997958955568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af41590 con 0x557d9af30630 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.222+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af41fd0 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.223+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.223+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93997958961952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af42870 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.223+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af43320 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.223+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93997958955568] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.224+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93997958961952] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.224+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.224+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93997958959328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af436c0 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.224+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af43f10 con 0x557d9af35020 2024-04-26T12:32:20.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93997958959328] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93997958969024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af43f90 con 0x557d9af35020 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 20 add_watcher() i=0 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 20 add_watcher() i=1 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 20 add_watcher() i=2 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 20 add_watcher() i=3 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 20 add_watcher() i=4 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 20 add_watcher() i=5 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.225+0000 7fce74d2e800 20 add_watcher() i=6 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.226+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93997958969024] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.226+0000 7fce74d2e800 20 add_watcher() i=7 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.226+0000 7fce74d2e800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.226+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af472d0 con 0x557d9af30630 2024-04-26T12:32:20.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.226+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.226+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93997958982896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af44100 con 0x557d9af30630 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93997958982896] v32'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fcd26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fce74d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fce74d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fce74d2e800 5 note: GC not initialized 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fcd25fe3640 20 reqs_thread_entry: start 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fce74d2e800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fce74d2e800 20 Filter name: none 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.227+0000 7fcc977fe640 20 reqs_thread_entry: start 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af7aa50 con 0x557d9af35020 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 20 rados_obj.operate() r=0 bl.length=490 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.228+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af81390 con 0x557d9af35020 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce74d2e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce74d2e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce74d2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93997959220736 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d9af7ca60 con 0x557d9af30630 2024-04-26T12:32:20.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 93997958955568 notify 137438953517 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fce68018d80 con 0x557d9af30630 2024-04-26T12:32:20.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fcd47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 93997958955568 notifier 4915 bl.length()=636 2024-04-26T12:32:20.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fcd47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fcd47fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 93997959220736 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fcd47fff640 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcd34003ea0 con 0x557d9af30630 2024-04-26T12:32:20.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.230+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 93997959220736 notify 137438953517 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fce68046510 con 0x557d9af30630 2024-04-26T12:32:20.247 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:20.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.231+0000 7fcd26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.231+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93997958982896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af7ce70 con 0x557d9af30630 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.232+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93997958982896] v32'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.232+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93997958945872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af46cf0 con 0x7fce64074040 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.233+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93997958945872] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.233+0000 7fce74d2e800 20 remove_watcher() i=0 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.233+0000 7fce74d2e800 2 removed watcher, disabling cache 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.233+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93997958950112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3dc50 con 0x557d9af30630 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.234+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93997958950112] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.234+0000 7fce74d2e800 20 remove_watcher() i=1 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.234+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93997958943664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3dc50 con 0x557d9af399d0 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.235+0000 7fce70266640 1 -- 172.21.15.170:0/3153888725 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93997958943664] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6407f070 con 0x557d9af399d0 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.235+0000 7fce74d2e800 20 remove_watcher() i=2 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.235+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93997958954512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d3b0 con 0x7fce64074040 2024-04-26T12:32:20.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.236+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93997958954512] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x7fce64074040 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.236+0000 7fce74d2e800 20 remove_watcher() i=3 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.236+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93997958955568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d3b0 con 0x557d9af30630 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.237+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93997958955568] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce68033040 con 0x557d9af30630 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.237+0000 7fce74d2e800 20 remove_watcher() i=4 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.237+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93997958961952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d3b0 con 0x557d9af35020 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.238+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93997958961952] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.238+0000 7fce74d2e800 20 remove_watcher() i=5 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.238+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93997958959328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d3b0 con 0x557d9af35020 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.239+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93997958959328] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.239+0000 7fce74d2e800 20 remove_watcher() i=6 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.239+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93997958969024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d9af3d3b0 con 0x557d9af35020 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce70a67640 1 -- 172.21.15.170:0/3153888725 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93997958969024] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce60068030 con 0x557d9af35020 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 20 remove_watcher() i=7 2024-04-26T12:32:20.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9af35020 msgr2=0x557d9af37410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9af35020 0x557d9af37410 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9af30630 msgr2=0x557d9af32af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9af30630 0x557d9af32af0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fce64074040 msgr2=0x7fce64081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7fce64074040 0x7fce64081410 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557d9af399d0 msgr2=0x557d9af3be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x557d9af399d0 0x557d9af3be90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd3c036900 msgr2=0x7fcd3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd3c036900 0x7fcd3c038dc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x557d9af02980 tx=0x7fce6404f000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 msgr2=0x557d9af24f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce71268640 1 -- 172.21.15.170:0/3153888725 reap_dead start 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af24f40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fce6003f1d0 tx=0x7fce60042ee0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 shutdown_connections 2024-04-26T12:32:20.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 --2- 172.21.15.170:0/3153888725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af1dbf0 0x557d9af24f40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.240+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 >> 172.21.15.170:0/3153888725 conn(0x557d9af19ec0 msgr2=0x557d9af17520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 shutdown_connections 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/3153888725 wait complete. 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd480368b0 msgr2=0x7fcd48038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd480368b0 0x7fcd48038d70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x557d9aef6700 tx=0x7fce64005ac0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af109e0 msgr2=0x557d9af10e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af109e0 0x557d9af10e00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fce6001d5c0 tx=0x7fce60017d70 comp rx=0 tx=0).stop 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 shutdown_connections 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd480368b0 0x7fcd48038d70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/2309008307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9af109e0 0x557d9af10e00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 >> 172.21.15.170:0/2309008307 conn(0x557d9af04a80 msgr2=0x557d9af04e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 shutdown_connections 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/2309008307 wait complete. 2024-04-26T12:32:20.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9aefbac0 msgr2=0x557d9aefdeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x557d9aefbac0 0x557d9aefdeb0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9adfd980 msgr2=0x557d9aef9210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x557d9adfd980 0x557d9aef9210 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557d9aeff9b0 msgr2=0x557d9af01e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x557d9aeff9b0 0x557d9af01e20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd58036950 msgr2=0x7fcd58038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fcd58036950 0x7fcd58038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce64054000 tx=0x7fce6404e000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 msgr2=0x557d9aef21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 --2- 172.21.15.170:0/612351044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x557d9adf95e0 0x557d9aef21a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fce60000fd0 tx=0x7fce60000ed0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce71268640 1 -- 172.21.15.170:0/612351044 reap_dead start 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 shutdown_connections 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 >> 172.21.15.170:0/612351044 conn(0x557d9adf4ba0 msgr2=0x557d9aee91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.241+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 shutdown_connections 2024-04-26T12:32:20.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.242+0000 7fce74d2e800 1 -- 172.21.15.170:0/612351044 wait complete. 2024-04-26T12:32:20.260 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.260 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.260 ERROR:root:0 2024-04-26T12:32:20.260 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:20.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:20.260 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T12:32:20.305 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:20.305 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa5ce16800 1 Processor -- start 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa5ce16800 1 -- start start 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa5ce16800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fcc2b155e0 0x55fcc2b15a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa5ce16800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fcc29c20c0 con 0x55fcc2b16750 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa5ce16800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55fcc29a64d0 con 0x55fcc2b155e0 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa58484640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fcc2b155e0 0x55fcc2b15a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa4ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55fcc2b16750 0x55fcc2b16bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58900/0 (socket says 172.21.15.170:58900) 2024-04-26T12:32:20.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa58484640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55fcc2b155e0 0x55fcc2b15a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45544/0 (socket says 172.21.15.170:45544) 2024-04-26T12:32:20.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.304+0000 7ffa4ffff640 1 -- 172.21.15.170:0/2665183329 learned_addr learned my addr 172.21.15.170:0/2665183329 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:32:20.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.305+0000 7ffa58484640 1 -- 172.21.15.170:0/2665183329 >> v1:172.21.15.132:6789/0 conn(0x55fcc2b16750 legacy=0x55fcc2b16bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.305+0000 7ffa58484640 1 -- 172.21.15.170:0/2665183329 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc29d3d40 con 0x55fcc2b155e0 2024-04-26T12:32:20.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.306+0000 7ffa58484640 1 --2- 172.21.15.170:0/2665183329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2b15a00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800a470 tx=0x7ffa4801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9825299aff42e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa57c83640 1 -- 172.21.15.170:0/2665183329 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48057070 con 0x55fcc2b155e0 2024-04-26T12:32:20.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa57c83640 1 -- 172.21.15.170:0/2665183329 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48052570 con 0x55fcc2b155e0 2024-04-26T12:32:20.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa57c83640 1 -- 172.21.15.170:0/2665183329 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48052870 con 0x55fcc2b155e0 2024-04-26T12:32:20.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa5ce16800 1 -- 172.21.15.170:0/2665183329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 msgr2=0x55fcc2b15a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/2665183329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2b15a00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800a470 tx=0x7ffa4801ce90 comp rx=0 tx=0).stop 2024-04-26T12:32:20.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa5ce16800 1 -- 172.21.15.170:0/2665183329 shutdown_connections 2024-04-26T12:32:20.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/2665183329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2b15a00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa5ce16800 1 -- 172.21.15.170:0/2665183329 >> 172.21.15.170:0/2665183329 conn(0x55fcc2b10ba0 msgr2=0x55fcc2b12fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa5ce16800 1 -- 172.21.15.170:0/2665183329 shutdown_connections 2024-04-26T12:32:20.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.307+0000 7ffa5ce16800 1 -- 172.21.15.170:0/2665183329 wait complete. 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa5ce16800 1 Processor -- start 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa5ce16800 1 -- start start 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa5ce16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c06c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa5ce16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fcc2a60b70 con 0x55fcc2b155e0 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c06c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c06c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45546/0 (socket says 172.21.15.170:45546) 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa58484640 1 -- 172.21.15.170:0/3664074622 learned_addr learned my addr 172.21.15.170:0/3664074622 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa58484640 1 -- 172.21.15.170:0/3664074622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc29d2590 con 0x55fcc2b155e0 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.319+0000 7ffa58484640 1 --2- 172.21.15.170:0/3664074622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c06c70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffa48055040 tx=0x7ffa4804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f5f5a12bce30f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ff94660c640 1 -- 172.21.15.170:0/3664074622 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48057070 con 0x55fcc2b155e0 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ff94660c640 1 -- 172.21.15.170:0/3664074622 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48063070 con 0x55fcc2b155e0 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ff94660c640 1 -- 172.21.15.170:0/3664074622 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48052720 con 0x55fcc2b155e0 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ffa5ce16800 1 -- 172.21.15.170:0/3664074622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 msgr2=0x55fcc2c06c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/3664074622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c06c70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffa48055040 tx=0x7ffa4804c000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ffa5ce16800 1 -- 172.21.15.170:0/3664074622 shutdown_connections 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/3664074622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c06c70 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ffa5ce16800 1 -- 172.21.15.170:0/3664074622 >> 172.21.15.170:0/3664074622 conn(0x55fcc2b10ba0 msgr2=0x55fcc2c02590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ffa5ce16800 1 -- 172.21.15.170:0/3664074622 shutdown_connections 2024-04-26T12:32:20.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.320+0000 7ffa5ce16800 1 -- 172.21.15.170:0/3664074622 wait complete. 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa5ce16800 1 Processor -- start 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa5ce16800 1 -- start start 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa5ce16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c0e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa5ce16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fcc2b1ebc0 con 0x55fcc2b155e0 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c0e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c0e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45556/0 (socket says 172.21.15.170:45556) 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa58484640 1 -- 172.21.15.170:0/1237459273 learned_addr learned my addr 172.21.15.170:0/1237459273 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa58484640 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc29c98f0 con 0x55fcc2b155e0 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.321+0000 7ffa58484640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c0e580 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffa48060040 tx=0x7ffa48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.322+0000 7ff944e09640 1 -- 172.21.15.170:0/1237459273 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48052c70 con 0x55fcc2b155e0 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.322+0000 7ff944e09640 1 -- 172.21.15.170:0/1237459273 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4806c070 con 0x55fcc2b155e0 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.322+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcc2c0eac0 con 0x55fcc2b155e0 2024-04-26T12:32:20.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.322+0000 7ff944e09640 1 -- 172.21.15.170:0/1237459273 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4805e480 con 0x55fcc2b155e0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.322+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcc2c0f040 con 0x55fcc2b155e0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.322+0000 7ff944e09640 1 -- 172.21.15.170:0/1237459273 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffa4805e620 con 0x55fcc2b155e0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.322+0000 7ff944e09640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff940036950 0x7ff940038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ff944e09640 1 -- 172.21.15.170:0/1237459273 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7ffa4808e7d0 con 0x55fcc2b155e0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff940036950 0x7ff940038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2b16750 0x55fcc2c155a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c15b20 con 0x55fcc2b16750 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa58c85640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2b16750 0x55fcc2c155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff940036950 0x7ff940038e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000f60 tx=0x7ffa400012b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa58c85640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2b16750 0x55fcc2c155a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa58c85640 1 -- 172.21.15.170:0/1237459273 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2b16750 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.323+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c12b70 con 0x55fcc2b16750 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.324+0000 7ffa58c85640 1 -- 172.21.15.170:0/1237459273 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2b16750 2024-04-26T12:32:20.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.324+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c17e50 0x55fcc2c1a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.324+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c1a8e0 con 0x55fcc2c17e50 2024-04-26T12:32:20.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.324+0000 7ffa58484640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c17e50 0x55fcc2c1a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.324+0000 7ffa58484640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c17e50 0x55fcc2c1a240 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.324+0000 7ffa58484640 1 -- 172.21.15.170:0/1237459273 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa48009d10 con 0x55fcc2c17e50 2024-04-26T12:32:20.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.324+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c16e00 con 0x55fcc2b16750 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.325+0000 7ffa58c85640 1 -- 172.21.15.170:0/1237459273 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2b16750 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.325+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fcc2c1bd90 0x55fcc2c1e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.325+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c1e940 con 0x55fcc2c1bd90 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.325+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fcc2c1bd90 0x55fcc2c1e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.325+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fcc2c1bd90 0x55fcc2c1e1e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.325+0000 7ffa4ffff640 1 -- 172.21.15.170:0/1237459273 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c1bd90 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa5ce16800 1 Processor -- start 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa5ce16800 1 -- start start 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa5ce16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c2cda0 0x55fcc2c2d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa5ce16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fcc2a06e60 con 0x55fcc2c2cda0 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c2cda0 0x55fcc2c2d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c2cda0 0x55fcc2c2d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45560/0 (socket says 172.21.15.170:45560) 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa58484640 1 -- 172.21.15.170:0/633019696 learned_addr learned my addr 172.21.15.170:0/633019696 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.326+0000 7ffa58484640 1 -- 172.21.15.170:0/633019696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc2c2d700 con 0x55fcc2c2cda0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.327+0000 7ffa58484640 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c2cda0 0x55fcc2c2d1c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ffa4808cab0 tx=0x7ffa48067df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.327+0000 7ff93dffb640 1 -- 172.21.15.170:0/633019696 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa48093070 con 0x55fcc2c2cda0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.327+0000 7ff93dffb640 1 -- 172.21.15.170:0/633019696 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48058040 con 0x55fcc2c2cda0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.327+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcc2c2e170 con 0x55fcc2c2cda0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.327+0000 7ff93dffb640 1 -- 172.21.15.170:0/633019696 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4808ce60 con 0x55fcc2c2cda0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.327+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcc2c2e670 con 0x55fcc2c2cda0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.327+0000 7ff93dffb640 1 -- 172.21.15.170:0/633019696 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffa48096070 con 0x55fcc2c2cda0 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ff93dffb640 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff930036900 0x7ff930038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.355 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ff93dffb640 1 -- 172.21.15.170:0/633019696 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7ffa48099d50 con 0x55fcc2c2cda0 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff930036900 0x7ff930038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa5ce16800 1 Processor -- start 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa5ce16800 1 -- start start 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff930036900 0x7ff930038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000bf50 tx=0x7ffa4000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa5ce16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c3a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa5ce16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fcc2c07330 con 0x55fcc2c39e30 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c3a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c3a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45568/0 (socket says 172.21.15.170:45568) 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa58484640 1 -- 172.21.15.170:0/1757178614 learned_addr learned my addr 172.21.15.170:0/1757178614 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.328+0000 7ffa58484640 1 -- 172.21.15.170:0/1757178614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc2c3a820 con 0x55fcc2c39e30 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa58484640 1 --2- 172.21.15.170:0/1757178614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c3a250 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ffa4807afd0 tx=0x7ffa4805edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497d574ce1e8f53d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ff9377fe640 1 -- 172.21.15.170:0/1757178614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4805f030 con 0x55fcc2c39e30 2024-04-26T12:32:20.356 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ff9377fe640 1 -- 172.21.15.170:0/1757178614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4804b100 con 0x55fcc2c39e30 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ff9377fe640 1 -- 172.21.15.170:0/1757178614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4805f1d0 con 0x55fcc2c39e30 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1757178614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 msgr2=0x55fcc2c3a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1757178614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c3a250 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ffa4807afd0 tx=0x7ffa4805edd0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1757178614 shutdown_connections 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1757178614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c3a250 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1757178614 >> 172.21.15.170:0/1757178614 conn(0x55fcc2c36190 msgr2=0x55fcc2c341f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1757178614 shutdown_connections 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.329+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1757178614 wait complete. 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa5ce16800 1 Processor -- start 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa5ce16800 1 -- start start 2024-04-26T12:32:20.357 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa5ce16800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c41280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa5ce16800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fcc2c3aed0 con 0x55fcc2c39e30 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c41280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa58484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c41280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45570/0 (socket says 172.21.15.170:45570) 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 learned_addr learned my addr 172.21.15.170:0/541294715 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc2c417c0 con 0x55fcc2c39e30 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.330+0000 7ffa58484640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c41280 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ffa48070000 tx=0x7ffa4806ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.331+0000 7ff935ffb640 1 -- 172.21.15.170:0/541294715 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4808ee60 con 0x55fcc2c39e30 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.331+0000 7ff935ffb640 1 -- 172.21.15.170:0/541294715 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48009820 con 0x55fcc2c39e30 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.331+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcc2c417c0 con 0x55fcc2c39e30 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.331+0000 7ff935ffb640 1 -- 172.21.15.170:0/541294715 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa4809b9c0 con 0x55fcc2c39e30 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.331+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcc2c417c0 con 0x55fcc2c39e30 2024-04-26T12:32:20.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.331+0000 7ff935ffb640 1 -- 172.21.15.170:0/541294715 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffa4809bb60 con 0x55fcc2c39e30 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ff935ffb640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff928036950 0x7ff928038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ff935ffb640 1 -- 172.21.15.170:0/541294715 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7ffa480a3070 con 0x55fcc2c39e30 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff928036950 0x7ff928038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff928036950 0x7ff928038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffa40001b60 tx=0x7ffa40010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2c4c990 0x55fcc2c4ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c4f5a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.332+0000 7ffa58c85640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2c4c990 0x55fcc2c4ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa58c85640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2c4c990 0x55fcc2c4ee50 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 20 realm 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c4f9b0 con 0x55fcc2c4c990 2024-04-26T12:32:20.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50280 con 0x55fcc2c4c990 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.333+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c51380 0x55fcc2c53770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c53d80 con 0x55fcc2c51380 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa58484640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c51380 0x55fcc2c53770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa58484640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c51380 0x55fcc2c53770 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 20 searching for the correct realm 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fcc2c55d10 0x55fcc2c581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c588a0 con 0x55fcc2c55d10 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.334+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fcc2c55d10 0x55fcc2c581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.335+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fcc2c55d10 0x55fcc2c581d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.335+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.335+0000 7ffa4ffff640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffa40038040 0x7ffa4001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.335+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c588a0 con 0x7ffa40038040 2024-04-26T12:32:20.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.335+0000 7ffa58c85640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffa40038040 0x7ffa4001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.335+0000 7ffa58c85640 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffa40038040 0x7ffa4001bab0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa5000a4a0 con 0x7ffa40038040 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.336+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x7ffa40038040 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5000a4a0 con 0x7ffa40038040 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.337+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x7ffa40038040 2024-04-26T12:32:20.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5000a4a0 con 0x7ffa40038040 2024-04-26T12:32:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa5000a4a0 con 0x55fcc2c4c990 2024-04-26T12:32:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x7ffa40038040 2024-04-26T12:32:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.338+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.339+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.340+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x7ffa40038040 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.341+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.341+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.341+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.341+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.341+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.341+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.341+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.342+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.342+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.342+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x7ffa40038040 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.342+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.342+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c55d10 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.342+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.342+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c51380 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x55fcc2c4c990 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c50620 con 0x7ffa40038040 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:20.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c54640 con 0x55fcc2c4c990 2024-04-26T12:32:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.343+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c54640 con 0x55fcc2c4c990 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c54640 con 0x7ffa40038040 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 zone default found 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 4 Realm: () 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:20.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 zonegroup default 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c54ee0 con 0x55fcc2c51380 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5a700 con 0x55fcc2c55d10 2024-04-26T12:32:20.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.344+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa5ce16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5aaa0 con 0x55fcc2c55d10 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa5ce16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa5ce16800 20 started sync module instance, tier type = 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa5ce16800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:20.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.345+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c59ba0 con 0x7ffa40038040 2024-04-26T12:32:20.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.346+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.346+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94544087851216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c59ba0 con 0x7ffa40038040 2024-04-26T12:32:20.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.346+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5b370 con 0x55fcc2c4c990 2024-04-26T12:32:20.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.347+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94544087851216] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.347+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.347+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94544087854656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c59ba0 con 0x55fcc2c4c990 2024-04-26T12:32:20.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.347+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5be10 con 0x55fcc2c55d10 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.348+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94544087854656] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.349+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.349+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94544087848688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c59b10 con 0x55fcc2c55d10 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.349+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5cba0 con 0x7ffa40038040 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.349+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94544087848688] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.350+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.350+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94544087859712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5cfc0 con 0x7ffa40038040 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.350+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5d9c0 con 0x55fcc2c4c990 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.351+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.351+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94544087864528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5d8f0 con 0x55fcc2c4c990 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.351+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5e910 con 0x55fcc2c51380 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.351+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94544087859712] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.352+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.352+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94544087868416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5ed00 con 0x55fcc2c51380 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.352+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5f700 con 0x55fcc2c51380 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.352+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94544087864528] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.353+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94544087868416] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.353+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.353+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94544087866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5faa0 con 0x55fcc2c51380 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.353+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c60350 con 0x55fcc2c51380 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94544087866800] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94544087872016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5ff50 con 0x55fcc2c51380 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 20 add_watcher() i=0 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 20 add_watcher() i=1 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 20 add_watcher() i=2 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 20 add_watcher() i=3 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 20 add_watcher() i=4 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 20 add_watcher() i=5 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.354+0000 7ffa5ce16800 20 add_watcher() i=6 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.355+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94544087872016] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.355+0000 7ffa5ce16800 20 add_watcher() i=7 2024-04-26T12:32:20.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.355+0000 7ffa5ce16800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.355+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c63770 con 0x55fcc2c4c990 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.355+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.355+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94544087874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c60c90 con 0x55fcc2c4c990 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.356+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94544087874672] v32'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.356+0000 7ff90e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.356+0000 7ffa5ce16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.356+0000 7ffa5ce16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.356+0000 7ffa5ce16800 5 note: GC not initialized 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.356+0000 7ff90d7e2640 20 reqs_thread_entry: start 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 20 Filter name: none 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ff87effd640 20 reqs_thread_entry: start 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c96ec0 con 0x55fcc2c51380 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 20 rados_obj.operate() r=0 bl.length=460 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.357+0000 7ffa5ce16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.358+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c9d470 con 0x55fcc2c51380 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa5ce16800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa5ce16800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa5ce16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94544088125152 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c98b40 con 0x55fcc2c4c990 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94544087864528 notify 137438953518 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7ffa50018980 con 0x55fcc2c4c990 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ff9377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953518 cookie 94544087864528 notifier 4922 bl.length()=649 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94544088125152 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ff9377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ff9377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ff9377fe640 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff91c003ea0 con 0x55fcc2c4c990 2024-04-26T12:32:20.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.359+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94544088125152 notify 137438953518 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffa50018c20 con 0x55fcc2c4c990 2024-04-26T12:32:20.385 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:20.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.360+0000 7ff90e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.360+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94544087874672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c9c7c0 con 0x55fcc2c4c990 2024-04-26T12:32:20.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.361+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94544087874672] v32'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.361+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94544087851216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c9c310 con 0x7ffa40038040 2024-04-26T12:32:20.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.362+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94544087851216] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.362+0000 7ffa5ce16800 20 remove_watcher() i=0 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.362+0000 7ffa5ce16800 2 removed watcher, disabling cache 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.362+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94544087854656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5a0d0 con 0x55fcc2c4c990 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.363+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94544087854656] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.363+0000 7ffa5ce16800 20 remove_watcher() i=1 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.363+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94544087848688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5a0d0 con 0x55fcc2c55d10 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.364+0000 7ffa4ffff640 1 -- 172.21.15.170:0/541294715 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94544087848688] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa40009050 con 0x55fcc2c55d10 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.364+0000 7ffa5ce16800 20 remove_watcher() i=2 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.364+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94544087859712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c596f0 con 0x7ffa40038040 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.365+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94544087859712] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x7ffa40038040 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.365+0000 7ffa5ce16800 20 remove_watcher() i=3 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.365+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94544087864528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5c200 con 0x55fcc2c4c990 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.366+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94544087864528] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa50033040 con 0x55fcc2c4c990 2024-04-26T12:32:20.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.366+0000 7ffa5ce16800 20 remove_watcher() i=4 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.366+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94544087868416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c596f0 con 0x55fcc2c51380 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.367+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94544087868416] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.367+0000 7ffa5ce16800 20 remove_watcher() i=5 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.367+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94544087866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5d4d0 con 0x55fcc2c51380 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.368+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94544087866800] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.368+0000 7ffa5ce16800 20 remove_watcher() i=6 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.368+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94544087872016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcc2c5c200 con 0x55fcc2c51380 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa58484640 1 -- 172.21.15.170:0/541294715 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94544087872016] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa48095030 con 0x55fcc2c51380 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 20 remove_watcher() i=7 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c51380 msgr2=0x55fcc2c53770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c51380 0x55fcc2c53770 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2c4c990 msgr2=0x55fcc2c4ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2c4c990 0x55fcc2c4ee50 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffa40038040 msgr2=0x7ffa4001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7ffa40038040 0x7ffa4001bab0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fcc2c55d10 msgr2=0x55fcc2c581d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55fcc2c55d10 0x55fcc2c581d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff928036950 msgr2=0x7ff928038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff928036950 0x7ff928038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffa40001b60 tx=0x7ffa40010000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 msgr2=0x55fcc2c41280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c41280 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ffa48070000 tx=0x7ffa4806ff90 comp rx=0 tx=0).stop 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa58c85640 1 -- 172.21.15.170:0/541294715 reap_dead start 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 shutdown_connections 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/541294715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c39e30 0x55fcc2c41280 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.369+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 >> 172.21.15.170:0/541294715 conn(0x55fcc2c36190 msgr2=0x55fcc2c337f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 shutdown_connections 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/541294715 wait complete. 2024-04-26T12:32:20.394 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff930036900 msgr2=0x7ff930038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff930036900 0x7ff930038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000bf50 tx=0x7ffa4000f000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c2cda0 msgr2=0x55fcc2c2d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c2cda0 0x55fcc2c2d1c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ffa4808cab0 tx=0x7ffa48067df0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 shutdown_connections 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff930036900 0x7ff930038dc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/633019696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2c2cda0 0x55fcc2c2d1c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 >> 172.21.15.170:0/633019696 conn(0x55fcc2c20e40 msgr2=0x55fcc2c21240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 shutdown_connections 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/633019696 wait complete. 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c17e50 msgr2=0x55fcc2c1a240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55fcc2c17e50 0x55fcc2c1a240 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2b16750 msgr2=0x55fcc2c155a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55fcc2b16750 0x55fcc2c155a0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fcc2c1bd90 msgr2=0x55fcc2c1e1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.395 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55fcc2c1bd90 0x55fcc2c1e1e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff940036950 msgr2=0x7ff940038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ff940036950 0x7ff940038e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000f60 tx=0x7ffa400012b0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 msgr2=0x55fcc2c0e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 --2- 172.21.15.170:0/1237459273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fcc2b155e0 0x55fcc2c0e580 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffa48060040 tx=0x7ffa48002fb0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa58c85640 1 -- 172.21.15.170:0/1237459273 reap_dead start 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 shutdown_connections 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 >> 172.21.15.170:0/1237459273 conn(0x55fcc2b10ba0 msgr2=0x55fcc2c05660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 shutdown_connections 2024-04-26T12:32:20.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.370+0000 7ffa5ce16800 1 -- 172.21.15.170:0/1237459273 wait complete. 2024-04-26T12:32:20.397 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.397 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.397 ERROR:root:0 2024-04-26T12:32:20.397 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:20.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-26T12:32:20.397 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-26T12:32:20.442 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:32:20.442 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.441+0000 7f45ad92f800 1 Processor -- start 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.441+0000 7f45ad92f800 1 -- start start 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.441+0000 7f45ad92f800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5595b1cef5e0 0x5595b1cefa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.441+0000 7f45ad92f800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595b1b9c0c0 con 0x5595b1cf0750 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.441+0000 7f45ad92f800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x5595b1b804d0 con 0x5595b1cef5e0 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.442+0000 7f45a95ae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5595b1cef5e0 0x5595b1cefa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.442+0000 7f45a95ae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x5595b1cef5e0 0x5595b1cefa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45572/0 (socket says 172.21.15.170:45572) 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.442+0000 7f45a95ae640 1 -- 172.21.15.170:0/4176637400 learned_addr learned my addr 172.21.15.170:0/4176637400 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.442+0000 7f45a8dad640 1 --1- 172.21.15.170:0/4176637400 >> v1:172.21.15.132:6789/0 conn(0x5595b1cf0750 0x5595b1cf0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:58912/0 (socket says 172.21.15.170:58912) 2024-04-26T12:32:20.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.442+0000 7f45a95ae640 1 -- 172.21.15.170:0/4176637400 >> v1:172.21.15.132:6789/0 conn(0x5595b1cf0750 legacy=0x5595b1cf0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.442+0000 7f45a95ae640 1 -- 172.21.15.170:0/4176637400 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b1badd40 con 0x5595b1cef5e0 2024-04-26T12:32:20.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45a95ae640 1 --2- 172.21.15.170:0/4176637400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1cefa00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f459c00a520 tx=0x7f459c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302b517f173a406b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f459bfff640 1 -- 172.21.15.170:0/4176637400 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c057070 con 0x5595b1cef5e0 2024-04-26T12:32:20.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f459bfff640 1 -- 172.21.15.170:0/4176637400 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c052570 con 0x5595b1cef5e0 2024-04-26T12:32:20.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f459bfff640 1 -- 172.21.15.170:0/4176637400 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c04ae60 con 0x5595b1cef5e0 2024-04-26T12:32:20.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45ad92f800 1 -- 172.21.15.170:0/4176637400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 msgr2=0x5595b1cefa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45ad92f800 1 --2- 172.21.15.170:0/4176637400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1cefa00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f459c00a520 tx=0x7f459c01d010 comp rx=0 tx=0).stop 2024-04-26T12:32:20.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45ad92f800 1 -- 172.21.15.170:0/4176637400 shutdown_connections 2024-04-26T12:32:20.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45ad92f800 1 --2- 172.21.15.170:0/4176637400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1cefa00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45ad92f800 1 -- 172.21.15.170:0/4176637400 >> 172.21.15.170:0/4176637400 conn(0x5595b1ceaba0 msgr2=0x5595b1cecfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45ad92f800 1 -- 172.21.15.170:0/4176637400 shutdown_connections 2024-04-26T12:32:20.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.444+0000 7f45ad92f800 1 -- 172.21.15.170:0/4176637400 wait complete. 2024-04-26T12:32:20.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.456+0000 7f45ad92f800 1 Processor -- start 2024-04-26T12:32:20.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.456+0000 7f45ad92f800 1 -- start start 2024-04-26T12:32:20.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.456+0000 7f45ad92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1c65020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.456+0000 7f45ad92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5595b1c3ab70 con 0x5595b1cef5e0 2024-04-26T12:32:20.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.456+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1c65020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.456+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1c65020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45580/0 (socket says 172.21.15.170:45580) 2024-04-26T12:32:20.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.456+0000 7f45a95ae640 1 -- 172.21.15.170:0/4031123880 learned_addr learned my addr 172.21.15.170:0/4031123880 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.457+0000 7f45a95ae640 1 -- 172.21.15.170:0/4031123880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b1bac590 con 0x5595b1cef5e0 2024-04-26T12:32:20.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.457+0000 7f45a95ae640 1 --2- 172.21.15.170:0/4031123880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1c65020 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f459c055040 tx=0x7f459c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8caba2b27e0ddd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.457+0000 7f4497606640 1 -- 172.21.15.170:0/4031123880 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c057040 con 0x5595b1cef5e0 2024-04-26T12:32:20.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.457+0000 7f4497606640 1 -- 172.21.15.170:0/4031123880 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c052720 con 0x5595b1cef5e0 2024-04-26T12:32:20.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.457+0000 7f4497606640 1 -- 172.21.15.170:0/4031123880 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c052a40 con 0x5595b1cef5e0 2024-04-26T12:32:20.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 -- 172.21.15.170:0/4031123880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 msgr2=0x5595b1c65020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 --2- 172.21.15.170:0/4031123880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1c65020 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f459c055040 tx=0x7f459c04c000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 -- 172.21.15.170:0/4031123880 shutdown_connections 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 --2- 172.21.15.170:0/4031123880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1c65020 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 -- 172.21.15.170:0/4031123880 >> 172.21.15.170:0/4031123880 conn(0x5595b1ceaba0 msgr2=0x5595b1ddc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 -- 172.21.15.170:0/4031123880 shutdown_connections 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 -- 172.21.15.170:0/4031123880 wait complete. 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 Processor -- start 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 -- start start 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1dea700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45ad92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5595b1cf8bc0 con 0x5595b1cef5e0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1dea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1dea700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45582/0 (socket says 172.21.15.170:45582) 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.458+0000 7f45a95ae640 1 -- 172.21.15.170:0/3187840876 learned_addr learned my addr 172.21.15.170:0/3187840876 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.459+0000 7f45a95ae640 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b1ba38f0 con 0x5595b1cef5e0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.459+0000 7f45a95ae640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1dea700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f459c052540 tx=0x7f459c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.459+0000 7f4495e03640 1 -- 172.21.15.170:0/3187840876 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c073070 con 0x5595b1cef5e0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.459+0000 7f4495e03640 1 -- 172.21.15.170:0/3187840876 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c052c90 con 0x5595b1cef5e0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.459+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595b1deac40 con 0x5595b1cef5e0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.459+0000 7f4495e03640 1 -- 172.21.15.170:0/3187840876 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c057070 con 0x5595b1cef5e0 2024-04-26T12:32:20.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.459+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b1deb160 con 0x5595b1cef5e0 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.460+0000 7f4495e03640 1 -- 172.21.15.170:0/3187840876 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f459c076070 con 0x5595b1cef5e0 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.460+0000 7f4495e03640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4490036950 0x7f4490038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.460+0000 7f4495e03640 1 -- 172.21.15.170:0/3187840876 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f459c08da20 con 0x5595b1cef5e0 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.460+0000 7f45a8dad640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4490036950 0x7f4490038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.460+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1cf0750 0x5595b1df1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.460+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1df1cb0 con 0x5595b1cf0750 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.460+0000 7f45a9daf640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1cf0750 0x5595b1df1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45a9daf640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1cf0750 0x5595b1df1770 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45a8dad640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4490036950 0x7f4490038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f45a0001e40 tx=0x7f45a00013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45a9daf640 1 -- 172.21.15.170:0/3187840876 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1cf0750 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1df25a0 con 0x5595b1cf0750 2024-04-26T12:32:20.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45a9daf640 1 -- 172.21.15.170:0/3187840876 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1cf0750 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1df3eb0 0x5595b1df6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1df6ae0 con 0x5595b1df3eb0 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.461+0000 7f45a95ae640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1df3eb0 0x5595b1df6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45a95ae640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1df3eb0 0x5595b1df6350 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45a95ae640 1 -- 172.21.15.170:0/3187840876 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f459c075030 con 0x5595b1df3eb0 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1df2e20 con 0x5595b1cf0750 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45a9daf640 1 -- 172.21.15.170:0/3187840876 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1cf0750 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5595b1df7f90 0x5595b1dfa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1dfab90 con 0x5595b1df7f90 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45a8dad640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5595b1df7f90 0x5595b1dfa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.462+0000 7f45a8dad640 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5595b1df7f90 0x5595b1dfa400 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45a8dad640 1 -- 172.21.15.170:0/3187840876 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f45a000f6d0 con 0x5595b1df7f90 2024-04-26T12:32:20.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45ad92f800 1 Processor -- start 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45ad92f800 1 -- start start 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45ad92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e08ff0 0x5595b1e09410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45ad92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5595b1be0e60 con 0x5595b1e08ff0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e08ff0 0x5595b1e09410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e08ff0 0x5595b1e09410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45596/0 (socket says 172.21.15.170:45596) 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.463+0000 7f45a95ae640 1 -- 172.21.15.170:0/1514547895 learned_addr learned my addr 172.21.15.170:0/1514547895 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.464+0000 7f45a95ae640 1 -- 172.21.15.170:0/1514547895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b1e09950 con 0x5595b1e08ff0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.464+0000 7f45a95ae640 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e08ff0 0x5595b1e09410 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f459c08be00 tx=0x7f459c076ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.464+0000 7f448effd640 1 -- 172.21.15.170:0/1514547895 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c0081d0 con 0x5595b1e08ff0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.464+0000 7f448effd640 1 -- 172.21.15.170:0/1514547895 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c05d440 con 0x5595b1e08ff0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.464+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595b1e0a3c0 con 0x5595b1e08ff0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.464+0000 7f448effd640 1 -- 172.21.15.170:0/1514547895 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c05d760 con 0x5595b1e08ff0 2024-04-26T12:32:20.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.464+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b1e0a8c0 con 0x5595b1e08ff0 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f448effd640 1 -- 172.21.15.170:0/1514547895 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f459c006980 con 0x5595b1e08ff0 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f448effd640 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4480036900 0x7f4480038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f448effd640 1 -- 172.21.15.170:0/1514547895 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f459c04c0e0 con 0x5595b1e08ff0 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f45a8dad640 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4480036900 0x7f4480038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f45ad92f800 1 Processor -- start 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f45ad92f800 1 -- start start 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f45a8dad640 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4480036900 0x7f4480038dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5595b1deeea0 tx=0x7f45a000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f45ad92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e16510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.465+0000 7f45ad92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5595b1c635e0 con 0x5595b1e160f0 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e16510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e16510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45608/0 (socket says 172.21.15.170:45608) 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f45a95ae640 1 -- 172.21.15.170:0/1963805913 learned_addr learned my addr 172.21.15.170:0/1963805913 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f45a95ae640 1 -- 172.21.15.170:0/1963805913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b1e16ae0 con 0x5595b1e160f0 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f45a95ae640 1 --2- 172.21.15.170:0/1963805913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e16510 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f459c06bfd0 tx=0x7f459c078500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a5b99899e3781f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f448cff9640 1 -- 172.21.15.170:0/1963805913 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c060110 con 0x5595b1e160f0 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f448cff9640 1 -- 172.21.15.170:0/1963805913 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c006e50 con 0x5595b1e160f0 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.466+0000 7f448cff9640 1 -- 172.21.15.170:0/1963805913 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c08d550 con 0x5595b1e160f0 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 -- 172.21.15.170:0/1963805913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 msgr2=0x5595b1e16510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 --2- 172.21.15.170:0/1963805913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e16510 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f459c06bfd0 tx=0x7f459c078500 comp rx=0 tx=0).stop 2024-04-26T12:32:20.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 -- 172.21.15.170:0/1963805913 shutdown_connections 2024-04-26T12:32:20.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 --2- 172.21.15.170:0/1963805913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e16510 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 -- 172.21.15.170:0/1963805913 >> 172.21.15.170:0/1963805913 conn(0x5595b1e12450 msgr2=0x5595b1e104b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 -- 172.21.15.170:0/1963805913 shutdown_connections 2024-04-26T12:32:20.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 -- 172.21.15.170:0/1963805913 wait complete. 2024-04-26T12:32:20.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 Processor -- start 2024-04-26T12:32:20.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 -- start start 2024-04-26T12:32:20.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e1d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45ad92f800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5595b1e17190 con 0x5595b1e160f0 2024-04-26T12:32:20.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e1d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45a95ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e1d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:45618/0 (socket says 172.21.15.170:45618) 2024-04-26T12:32:20.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.467+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 learned_addr learned my addr 172.21.15.170:0/187356052 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:32:20.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.468+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b1e1daa0 con 0x5595b1e160f0 2024-04-26T12:32:20.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.468+0000 7f45a95ae640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e1d560 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f459c078600 tx=0x7f459c04eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.468+0000 7f447effd640 1 -- 172.21.15.170:0/187356052 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c0ba070 con 0x5595b1e160f0 2024-04-26T12:32:20.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.468+0000 7f447effd640 1 -- 172.21.15.170:0/187356052 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c08d810 con 0x5595b1e160f0 2024-04-26T12:32:20.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.468+0000 7f447effd640 1 -- 172.21.15.170:0/187356052 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c079510 con 0x5595b1e160f0 2024-04-26T12:32:20.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.468+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595b1e1daa0 con 0x5595b1e160f0 2024-04-26T12:32:20.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.468+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b1e1daa0 con 0x5595b1e160f0 2024-04-26T12:32:20.501 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f447effd640 1 -- 172.21.15.170:0/187356052 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f459c0bd070 con 0x5595b1e160f0 2024-04-26T12:32:20.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f447effd640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4474036950 0x7f4474038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f447effd640 1 -- 172.21.15.170:0/187356052 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f459c0b6d80 con 0x5595b1e160f0 2024-04-26T12:32:20.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f45a8dad640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4474036950 0x7f4474038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f45a8dad640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4474036950 0x7f4474038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5595b1dfaf90 tx=0x7f45a0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1e28c30 0x5595b1e2b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2b840 con 0x5595b1e28c30 2024-04-26T12:32:20.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.469+0000 7f45a9daf640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1e28c30 0x5595b1e2b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45a9daf640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1e28c30 0x5595b1e2b0f0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 20 realm 2024-04-26T12:32:20.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2bc50 con 0x5595b1e28c30 2024-04-26T12:32:20.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:32:20.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c520 con 0x5595b1e28c30 2024-04-26T12:32:20.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.470+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1e2d620 0x5595b1e2fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2ffd0 con 0x5595b1e2d620 2024-04-26T12:32:20.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45a95ae640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1e2d620 0x5595b1e2fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45a95ae640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1e2d620 0x5595b1e2fa10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:32:20.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 20 searching for the correct realm 2024-04-26T12:32:20.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5595b1e31f80 0x5595b1e34440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e34b10 con 0x5595b1e31f80 2024-04-26T12:32:20.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.471+0000 7f45a8dad640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5595b1e31f80 0x5595b1e34440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.472+0000 7f45a8dad640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5595b1e31f80 0x5595b1e34440 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.472+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.472+0000 7f45a8dad640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f45a000f070 0x7f45a003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:32:20.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.472+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e34b10 con 0x7f45a000f070 2024-04-26T12:32:20.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.472+0000 7f45a9daf640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f45a000f070 0x7f45a003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:32:20.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.472+0000 7f45a9daf640 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f45a000f070 0x7f45a003a3c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:32:20.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f45a400a4a0 con 0x7f45a000f070 2024-04-26T12:32:20.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.473+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x7f45a000f070 2024-04-26T12:32:20.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a400a4a0 con 0x7f45a000f070 2024-04-26T12:32:20.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.511 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.474+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x7f45a000f070 2024-04-26T12:32:20.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a400a4a0 con 0x7f45a000f070 2024-04-26T12:32:20.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.512 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a400a4a0 con 0x5595b1e28c30 2024-04-26T12:32:20.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x7f45a000f070 2024-04-26T12:32:20.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.475+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.513 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.476+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.477+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x7f45a000f070 2024-04-26T12:32:20.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.478+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x7f45a000f070 2024-04-26T12:32:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e31f80 2024-04-26T12:32:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e2d620 2024-04-26T12:32:20.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.479+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x5595b1e28c30 2024-04-26T12:32:20.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e2c8c0 con 0x7f45a000f070 2024-04-26T12:32:20.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:32:20.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:32:20.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:32:20.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:32:20.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:32:20.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:32:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e30890 con 0x5595b1e28c30 2024-04-26T12:32:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e30890 con 0x5595b1e28c30 2024-04-26T12:32:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:32:20.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.480+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e30890 con 0x7f45a000f070 2024-04-26T12:32:20.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:32:20.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 zone default found 2024-04-26T12:32:20.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 4 Realm: () 2024-04-26T12:32:20.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:32:20.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:32:20.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:32:20.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 zonegroup default 2024-04-26T12:32:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e31130 con 0x5595b1e2d620 2024-04-26T12:32:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e36970 con 0x5595b1e31f80 2024-04-26T12:32:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e36d10 con 0x5595b1e31f80 2024-04-26T12:32:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.481+0000 7f45ad92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:32:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.482+0000 7f45ad92f800 20 started sync module instance, tier type = 2024-04-26T12:32:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.482+0000 7f45ad92f800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:32:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.482+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e35e10 con 0x7f45a000f070 2024-04-26T12:32:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.483+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.483+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94101422957376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e35e10 con 0x7f45a000f070 2024-04-26T12:32:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.483+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e37710 con 0x5595b1e28c30 2024-04-26T12:32:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.484+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94101422957376] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.484+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.484+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94101422961184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e378f0 con 0x5595b1e28c30 2024-04-26T12:32:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.484+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e38180 con 0x5595b1e31f80 2024-04-26T12:32:20.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.485+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94101422961184] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.485+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.485+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94101422962928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e37d10 con 0x5595b1e31f80 2024-04-26T12:32:20.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.485+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e39040 con 0x7f45a000f070 2024-04-26T12:32:20.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.486+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94101422962928] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.486+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.486+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94101422967696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e39460 con 0x7f45a000f070 2024-04-26T12:32:20.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.486+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e39e20 con 0x5595b1e28c30 2024-04-26T12:32:20.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.487+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94101422967696] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.487+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.487+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94101422969232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e39e20 con 0x5595b1e28c30 2024-04-26T12:32:20.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.487+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e3a7e0 con 0x5595b1e2d620 2024-04-26T12:32:20.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.488+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.488+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94101422973744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e3b030 con 0x5595b1e2d620 2024-04-26T12:32:20.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.488+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e3ba60 con 0x5595b1e2d620 2024-04-26T12:32:20.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.488+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94101422969232] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.489+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94101422973744] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.489+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.489+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94101422975872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e39970 con 0x5595b1e2d620 2024-04-26T12:32:20.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.489+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e3c2c0 con 0x5595b1e2d620 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.490+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94101422975872] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94101422980528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e3c280 con 0x5595b1e2d620 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 20 add_watcher() i=0 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 20 add_watcher() i=1 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 20 add_watcher() i=2 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 20 add_watcher() i=3 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 20 add_watcher() i=4 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 20 add_watcher() i=5 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.491+0000 7f45ad92f800 20 add_watcher() i=6 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.492+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94101422980528] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.492+0000 7f45ad92f800 20 add_watcher() i=7 2024-04-26T12:32:20.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.492+0000 7f45ad92f800 2 all 8 watchers are set, enabling cache 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.492+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e3f740 con 0x5595b1e28c30 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.492+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.492+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94101422978416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e3cc60 con 0x5595b1e28c30 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.493+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94101422978416] v32'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f445f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 5 note: GC not initialized 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f445e7e4640 20 reqs_thread_entry: start 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 20 init_complete bucket index max shards: 11 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 20 Filter name: none 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f43cffff640 20 reqs_thread_entry: start 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 20 rados->read ofs=0 len=0 2024-04-26T12:32:20.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.494+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e72e40 con 0x5595b1e2d620 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.496+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.496+0000 7f45ad92f800 20 rados_obj.operate() r=0 bl.length=473 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.496+0000 7f45ad92f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.496+0000 7f45ad92f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.496+0000 7f45ad92f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.496+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e79760 con 0x5595b1e2d620 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f45ad92f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f45ad92f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f45ad92f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94101423231440 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e74e50 con 0x5595b1e28c30 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== watch-notify(notify (1) cookie 94101422969232 notify 137438953519 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f45a4018a90 con 0x5595b1e28c30 2024-04-26T12:32:20.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f448cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953519 cookie 94101422969232 notifier 4929 bl.length()=649 2024-04-26T12:32:20.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f448cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-26T12:32:20.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f448cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-26T12:32:20.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f448cff9640 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f446c003ea0 con 0x5595b1e28c30 2024-04-26T12:32:20.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.497+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(64 notify.4 [notify cookie 94101423231440 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.498+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.498+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== watch-notify(notify_complete (2) cookie 94101423231440 notify 137438953519 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f45a4018d30 con 0x5595b1e28c30 2024-04-26T12:32:20.539 INFO:teuthology.orchestra.run.smithi170.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-26T12:32:18.570704Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-26T12:32:18.570687Z","tags":[],"group_ids":[]} 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.499+0000 7f445f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.499+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94101422978416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e78ab0 con 0x5595b1e28c30 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.500+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94101422978416] v32'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.500+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94101422957376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e78ab0 con 0x7f45a000f070 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.501+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94101422957376] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.501+0000 7f45ad92f800 20 remove_watcher() i=0 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.501+0000 7f45ad92f800 2 removed watcher, disabling cache 2024-04-26T12:32:20.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.501+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94101422961184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e78ab0 con 0x5595b1e28c30 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.502+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94101422961184] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.502+0000 7f45ad92f800 20 remove_watcher() i=1 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.502+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94101422962928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e78ab0 con 0x5595b1e31f80 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.503+0000 7f45a8dad640 1 -- 172.21.15.170:0/187356052 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94101422962928] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a0037040 con 0x5595b1e31f80 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.503+0000 7f45ad92f800 20 remove_watcher() i=2 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.503+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94101422967696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e37220 con 0x7f45a000f070 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.504+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94101422967696] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x7f45a000f070 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.504+0000 7f45ad92f800 20 remove_watcher() i=3 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.504+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94101422969232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e378f0 con 0x5595b1e28c30 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.505+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94101422969232] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45a4033040 con 0x5595b1e28c30 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.505+0000 7f45ad92f800 20 remove_watcher() i=4 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.505+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94101422973744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e38b90 con 0x5595b1e2d620 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.506+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94101422973744] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.506+0000 7f45ad92f800 20 remove_watcher() i=5 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.506+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94101422975872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e37220 con 0x5595b1e2d620 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.507+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94101422975872] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.507+0000 7f45ad92f800 20 remove_watcher() i=6 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.507+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94101422980528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5595b1e39190 con 0x5595b1e2d620 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45a95ae640 1 -- 172.21.15.170:0/187356052 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94101422980528] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c0bc030 con 0x5595b1e2d620 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 20 remove_watcher() i=7 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1e2d620 msgr2=0x5595b1e2fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1e2d620 0x5595b1e2fa10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1e28c30 msgr2=0x5595b1e2b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1e28c30 0x5595b1e2b0f0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f45a000f070 msgr2=0x7f45a003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f45a000f070 0x7f45a003a3c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5595b1e31f80 msgr2=0x5595b1e34440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x5595b1e31f80 0x5595b1e34440 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4474036950 msgr2=0x7f4474038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4474036950 0x7f4474038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5595b1dfaf90 tx=0x7f45a0010000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 msgr2=0x5595b1e1d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/187356052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e160f0 0x5595b1e1d560 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f459c078600 tx=0x7f459c04eef0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 reap_dead start 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45a9daf640 1 -- 172.21.15.170:0/187356052 reap_dead start 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 shutdown_connections 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 >> 172.21.15.170:0/187356052 conn(0x5595b1e12450 msgr2=0x5595b1e0fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 shutdown_connections 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/187356052 wait complete. 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4480036900 msgr2=0x7f4480038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4480036900 0x7f4480038dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5595b1deeea0 tx=0x7f45a000f000 comp rx=0 tx=0).stop 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e08ff0 msgr2=0x5595b1e09410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.508+0000 7f45ad92f800 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e08ff0 0x5595b1e09410 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f459c08be00 tx=0x7f459c076ce0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 shutdown_connections 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4480036900 0x7f4480038dc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 --2- 172.21.15.170:0/1514547895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1e08ff0 0x5595b1e09410 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 >> 172.21.15.170:0/1514547895 conn(0x5595b1dfd090 msgr2=0x5595b1dfd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 shutdown_connections 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/1514547895 wait complete. 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1df3eb0 msgr2=0x5595b1df6350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x5595b1df3eb0 0x5595b1df6350 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1cf0750 msgr2=0x5595b1df1770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x5595b1cf0750 0x5595b1df1770 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5595b1df7f90 msgr2=0x5595b1dfa400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x5595b1df7f90 0x5595b1dfa400 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4490036950 msgr2=0x7f4490038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f4490036950 0x7f4490038e10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f45a0001e40 tx=0x7f45a00013a0 comp rx=0 tx=0).stop 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 msgr2=0x5595b1dea700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:32:20.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 --2- 172.21.15.170:0/3187840876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5595b1cef5e0 0x5595b1dea700 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f459c052540 tx=0x7f459c003020 comp rx=0 tx=0).stop 2024-04-26T12:32:20.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45a9daf640 1 -- 172.21.15.170:0/3187840876 reap_dead start 2024-04-26T12:32:20.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 shutdown_connections 2024-04-26T12:32:20.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 >> 172.21.15.170:0/3187840876 conn(0x5595b1ceaba0 msgr2=0x5595b1ddc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:32:20.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 shutdown_connections 2024-04-26T12:32:20.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:32:20.509+0000 7f45ad92f800 1 -- 172.21.15.170:0/3187840876 wait complete. 2024-04-26T12:32:20.550 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.550 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-26T12:32:18.570704Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-26T12:32:18.570687Z', 'tags': [], 'group_ids': []} 2024-04-26T12:32:20.550 ERROR:root:0 2024-04-26T12:32:20.550 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-26T12:32:20.558 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.560 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.565 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.565 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-26T12:32:20.570 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.574 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.575 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-26T12:32:20.582 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-04-26T12:32:20.583 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.586 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.587 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-26T12:32:20.593 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.594 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.597 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.597 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-26T12:32:20.604 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-26T12:32:20.605 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.608 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.608 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-26T12:32:20.617 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-26T12:32:20.617 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.621 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.621 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-26T12:32:20.628 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.628 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.632 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.632 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-26T12:32:20.638 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.643 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.643 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-26T12:32:20.651 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.651 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.655 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.655 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.663 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T12:32:20.665 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-26T12:32:20.672 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T12:32:20.686 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-26T12:32:20.691 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-26T12:32:20.692 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T12:32:20.696 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:32:20.680804Z', 'creation_time': '2024-04-26T12:32:20.676495Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:32:20.697 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-26T12:32:20.702 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:32:20.680804Z', 'creation_time': '2024-04-26T12:32:20.676495Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-26T12:32:20.707 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T12:32:20.712 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:32:20.680804Z', 'creation_time': '2024-04-26T12:32:20.676495Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:32:20.712 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-26T12:32:20.717 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000009189731467a12240-00662b9ed4-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:32:20.721 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-26T12:32:20.729 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.730 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-26T12:32:20.738 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:32:20.787 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11'} 2024-04-26T12:32:20.797 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.800 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11'} 2024-04-26T12:32:20.809 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.809 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-26T12:32:20.818 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.825 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-26T12:32:20.830 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:32:20.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-26T12:32:20.835 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '533c183d-6c44-41ed-a056-8506aff12524', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'marker': '1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-26T12:32:20.804978Z', 'creation_time': '2024-04-26T12:32:20.676495Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-26T12:33:20.880 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-26T12:33:20.899 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-04-26T12:33:20.899 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-26T12:33:20.914 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-04-26T12:33:20.914 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-26T12:33:20.920 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-04-26T12:33:20.920 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-26T12:33:20.925 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-04-26T12:33:20.926 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-26T12:33:20.931 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-04-26T12:33:20.932 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-26T12:33:20.937 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-04-26T12:33:20.937 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-26T12:33:20.942 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-04-26T12:00:00.000000Z', 'epoch': 1714132800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-04-26T12:33:20.943 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-26T12:33:20.951 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:33:20.952 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-26T12:33:20.957 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-26T12:33:20.957 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-26T12:33:20.966 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:33:20.971 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-26T12:33:20.980 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:33:21.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-26T12:33:21.218 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000001e2719733953d677-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.315 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-26T12:33:21.320 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-26T12:33:21.325 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-26T12:33:21.331 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-26T12:33:21.439 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-26T12:33:21.473 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:33:21.474 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-26T12:33:21.480 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-26T12:33:21.480 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-26T12:33:21.485 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-26T12:33:21.495 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-26T12:33:21.499 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000001cd4a8f427ee5366-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-26T12:33:21.546 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:33:21.547 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-26T12:33:21.551 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000e9972bbb61175870-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.551 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-26T12:33:21.555 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '9f7de4b1-7365-4f06-b9fa-64d18aa7a81a'}]}} 2024-04-26T12:33:21.555 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-26T12:33:21.565 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-26T12:33:21.566 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-26T12:33:21.570 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T12:33:21.570 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-26T12:33:21.574 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000da3ee3d244c602b3-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.575 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-26T12:33:21.578 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f65b76f10451837f-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.588 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-26T12:33:21.591 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T12:33:21.591 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-26T12:33:21.595 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000066a30b951a104997-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.595 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-26T12:33:21.599 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f5470365bd47fb36-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.599 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-26T12:33:21.603 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-26T12:33:21.604 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-26T12:33:21.607 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d906e4e8c324d574-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.607 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-26T12:33:21.611 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000005eba9f2fe168fba3-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.611 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-26T12:33:21.615 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000001d617f116238232-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.615 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-26T12:33:21.619 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000c4d38cc32631d3bf-00662b9f11-4236-default', 'HostId': '4236-default-default'} 2024-04-26T12:33:21.619 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-26T12:33:21.629 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:33:21.629 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-26T12:33:21.633 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-26T12:33:21.634 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-26T12:33:21.639 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:33:21.640 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-26T12:33:21.644 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-26T12:33:21.644 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-26T12:33:21.649 INFO:tasks.radosgw_admin_rest: empty result 2024-04-26T12:33:21.654 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-26T12:33:21.664 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:21.665 INFO:tasks.rgw.client.0.smithi170.stdout:2024-04-26T12:33:21.664+0000 7f68791b3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 33798) UID: 0 2024-04-26T12:33:21.665 INFO:tasks.rgw.client.0.smithi170.stdout:2024-04-26T12:33:21.664+0000 7f687eb24880 -1 shutting down 2024-04-26T12:33:27.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-26T12:33:27.766 INFO:tasks.rgw.client.0:Stopped 2024-04-26T12:33:27.767 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-26T12:33:27.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/vault-root-token 2024-04-26T12:33:27.855 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-26T12:33:27.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-26T12:33:27.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-26T12:33:27.923 DEBUG:teuthology.orchestra.run.smithi170:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-26T12:33:28.010 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setuser ceph since I am not root 2024-04-26T12:33:28.010 INFO:teuthology.orchestra.run.smithi170.stderr:ignoring --setgroup ceph since I am not root 2024-04-26T12:33:28.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.010+0000 7f540f736800 1 Processor -- start 2024-04-26T12:33:28.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.010+0000 7f540f736800 1 -- start start 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.010+0000 7f540f736800 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55afcba22000 0x55afcba243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.010+0000 7f540f736800 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55afcb8ce0c0 con 0x55afcba24930 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.010+0000 7f540f736800 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x55afcb8b24d0 con 0x55afcba22000 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.010+0000 7f540b4cc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x55afcba22000 0x55afcba243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.011+0000 7f540accb640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x55afcba24930 0x55afcba26d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.170:42684/0 (socket says 172.21.15.170:42684) 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.011+0000 7f540accb640 1 -- 172.21.15.170:0/3239555571 learned_addr learned my addr 172.21.15.170:0/3239555571 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.011+0000 7f540b4cc640 1 -- 172.21.15.170:0/3239555571 >> v1:172.21.15.132:6789/0 conn(0x55afcba24930 legacy=0x55afcba26d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.011+0000 7f540b4cc640 1 -- 172.21.15.170:0/3239555571 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afcb8dfd40 con 0x55afcba22000 2024-04-26T12:33:28.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.013+0000 7f540b4cc640 1 --2- 172.21.15.170:0/3239555571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcba243f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00a470 tx=0x7f53fc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4db35d314037b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.013+0000 7f540a4ca640 1 -- 172.21.15.170:0/3239555571 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc057070 con 0x55afcba22000 2024-04-26T12:33:28.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.013+0000 7f540a4ca640 1 -- 172.21.15.170:0/3239555571 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc052570 con 0x55afcba22000 2024-04-26T12:33:28.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.013+0000 7f540a4ca640 1 -- 172.21.15.170:0/3239555571 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc052870 con 0x55afcba22000 2024-04-26T12:33:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.014+0000 7f540f736800 1 -- 172.21.15.170:0/3239555571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 msgr2=0x55afcba243f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.014+0000 7f540f736800 1 --2- 172.21.15.170:0/3239555571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcba243f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00a470 tx=0x7f53fc01ce90 comp rx=0 tx=0).stop 2024-04-26T12:33:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.014+0000 7f540f736800 1 -- 172.21.15.170:0/3239555571 shutdown_connections 2024-04-26T12:33:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.014+0000 7f540f736800 1 --2- 172.21.15.170:0/3239555571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcba243f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.014+0000 7f540f736800 1 -- 172.21.15.170:0/3239555571 >> 172.21.15.170:0/3239555571 conn(0x55afcba1b990 msgr2=0x55afcba1ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.014+0000 7f540f736800 1 -- 172.21.15.170:0/3239555571 shutdown_connections 2024-04-26T12:33:28.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.014+0000 7f540f736800 1 -- 172.21.15.170:0/3239555571 wait complete. 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.027+0000 7f540f736800 1 Processor -- start 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.027+0000 7f540f736800 1 -- start start 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.027+0000 7f540f736800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb12680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.027+0000 7f540f736800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55afcb96cb40 con 0x55afcba22000 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.027+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb12680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.027+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb12680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42876/0 (socket says 172.21.15.170:42876) 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.027+0000 7f540b4cc640 1 -- 172.21.15.170:0/3136481281 learned_addr learned my addr 172.21.15.170:0/3136481281 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.028+0000 7f540b4cc640 1 -- 172.21.15.170:0/3136481281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afcb8de590 con 0x55afcba22000 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.028+0000 7f540b4cc640 1 --2- 172.21.15.170:0/3136481281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb12680 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f53fc055040 tx=0x7f53fc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08e81c8559e9449 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.028+0000 7f52f960a640 1 -- 172.21.15.170:0/3136481281 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc057070 con 0x55afcba22000 2024-04-26T12:33:28.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.028+0000 7f52f960a640 1 -- 172.21.15.170:0/3136481281 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc063070 con 0x55afcba22000 2024-04-26T12:33:28.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.028+0000 7f52f960a640 1 -- 172.21.15.170:0/3136481281 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc052720 con 0x55afcba22000 2024-04-26T12:33:28.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 -- 172.21.15.170:0/3136481281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 msgr2=0x55afcbb12680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 --2- 172.21.15.170:0/3136481281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb12680 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f53fc055040 tx=0x7f53fc04c000 comp rx=0 tx=0).stop 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 -- 172.21.15.170:0/3136481281 shutdown_connections 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 --2- 172.21.15.170:0/3136481281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb12680 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 -- 172.21.15.170:0/3136481281 >> 172.21.15.170:0/3136481281 conn(0x55afcba1b990 msgr2=0x55afcbb0dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 -- 172.21.15.170:0/3136481281 shutdown_connections 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 -- 172.21.15.170:0/3136481281 wait complete. 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 Processor -- start 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 -- start start 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb19f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.029+0000 7f540f736800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55afcba2a750 con 0x55afcba22000 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb19f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb19f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42886/0 (socket says 172.21.15.170:42886) 2024-04-26T12:33:28.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f540b4cc640 1 -- 172.21.15.170:0/886721842 learned_addr learned my addr 172.21.15.170:0/886721842 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f540b4cc640 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afcb8d58f0 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f540b4cc640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb19f20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f53fc055040 tx=0x7f53fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f52f7e07640 1 -- 172.21.15.170:0/886721842 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc052d30 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f52f7e07640 1 -- 172.21.15.170:0/886721842 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc06c070 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afcbb1a460 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f52f7e07640 1 -- 172.21.15.170:0/886721842 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc05e480 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.030+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afcbb1a980 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.031+0000 7f52f7e07640 1 -- 172.21.15.170:0/886721842 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f53fc077060 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.031+0000 7f52f7e07640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52f0036900 0x7f52f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.031+0000 7f52f7e07640 1 -- 172.21.15.170:0/886721842 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f53fc08e460 con 0x55afcba22000 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540accb640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52f0036900 0x7f52f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcba24930 0x55afcbb20f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb21560 con 0x55afcba24930 2024-04-26T12:33:28.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540bccd640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcba24930 0x55afcbb20f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540accb640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52f0036900 0x7f52f0038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5400001d90 tx=0x7f54000012f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540bccd640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcba24930 0x55afcbb20f90 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540bccd640 1 -- 172.21.15.170:0/886721842 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcba24930 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.032+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb21e00 con 0x55afcba24930 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.033+0000 7f540bccd640 1 -- 172.21.15.170:0/886721842 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcba24930 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.033+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb23710 0x55afcbb25ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.033+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:3 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb26330 con 0x55afcbb23710 2024-04-26T12:33:28.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.033+0000 7f540b4cc640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb23710 0x55afcbb25ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.033+0000 7f540b4cc640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb23710 0x55afcbb25ba0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.034+0000 7f540b4cc640 1 -- 172.21.15.170:0/886721842 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(3 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f53fc009d30 con 0x55afcbb23710 2024-04-26T12:33:28.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.034+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb22680 con 0x55afcba24930 2024-04-26T12:33:28.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.034+0000 7f540bccd640 1 -- 172.21.15.170:0/886721842 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcba24930 2024-04-26T12:33:28.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.034+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55afcbb277e0 0x55afcbb29c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.034+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:5 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb2a3b0 con 0x55afcbb277e0 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.034+0000 7f540accb640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55afcbb277e0 0x55afcbb29c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.035+0000 7f540accb640 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55afcbb277e0 0x55afcbb29c50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.035+0000 7f540accb640 1 -- 172.21.15.170:0/886721842 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(5 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb277e0 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.035+0000 7f540f736800 1 Processor -- start 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.035+0000 7f540f736800 1 -- start start 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.035+0000 7f540f736800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba21ba0 0x55afcba20010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.035+0000 7f540f736800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55afcb912e60 con 0x55afcba21ba0 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba21ba0 0x55afcba20010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba21ba0 0x55afcba20010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42892/0 (socket says 172.21.15.170:42892) 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f540b4cc640 1 -- 172.21.15.170:0/690062630 learned_addr learned my addr 172.21.15.170:0/690062630 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f540b4cc640 1 -- 172.21.15.170:0/690062630 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afcba20550 con 0x55afcba21ba0 2024-04-26T12:33:28.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f540b4cc640 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba21ba0 0x55afcba20010 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f53fc08c860 tx=0x7f53fc08e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f52f5602640 1 -- 172.21.15.170:0/690062630 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc089070 con 0x55afcba21ba0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f52f5602640 1 -- 172.21.15.170:0/690062630 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc058040 con 0x55afcba21ba0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afcba207e0 con 0x55afcba21ba0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f52f5602640 1 -- 172.21.15.170:0/690062630 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc08b3f0 con 0x55afcba21ba0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.036+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afcba207e0 con 0x55afcba21ba0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.037+0000 7f52f5602640 1 -- 172.21.15.170:0/690062630 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f53fc06e030 con 0x55afcba21ba0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.037+0000 7f52f5602640 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52e4036900 0x7f52e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.037+0000 7f52f5602640 1 -- 172.21.15.170:0/690062630 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f53fc07b0b0 con 0x55afcba21ba0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.037+0000 7f540accb640 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52e4036900 0x7f52e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540f736800 1 Processor -- start 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540f736800 1 -- start start 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540accb640 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52e4036900 0x7f52e4038dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55afcbb1e480 tx=0x7f540000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540f736800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb47d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540f736800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55afcbb12d40 con 0x55afcbb47900 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb47d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb47d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42906/0 (socket says 172.21.15.170:42906) 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540b4cc640 1 -- 172.21.15.170:0/2261370756 learned_addr learned my addr 172.21.15.170:0/2261370756 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.038+0000 7f540b4cc640 1 -- 172.21.15.170:0/2261370756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afcbb482f0 con 0x55afcbb47900 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f540b4cc640 1 --2- 172.21.15.170:0/2261370756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb47d20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f53fc067fd0 tx=0x7f53fc069d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eab20f84f5adad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f52eeffd640 1 -- 172.21.15.170:0/2261370756 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc06fb90 con 0x55afcbb47900 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f52eeffd640 1 -- 172.21.15.170:0/2261370756 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc0a0070 con 0x55afcbb47900 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f52eeffd640 1 -- 172.21.15.170:0/2261370756 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc066c00 con 0x55afcbb47900 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f540f736800 1 -- 172.21.15.170:0/2261370756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 msgr2=0x55afcbb47d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f540f736800 1 --2- 172.21.15.170:0/2261370756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb47d20 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f53fc067fd0 tx=0x7f53fc069d60 comp rx=0 tx=0).stop 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f540f736800 1 -- 172.21.15.170:0/2261370756 shutdown_connections 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f540f736800 1 --2- 172.21.15.170:0/2261370756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb47d20 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f540f736800 1 -- 172.21.15.170:0/2261370756 >> 172.21.15.170:0/2261370756 conn(0x55afcbb43c60 msgr2=0x55afcbb41cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.039+0000 7f540f736800 1 -- 172.21.15.170:0/2261370756 shutdown_connections 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540f736800 1 -- 172.21.15.170:0/2261370756 wait complete. 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540f736800 1 Processor -- start 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540f736800 1 -- start start 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540f736800 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb4edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540f736800 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55afcbb489a0 con 0x55afcbb47900 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb4edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540b4cc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb4edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.170:42912/0 (socket says 172.21.15.170:42912) 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.040+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 learned_addr learned my addr 172.21.15.170:0/287231627 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.041+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afcbb4f300 con 0x55afcbb47900 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.041+0000 7f540b4cc640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb4edc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f53fc069410 tx=0x7f53fc08aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.041+0000 7f52ed7fa640 1 -- 172.21.15.170:0/287231627 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc0b4070 con 0x55afcbb47900 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.041+0000 7f52ed7fa640 1 -- 172.21.15.170:0/287231627 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc066e30 con 0x55afcbb47900 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.041+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55afcbb4f300 con 0x55afcbb47900 2024-04-26T12:33:28.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.041+0000 7f52ed7fa640 1 -- 172.21.15.170:0/287231627 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53fc067c60 con 0x55afcbb47900 2024-04-26T12:33:28.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.041+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afcbb4f300 con 0x55afcbb47900 2024-04-26T12:33:28.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.042+0000 7f52ed7fa640 1 -- 172.21.15.170:0/287231627 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f53fc0b7070 con 0x55afcbb47900 2024-04-26T12:33:28.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.042+0000 7f52ed7fa640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52d40368b0 0x7f52d4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.042+0000 7f52ed7fa640 1 -- 172.21.15.170:0/287231627 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f53fc0b0d80 con 0x55afcbb47900 2024-04-26T12:33:28.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.042+0000 7f540accb640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52d40368b0 0x7f52d4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.043+0000 7f540accb640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52d40368b0 0x7f52d4038d70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55afcbb2a7b0 tx=0x7f5400010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.043+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.043+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcbb5a4b0 0x55afcbb5c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.043+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5d0c0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.043+0000 7f540bccd640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcbb5a4b0 0x55afcbb5c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.043+0000 7f540bccd640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcbb5a4b0 0x55afcbb5c970 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 realm 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5d4d0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5dda0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:33:28.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb5eea0 0x55afcbb61290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.044+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:5 5.17 5:e8747470:::zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb618a0 con 0x55afcbb5eea0 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.045+0000 7f540b4cc640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb5eea0 0x55afcbb61290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.045+0000 7f540b4cc640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb5eea0 0x55afcbb61290 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.045+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== osd_op_reply(5 zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.045+0000 7f540f736800 20 rados_obj.operate() r=0 bl.length=993 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.045+0000 7f540f736800 20 searching for the correct realm 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.045+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55afcbb63850 0x55afcbb65d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.045+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb663e0 con 0x55afcbb63850 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.046+0000 7f540accb640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55afcbb63850 0x55afcbb65d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.046+0000 7f540accb640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55afcbb63850 0x55afcbb65d10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.046+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.046+0000 7f540accb640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5400037040 0x7f5400036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.046+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb663e0 con 0x7f5400037040 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.046+0000 7f540bccd640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5400037040 0x7f5400036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.047+0000 7f540bccd640 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5400037040 0x7f5400036410 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.047+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f540400a4a0 con 0x7f5400037040 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.047+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.047+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.047+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.048+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x7f5400037040 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f540400a4a0 con 0x7f5400037040 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x7f5400037040 2024-04-26T12:33:28.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f540400a4a0 con 0x7f5400037040 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.049+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f540400a4a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x7f5400037040 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.050+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.051+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.052+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.052+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.052+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.052+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.052+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.052+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x7f5400037040 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=82b] v32'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.053+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.054+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.054+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x7f5400037040 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.054+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.054+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb63850 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.054+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.054+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5eea0 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x55afcbb5a4b0 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb5e140 con 0x7f5400037040 2024-04-26T12:33:28.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 RGWRados::pool_iterate: got zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 RGWRados::pool_iterate: got default.zone. 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 RGWRados::pool_iterate: got period_config.default 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 RGWRados::pool_iterate: got zone_info.1c3ccbd9-cd62-4733-b75e-94c1e85d1aae 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb62160 con 0x55afcbb5a4b0 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.055+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb62160 con 0x55afcbb5a4b0 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 20 rados_obj.operate() r=0 bl.length=46 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:40 5.10 5:0d215a27:::zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb62160 con 0x7f5400037040 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 8 ==== osd_op_reply(40 zonegroup_info.533c183d-6c44-41ed-a056-8506aff12524 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 20 rados_obj.operate() r=0 bl.length=436 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 20 zone default found 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 4 Realm: () 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 4 ZoneGroup: default (533c183d-6c44-41ed-a056-8506aff12524) 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 4 Zone: default (1c3ccbd9-cd62-4733-b75e-94c1e85d1aae) 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-26T12:33:28.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 20 zonegroup default 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.056+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb62a00 con 0x55afcbb5eea0 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 20 rados_obj.operate() r=0 bl.length=187 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb68240 con 0x55afcbb63850 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 20 rados->read ofs=0 len=0 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb685e0 con 0x55afcbb63850 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 20 started sync module instance, tier type = 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 20 started zone id=1c3ccbd9-cd62-4733-b75e-94c1e85d1aae (name=default) with tier type = 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.057+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb676e0 con 0x7f5400037040 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.058+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 9 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.058+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94213525371872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb676e0 con 0x7f5400037040 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.058+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb68fa0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.059+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94213525371872] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.060+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 15 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.060+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94213525376000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb676e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.060+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb699b0 con 0x55afcbb63850 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.061+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94213525376000] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.062+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 12 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.062+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94213525369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb67650 con 0x55afcbb63850 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.062+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6a870 con 0x7f5400037040 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.063+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 11 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.063+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94213525369392] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.063+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94213525382560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb69e40 con 0x7f5400037040 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.063+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6b5b0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.064+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94213525382560] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.064+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 17 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.064+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94213525385440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6b5b0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.064+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6bff0 con 0x55afcbb5eea0 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.065+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94213525385440] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.065+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 11 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.065+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94213525388096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6c3e0 con 0x55afcbb5eea0 2024-04-26T12:33:28.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.065+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6cda0 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.066+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94213525388096] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.067+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 13 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.067+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94213525391600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6d1c0 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.067+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6db80 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94213525391600] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 15 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94213525393136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6db80 con 0x55afcbb5eea0 2024-04-26T12:33:28.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 20 add_watcher() i=0 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 20 add_watcher() i=1 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 20 add_watcher() i=2 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 20 add_watcher() i=3 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 20 add_watcher() i=4 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 20 add_watcher() i=5 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.068+0000 7f540f736800 20 add_watcher() i=6 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.069+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94213525393136] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.069+0000 7f540f736800 20 add_watcher() i=7 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.069+0000 7f540f736800 2 all 8 watchers are set, enabling cache 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.069+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb70ea0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.069+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.069+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94213525395520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6e110 con 0x55afcbb5a4b0 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.070+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94213525395520] v32'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.071+0000 7f52c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.071+0000 7f540f736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.071+0000 7f540f736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.071+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb70730 con 0x55afcbb5a4b0 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.072+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.072+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb79fe0 con 0x55afcbb5eea0 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.073+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.073+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb79fe0 con 0x55afcbb63850 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.074+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'33 uv32 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.074+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7aa60 con 0x55afcbb5a4b0 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.075+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.075+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb796e0 con 0x7f5400037040 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.076+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'85 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.076+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb796e0 con 0x55afcbb63850 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.077+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.077+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7bc40 con 0x55afcbb5a4b0 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.078+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.079+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7bcd0 con 0x55afcbb5eea0 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.080+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.080+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7bd60 con 0x7f5400037040 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.081+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.081+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7bdf0 con 0x55afcbb63850 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.082+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.082+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c2a0 con 0x7f5400037040 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.083+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'86 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.083+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c2a0 con 0x55afcbb5eea0 2024-04-26T12:33:28.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.084+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.084+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c2a0 con 0x7f5400037040 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.085+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.085+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c2a0 con 0x55afcbb5eea0 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.086+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.086+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c330 con 0x55afcbb5a4b0 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.087+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.087+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c330 con 0x55afcbb63850 2024-04-26T12:33:28.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.088+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.088+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x7f5400037040 2024-04-26T12:33:28.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.089+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'87 uv57 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.089+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.090+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.090+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.092+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.092+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.093+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.094 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.093+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.094+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.094+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x7f5400037040 2024-04-26T12:33:28.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.095+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'44 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.095+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.096+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.096+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.097+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.097+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.098+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.098+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.099+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.099+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb5eea0 2024-04-26T12:33:28.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.100+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.100+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.101+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.101+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb5eea0 2024-04-26T12:33:28.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.102+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.102+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb63850 2024-04-26T12:33:28.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.103+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.103+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x55afcbb5eea0 2024-04-26T12:33:28.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.104+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.104+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb7c7e0 con 0x7f5400037040 2024-04-26T12:33:28.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.106+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.106+0000 7f52c0fe1640 20 reqs_thread_entry: start 2024-04-26T12:33:28.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.106+0000 7f540f736800 20 init_complete bucket index max shards: 11 2024-04-26T12:33:28.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.106+0000 7f540f736800 20 Filter name: none 2024-04-26T12:33:28.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.106+0000 7f523a7fc640 20 reqs_thread_entry: start 2024-04-26T12:33:28.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.106+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-26T12:33:28.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.106+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:94 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb5eea0 2024-04-26T12:33:28.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.107+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 24 ==== osd_op_reply(94 gc.1 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.107+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:95 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb5eea0 2024-04-26T12:33:28.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.107+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 25 ==== osd_op_reply(95 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:96 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba7820 con 0x55afcbb5eea0 2024-04-26T12:33:28.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 26 ==== osd_op_reply(96 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb5eea0 2024-04-26T12:33:28.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 27 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb5eea0 2024-04-26T12:33:28.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 28 ==== osd_op_reply(98 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.108+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb5eea0 2024-04-26T12:33:28.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.110+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 29 ==== osd_op_reply(99 gc.1 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.110+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-26T12:33:28.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.110+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb63850 2024-04-26T12:33:28.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 26 ==== osd_op_reply(100 gc.2 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb63850 2024-04-26T12:33:28.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 27 ==== osd_op_reply(101 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba7820 con 0x55afcbb63850 2024-04-26T12:33:28.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 28 ==== osd_op_reply(102 gc.2 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:103 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb63850 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 29 ==== osd_op_reply(103 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.111+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:104 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba8830 con 0x55afcbb63850 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 30 ==== osd_op_reply(104 gc.2 [call out=1716b] v0'0 uv34 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 20 garbage collection: RGWGC::process iterating over entry tag='1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.15035111459398634948', time=2024-04-26T12:33:36.212583+0000, chain.objs.size()=7 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_1 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:105 3.21s0 3:86a5e28e:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbba6b20 con 0x55afcbb5eea0 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_2 2024-04-26T12:33:28.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:106 3.27s0 3:e7a53a34:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbabbd0 con 0x55afcbb5eea0 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_3 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:107 3.39s0 3:9ec64942:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae740 con 0x55afcbb63850 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_4 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:108 3.6s0 3:60fce614:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbabbd0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_5 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:109 3.3s0 3:c0db2b77:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb34e0 con 0x7f5400037040 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_6 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:110 3.ds0 3:b372b2b5:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5e90 con 0x55afcbb63850 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_7 2024-04-26T12:33:28.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.112+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:111 3.32s0 3:4e7db218:::1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb34e0 con 0x55afcbb63850 2024-04-26T12:33:28.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.115+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 31 ==== osd_op_reply(110 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_6 [call] v32'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.115+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 32 ==== osd_op_reply(111 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_7 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.115+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 33 ==== osd_op_reply(107 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_3 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.115+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 27 ==== osd_op_reply(108 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_4 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.115+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 30 ==== osd_op_reply(106 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_2 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.116+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 31 ==== osd_op_reply(105 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_1 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.117+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 20 ==== osd_op_reply(109 1c3ccbd9-cd62-4733-b75e-94c1e85d1aae.4236.11__shadow_.ZAYkbV0mEKT4W6xeD5L11O6eJSrb2q8_5 [call] v32'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.117+0000 7f540f736800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-26T12:33:28.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.117+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:112 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.119+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 34 ==== osd_op_reply(112 gc.2 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.119+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:113 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.119+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 35 ==== osd_op_reply(113 gc.2 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.119+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-26T12:33:28.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.119+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:114 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.120+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 28 ==== osd_op_reply(114 gc.3 [call] v32'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.120+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:115 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 29 ==== osd_op_reply(115 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:116 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 30 ==== osd_op_reply(116 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:117 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 31 ==== osd_op_reply(117 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:118 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 32 ==== osd_op_reply(118 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.121+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:119 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.122+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 33 ==== osd_op_reply(119 gc.3 [call] v32'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5404033040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.122+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-26T12:33:28.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.122+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:120 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.123+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 21 ==== osd_op_reply(120 gc.4 [call] v32'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.123+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:121 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.123+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 22 ==== osd_op_reply(121 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.123+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.123+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:122 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 23 ==== osd_op_reply(122 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:123 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 24 ==== osd_op_reply(123 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:124 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 25 ==== osd_op_reply(124 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5404033040 con 0x7f5400037040 2024-04-26T12:33:28.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.124+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:125 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.125+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 26 ==== osd_op_reply(125 gc.4 [call] v32'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.125+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-26T12:33:28.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.125+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:126 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.126+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 36 ==== osd_op_reply(126 gc.5 [call] v32'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.126+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:127 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.126+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 37 ==== osd_op_reply(127 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.126+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.126+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:128 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.126+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 38 ==== osd_op_reply(128 gc.5 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.127+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:129 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.127+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 39 ==== osd_op_reply(129 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.127+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.127+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:130 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.127+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 40 ==== osd_op_reply(130 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.127+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.127+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:131 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.128+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 41 ==== osd_op_reply(131 gc.5 [call] v32'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.128+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-26T12:33:28.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.128+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:132 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.129+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 34 ==== osd_op_reply(132 gc.6 [call] v32'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.129+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:133 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.129+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 35 ==== osd_op_reply(133 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.129+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:134 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 36 ==== osd_op_reply(134 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:135 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 37 ==== osd_op_reply(135 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:136 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 38 ==== osd_op_reply(136 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.130+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:137 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.131+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 39 ==== osd_op_reply(137 gc.6 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.131+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-26T12:33:28.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.131+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:138 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.132+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 32 ==== osd_op_reply(138 gc.7 [call] v32'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.132+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:139 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 33 ==== osd_op_reply(139 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:140 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 34 ==== osd_op_reply(140 gc.7 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:141 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 35 ==== osd_op_reply(141 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.133+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:142 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.134+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 36 ==== osd_op_reply(142 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.134+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.134+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:143 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.135+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 37 ==== osd_op_reply(143 gc.7 [call] v32'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.135+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-26T12:33:28.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.135+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:144 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 27 ==== osd_op_reply(144 gc.8 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:145 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 28 ==== osd_op_reply(145 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:146 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 29 ==== osd_op_reply(146 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:147 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 30 ==== osd_op_reply(147 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.136+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:148 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.137+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 31 ==== osd_op_reply(148 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.137+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.137+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:149 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.138+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 32 ==== osd_op_reply(149 gc.8 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.138+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-26T12:33:28.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.138+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:150 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.139+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 42 ==== osd_op_reply(150 gc.9 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.139+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:151 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.139+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 43 ==== osd_op_reply(151 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.139+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.139+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:152 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.139+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 44 ==== osd_op_reply(152 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.139+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:153 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.140+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 45 ==== osd_op_reply(153 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.140+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.140+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:154 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.140+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 46 ==== osd_op_reply(154 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.140+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.140+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:155 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb63850 2024-04-26T12:33:28.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.141+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 47 ==== osd_op_reply(155 gc.9 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.141+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-26T12:33:28.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.141+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:156 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 33 ==== osd_op_reply(156 gc.10 [call] v32'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:157 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 34 ==== osd_op_reply(157 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:158 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 35 ==== osd_op_reply(158 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:159 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 36 ==== osd_op_reply(159 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.142+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:160 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.143+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 37 ==== osd_op_reply(160 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.143+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.143+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:161 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.144+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 38 ==== osd_op_reply(161 gc.10 [call] v32'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.144+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-26T12:33:28.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.144+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:162 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.145+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 38 ==== osd_op_reply(162 gc.11 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.145+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:163 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.145+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 39 ==== osd_op_reply(163 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.145+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.145+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:164 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.145+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 40 ==== osd_op_reply(164 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.145+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:165 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.146+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 41 ==== osd_op_reply(165 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.146+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.146+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:166 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.146+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 42 ==== osd_op_reply(166 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.146+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.146+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:167 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.147+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 43 ==== osd_op_reply(167 gc.11 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.147+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.147+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:168 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.148+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 39 ==== osd_op_reply(168 gc.12 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.148+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:169 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.148+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 40 ==== osd_op_reply(169 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.148+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.148+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:170 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 41 ==== osd_op_reply(170 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:171 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 42 ==== osd_op_reply(171 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:172 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 43 ==== osd_op_reply(172 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.149+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:173 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x7f5400037040 2024-04-26T12:33:28.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.150+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 44 ==== osd_op_reply(173 gc.12 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.150+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-26T12:33:28.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.150+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:174 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.151+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 44 ==== osd_op_reply(174 gc.13 [call] v32'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.151+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:175 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbb5df0 con 0x55afcbb5eea0 2024-04-26T12:33:28.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 45 ==== osd_op_reply(175 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:176 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 46 ==== osd_op_reply(176 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:177 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 47 ==== osd_op_reply(177 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:178 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 48 ==== osd_op_reply(178 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.152+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:179 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.153+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 49 ==== osd_op_reply(179 gc.13 [call] v32'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.153+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-26T12:33:28.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.153+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:180 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.154+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 40 ==== osd_op_reply(180 gc.14 [call] v32'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.154+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:181 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.154+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 41 ==== osd_op_reply(181 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.154+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:182 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 42 ==== osd_op_reply(182 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:183 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 43 ==== osd_op_reply(183 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:184 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 44 ==== osd_op_reply(184 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.155+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:185 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.156+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 45 ==== osd_op_reply(185 gc.14 [call] v32'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.156+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.156+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:186 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.157+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 48 ==== osd_op_reply(186 gc.15 [call] v32'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.157+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:187 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.157+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 49 ==== osd_op_reply(187 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.157+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.157+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:188 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 50 ==== osd_op_reply(188 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:189 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 51 ==== osd_op_reply(189 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:190 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 52 ==== osd_op_reply(190 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.158+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:191 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.159+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 53 ==== osd_op_reply(191 gc.15 [call] v32'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.159+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-26T12:33:28.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.159+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:192 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.160+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 45 ==== osd_op_reply(192 gc.16 [call] v32'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.160+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:193 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.160+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 46 ==== osd_op_reply(193 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.160+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.160+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:194 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x7f5400037040 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 47 ==== osd_op_reply(194 gc.16 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:195 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 48 ==== osd_op_reply(195 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:196 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 49 ==== osd_op_reply(196 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.161+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:197 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.162+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 50 ==== osd_op_reply(197 gc.16 [call] v32'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.162+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.162+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:198 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.163+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 54 ==== osd_op_reply(198 gc.17 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.163+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:199 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.163+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 55 ==== osd_op_reply(199 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.163+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.163+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:200 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.163+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 56 ==== osd_op_reply(200 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.163+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:201 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.164+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 57 ==== osd_op_reply(201 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.164+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.164+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:202 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.164+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 58 ==== osd_op_reply(202 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.164+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.164+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:203 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.165+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 59 ==== osd_op_reply(203 gc.17 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.165+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-26T12:33:28.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.165+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:204 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.166+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 46 ==== osd_op_reply(204 gc.18 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.166+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:205 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.166+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 47 ==== osd_op_reply(205 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.166+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.166+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:206 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 48 ==== osd_op_reply(206 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:207 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 49 ==== osd_op_reply(207 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:208 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 50 ==== osd_op_reply(208 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.167+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:209 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.168+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 51 ==== osd_op_reply(209 gc.18 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.168+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-26T12:33:28.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.168+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:210 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.169+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 52 ==== osd_op_reply(210 gc.19 [call] v32'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.169+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:211 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.169+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 53 ==== osd_op_reply(211 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.169+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.169+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:212 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 54 ==== osd_op_reply(212 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:213 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 55 ==== osd_op_reply(213 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:214 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 56 ==== osd_op_reply(214 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.170+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:215 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.171+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 57 ==== osd_op_reply(215 gc.19 [call] v32'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.171+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.171+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:216 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.172+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 60 ==== osd_op_reply(216 gc.20 [call] v32'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.172+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:217 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.172+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 61 ==== osd_op_reply(217 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.172+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.172+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:218 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.172+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 62 ==== osd_op_reply(218 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.172+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:219 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.173+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 63 ==== osd_op_reply(219 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.173+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.173+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:220 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.173+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 64 ==== osd_op_reply(220 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.173+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.173+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:221 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.174+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 65 ==== osd_op_reply(221 gc.20 [call] v32'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.174+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-26T12:33:28.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.174+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:222 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.175+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 51 ==== osd_op_reply(222 gc.21 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.175+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:223 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.175+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 52 ==== osd_op_reply(223 gc.21 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.175+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.175+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:224 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.175+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 53 ==== osd_op_reply(224 gc.21 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.175+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:225 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.176+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 54 ==== osd_op_reply(225 gc.21 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.176+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.176+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:226 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.176+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 55 ==== osd_op_reply(226 gc.21 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.176+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.176+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:227 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.177+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 56 ==== osd_op_reply(227 gc.21 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.177+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.177+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:228 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.178+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 66 ==== osd_op_reply(228 gc.22 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.178+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:229 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.178+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 67 ==== osd_op_reply(229 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.178+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.178+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:230 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.178+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 68 ==== osd_op_reply(230 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.178+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:231 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.179+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 69 ==== osd_op_reply(231 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.179+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.179+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:232 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.179+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 70 ==== osd_op_reply(232 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.179+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.179+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:233 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.180+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 71 ==== osd_op_reply(233 gc.22 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.180+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-26T12:33:28.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.180+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:234 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 72 ==== osd_op_reply(234 gc.23 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:235 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 73 ==== osd_op_reply(235 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:236 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 74 ==== osd_op_reply(236 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:237 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 75 ==== osd_op_reply(237 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.181+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:238 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.182+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 76 ==== osd_op_reply(238 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.182+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.182+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:239 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.182+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 77 ==== osd_op_reply(239 gc.23 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.182+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-26T12:33:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.182+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:240 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.183+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 78 ==== osd_op_reply(240 gc.24 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.183+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:241 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 79 ==== osd_op_reply(241 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:242 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 80 ==== osd_op_reply(242 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:243 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 81 ==== osd_op_reply(243 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:244 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 82 ==== osd_op_reply(244 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.184+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:245 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.185+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 83 ==== osd_op_reply(245 gc.24 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.185+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.185+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:246 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.186+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 84 ==== osd_op_reply(246 gc.25 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.186+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:247 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.186+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 85 ==== osd_op_reply(247 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.186+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.186+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:248 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.186+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 86 ==== osd_op_reply(248 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.186+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:249 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.187+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 87 ==== osd_op_reply(249 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.187+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.187+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:250 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.187+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 88 ==== osd_op_reply(250 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.187+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.187+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:251 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.188+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 89 ==== osd_op_reply(251 gc.25 [call] v32'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.188+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.188+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:252 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.189+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 50 ==== osd_op_reply(252 gc.26 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.189+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:253 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.189+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 51 ==== osd_op_reply(253 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.189+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.189+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:254 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.189+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 52 ==== osd_op_reply(254 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.189+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:255 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.190+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 53 ==== osd_op_reply(255 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.190+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.190+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:256 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.190+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 54 ==== osd_op_reply(256 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.190+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.190+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:257 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.191+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 55 ==== osd_op_reply(257 gc.26 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.191+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.191+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:258 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.192+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 90 ==== osd_op_reply(258 gc.27 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.192+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:259 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.192+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 91 ==== osd_op_reply(259 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.192+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.192+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:260 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.192+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 92 ==== osd_op_reply(260 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.192+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:261 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.193+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 93 ==== osd_op_reply(261 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.193+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.193+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:262 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.193+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 94 ==== osd_op_reply(262 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.193+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.193+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:263 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.194+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 95 ==== osd_op_reply(263 gc.27 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.194+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.194+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:264 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 56 ==== osd_op_reply(264 gc.28 [call] v32'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:265 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 57 ==== osd_op_reply(265 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:266 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 58 ==== osd_op_reply(266 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:267 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 59 ==== osd_op_reply(267 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.195+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:268 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.196+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 60 ==== osd_op_reply(268 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.196+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.196+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:269 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.197+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 61 ==== osd_op_reply(269 gc.28 [call] v32'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.197+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.197+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:270 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.198+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 96 ==== osd_op_reply(270 gc.29 [call] v32'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.198+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:271 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.198+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 97 ==== osd_op_reply(271 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.198+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.198+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:272 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb63850 2024-04-26T12:33:28.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.198+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 98 ==== osd_op_reply(272 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.199+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:273 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.199+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 99 ==== osd_op_reply(273 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.199+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.199+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:274 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.199+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 100 ==== osd_op_reply(274 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.199+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.199+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:275 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb63850 2024-04-26T12:33:28.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.200+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 101 ==== osd_op_reply(275 gc.29 [call] v32'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.200+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-26T12:33:28.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.200+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:276 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.201+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 62 ==== osd_op_reply(276 gc.30 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.201+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:277 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.201+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 63 ==== osd_op_reply(277 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.201+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.201+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:278 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 64 ==== osd_op_reply(278 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:279 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 65 ==== osd_op_reply(279 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:280 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbacde0 con 0x55afcbb5eea0 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 66 ==== osd_op_reply(280 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.202+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:281 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5eea0 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.203+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 67 ==== osd_op_reply(281 gc.30 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.203+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.203+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:282 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.204+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 57 ==== osd_op_reply(282 gc.31 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.204+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:283 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.204+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 58 ==== osd_op_reply(283 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.204+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.204+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:284 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x7f5400037040 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 59 ==== osd_op_reply(284 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:285 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 60 ==== osd_op_reply(285 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:286 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 61 ==== osd_op_reply(286 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.205+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:287 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x7f5400037040 2024-04-26T12:33:28.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.206+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 62 ==== osd_op_reply(287 gc.31 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.206+0000 7f540f736800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-26T12:33:28.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.206+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:288 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.207+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 58 ==== osd_op_reply(288 gc.0 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.207+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:289 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.207+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 59 ==== osd_op_reply(289 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.207+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.207+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:290 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 60 ==== osd_op_reply(290 gc.0 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:291 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 61 ==== osd_op_reply(291 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:292 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 62 ==== osd_op_reply(292 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540f736800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-26T12:33:28.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.208+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:293 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbaddf0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.209+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 63 ==== osd_op_reply(293 gc.0 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.210+0000 7f52c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-26T12:33:28.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.210+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94213525395520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.211+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94213525395520] v32'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.211+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94213525371872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbbae1e0 con 0x7f5400037040 2024-04-26T12:33:28.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.212+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94213525371872] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.212+0000 7f540f736800 20 remove_watcher() i=0 2024-04-26T12:33:28.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.212+0000 7f540f736800 2 removed watcher, disabling cache 2024-04-26T12:33:28.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.212+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94213525376000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb67be0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.213+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94213525376000] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.213+0000 7f540f736800 20 remove_watcher() i=1 2024-04-26T12:33:28.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.213+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94213525369392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb68c00 con 0x55afcbb63850 2024-04-26T12:33:28.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.214+0000 7f540accb640 1 -- 172.21.15.170:0/287231627 <== osd.3 v2:172.21.15.170:6816/2349137764 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94213525369392] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5400009050 con 0x55afcbb63850 2024-04-26T12:33:28.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.214+0000 7f540f736800 20 remove_watcher() i=2 2024-04-26T12:33:28.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.214+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94213525382560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb68c00 con 0x7f5400037040 2024-04-26T12:33:28.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.215+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.2 v2:172.21.15.170:6800/1189813177 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94213525382560] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f540404e040 con 0x7f5400037040 2024-04-26T12:33:28.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.215+0000 7f540f736800 20 remove_watcher() i=3 2024-04-26T12:33:28.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.215+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94213525385440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6a5a0 con 0x55afcbb5a4b0 2024-04-26T12:33:28.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.216+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 <== osd.1 v2:172.21.15.170:6808/2372702203 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94213525385440] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f540404e040 con 0x55afcbb5a4b0 2024-04-26T12:33:28.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.216+0000 7f540f736800 20 remove_watcher() i=4 2024-04-26T12:33:28.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.216+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94213525388096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb68c00 con 0x55afcbb5eea0 2024-04-26T12:33:28.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.217+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94213525388096] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.217+0000 7f540f736800 20 remove_watcher() i=5 2024-04-26T12:33:28.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.217+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94213525391600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6a5a0 con 0x55afcbb5eea0 2024-04-26T12:33:28.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.218+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94213525391600] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.218+0000 7f540f736800 20 remove_watcher() i=6 2024-04-26T12:33:28.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.218+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94213525393136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55afcbb6bb40 con 0x55afcbb5eea0 2024-04-26T12:33:28.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540b4cc640 1 -- 172.21.15.170:0/287231627 <== osd.0 v2:172.21.15.132:6800/965566727 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94213525393136] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53fc0b6030 con 0x55afcbb5eea0 2024-04-26T12:33:28.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 20 remove_watcher() i=7 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb5eea0 msgr2=0x55afcbb61290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb5eea0 0x55afcbb61290 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcbb5a4b0 msgr2=0x55afcbb5c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcbb5a4b0 0x55afcbb5c970 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5400037040 msgr2=0x7f5400036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f5400037040 0x7f5400036410 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55afcbb63850 msgr2=0x55afcbb65d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x55afcbb63850 0x55afcbb65d10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52d40368b0 msgr2=0x7f52d4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52d40368b0 0x7f52d4038d70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55afcbb2a7b0 tx=0x7f5400010000 comp rx=0 tx=0).stop 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 msgr2=0x55afcbb4edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540bccd640 1 -- 172.21.15.170:0/287231627 reap_dead start 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.219+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb4edc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f53fc069410 tx=0x7f53fc08aeb0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 shutdown_connections 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/287231627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcbb47900 0x55afcbb4edc0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 >> 172.21.15.170:0/287231627 conn(0x55afcbb43c60 msgr2=0x55afcbb412c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 shutdown_connections 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/287231627 wait complete. 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52e4036900 msgr2=0x7f52e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52e4036900 0x7f52e4038dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55afcbb1e480 tx=0x7f540000f000 comp rx=0 tx=0).stop 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba21ba0 msgr2=0x55afcba20010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba21ba0 0x55afcba20010 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f53fc08c860 tx=0x7f53fc08e110 comp rx=0 tx=0).stop 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 shutdown_connections 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52e4036900 0x7f52e4038dc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/690062630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba21ba0 0x55afcba20010 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 >> 172.21.15.170:0/690062630 conn(0x55afcbb2c8b0 msgr2=0x55afcbb2ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 shutdown_connections 2024-04-26T12:33:28.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/690062630 wait complete. 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb23710 msgr2=0x55afcbb25ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x55afcbb23710 0x55afcbb25ba0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcba24930 msgr2=0x55afcbb20f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x55afcba24930 0x55afcbb20f90 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55afcbb277e0 msgr2=0x55afcbb29c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x55afcbb277e0 0x55afcbb29c50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52f0036900 msgr2=0x7f52f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f52f0036900 0x7f52f0038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5400001d90 tx=0x7f54000012f0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 msgr2=0x55afcbb19f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.220+0000 7f540f736800 1 --2- 172.21.15.170:0/886721842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55afcba22000 0x55afcbb19f20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f53fc055040 tx=0x7f53fc002fb0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.221+0000 7f540bccd640 1 -- 172.21.15.170:0/886721842 reap_dead start 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.221+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 shutdown_connections 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.221+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 >> 172.21.15.170:0/886721842 conn(0x55afcba1b990 msgr2=0x55afcbb11070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.221+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 shutdown_connections 2024-04-26T12:33:28.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T12:33:28.221+0000 7f540f736800 1 -- 172.21.15.170:0/886721842 wait complete. 2024-04-26T12:33:28.229 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:33:28.239 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:33:28.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:33:28.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.336+0000 7f08ee10f640 1 Processor -- start 2024-04-26T12:33:28.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.336+0000 7f08ee10f640 1 -- start start 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08ee10f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08e8092640 0x7f08e81337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08ee10f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e806e120 con 0x7f08e8091b50 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08ee10f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f08e8092d40 con 0x7f08e8092640 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08e6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08e8092640 0x7f08e81337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08e77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f08e8091b50 0x7f08e8091f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43196/0 (socket says 172.21.15.132:43196) 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08e77fe640 1 -- 172.21.15.132:0/2477550707 learned_addr learned my addr 172.21.15.132:0/2477550707 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08e67fc640 1 -- 172.21.15.132:0/2477550707 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131404343 0 0) 0x7f08e806e120 con 0x7f08e8091b50 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08e67fc640 1 -- 172.21.15.132:0/2477550707 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08d4003520 con 0x7f08e8091b50 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08e6ffd640 1 -- 172.21.15.132:0/2477550707 >> v1:172.21.15.132:6789/0 conn(0x7f08e8091b50 legacy=0x7f08e8091f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.337+0000 7f08e6ffd640 1 -- 172.21.15.132:0/2477550707 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e806dd00 con 0x7f08e8092640 2024-04-26T12:33:28.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.338+0000 7f08e6ffd640 1 --2- 172.21.15.132:0/2477550707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8092640 0x7f08e81337a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009720 tx=0x7f08d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1205d20a30d742 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.338+0000 7f08e67fc640 1 -- 172.21.15.132:0/2477550707 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d0035020 con 0x7f08e8092640 2024-04-26T12:33:28.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.338+0000 7f08e67fc640 1 -- 172.21.15.132:0/2477550707 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d0031760 con 0x7f08e8092640 2024-04-26T12:33:28.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.338+0000 7f08e67fc640 1 -- 172.21.15.132:0/2477550707 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d0031a60 con 0x7f08e8092640 2024-04-26T12:33:28.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.338+0000 7f08ee10f640 1 -- 172.21.15.132:0/2477550707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8092640 msgr2=0x7f08e81337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.338+0000 7f08ee10f640 1 --2- 172.21.15.132:0/2477550707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8092640 0x7f08e81337a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009720 tx=0x7f08d002b8d0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.339+0000 7f08ee10f640 1 -- 172.21.15.132:0/2477550707 shutdown_connections 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.339+0000 7f08ee10f640 1 --2- 172.21.15.132:0/2477550707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8092640 0x7f08e81337a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.339+0000 7f08ee10f640 1 -- 172.21.15.132:0/2477550707 >> 172.21.15.132:0/2477550707 conn(0x7f08e809fdd0 msgr2=0x7f08e80a01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.339+0000 7f08ee10f640 1 -- 172.21.15.132:0/2477550707 shutdown_connections 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.339+0000 7f08ee10f640 1 -- 172.21.15.132:0/2477550707 wait complete. 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.339+0000 7f08ee10f640 1 Processor -- start 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08ee10f640 1 -- start start 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08ee10f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8091b50 0x7f08e8131060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08ee10f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8134070 con 0x7f08e8091b50 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8091b50 0x7f08e8131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8091b50 0x7f08e8131060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47324/0 (socket says 172.21.15.132:47324) 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08e77fe640 1 -- 172.21.15.132:0/4044114435 learned_addr learned my addr 172.21.15.132:0/4044114435 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08e77fe640 1 -- 172.21.15.132:0/4044114435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e8128a00 con 0x7f08e8091b50 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08e77fe640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8091b50 0x7f08e8131060 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f08d800cb40 tx=0x7f08d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08dffff640 1 -- 172.21.15.132:0/4044114435 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8017070 con 0x7f08e8091b50 2024-04-26T12:33:28.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08dffff640 1 -- 172.21.15.132:0/4044114435 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d800abf0 con 0x7f08e8091b50 2024-04-26T12:33:28.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e806f510 con 0x7f08e8091b50 2024-04-26T12:33:28.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08dffff640 1 -- 172.21.15.132:0/4044114435 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8012400 con 0x7f08e8091b50 2024-04-26T12:33:28.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.340+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e81315a0 con 0x7f08e8091b50 2024-04-26T12:33:28.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.341+0000 7f08dffff640 1 -- 172.21.15.132:0/4044114435 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f08d801a070 con 0x7f08e8091b50 2024-04-26T12:33:28.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.342+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e8062ed0 con 0x7f08e8091b50 2024-04-26T12:33:28.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.342+0000 7f08dffff640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c8038060 0x7f08c803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.342+0000 7f08dffff640 1 -- 172.21.15.132:0/4044114435 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f08d804b780 con 0x7f08e8091b50 2024-04-26T12:33:28.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.342+0000 7f08e6ffd640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c8038060 0x7f08c803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.342+0000 7f08e6ffd640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c8038060 0x7f08c803a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f08d0036000 tx=0x7f08d0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.346+0000 7f08dffff640 1 -- 172.21.15.132:0/4044114435 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08d8011df0 con 0x7f08e8091b50 2024-04-26T12:33:28.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.515+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08e81329c0 con 0x7f08c8038060 2024-04-26T12:33:28.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.532+0000 7f08dffff640 1 -- 172.21.15.132:0/4044114435 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665923 (secure 0 0 0) 0x7f08e81329c0 con 0x7f08c8038060 2024-04-26T12:33:28.541 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:33:28.547 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c8038060 msgr2=0x7f08c803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c8038060 0x7f08c803a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f08d0036000 tx=0x7f08d0008030 comp rx=0 tx=0).stop 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8091b50 msgr2=0x7f08e8131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8091b50 0x7f08e8131060 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f08d800cb40 tx=0x7f08d800a060 comp rx=0 tx=0).stop 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 shutdown_connections 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f08c8038060 0x7f08c803a520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 --2- 172.21.15.132:0/4044114435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08e8091b50 0x7f08e8131060 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 >> 172.21.15.132:0/4044114435 conn(0x7f08e809fdd0 msgr2=0x7f08e812e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 shutdown_connections 2024-04-26T12:33:28.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.537+0000 7f08ee10f640 1 -- 172.21.15.132:0/4044114435 wait complete. 2024-04-26T12:33:28.551 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-26T12:33:28.487118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4879,"num_read_kb":4456,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":157008,"kb_used_data":36464,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377330352,"statfs":{"total":386547056640,"available":386386280448,"internally_reserved":0,"allocated":37339136,"data_stored":36186180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003882"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548520+0000","last_change":"2024-04-26T12:30:10.508974+0000","last_active":"2024-04-26T12:30:49.548520+0000","last_peered":"2024-04-26T12:30:49.548520+0000","last_clean":"2024-04-26T12:30:49.548520+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:30:49.548520+0000","last_undegraded":"2024-04-26T12:30:49.548520+0000","last_fullsized":"2024-04-26T12:30:49.548520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540674+0000","last_change":"2024-04-26T12:30:12.499017+0000","last_active":"2024-04-26T12:30:49.540674+0000","last_peered":"2024-04-26T12:30:49.540674+0000","last_clean":"2024-04-26T12:30:49.540674+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:30:49.540674+0000","last_undegraded":"2024-04-26T12:30:49.540674+0000","last_fullsized":"2024-04-26T12:30:49.540674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:04.180301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599043+0000","last_change":"2024-04-26T12:30:10.489909+0000","last_active":"2024-04-26T12:30:53.599043+0000","last_peered":"2024-04-26T12:30:53.599043+0000","last_clean":"2024-04-26T12:30:53.599043+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:30:53.599043+0000","last_undegraded":"2024-04-26T12:30:53.599043+0000","last_fullsized":"2024-04-26T12:30:53.599043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'17","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470254+0000","last_change":"2024-04-26T12:30:12.484427+0000","last_active":"2024-04-26T12:33:21.470254+0000","last_peered":"2024-04-26T12:33:21.470254+0000","last_clean":"2024-04-26T12:33:21.470254+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:33:21.470254+0000","last_undegraded":"2024-04-26T12:33:21.470254+0000","last_fullsized":"2024-04-26T12:33:21.470254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:44.161301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.447466+0000","last_change":"2024-04-26T12:30:10.524821+0000","last_active":"2024-04-26T12:33:21.447466+0000","last_peered":"2024-04-26T12:33:21.447466+0000","last_clean":"2024-04-26T12:33:21.447466+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:33:21.447466+0000","last_undegraded":"2024-04-26T12:33:21.447466+0000","last_fullsized":"2024-04-26T12:33:21.447466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:32.006623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246297+0000","last_change":"2024-04-26T12:30:12.493540+0000","last_active":"2024-04-26T12:33:21.246297+0000","last_peered":"2024-04-26T12:33:21.246297+0000","last_clean":"2024-04-26T12:33:21.246297+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:33:21.246297+0000","last_undegraded":"2024-04-26T12:33:21.246297+0000","last_fullsized":"2024-04-26T12:33:21.246297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:40.024999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543651+0000","last_change":"2024-04-26T12:30:10.501461+0000","last_active":"2024-04-26T12:30:49.543651+0000","last_peered":"2024-04-26T12:30:49.543651+0000","last_clean":"2024-04-26T12:30:49.543651+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:30:49.543651+0000","last_undegraded":"2024-04-26T12:30:49.543651+0000","last_fullsized":"2024-04-26T12:30:49.543651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.740937+0000","last_change":"2024-04-26T12:30:12.489894+0000","last_active":"2024-04-26T12:30:54.740937+0000","last_peered":"2024-04-26T12:30:54.740937+0000","last_clean":"2024-04-26T12:30:54.740937+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:30:54.740937+0000","last_undegraded":"2024-04-26T12:30:54.740937+0000","last_fullsized":"2024-04-26T12:30:54.740937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:10.496671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544940+0000","last_change":"2024-04-26T12:30:10.521268+0000","last_active":"2024-04-26T12:30:49.544940+0000","last_peered":"2024-04-26T12:30:49.544940+0000","last_clean":"2024-04-26T12:30:49.544940+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:30:49.544940+0000","last_undegraded":"2024-04-26T12:30:49.544940+0000","last_fullsized":"2024-04-26T12:30:49.544940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:47.412681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532137+0000","last_change":"2024-04-26T12:30:12.497804+0000","last_active":"2024-04-26T12:33:21.532137+0000","last_peered":"2024-04-26T12:33:21.532137+0000","last_clean":"2024-04-26T12:33:21.532137+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:33:21.532137+0000","last_undegraded":"2024-04-26T12:33:21.532137+0000","last_fullsized":"2024-04-26T12:33:21.532137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:34.016204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547675+0000","last_change":"2024-04-26T12:30:10.505875+0000","last_active":"2024-04-26T12:30:49.547675+0000","last_peered":"2024-04-26T12:30:49.547675+0000","last_clean":"2024-04-26T12:30:49.547675+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:30:49.547675+0000","last_undegraded":"2024-04-26T12:30:49.547675+0000","last_fullsized":"2024-04-26T12:30:49.547675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531924+0000","last_change":"2024-04-26T12:30:49.554267+0000","last_active":"2024-04-26T12:33:21.531924+0000","last_peered":"2024-04-26T12:33:21.531924+0000","last_clean":"2024-04-26T12:33:21.531924+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:33:21.531924+0000","last_undegraded":"2024-04-26T12:33:21.531924+0000","last_fullsized":"2024-04-26T12:33:21.531924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:32.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513928+0000","last_change":"2024-04-26T12:30:10.519048+0000","last_active":"2024-04-26T12:32:43.513928+0000","last_peered":"2024-04-26T12:32:43.513928+0000","last_clean":"2024-04-26T12:32:43.513928+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:32:43.513928+0000","last_undegraded":"2024-04-26T12:32:43.513928+0000","last_fullsized":"2024-04-26T12:32:43.513928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:28.446368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675537+0000","last_change":"2024-04-26T12:30:12.491137+0000","last_active":"2024-04-26T12:32:17.675537+0000","last_peered":"2024-04-26T12:32:17.675537+0000","last_clean":"2024-04-26T12:32:17.675537+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:32:17.675537+0000","last_undegraded":"2024-04-26T12:32:17.675537+0000","last_fullsized":"2024-04-26T12:32:17.675537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694288+0000","last_change":"2024-04-26T12:30:10.505714+0000","last_active":"2024-04-26T12:30:49.694288+0000","last_peered":"2024-04-26T12:30:49.694288+0000","last_clean":"2024-04-26T12:30:49.694288+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:30:49.694288+0000","last_undegraded":"2024-04-26T12:30:49.694288+0000","last_fullsized":"2024-04-26T12:30:49.694288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463709+0000","last_change":"2024-04-26T12:30:12.483230+0000","last_active":"2024-04-26T12:33:21.463709+0000","last_peered":"2024-04-26T12:33:21.463709+0000","last_clean":"2024-04-26T12:33:21.463709+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:21.463709+0000","last_undegraded":"2024-04-26T12:33:21.463709+0000","last_fullsized":"2024-04-26T12:33:21.463709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463505+0000","last_change":"2024-04-26T12:30:12.480460+0000","last_active":"2024-04-26T12:33:21.463505+0000","last_peered":"2024-04-26T12:33:21.463505+0000","last_clean":"2024-04-26T12:33:21.463505+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:33:21.463505+0000","last_undegraded":"2024-04-26T12:33:21.463505+0000","last_fullsized":"2024-04-26T12:33:21.463505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:34.798040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544770+0000","last_change":"2024-04-26T12:30:10.514263+0000","last_active":"2024-04-26T12:30:49.544770+0000","last_peered":"2024-04-26T12:30:49.544770+0000","last_clean":"2024-04-26T12:30:49.544770+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:30:49.544770+0000","last_undegraded":"2024-04-26T12:30:49.544770+0000","last_fullsized":"2024-04-26T12:30:49.544770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:17.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341367+0000","last_change":"2024-04-26T12:30:12.498685+0000","last_active":"2024-04-26T12:33:21.341367+0000","last_peered":"2024-04-26T12:33:21.341367+0000","last_clean":"2024-04-26T12:33:21.341367+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:21.341367+0000","last_undegraded":"2024-04-26T12:33:21.341367+0000","last_fullsized":"2024-04-26T12:33:21.341367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:28.769117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549354+0000","last_change":"2024-04-26T12:30:10.503403+0000","last_active":"2024-04-26T12:30:49.549354+0000","last_peered":"2024-04-26T12:30:49.549354+0000","last_clean":"2024-04-26T12:30:49.549354+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:30:49.549354+0000","last_undegraded":"2024-04-26T12:30:49.549354+0000","last_fullsized":"2024-04-26T12:30:49.549354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531887+0000","last_change":"2024-04-26T12:30:12.497749+0000","last_active":"2024-04-26T12:33:21.531887+0000","last_peered":"2024-04-26T12:33:21.531887+0000","last_clean":"2024-04-26T12:33:21.531887+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:33:21.531887+0000","last_undegraded":"2024-04-26T12:33:21.531887+0000","last_fullsized":"2024-04-26T12:33:21.531887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:16.569333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545533+0000","last_change":"2024-04-26T12:30:10.514510+0000","last_active":"2024-04-26T12:30:49.545533+0000","last_peered":"2024-04-26T12:30:49.545533+0000","last_clean":"2024-04-26T12:30:49.545533+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:30:49.545533+0000","last_undegraded":"2024-04-26T12:30:49.545533+0000","last_fullsized":"2024-04-26T12:30:49.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:19.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463231+0000","last_change":"2024-04-26T12:30:12.482516+0000","last_active":"2024-04-26T12:33:21.463231+0000","last_peered":"2024-04-26T12:33:21.463231+0000","last_clean":"2024-04-26T12:33:21.463231+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:33:21.463231+0000","last_undegraded":"2024-04-26T12:33:21.463231+0000","last_fullsized":"2024-04-26T12:33:21.463231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.209436+0000","last_change":"2024-04-26T12:30:10.513694+0000","last_active":"2024-04-26T12:33:21.209436+0000","last_peered":"2024-04-26T12:33:21.209436+0000","last_clean":"2024-04-26T12:33:21.209436+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:33:21.209436+0000","last_undegraded":"2024-04-26T12:33:21.209436+0000","last_fullsized":"2024-04-26T12:33:21.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:54.580399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505184+0000","last_change":"2024-04-26T12:30:12.484509+0000","last_active":"2024-04-26T12:32:37.505184+0000","last_peered":"2024-04-26T12:32:37.505184+0000","last_clean":"2024-04-26T12:32:37.505184+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:32:37.505184+0000","last_undegraded":"2024-04-26T12:32:37.505184+0000","last_fullsized":"2024-04-26T12:32:37.505184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.453057+0000","last_change":"2024-04-26T12:30:10.499600+0000","last_active":"2024-04-26T12:33:21.453057+0000","last_peered":"2024-04-26T12:33:21.453057+0000","last_clean":"2024-04-26T12:33:21.453057+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:33:21.453057+0000","last_undegraded":"2024-04-26T12:33:21.453057+0000","last_fullsized":"2024-04-26T12:33:21.453057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470960+0000","last_change":"2024-04-26T12:30:12.496161+0000","last_active":"2024-04-26T12:30:54.470960+0000","last_peered":"2024-04-26T12:30:54.470960+0000","last_clean":"2024-04-26T12:30:54.470960+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:30:54.470960+0000","last_undegraded":"2024-04-26T12:30:54.470960+0000","last_fullsized":"2024-04-26T12:30:54.470960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:32.006910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512341+0000","last_change":"2024-04-26T12:30:10.516884+0000","last_active":"2024-04-26T12:32:33.512341+0000","last_peered":"2024-04-26T12:32:33.512341+0000","last_clean":"2024-04-26T12:32:33.512341+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:32:33.512341+0000","last_undegraded":"2024-04-26T12:32:33.512341+0000","last_fullsized":"2024-04-26T12:32:33.512341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:01.370198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.484967+0000","last_change":"2024-04-26T12:30:20.535283+0000","last_active":"2024-04-26T12:33:21.484967+0000","last_peered":"2024-04-26T12:33:21.484967+0000","last_clean":"2024-04-26T12:33:21.484967+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:33:21.484967+0000","last_undegraded":"2024-04-26T12:33:21.484967+0000","last_fullsized":"2024-04-26T12:33:21.484967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:17.265170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971392+0000","last_change":"2024-04-26T12:30:12.490640+0000","last_active":"2024-04-26T12:31:36.971392+0000","last_peered":"2024-04-26T12:31:36.971392+0000","last_clean":"2024-04-26T12:31:36.971392+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:31:36.971392+0000","last_undegraded":"2024-04-26T12:31:36.971392+0000","last_fullsized":"2024-04-26T12:31:36.971392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:17.780262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544525+0000","last_change":"2024-04-26T12:30:10.524372+0000","last_active":"2024-04-26T12:30:49.544525+0000","last_peered":"2024-04-26T12:30:49.544525+0000","last_clean":"2024-04-26T12:30:49.544525+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:30:49.544525+0000","last_undegraded":"2024-04-26T12:30:49.544525+0000","last_fullsized":"2024-04-26T12:30:49.544525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:24.047246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550199+0000","last_change":"2024-04-26T12:30:14.491887+0000","last_active":"2024-04-26T12:30:49.550199+0000","last_peered":"2024-04-26T12:30:49.550199+0000","last_clean":"2024-04-26T12:30:49.550199+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:30:49.550199+0000","last_undegraded":"2024-04-26T12:30:49.550199+0000","last_fullsized":"2024-04-26T12:30:49.550199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:51.835729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.377483+0000","last_change":"2024-04-26T12:30:16.517097+0000","last_active":"2024-04-26T12:32:19.377483+0000","last_peered":"2024-04-26T12:32:19.377483+0000","last_clean":"2024-04-26T12:32:19.377483+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:32:19.377483+0000","last_undegraded":"2024-04-26T12:32:19.377483+0000","last_fullsized":"2024-04-26T12:32:19.377483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:39.359708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542379+0000","last_change":"2024-04-26T12:30:18.527594+0000","last_active":"2024-04-26T12:30:49.542379+0000","last_peered":"2024-04-26T12:30:49.542379+0000","last_clean":"2024-04-26T12:30:49.542379+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:30:49.542379+0000","last_undegraded":"2024-04-26T12:30:49.542379+0000","last_fullsized":"2024-04-26T12:30:49.542379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:00.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.976923+0000","last_change":"2024-04-26T12:30:20.530528+0000","last_active":"2024-04-26T12:31:36.976923+0000","last_peered":"2024-04-26T12:31:36.976923+0000","last_clean":"2024-04-26T12:31:36.976923+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:31:36.976923+0000","last_undegraded":"2024-04-26T12:31:36.976923+0000","last_fullsized":"2024-04-26T12:31:36.976923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.750584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531970+0000","last_change":"2024-04-26T12:30:12.491732+0000","last_active":"2024-04-26T12:33:21.531970+0000","last_peered":"2024-04-26T12:33:21.531970+0000","last_clean":"2024-04-26T12:33:21.531970+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:33:21.531970+0000","last_undegraded":"2024-04-26T12:33:21.531970+0000","last_fullsized":"2024-04-26T12:33:21.531970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.360440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.721856+0000","last_change":"2024-04-26T12:30:10.507052+0000","last_active":"2024-04-26T12:32:20.721856+0000","last_peered":"2024-04-26T12:32:20.721856+0000","last_clean":"2024-04-26T12:32:20.721856+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:32:20.721856+0000","last_undegraded":"2024-04-26T12:32:20.721856+0000","last_fullsized":"2024-04-26T12:32:20.721856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695639+0000","last_change":"2024-04-26T12:30:14.490693+0000","last_active":"2024-04-26T12:30:49.695639+0000","last_peered":"2024-04-26T12:30:49.695639+0000","last_clean":"2024-04-26T12:30:49.695639+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:30:49.695639+0000","last_undegraded":"2024-04-26T12:30:49.695639+0000","last_fullsized":"2024-04-26T12:30:49.695639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:24.002229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541715+0000","last_change":"2024-04-26T12:30:16.512671+0000","last_active":"2024-04-26T12:30:49.541715+0000","last_peered":"2024-04-26T12:30:49.541715+0000","last_clean":"2024-04-26T12:30:49.541715+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:30:49.541715+0000","last_undegraded":"2024-04-26T12:30:49.541715+0000","last_fullsized":"2024-04-26T12:30:49.541715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:56.174827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541431+0000","last_change":"2024-04-26T12:30:18.526535+0000","last_active":"2024-04-26T12:30:49.541431+0000","last_peered":"2024-04-26T12:30:49.541431+0000","last_clean":"2024-04-26T12:30:49.541431+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:30:49.541431+0000","last_undegraded":"2024-04-26T12:30:49.541431+0000","last_fullsized":"2024-04-26T12:30:49.541431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:47.825774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694295+0000","last_change":"2024-04-26T12:30:20.523683+0000","last_active":"2024-04-26T12:30:49.694295+0000","last_peered":"2024-04-26T12:30:49.694295+0000","last_clean":"2024-04-26T12:30:49.694295+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:30:49.694295+0000","last_undegraded":"2024-04-26T12:30:49.694295+0000","last_fullsized":"2024-04-26T12:30:49.694295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:12.874354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245067+0000","last_change":"2024-04-26T12:30:49.694875+0000","last_active":"2024-04-26T12:33:21.245067+0000","last_peered":"2024-04-26T12:33:21.245067+0000","last_clean":"2024-04-26T12:33:21.245067+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:33:21.245067+0000","last_undegraded":"2024-04-26T12:33:21.245067+0000","last_fullsized":"2024-04-26T12:33:21.245067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:41.776603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.729407+0000","last_change":"2024-04-26T12:30:10.523616+0000","last_active":"2024-04-26T12:30:54.729407+0000","last_peered":"2024-04-26T12:30:54.729407+0000","last_clean":"2024-04-26T12:30:54.729407+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:30:54.729407+0000","last_undegraded":"2024-04-26T12:30:54.729407+0000","last_fullsized":"2024-04-26T12:30:54.729407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:33.941949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.473479+0000","last_change":"2024-04-26T12:30:14.495445+0000","last_active":"2024-04-26T12:32:20.473479+0000","last_peered":"2024-04-26T12:32:20.473479+0000","last_clean":"2024-04-26T12:32:20.473479+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:32:20.473479+0000","last_undegraded":"2024-04-26T12:32:20.473479+0000","last_fullsized":"2024-04-26T12:32:20.473479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543479+0000","last_change":"2024-04-26T12:30:16.518014+0000","last_active":"2024-04-26T12:30:49.543479+0000","last_peered":"2024-04-26T12:30:49.543479+0000","last_clean":"2024-04-26T12:30:49.543479+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:30:49.543479+0000","last_undegraded":"2024-04-26T12:30:49.543479+0000","last_fullsized":"2024-04-26T12:30:49.543479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.152332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":381,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574516+0000","last_change":"2024-04-26T12:30:18.530920+0000","last_active":"2024-04-26T12:33:19.574516+0000","last_peered":"2024-04-26T12:33:19.574516+0000","last_clean":"2024-04-26T12:33:19.574516+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:33:19.574516+0000","last_undegraded":"2024-04-26T12:33:19.574516+0000","last_fullsized":"2024-04-26T12:33:19.574516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:42.827240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542674+0000","last_change":"2024-04-26T12:30:20.528257+0000","last_active":"2024-04-26T12:30:49.542674+0000","last_peered":"2024-04-26T12:30:49.542674+0000","last_clean":"2024-04-26T12:30:49.542674+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:30:49.542674+0000","last_undegraded":"2024-04-26T12:30:49.542674+0000","last_fullsized":"2024-04-26T12:30:49.542674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:16.184218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.192878+0000","last_change":"2024-04-26T12:30:12.500154+0000","last_active":"2024-04-26T12:31:37.192878+0000","last_peered":"2024-04-26T12:31:37.192878+0000","last_clean":"2024-04-26T12:31:37.192878+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:31:37.192878+0000","last_undegraded":"2024-04-26T12:31:37.192878+0000","last_fullsized":"2024-04-26T12:31:37.192878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:27.199714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540446+0000","last_change":"2024-04-26T12:30:10.512902+0000","last_active":"2024-04-26T12:30:49.540446+0000","last_peered":"2024-04-26T12:30:49.540446+0000","last_clean":"2024-04-26T12:30:49.540446+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:30:49.540446+0000","last_undegraded":"2024-04-26T12:30:49.540446+0000","last_fullsized":"2024-04-26T12:30:49.540446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:51.487985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547825+0000","last_change":"2024-04-26T12:30:14.492539+0000","last_active":"2024-04-26T12:30:49.547825+0000","last_peered":"2024-04-26T12:30:49.547825+0000","last_clean":"2024-04-26T12:30:49.547825+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:30:49.547825+0000","last_undegraded":"2024-04-26T12:30:49.547825+0000","last_fullsized":"2024-04-26T12:30:49.547825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.745596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.372407+0000","last_change":"2024-04-26T12:30:16.516605+0000","last_active":"2024-04-26T12:32:19.372407+0000","last_peered":"2024-04-26T12:32:19.372407+0000","last_clean":"2024-04-26T12:32:19.372407+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:32:19.372407+0000","last_undegraded":"2024-04-26T12:32:19.372407+0000","last_fullsized":"2024-04-26T12:32:19.372407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:12.674195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.534831+0000","last_change":"2024-04-26T12:30:18.513633+0000","last_active":"2024-04-26T12:33:21.534831+0000","last_peered":"2024-04-26T12:33:21.534831+0000","last_clean":"2024-04-26T12:33:21.534831+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:21.534831+0000","last_undegraded":"2024-04-26T12:33:21.534831+0000","last_fullsized":"2024-04-26T12:33:21.534831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:21.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876787+0000","last_change":"2024-04-26T12:30:12.493252+0000","last_active":"2024-04-26T12:32:20.876787+0000","last_peered":"2024-04-26T12:32:20.876787+0000","last_clean":"2024-04-26T12:32:20.876787+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:32:20.876787+0000","last_undegraded":"2024-04-26T12:32:20.876787+0000","last_fullsized":"2024-04-26T12:32:20.876787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:05.333696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547945+0000","last_change":"2024-04-26T12:30:10.508473+0000","last_active":"2024-04-26T12:30:49.547945+0000","last_peered":"2024-04-26T12:30:49.547945+0000","last_clean":"2024-04-26T12:30:49.547945+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:30:49.547945+0000","last_undegraded":"2024-04-26T12:30:49.547945+0000","last_fullsized":"2024-04-26T12:30:49.547945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540186+0000","last_change":"2024-04-26T12:30:14.488895+0000","last_active":"2024-04-26T12:30:49.540186+0000","last_peered":"2024-04-26T12:30:49.540186+0000","last_clean":"2024-04-26T12:30:49.540186+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:30:49.540186+0000","last_undegraded":"2024-04-26T12:30:49.540186+0000","last_fullsized":"2024-04-26T12:30:49.540186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:46.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.381746+0000","last_change":"2024-04-26T12:30:16.512244+0000","last_active":"2024-04-26T12:32:19.381746+0000","last_peered":"2024-04-26T12:32:19.381746+0000","last_clean":"2024-04-26T12:32:19.381746+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:32:19.381746+0000","last_undegraded":"2024-04-26T12:32:19.381746+0000","last_fullsized":"2024-04-26T12:32:19.381746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:44.659809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696627+0000","last_change":"2024-04-26T12:30:18.517298+0000","last_active":"2024-04-26T12:30:49.696627+0000","last_peered":"2024-04-26T12:30:49.696627+0000","last_clean":"2024-04-26T12:30:49.696627+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:30:49.696627+0000","last_undegraded":"2024-04-26T12:30:49.696627+0000","last_fullsized":"2024-04-26T12:30:49.696627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:08.568225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.978624+0000","last_change":"2024-04-26T12:30:20.529100+0000","last_active":"2024-04-26T12:31:36.978624+0000","last_peered":"2024-04-26T12:31:36.978624+0000","last_clean":"2024-04-26T12:31:36.978624+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:31:36.978624+0000","last_undegraded":"2024-04-26T12:31:36.978624+0000","last_fullsized":"2024-04-26T12:31:36.978624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.337272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247623+0000","last_change":"2024-04-26T12:30:12.496041+0000","last_active":"2024-04-26T12:33:21.247623+0000","last_peered":"2024-04-26T12:33:21.247623+0000","last_clean":"2024-04-26T12:33:21.247623+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:33:21.247623+0000","last_undegraded":"2024-04-26T12:33:21.247623+0000","last_fullsized":"2024-04-26T12:33:21.247623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:20.528504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546239+0000","last_change":"2024-04-26T12:30:10.501359+0000","last_active":"2024-04-26T12:30:49.546239+0000","last_peered":"2024-04-26T12:30:49.546239+0000","last_clean":"2024-04-26T12:30:49.546239+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:30:49.546239+0000","last_undegraded":"2024-04-26T12:30:49.546239+0000","last_fullsized":"2024-04-26T12:30:49.546239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694371+0000","last_change":"2024-04-26T12:30:14.491272+0000","last_active":"2024-04-26T12:30:49.694371+0000","last_peered":"2024-04-26T12:30:49.694371+0000","last_clean":"2024-04-26T12:30:49.694371+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:30:49.694371+0000","last_undegraded":"2024-04-26T12:30:49.694371+0000","last_fullsized":"2024-04-26T12:30:49.694371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:07.482770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512362+0000","last_change":"2024-04-26T12:30:16.517757+0000","last_active":"2024-04-26T12:32:33.512362+0000","last_peered":"2024-04-26T12:32:33.512362+0000","last_clean":"2024-04-26T12:32:33.512362+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:32:33.512362+0000","last_undegraded":"2024-04-26T12:32:33.512362+0000","last_fullsized":"2024-04-26T12:32:33.512362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:28.076471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695218+0000","last_change":"2024-04-26T12:30:18.522879+0000","last_active":"2024-04-26T12:30:49.695218+0000","last_peered":"2024-04-26T12:30:49.695218+0000","last_clean":"2024-04-26T12:30:49.695218+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:30:49.695218+0000","last_undegraded":"2024-04-26T12:30:49.695218+0000","last_fullsized":"2024-04-26T12:30:49.695218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:01.222542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.431404+0000","last_change":"2024-04-26T12:30:20.531982+0000","last_active":"2024-04-26T12:31:31.431404+0000","last_peered":"2024-04-26T12:31:31.431404+0000","last_clean":"2024-04-26T12:31:31.431404+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:31:31.431404+0000","last_undegraded":"2024-04-26T12:31:31.431404+0000","last_fullsized":"2024-04-26T12:31:31.431404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:39.756767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.509020+0000","last_change":"2024-04-26T12:30:12.483941+0000","last_active":"2024-04-26T12:33:21.509020+0000","last_peered":"2024-04-26T12:33:21.509020+0000","last_clean":"2024-04-26T12:33:21.509020+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:33:21.509020+0000","last_undegraded":"2024-04-26T12:33:21.509020+0000","last_fullsized":"2024-04-26T12:33:21.509020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.061530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'5","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511634+0000","last_change":"2024-04-26T12:30:10.524374+0000","last_active":"2024-04-26T12:32:28.511634+0000","last_peered":"2024-04-26T12:32:28.511634+0000","last_clean":"2024-04-26T12:32:28.511634+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:32:28.511634+0000","last_undegraded":"2024-04-26T12:32:28.511634+0000","last_fullsized":"2024-04-26T12:32:28.511634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:17.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695767+0000","last_change":"2024-04-26T12:30:14.491692+0000","last_active":"2024-04-26T12:30:49.695767+0000","last_peered":"2024-04-26T12:30:49.695767+0000","last_clean":"2024-04-26T12:30:49.695767+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:30:49.695767+0000","last_undegraded":"2024-04-26T12:30:49.695767+0000","last_fullsized":"2024-04-26T12:30:49.695767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:18.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.383610+0000","last_change":"2024-04-26T12:30:16.517072+0000","last_active":"2024-04-26T12:32:19.383610+0000","last_peered":"2024-04-26T12:32:19.383610+0000","last_clean":"2024-04-26T12:32:19.383610+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:32:19.383610+0000","last_undegraded":"2024-04-26T12:32:19.383610+0000","last_fullsized":"2024-04-26T12:32:19.383610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:35.697992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.649875+0000","last_change":"2024-04-26T12:30:18.526287+0000","last_active":"2024-04-26T12:33:21.649875+0000","last_peered":"2024-04-26T12:33:21.649875+0000","last_clean":"2024-04-26T12:33:21.649875+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:21.649875+0000","last_undegraded":"2024-04-26T12:33:21.649875+0000","last_fullsized":"2024-04-26T12:33:21.649875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:19.306792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695667+0000","last_change":"2024-04-26T12:30:20.531457+0000","last_active":"2024-04-26T12:30:49.695667+0000","last_peered":"2024-04-26T12:30:49.695667+0000","last_clean":"2024-04-26T12:30:49.695667+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:30:49.695667+0000","last_undegraded":"2024-04-26T12:30:49.695667+0000","last_fullsized":"2024-04-26T12:30:49.695667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:06.390024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546441+0000","last_change":"2024-04-26T12:30:12.490458+0000","last_active":"2024-04-26T12:30:49.546441+0000","last_peered":"2024-04-26T12:30:49.546441+0000","last_clean":"2024-04-26T12:30:49.546441+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:30:49.546441+0000","last_undegraded":"2024-04-26T12:30:49.546441+0000","last_fullsized":"2024-04-26T12:30:49.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547353+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:30:49.547353+0000","last_peered":"2024-04-26T12:30:49.547353+0000","last_clean":"2024-04-26T12:30:49.547353+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:30:49.547353+0000","last_undegraded":"2024-04-26T12:30:49.547353+0000","last_fullsized":"2024-04-26T12:30:49.547353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:24.660776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.491181+0000","last_change":"2024-04-26T12:30:49.553037+0000","last_active":"2024-04-26T12:30:52.491181+0000","last_peered":"2024-04-26T12:30:52.491181+0000","last_clean":"2024-04-26T12:30:52.491181+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:30:52.491181+0000","last_undegraded":"2024-04-26T12:30:52.491181+0000","last_fullsized":"2024-04-26T12:30:52.491181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:54.425258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.385402+0000","last_change":"2024-04-26T12:30:16.516843+0000","last_active":"2024-04-26T12:32:19.385402+0000","last_peered":"2024-04-26T12:32:19.385402+0000","last_clean":"2024-04-26T12:32:19.385402+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:32:19.385402+0000","last_undegraded":"2024-04-26T12:32:19.385402+0000","last_fullsized":"2024-04-26T12:32:19.385402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:04.838523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694139+0000","last_change":"2024-04-26T12:30:18.522525+0000","last_active":"2024-04-26T12:30:49.694139+0000","last_peered":"2024-04-26T12:30:49.694139+0000","last_clean":"2024-04-26T12:30:49.694139+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:30:49.694139+0000","last_undegraded":"2024-04-26T12:30:49.694139+0000","last_fullsized":"2024-04-26T12:30:49.694139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:59.330423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625284+0000","last_change":"2024-04-26T12:30:20.522951+0000","last_active":"2024-04-26T12:33:21.625284+0000","last_peered":"2024-04-26T12:33:21.625284+0000","last_clean":"2024-04-26T12:33:21.625284+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:33:21.625284+0000","last_undegraded":"2024-04-26T12:33:21.625284+0000","last_fullsized":"2024-04-26T12:33:21.625284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:10.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511024+0000","last_change":"2024-04-26T12:30:12.498504+0000","last_active":"2024-04-26T12:32:28.511024+0000","last_peered":"2024-04-26T12:32:28.511024+0000","last_clean":"2024-04-26T12:32:28.511024+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:32:28.511024+0000","last_undegraded":"2024-04-26T12:32:28.511024+0000","last_fullsized":"2024-04-26T12:32:28.511024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:01.405398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.853500+0000","last_change":"2024-04-26T12:30:10.499408+0000","last_active":"2024-04-26T12:32:20.853500+0000","last_peered":"2024-04-26T12:32:20.853500+0000","last_clean":"2024-04-26T12:32:20.853500+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:32:20.853500+0000","last_undegraded":"2024-04-26T12:32:20.853500+0000","last_fullsized":"2024-04-26T12:32:20.853500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543749+0000","last_change":"2024-04-26T12:30:14.488769+0000","last_active":"2024-04-26T12:30:49.543749+0000","last_peered":"2024-04-26T12:30:49.543749+0000","last_clean":"2024-04-26T12:30:49.543749+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:30:49.543749+0000","last_undegraded":"2024-04-26T12:30:49.543749+0000","last_fullsized":"2024-04-26T12:30:49.543749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:56.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.366761+0000","last_change":"2024-04-26T12:30:16.512181+0000","last_active":"2024-04-26T12:32:19.366761+0000","last_peered":"2024-04-26T12:32:19.366761+0000","last_clean":"2024-04-26T12:32:19.366761+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:32:19.366761+0000","last_undegraded":"2024-04-26T12:32:19.366761+0000","last_fullsized":"2024-04-26T12:32:19.366761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:05.265330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547995+0000","last_change":"2024-04-26T12:30:18.528738+0000","last_active":"2024-04-26T12:30:49.547995+0000","last_peered":"2024-04-26T12:30:49.547995+0000","last_clean":"2024-04-26T12:30:49.547995+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:30:49.547995+0000","last_undegraded":"2024-04-26T12:30:49.547995+0000","last_fullsized":"2024-04-26T12:30:49.547995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.890333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510646+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:32:23.510646+0000","last_peered":"2024-04-26T12:32:23.510646+0000","last_clean":"2024-04-26T12:32:23.510646+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:32:23.510646+0000","last_undegraded":"2024-04-26T12:32:23.510646+0000","last_fullsized":"2024-04-26T12:32:23.510646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:22.903178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550859+0000","last_change":"2024-04-26T12:30:12.501179+0000","last_active":"2024-04-26T12:30:49.550859+0000","last_peered":"2024-04-26T12:30:49.550859+0000","last_clean":"2024-04-26T12:30:49.550859+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:30:49.550859+0000","last_undegraded":"2024-04-26T12:30:49.550859+0000","last_fullsized":"2024-04-26T12:30:49.550859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:04.520788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.526847+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:21.526847+0000","last_peered":"2024-04-26T12:33:21.526847+0000","last_clean":"2024-04-26T12:33:21.526847+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:21.526847+0000","last_undegraded":"2024-04-26T12:33:21.526847+0000","last_fullsized":"2024-04-26T12:33:21.526847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.901139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695748+0000","last_change":"2024-04-26T12:30:14.491390+0000","last_active":"2024-04-26T12:30:49.695748+0000","last_peered":"2024-04-26T12:30:49.695748+0000","last_clean":"2024-04-26T12:30:49.695748+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:30:49.695748+0000","last_undegraded":"2024-04-26T12:30:49.695748+0000","last_fullsized":"2024-04-26T12:30:49.695748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:26.342488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.391961+0000","last_change":"2024-04-26T12:30:16.509310+0000","last_active":"2024-04-26T12:32:19.391961+0000","last_peered":"2024-04-26T12:32:19.391961+0000","last_clean":"2024-04-26T12:32:19.391961+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:32:19.391961+0000","last_undegraded":"2024-04-26T12:32:19.391961+0000","last_fullsized":"2024-04-26T12:32:19.391961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:24.483163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.629477+0000","last_change":"2024-04-26T12:30:18.526558+0000","last_active":"2024-04-26T12:33:21.629477+0000","last_peered":"2024-04-26T12:33:21.629477+0000","last_clean":"2024-04-26T12:33:21.629477+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:21.629477+0000","last_undegraded":"2024-04-26T12:33:21.629477+0000","last_fullsized":"2024-04-26T12:33:21.629477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:07.868452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499378+0000","last_change":"2024-04-26T12:30:20.523809+0000","last_active":"2024-04-26T12:32:27.499378+0000","last_peered":"2024-04-26T12:32:27.499378+0000","last_clean":"2024-04-26T12:32:27.499378+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:32:27.499378+0000","last_undegraded":"2024-04-26T12:32:27.499378+0000","last_fullsized":"2024-04-26T12:32:27.499378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:28.735728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503582+0000","last_change":"2024-04-26T12:30:12.484589+0000","last_active":"2024-04-26T12:33:21.503582+0000","last_peered":"2024-04-26T12:33:21.503582+0000","last_clean":"2024-04-26T12:33:21.503582+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:33:21.503582+0000","last_undegraded":"2024-04-26T12:33:21.503582+0000","last_fullsized":"2024-04-26T12:33:21.503582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544074+0000","last_change":"2024-04-26T12:30:10.524444+0000","last_active":"2024-04-26T12:30:49.544074+0000","last_peered":"2024-04-26T12:30:49.544074+0000","last_clean":"2024-04-26T12:30:49.544074+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:30:49.544074+0000","last_undegraded":"2024-04-26T12:30:49.544074+0000","last_fullsized":"2024-04-26T12:30:49.544074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:25.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.482598+0000","last_change":"2024-04-26T12:30:14.495065+0000","last_active":"2024-04-26T12:32:20.482598+0000","last_peered":"2024-04-26T12:32:20.482598+0000","last_clean":"2024-04-26T12:32:20.482598+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:32:20.482598+0000","last_undegraded":"2024-04-26T12:32:20.482598+0000","last_fullsized":"2024-04-26T12:32:20.482598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:42.031534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549960+0000","last_change":"2024-04-26T12:30:16.515078+0000","last_active":"2024-04-26T12:30:49.549960+0000","last_peered":"2024-04-26T12:30:49.549960+0000","last_clean":"2024-04-26T12:30:49.549960+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:30:49.549960+0000","last_undegraded":"2024-04-26T12:30:49.549960+0000","last_fullsized":"2024-04-26T12:30:49.549960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:38.268633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":499,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.587326+0000","last_change":"2024-04-26T12:30:18.519523+0000","last_active":"2024-04-26T12:33:21.587326+0000","last_peered":"2024-04-26T12:33:21.587326+0000","last_clean":"2024-04-26T12:33:21.587326+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:21.587326+0000","last_undegraded":"2024-04-26T12:33:21.587326+0000","last_fullsized":"2024-04-26T12:33:21.587326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:16.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.504960+0000","last_change":"2024-04-26T12:30:20.527644+0000","last_active":"2024-04-26T12:33:21.504960+0000","last_peered":"2024-04-26T12:33:21.504960+0000","last_clean":"2024-04-26T12:33:21.504960+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:21.504960+0000","last_undegraded":"2024-04-26T12:33:21.504960+0000","last_fullsized":"2024-04-26T12:33:21.504960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:21.313640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583012+0000","last_change":"2024-04-26T12:30:12.498024+0000","last_active":"2024-04-26T12:33:21.583012+0000","last_peered":"2024-04-26T12:33:21.583012+0000","last_clean":"2024-04-26T12:33:21.583012+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:21.583012+0000","last_undegraded":"2024-04-26T12:33:21.583012+0000","last_fullsized":"2024-04-26T12:33:21.583012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:50.998968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543235+0000","last_change":"2024-04-26T12:30:10.521698+0000","last_active":"2024-04-26T12:30:49.543235+0000","last_peered":"2024-04-26T12:30:49.543235+0000","last_clean":"2024-04-26T12:30:49.543235+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:30:49.543235+0000","last_undegraded":"2024-04-26T12:30:49.543235+0000","last_fullsized":"2024-04-26T12:30:49.543235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:17.318885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548138+0000","last_change":"2024-04-26T12:30:14.493082+0000","last_active":"2024-04-26T12:30:49.548138+0000","last_peered":"2024-04-26T12:30:49.548138+0000","last_clean":"2024-04-26T12:30:49.548138+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:30:49.548138+0000","last_undegraded":"2024-04-26T12:30:49.548138+0000","last_fullsized":"2024-04-26T12:30:49.548138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:53.061967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.378749+0000","last_change":"2024-04-26T12:30:16.512907+0000","last_active":"2024-04-26T12:32:19.378749+0000","last_peered":"2024-04-26T12:32:19.378749+0000","last_clean":"2024-04-26T12:32:19.378749+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:32:19.378749+0000","last_undegraded":"2024-04-26T12:32:19.378749+0000","last_fullsized":"2024-04-26T12:32:19.378749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:44.039858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543293+0000","last_change":"2024-04-26T12:30:18.525037+0000","last_active":"2024-04-26T12:30:49.543293+0000","last_peered":"2024-04-26T12:30:49.543293+0000","last_clean":"2024-04-26T12:30:49.543293+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:30:49.543293+0000","last_undegraded":"2024-04-26T12:30:49.543293+0000","last_fullsized":"2024-04-26T12:30:49.543293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:34.358080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.563122+0000","last_change":"2024-04-26T12:30:20.527103+0000","last_active":"2024-04-26T12:33:21.563122+0000","last_peered":"2024-04-26T12:33:21.563122+0000","last_clean":"2024-04-26T12:33:21.563122+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:21.563122+0000","last_undegraded":"2024-04-26T12:33:21.563122+0000","last_fullsized":"2024-04-26T12:33:21.563122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.874402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532058+0000","last_change":"2024-04-26T12:30:12.500664+0000","last_active":"2024-04-26T12:33:21.532058+0000","last_peered":"2024-04-26T12:33:21.532058+0000","last_clean":"2024-04-26T12:33:21.532058+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:21.532058+0000","last_undegraded":"2024-04-26T12:33:21.532058+0000","last_fullsized":"2024-04-26T12:33:21.532058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:30.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539702+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:30:49.539702+0000","last_peered":"2024-04-26T12:30:49.539702+0000","last_clean":"2024-04-26T12:30:49.539702+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:30:49.539702+0000","last_undegraded":"2024-04-26T12:30:49.539702+0000","last_fullsized":"2024-04-26T12:30:49.539702+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:34.223814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545163+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:30:49.545163+0000","last_peered":"2024-04-26T12:30:49.545163+0000","last_clean":"2024-04-26T12:30:49.545163+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:30:49.545163+0000","last_undegraded":"2024-04-26T12:30:49.545163+0000","last_fullsized":"2024-04-26T12:30:49.545163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.762234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544162+0000","last_change":"2024-04-26T12:30:10.518603+0000","last_active":"2024-04-26T12:30:49.544162+0000","last_peered":"2024-04-26T12:30:49.544162+0000","last_clean":"2024-04-26T12:30:49.544162+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:30:49.544162+0000","last_undegraded":"2024-04-26T12:30:49.544162+0000","last_fullsized":"2024-04-26T12:30:49.544162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:01.289832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541419+0000","last_change":"2024-04-26T12:30:14.493329+0000","last_active":"2024-04-26T12:30:49.541419+0000","last_peered":"2024-04-26T12:30:49.541419+0000","last_clean":"2024-04-26T12:30:49.541419+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:30:49.541419+0000","last_undegraded":"2024-04-26T12:30:49.541419+0000","last_fullsized":"2024-04-26T12:30:49.541419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.398590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":145,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.390018+0000","last_change":"2024-04-26T12:30:16.517527+0000","last_active":"2024-04-26T12:32:19.390018+0000","last_peered":"2024-04-26T12:32:19.390018+0000","last_clean":"2024-04-26T12:32:19.390018+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:32:19.390018+0000","last_undegraded":"2024-04-26T12:32:19.390018+0000","last_fullsized":"2024-04-26T12:32:19.390018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:40.510822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696149+0000","last_change":"2024-04-26T12:30:18.526193+0000","last_active":"2024-04-26T12:30:49.696149+0000","last_peered":"2024-04-26T12:30:49.696149+0000","last_clean":"2024-04-26T12:30:49.696149+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:30:49.696149+0000","last_undegraded":"2024-04-26T12:30:49.696149+0000","last_fullsized":"2024-04-26T12:30:49.696149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:25.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":164,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.540830+0000","last_change":"2024-04-26T12:30:20.526296+0000","last_active":"2024-04-26T12:33:21.540830+0000","last_peered":"2024-04-26T12:33:21.540830+0000","last_clean":"2024-04-26T12:33:21.540830+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:21.540830+0000","last_undegraded":"2024-04-26T12:33:21.540830+0000","last_fullsized":"2024-04-26T12:33:21.540830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:54.224734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675274+0000","last_change":"2024-04-26T12:30:12.488875+0000","last_active":"2024-04-26T12:32:17.675274+0000","last_peered":"2024-04-26T12:32:17.675274+0000","last_clean":"2024-04-26T12:32:17.675274+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:32:17.675274+0000","last_undegraded":"2024-04-26T12:32:17.675274+0000","last_fullsized":"2024-04-26T12:32:17.675274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:41.425033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542657+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:30:49.542657+0000","last_peered":"2024-04-26T12:30:49.542657+0000","last_clean":"2024-04-26T12:30:49.542657+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:30:49.542657+0000","last_undegraded":"2024-04-26T12:30:49.542657+0000","last_fullsized":"2024-04-26T12:30:49.542657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:20.023037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694359+0000","last_change":"2024-04-26T12:30:10.488700+0000","last_active":"2024-04-26T12:30:49.694359+0000","last_peered":"2024-04-26T12:30:49.694359+0000","last_clean":"2024-04-26T12:30:49.694359+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:30:49.694359+0000","last_undegraded":"2024-04-26T12:30:49.694359+0000","last_fullsized":"2024-04-26T12:30:49.694359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548136+0000","last_change":"2024-04-26T12:30:14.492528+0000","last_active":"2024-04-26T12:30:49.548136+0000","last_peered":"2024-04-26T12:30:49.548136+0000","last_clean":"2024-04-26T12:30:49.548136+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:30:49.548136+0000","last_undegraded":"2024-04-26T12:30:49.548136+0000","last_fullsized":"2024-04-26T12:30:49.548136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:32.660138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'273","reported_seq":476,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574678+0000","last_change":"2024-04-26T12:30:16.515291+0000","last_active":"2024-04-26T12:33:19.574678+0000","last_peered":"2024-04-26T12:33:19.574678+0000","last_clean":"2024-04-26T12:33:19.574678+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:19.574678+0000","last_undegraded":"2024-04-26T12:33:19.574678+0000","last_fullsized":"2024-04-26T12:33:19.574678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:16.639770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547578+0000","last_change":"2024-04-26T12:30:18.530303+0000","last_active":"2024-04-26T12:30:49.547578+0000","last_peered":"2024-04-26T12:30:49.547578+0000","last_clean":"2024-04-26T12:30:49.547578+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:30:49.547578+0000","last_undegraded":"2024-04-26T12:30:49.547578+0000","last_fullsized":"2024-04-26T12:30:49.547578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:17.619205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.975177+0000","last_change":"2024-04-26T12:30:20.532161+0000","last_active":"2024-04-26T12:31:36.975177+0000","last_peered":"2024-04-26T12:31:36.975177+0000","last_clean":"2024-04-26T12:31:36.975177+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:31:36.975177+0000","last_undegraded":"2024-04-26T12:31:36.975177+0000","last_fullsized":"2024-04-26T12:31:36.975177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:51.654625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498769+0000","last_change":"2024-04-26T12:30:12.500451+0000","last_active":"2024-04-26T12:32:22.498769+0000","last_peered":"2024-04-26T12:32:22.498769+0000","last_clean":"2024-04-26T12:32:22.498769+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:32:22.498769+0000","last_undegraded":"2024-04-26T12:32:22.498769+0000","last_fullsized":"2024-04-26T12:32:22.498769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:13.176012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542574+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:30:49.542574+0000","last_peered":"2024-04-26T12:30:49.542574+0000","last_clean":"2024-04-26T12:30:49.542574+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:30:49.542574+0000","last_undegraded":"2024-04-26T12:30:49.542574+0000","last_fullsized":"2024-04-26T12:30:49.542574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:40.531155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.693869+0000","last_change":"2024-04-26T12:30:10.489913+0000","last_active":"2024-04-26T12:30:49.693869+0000","last_peered":"2024-04-26T12:30:49.693869+0000","last_clean":"2024-04-26T12:30:49.693869+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:30:49.693869+0000","last_undegraded":"2024-04-26T12:30:49.693869+0000","last_fullsized":"2024-04-26T12:30:49.693869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546002+0000","last_change":"2024-04-26T12:30:14.492118+0000","last_active":"2024-04-26T12:30:49.546002+0000","last_peered":"2024-04-26T12:30:49.546002+0000","last_clean":"2024-04-26T12:30:49.546002+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:30:49.546002+0000","last_undegraded":"2024-04-26T12:30:49.546002+0000","last_fullsized":"2024-04-26T12:30:49.546002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:34.317162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574673+0000","last_change":"2024-04-26T12:30:16.509140+0000","last_active":"2024-04-26T12:33:19.574673+0000","last_peered":"2024-04-26T12:33:19.574673+0000","last_clean":"2024-04-26T12:33:19.574673+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:19.574673+0000","last_undegraded":"2024-04-26T12:33:19.574673+0000","last_fullsized":"2024-04-26T12:33:19.574673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:55.319866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696077+0000","last_change":"2024-04-26T12:30:18.526395+0000","last_active":"2024-04-26T12:30:49.696077+0000","last_peered":"2024-04-26T12:30:49.696077+0000","last_clean":"2024-04-26T12:30:49.696077+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:30:49.696077+0000","last_undegraded":"2024-04-26T12:30:49.696077+0000","last_fullsized":"2024-04-26T12:30:49.696077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:27.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.189438+0000","last_change":"2024-04-26T12:30:20.531432+0000","last_active":"2024-04-26T12:31:37.189438+0000","last_peered":"2024-04-26T12:31:37.189438+0000","last_clean":"2024-04-26T12:31:37.189438+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:31:37.189438+0000","last_undegraded":"2024-04-26T12:31:37.189438+0000","last_fullsized":"2024-04-26T12:31:37.189438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:35.605929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.697139+0000","last_change":"2024-04-26T12:30:12.489234+0000","last_active":"2024-04-26T12:30:49.697139+0000","last_peered":"2024-04-26T12:30:49.697139+0000","last_clean":"2024-04-26T12:30:49.697139+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:30:49.697139+0000","last_undegraded":"2024-04-26T12:30:49.697139+0000","last_fullsized":"2024-04-26T12:30:49.697139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.716751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543541+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:30:49.543541+0000","last_peered":"2024-04-26T12:30:49.543541+0000","last_clean":"2024-04-26T12:30:49.543541+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:30:49.543541+0000","last_undegraded":"2024-04-26T12:30:49.543541+0000","last_fullsized":"2024-04-26T12:30:49.543541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:36.069601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501863+0000","last_change":"2024-04-26T12:30:10.500548+0000","last_active":"2024-04-26T12:32:17.501863+0000","last_peered":"2024-04-26T12:32:17.501863+0000","last_clean":"2024-04-26T12:32:17.501863+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:32:17.501863+0000","last_undegraded":"2024-04-26T12:32:17.501863+0000","last_fullsized":"2024-04-26T12:32:17.501863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696292+0000","last_change":"2024-04-26T12:30:14.487929+0000","last_active":"2024-04-26T12:30:49.696292+0000","last_peered":"2024-04-26T12:30:49.696292+0000","last_clean":"2024-04-26T12:30:49.696292+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:30:49.696292+0000","last_undegraded":"2024-04-26T12:30:49.696292+0000","last_fullsized":"2024-04-26T12:30:49.696292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:52.557515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.889030+0000","last_change":"2024-04-26T12:30:16.517033+0000","last_active":"2024-04-26T12:33:20.889030+0000","last_peered":"2024-04-26T12:33:20.889030+0000","last_clean":"2024-04-26T12:33:20.889030+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:20.889030+0000","last_undegraded":"2024-04-26T12:33:20.889030+0000","last_fullsized":"2024-04-26T12:33:20.889030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:38.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549097+0000","last_change":"2024-04-26T12:30:18.529014+0000","last_active":"2024-04-26T12:30:49.549097+0000","last_peered":"2024-04-26T12:30:49.549097+0000","last_clean":"2024-04-26T12:30:49.549097+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:30:49.549097+0000","last_undegraded":"2024-04-26T12:30:49.549097+0000","last_fullsized":"2024-04-26T12:30:49.549097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:10.143592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.627536+0000","last_change":"2024-04-26T12:30:20.535350+0000","last_active":"2024-04-26T12:32:20.627536+0000","last_peered":"2024-04-26T12:32:20.627536+0000","last_clean":"2024-04-26T12:32:20.627536+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:32:20.627536+0000","last_undegraded":"2024-04-26T12:32:20.627536+0000","last_fullsized":"2024-04-26T12:32:20.627536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:44.849843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540587+0000","last_change":"2024-04-26T12:30:12.494538+0000","last_active":"2024-04-26T12:30:49.540587+0000","last_peered":"2024-04-26T12:30:49.540587+0000","last_clean":"2024-04-26T12:30:49.540587+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:30:49.540587+0000","last_undegraded":"2024-04-26T12:30:49.540587+0000","last_fullsized":"2024-04-26T12:30:49.540587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:34.559667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542876+0000","last_change":"2024-04-26T12:30:10.502077+0000","last_active":"2024-04-26T12:30:49.542876+0000","last_peered":"2024-04-26T12:30:49.542876+0000","last_clean":"2024-04-26T12:30:49.542876+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:30:49.542876+0000","last_undegraded":"2024-04-26T12:30:49.542876+0000","last_fullsized":"2024-04-26T12:30:49.542876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695937+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:30:49.695937+0000","last_peered":"2024-04-26T12:30:49.695937+0000","last_clean":"2024-04-26T12:30:49.695937+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.695937+0000","last_undegraded":"2024-04-26T12:30:49.695937+0000","last_fullsized":"2024-04-26T12:30:49.695937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:41.365768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498561+0000","last_change":"2024-04-26T12:30:14.490527+0000","last_active":"2024-04-26T12:32:22.498561+0000","last_peered":"2024-04-26T12:32:22.498561+0000","last_clean":"2024-04-26T12:32:22.498561+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:32:22.498561+0000","last_undegraded":"2024-04-26T12:32:22.498561+0000","last_fullsized":"2024-04-26T12:32:22.498561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:44.342932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.390913+0000","last_change":"2024-04-26T12:30:16.516144+0000","last_active":"2024-04-26T12:32:19.390913+0000","last_peered":"2024-04-26T12:32:19.390913+0000","last_clean":"2024-04-26T12:32:19.390913+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:32:19.390913+0000","last_undegraded":"2024-04-26T12:32:19.390913+0000","last_fullsized":"2024-04-26T12:32:19.390913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:35.964112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542090+0000","last_change":"2024-04-26T12:30:18.523448+0000","last_active":"2024-04-26T12:30:49.542090+0000","last_peered":"2024-04-26T12:30:49.542090+0000","last_clean":"2024-04-26T12:30:49.542090+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:30:49.542090+0000","last_undegraded":"2024-04-26T12:30:49.542090+0000","last_fullsized":"2024-04-26T12:30:49.542090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:00.948613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.817678+0000","last_change":"2024-04-26T12:30:20.527189+0000","last_active":"2024-04-26T12:32:20.817678+0000","last_peered":"2024-04-26T12:32:20.817678+0000","last_clean":"2024-04-26T12:32:20.817678+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:32:20.817678+0000","last_undegraded":"2024-04-26T12:32:20.817678+0000","last_fullsized":"2024-04-26T12:32:20.817678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:22.610410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247296+0000","last_change":"2024-04-26T12:30:12.493953+0000","last_active":"2024-04-26T12:33:21.247296+0000","last_peered":"2024-04-26T12:33:21.247296+0000","last_clean":"2024-04-26T12:33:21.247296+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:33:21.247296+0000","last_undegraded":"2024-04-26T12:33:21.247296+0000","last_fullsized":"2024-04-26T12:33:21.247296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:29.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696477+0000","last_change":"2024-04-26T12:30:10.499533+0000","last_active":"2024-04-26T12:30:49.696477+0000","last_peered":"2024-04-26T12:30:49.696477+0000","last_clean":"2024-04-26T12:30:49.696477+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:30:49.696477+0000","last_undegraded":"2024-04-26T12:30:49.696477+0000","last_fullsized":"2024-04-26T12:30:49.696477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549792+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:30:49.549792+0000","last_peered":"2024-04-26T12:30:49.549792+0000","last_clean":"2024-04-26T12:30:49.549792+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:30:49.549792+0000","last_undegraded":"2024-04-26T12:30:49.549792+0000","last_fullsized":"2024-04-26T12:30:49.549792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:20.349910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552858+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:30:49.552858+0000","last_peered":"2024-04-26T12:30:49.552858+0000","last_clean":"2024-04-26T12:30:49.552858+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:30:49.552858+0000","last_undegraded":"2024-04-26T12:30:49.552858+0000","last_fullsized":"2024-04-26T12:30:49.552858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:36.051479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541073+0000","last_change":"2024-04-26T12:30:16.519723+0000","last_active":"2024-04-26T12:30:49.541073+0000","last_peered":"2024-04-26T12:30:49.541073+0000","last_clean":"2024-04-26T12:30:49.541073+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:30:49.541073+0000","last_undegraded":"2024-04-26T12:30:49.541073+0000","last_fullsized":"2024-04-26T12:30:49.541073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:15.493662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574649+0000","last_change":"2024-04-26T12:30:18.522379+0000","last_active":"2024-04-26T12:33:19.574649+0000","last_peered":"2024-04-26T12:33:19.574649+0000","last_clean":"2024-04-26T12:33:19.574649+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:19.574649+0000","last_undegraded":"2024-04-26T12:33:19.574649+0000","last_fullsized":"2024-04-26T12:33:19.574649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:31.575194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.472108+0000","last_change":"2024-04-26T12:30:20.530218+0000","last_active":"2024-04-26T12:30:54.472108+0000","last_peered":"2024-04-26T12:30:54.472108+0000","last_clean":"2024-04-26T12:30:54.472108+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:30:54.472108+0000","last_undegraded":"2024-04-26T12:30:54.472108+0000","last_fullsized":"2024-04-26T12:30:54.472108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:19.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502925+0000","last_change":"2024-04-26T12:30:12.496796+0000","last_active":"2024-04-26T12:33:21.502925+0000","last_peered":"2024-04-26T12:33:21.502925+0000","last_clean":"2024-04-26T12:33:21.502925+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:21.502925+0000","last_undegraded":"2024-04-26T12:33:21.502925+0000","last_fullsized":"2024-04-26T12:33:21.502925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:20.540141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550102+0000","last_change":"2024-04-26T12:30:10.516983+0000","last_active":"2024-04-26T12:30:49.550102+0000","last_peered":"2024-04-26T12:30:49.550102+0000","last_clean":"2024-04-26T12:30:49.550102+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:30:49.550102+0000","last_undegraded":"2024-04-26T12:30:49.550102+0000","last_fullsized":"2024-04-26T12:30:49.550102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:02.170720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696304+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:30:49.696304+0000","last_peered":"2024-04-26T12:30:49.696304+0000","last_clean":"2024-04-26T12:30:49.696304+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.696304+0000","last_undegraded":"2024-04-26T12:30:49.696304+0000","last_fullsized":"2024-04-26T12:30:49.696304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:36.830729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542420+0000","last_change":"2024-04-26T12:30:14.491970+0000","last_active":"2024-04-26T12:30:49.542420+0000","last_peered":"2024-04-26T12:30:49.542420+0000","last_clean":"2024-04-26T12:30:49.542420+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:30:49.542420+0000","last_undegraded":"2024-04-26T12:30:49.542420+0000","last_fullsized":"2024-04-26T12:30:49.542420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.888576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'12","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510792+0000","last_change":"2024-04-26T12:30:16.517776+0000","last_active":"2024-04-26T12:32:23.510792+0000","last_peered":"2024-04-26T12:32:23.510792+0000","last_clean":"2024-04-26T12:32:23.510792+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:32:23.510792+0000","last_undegraded":"2024-04-26T12:32:23.510792+0000","last_fullsized":"2024-04-26T12:32:23.510792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:16.311902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625853+0000","last_change":"2024-04-26T12:30:18.513636+0000","last_active":"2024-04-26T12:33:21.625853+0000","last_peered":"2024-04-26T12:33:21.625853+0000","last_clean":"2024-04-26T12:33:21.625853+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:21.625853+0000","last_undegraded":"2024-04-26T12:33:21.625853+0000","last_fullsized":"2024-04-26T12:33:21.625853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:16.493488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540087+0000","last_change":"2024-04-26T12:30:20.532905+0000","last_active":"2024-04-26T12:30:49.540087+0000","last_peered":"2024-04-26T12:30:49.540087+0000","last_clean":"2024-04-26T12:30:49.540087+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:30:49.540087+0000","last_undegraded":"2024-04-26T12:30:49.540087+0000","last_fullsized":"2024-04-26T12:30:49.540087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:44.711542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463354+0000","last_change":"2024-04-26T12:30:12.481683+0000","last_active":"2024-04-26T12:33:21.463354+0000","last_peered":"2024-04-26T12:33:21.463354+0000","last_clean":"2024-04-26T12:33:21.463354+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:21.463354+0000","last_undegraded":"2024-04-26T12:33:21.463354+0000","last_fullsized":"2024-04-26T12:33:21.463354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:19.678454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510273+0000","last_change":"2024-04-26T12:30:10.507125+0000","last_active":"2024-04-26T12:32:23.510273+0000","last_peered":"2024-04-26T12:32:23.510273+0000","last_clean":"2024-04-26T12:32:23.510273+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:32:23.510273+0000","last_undegraded":"2024-04-26T12:32:23.510273+0000","last_fullsized":"2024-04-26T12:32:23.510273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:00.550498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549681+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:30:49.549681+0000","last_peered":"2024-04-26T12:30:49.549681+0000","last_clean":"2024-04-26T12:30:49.549681+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:30:49.549681+0000","last_undegraded":"2024-04-26T12:30:49.549681+0000","last_fullsized":"2024-04-26T12:30:49.549681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:40.435075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542501+0000","last_change":"2024-04-26T12:30:14.491299+0000","last_active":"2024-04-26T12:30:49.542501+0000","last_peered":"2024-04-26T12:30:49.542501+0000","last_clean":"2024-04-26T12:30:49.542501+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:30:49.542501+0000","last_undegraded":"2024-04-26T12:30:49.542501+0000","last_fullsized":"2024-04-26T12:30:49.542501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'84","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.376553+0000","last_change":"2024-04-26T12:30:16.518167+0000","last_active":"2024-04-26T12:32:19.376553+0000","last_peered":"2024-04-26T12:32:19.376553+0000","last_clean":"2024-04-26T12:32:19.376553+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:32:19.376553+0000","last_undegraded":"2024-04-26T12:32:19.376553+0000","last_fullsized":"2024-04-26T12:32:19.376553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:20.616941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694602+0000","last_change":"2024-04-26T12:30:18.522507+0000","last_active":"2024-04-26T12:30:49.694602+0000","last_peered":"2024-04-26T12:30:49.694602+0000","last_clean":"2024-04-26T12:30:49.694602+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:30:49.694602+0000","last_undegraded":"2024-04-26T12:30:49.694602+0000","last_fullsized":"2024-04-26T12:30:49.694602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:14.177370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.492214+0000","last_change":"2024-04-26T12:30:20.530332+0000","last_active":"2024-04-26T12:33:21.492214+0000","last_peered":"2024-04-26T12:33:21.492214+0000","last_clean":"2024-04-26T12:33:21.492214+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:33:21.492214+0000","last_undegraded":"2024-04-26T12:33:21.492214+0000","last_fullsized":"2024-04-26T12:33:21.492214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:21.002104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547852+0000","last_change":"2024-04-26T12:30:20.528129+0000","last_active":"2024-04-26T12:30:49.547852+0000","last_peered":"2024-04-26T12:30:49.547852+0000","last_clean":"2024-04-26T12:30:49.547852+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:30:49.547852+0000","last_undegraded":"2024-04-26T12:30:49.547852+0000","last_fullsized":"2024-04-26T12:30:49.547852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:23.397024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.741112+0000","last_change":"2024-04-26T12:30:12.480553+0000","last_active":"2024-04-26T12:30:54.741112+0000","last_peered":"2024-04-26T12:30:54.741112+0000","last_clean":"2024-04-26T12:30:54.741112+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:30:54.741112+0000","last_undegraded":"2024-04-26T12:30:54.741112+0000","last_fullsized":"2024-04-26T12:30:54.741112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.226828+0000","last_change":"2024-04-26T12:30:10.523769+0000","last_active":"2024-04-26T12:33:21.226828+0000","last_peered":"2024-04-26T12:33:21.226828+0000","last_clean":"2024-04-26T12:33:21.226828+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:33:21.226828+0000","last_undegraded":"2024-04-26T12:33:21.226828+0000","last_fullsized":"2024-04-26T12:33:21.226828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:54.971518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540221+0000","last_change":"2024-04-26T12:30:14.493380+0000","last_active":"2024-04-26T12:30:49.540221+0000","last_peered":"2024-04-26T12:30:49.540221+0000","last_clean":"2024-04-26T12:30:49.540221+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:30:49.540221+0000","last_undegraded":"2024-04-26T12:30:49.540221+0000","last_fullsized":"2024-04-26T12:30:49.540221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:18.581583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.382642+0000","last_change":"2024-04-26T12:30:16.518746+0000","last_active":"2024-04-26T12:32:19.382642+0000","last_peered":"2024-04-26T12:32:19.382642+0000","last_clean":"2024-04-26T12:32:19.382642+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:32:19.382642+0000","last_undegraded":"2024-04-26T12:32:19.382642+0000","last_fullsized":"2024-04-26T12:32:19.382642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:04.293139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544178+0000","last_change":"2024-04-26T12:30:18.529377+0000","last_active":"2024-04-26T12:30:49.544178+0000","last_peered":"2024-04-26T12:30:49.544178+0000","last_clean":"2024-04-26T12:30:49.544178+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:30:49.544178+0000","last_undegraded":"2024-04-26T12:30:49.544178+0000","last_fullsized":"2024-04-26T12:30:49.544178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:31.772676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.057676+0000","last_change":"2024-04-26T12:30:20.528724+0000","last_active":"2024-04-26T12:32:19.057676+0000","last_peered":"2024-04-26T12:32:19.057676+0000","last_clean":"2024-04-26T12:32:19.057676+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:32:19.057676+0000","last_undegraded":"2024-04-26T12:32:19.057676+0000","last_fullsized":"2024-04-26T12:32:19.057676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:50.736220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876246+0000","last_change":"2024-04-26T12:30:49.555701+0000","last_active":"2024-04-26T12:32:20.876246+0000","last_peered":"2024-04-26T12:32:20.876246+0000","last_clean":"2024-04-26T12:32:20.876246+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:32:20.876246+0000","last_undegraded":"2024-04-26T12:32:20.876246+0000","last_fullsized":"2024-04-26T12:32:20.876246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:34.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.600051+0000","last_change":"2024-04-26T12:30:10.502612+0000","last_active":"2024-04-26T12:30:53.600051+0000","last_peered":"2024-04-26T12:30:53.600051+0000","last_clean":"2024-04-26T12:30:53.600051+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:30:53.600051+0000","last_undegraded":"2024-04-26T12:30:53.600051+0000","last_fullsized":"2024-04-26T12:30:53.600051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:03.814159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544101+0000","last_change":"2024-04-26T12:30:14.491480+0000","last_active":"2024-04-26T12:30:49.544101+0000","last_peered":"2024-04-26T12:30:49.544101+0000","last_clean":"2024-04-26T12:30:49.544101+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:30:49.544101+0000","last_undegraded":"2024-04-26T12:30:49.544101+0000","last_fullsized":"2024-04-26T12:30:49.544101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:27.548981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.893403+0000","last_change":"2024-04-26T12:30:16.504440+0000","last_active":"2024-04-26T12:33:20.893403+0000","last_peered":"2024-04-26T12:33:20.893403+0000","last_clean":"2024-04-26T12:33:20.893403+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:20.893403+0000","last_undegraded":"2024-04-26T12:33:20.893403+0000","last_fullsized":"2024-04-26T12:33:20.893403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:12.728383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542390+0000","last_change":"2024-04-26T12:30:18.523667+0000","last_active":"2024-04-26T12:30:49.542390+0000","last_peered":"2024-04-26T12:30:49.542390+0000","last_clean":"2024-04-26T12:30:49.542390+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:30:49.542390+0000","last_undegraded":"2024-04-26T12:30:49.542390+0000","last_fullsized":"2024-04-26T12:30:49.542390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:23.693333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.263020+0000","last_change":"2024-04-26T12:30:20.531528+0000","last_active":"2024-04-26T12:33:21.263020+0000","last_peered":"2024-04-26T12:33:21.263020+0000","last_clean":"2024-04-26T12:33:21.263020+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:33:21.263020+0000","last_undegraded":"2024-04-26T12:33:21.263020+0000","last_fullsized":"2024-04-26T12:33:21.263020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:58.871702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876582+0000","last_change":"2024-04-26T12:30:12.482043+0000","last_active":"2024-04-26T12:32:20.876582+0000","last_peered":"2024-04-26T12:32:20.876582+0000","last_clean":"2024-04-26T12:32:20.876582+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:32:20.876582+0000","last_undegraded":"2024-04-26T12:32:20.876582+0000","last_fullsized":"2024-04-26T12:32:20.876582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546282+0000","last_change":"2024-04-26T12:30:10.493462+0000","last_active":"2024-04-26T12:30:49.546282+0000","last_peered":"2024-04-26T12:30:49.546282+0000","last_clean":"2024-04-26T12:30:49.546282+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:30:49.546282+0000","last_undegraded":"2024-04-26T12:30:49.546282+0000","last_fullsized":"2024-04-26T12:30:49.546282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.482873+0000","last_change":"2024-04-26T12:30:14.489635+0000","last_active":"2024-04-26T12:32:20.482873+0000","last_peered":"2024-04-26T12:32:20.482873+0000","last_clean":"2024-04-26T12:32:20.482873+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:32:20.482873+0000","last_undegraded":"2024-04-26T12:32:20.482873+0000","last_fullsized":"2024-04-26T12:32:20.482873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:54.728684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.957035+0000","last_change":"2024-04-26T12:30:16.507208+0000","last_active":"2024-04-26T12:33:20.957035+0000","last_peered":"2024-04-26T12:33:20.957035+0000","last_clean":"2024-04-26T12:33:20.957035+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:20.957035+0000","last_undegraded":"2024-04-26T12:33:20.957035+0000","last_fullsized":"2024-04-26T12:33:20.957035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:41.932885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539732+0000","last_change":"2024-04-26T12:30:18.521304+0000","last_active":"2024-04-26T12:30:49.539732+0000","last_peered":"2024-04-26T12:30:49.539732+0000","last_clean":"2024-04-26T12:30:49.539732+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:30:49.539732+0000","last_undegraded":"2024-04-26T12:30:49.539732+0000","last_fullsized":"2024-04-26T12:30:49.539732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:41.695559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545725+0000","last_change":"2024-04-26T12:30:20.524900+0000","last_active":"2024-04-26T12:30:49.545725+0000","last_peered":"2024-04-26T12:30:49.545725+0000","last_clean":"2024-04-26T12:30:49.545725+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:30:49.545725+0000","last_undegraded":"2024-04-26T12:30:49.545725+0000","last_fullsized":"2024-04-26T12:30:49.545725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:29.025840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463384+0000","last_change":"2024-04-26T12:30:12.502223+0000","last_active":"2024-04-26T12:33:21.463384+0000","last_peered":"2024-04-26T12:33:21.463384+0000","last_clean":"2024-04-26T12:33:21.463384+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:21.463384+0000","last_undegraded":"2024-04-26T12:33:21.463384+0000","last_fullsized":"2024-04-26T12:33:21.463384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:06.713634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542218+0000","last_change":"2024-04-26T12:30:10.513562+0000","last_active":"2024-04-26T12:30:49.542218+0000","last_peered":"2024-04-26T12:30:49.542218+0000","last_clean":"2024-04-26T12:30:49.542218+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:30:49.542218+0000","last_undegraded":"2024-04-26T12:30:49.542218+0000","last_fullsized":"2024-04-26T12:30:49.542218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:55.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542323+0000","last_change":"2024-04-26T12:30:14.490374+0000","last_active":"2024-04-26T12:30:49.542323+0000","last_peered":"2024-04-26T12:30:49.542323+0000","last_clean":"2024-04-26T12:30:49.542323+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:30:49.542323+0000","last_undegraded":"2024-04-26T12:30:49.542323+0000","last_fullsized":"2024-04-26T12:30:49.542323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:12.379331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.368648+0000","last_change":"2024-04-26T12:30:16.511513+0000","last_active":"2024-04-26T12:32:19.368648+0000","last_peered":"2024-04-26T12:32:19.368648+0000","last_clean":"2024-04-26T12:32:19.368648+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:32:19.368648+0000","last_undegraded":"2024-04-26T12:32:19.368648+0000","last_fullsized":"2024-04-26T12:32:19.368648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:54.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542848+0000","last_change":"2024-04-26T12:30:18.515934+0000","last_active":"2024-04-26T12:30:49.542848+0000","last_peered":"2024-04-26T12:30:49.542848+0000","last_clean":"2024-04-26T12:30:49.542848+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:30:49.542848+0000","last_undegraded":"2024-04-26T12:30:49.542848+0000","last_fullsized":"2024-04-26T12:30:49.542848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:25.200262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.185099+0000","last_change":"2024-04-26T12:30:12.490077+0000","last_active":"2024-04-26T12:30:55.185099+0000","last_peered":"2024-04-26T12:30:55.185099+0000","last_clean":"2024-04-26T12:30:55.185099+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:30:55.185099+0000","last_undegraded":"2024-04-26T12:30:55.185099+0000","last_fullsized":"2024-04-26T12:30:55.185099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:11.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542763+0000","last_change":"2024-04-26T12:30:10.523507+0000","last_active":"2024-04-26T12:30:49.542763+0000","last_peered":"2024-04-26T12:30:49.542763+0000","last_clean":"2024-04-26T12:30:49.542763+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:30:49.542763+0000","last_undegraded":"2024-04-26T12:30:49.542763+0000","last_fullsized":"2024-04-26T12:30:49.542763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:43.079489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696240+0000","last_change":"2024-04-26T12:30:14.487589+0000","last_active":"2024-04-26T12:30:49.696240+0000","last_peered":"2024-04-26T12:30:49.696240+0000","last_clean":"2024-04-26T12:30:49.696240+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:30:49.696240+0000","last_undegraded":"2024-04-26T12:30:49.696240+0000","last_fullsized":"2024-04-26T12:30:49.696240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:18.599868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.388968+0000","last_change":"2024-04-26T12:30:16.510514+0000","last_active":"2024-04-26T12:32:19.388968+0000","last_peered":"2024-04-26T12:32:19.388968+0000","last_clean":"2024-04-26T12:32:19.388968+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:32:19.388968+0000","last_undegraded":"2024-04-26T12:32:19.388968+0000","last_fullsized":"2024-04-26T12:32:19.388968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:58.939474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543187+0000","last_change":"2024-04-26T12:30:18.517450+0000","last_active":"2024-04-26T12:30:49.543187+0000","last_peered":"2024-04-26T12:30:49.543187+0000","last_clean":"2024-04-26T12:30:49.543187+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:30:49.543187+0000","last_undegraded":"2024-04-26T12:30:49.543187+0000","last_fullsized":"2024-04-26T12:30:49.543187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:21.795370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.814710+0000","last_change":"2024-04-26T12:30:20.523862+0000","last_active":"2024-04-26T12:32:20.814710+0000","last_peered":"2024-04-26T12:32:20.814710+0000","last_clean":"2024-04-26T12:32:20.814710+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:32:20.814710+0000","last_undegraded":"2024-04-26T12:32:20.814710+0000","last_fullsized":"2024-04-26T12:32:20.814710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:24.979123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470742+0000","last_change":"2024-04-26T12:30:12.496190+0000","last_active":"2024-04-26T12:30:54.470742+0000","last_peered":"2024-04-26T12:30:54.470742+0000","last_clean":"2024-04-26T12:30:54.470742+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:30:54.470742+0000","last_undegraded":"2024-04-26T12:30:54.470742+0000","last_fullsized":"2024-04-26T12:30:54.470742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:40.668373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.455964+0000","last_change":"2024-04-26T12:30:10.495713+0000","last_active":"2024-04-26T12:33:21.455964+0000","last_peered":"2024-04-26T12:33:21.455964+0000","last_clean":"2024-04-26T12:33:21.455964+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:33:21.455964+0000","last_undegraded":"2024-04-26T12:33:21.455964+0000","last_fullsized":"2024-04-26T12:33:21.455964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:07.560296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548625+0000","last_change":"2024-04-26T12:30:14.491780+0000","last_active":"2024-04-26T12:30:49.548625+0000","last_peered":"2024-04-26T12:30:49.548625+0000","last_clean":"2024-04-26T12:30:49.548625+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:30:49.548625+0000","last_undegraded":"2024-04-26T12:30:49.548625+0000","last_fullsized":"2024-04-26T12:30:49.548625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514934+0000","last_change":"2024-04-26T12:30:16.514001+0000","last_active":"2024-04-26T12:32:48.514934+0000","last_peered":"2024-04-26T12:32:48.514934+0000","last_clean":"2024-04-26T12:32:48.514934+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:32:48.514934+0000","last_undegraded":"2024-04-26T12:32:48.514934+0000","last_fullsized":"2024-04-26T12:32:48.514934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:45.982767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546565+0000","last_change":"2024-04-26T12:30:18.528125+0000","last_active":"2024-04-26T12:30:49.546565+0000","last_peered":"2024-04-26T12:30:49.546565+0000","last_clean":"2024-04-26T12:30:49.546565+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:30:49.546565+0000","last_undegraded":"2024-04-26T12:30:49.546565+0000","last_fullsized":"2024-04-26T12:30:49.546565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:27.914789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542587+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:30:49.542587+0000","last_peered":"2024-04-26T12:30:49.542587+0000","last_clean":"2024-04-26T12:30:49.542587+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:30:49.542587+0000","last_undegraded":"2024-04-26T12:30:49.542587+0000","last_fullsized":"2024-04-26T12:30:49.542587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:46.834895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246915+0000","last_change":"2024-04-26T12:30:12.501410+0000","last_active":"2024-04-26T12:33:21.246915+0000","last_peered":"2024-04-26T12:33:21.246915+0000","last_clean":"2024-04-26T12:33:21.246915+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:21.246915+0000","last_undegraded":"2024-04-26T12:33:21.246915+0000","last_fullsized":"2024-04-26T12:33:21.246915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:12.616162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540042+0000","last_change":"2024-04-26T12:30:10.511419+0000","last_active":"2024-04-26T12:30:49.540042+0000","last_peered":"2024-04-26T12:30:49.540042+0000","last_clean":"2024-04-26T12:30:49.540042+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:30:49.540042+0000","last_undegraded":"2024-04-26T12:30:49.540042+0000","last_fullsized":"2024-04-26T12:30:49.540042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.067840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545955+0000","last_change":"2024-04-26T12:30:14.492168+0000","last_active":"2024-04-26T12:30:49.545955+0000","last_peered":"2024-04-26T12:30:49.545955+0000","last_clean":"2024-04-26T12:30:49.545955+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:30:49.545955+0000","last_undegraded":"2024-04-26T12:30:49.545955+0000","last_fullsized":"2024-04-26T12:30:49.545955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:24.135193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.386930+0000","last_change":"2024-04-26T12:30:16.515815+0000","last_active":"2024-04-26T12:32:19.386930+0000","last_peered":"2024-04-26T12:32:19.386930+0000","last_clean":"2024-04-26T12:32:19.386930+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:32:19.386930+0000","last_undegraded":"2024-04-26T12:32:19.386930+0000","last_fullsized":"2024-04-26T12:32:19.386930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:21.684193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695869+0000","last_change":"2024-04-26T12:30:18.517414+0000","last_active":"2024-04-26T12:30:49.695869+0000","last_peered":"2024-04-26T12:30:49.695869+0000","last_clean":"2024-04-26T12:30:49.695869+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:30:49.695869+0000","last_undegraded":"2024-04-26T12:30:49.695869+0000","last_fullsized":"2024-04-26T12:30:49.695869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:01.210587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.872383+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:20.872383+0000","last_peered":"2024-04-26T12:32:20.872383+0000","last_clean":"2024-04-26T12:32:20.872383+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:20.872383+0000","last_undegraded":"2024-04-26T12:32:20.872383+0000","last_fullsized":"2024-04-26T12:32:20.872383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:23.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184192+0000","last_change":"2024-04-26T12:30:12.491493+0000","last_active":"2024-04-26T12:30:55.184192+0000","last_peered":"2024-04-26T12:30:55.184192+0000","last_clean":"2024-04-26T12:30:55.184192+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:30:55.184192+0000","last_undegraded":"2024-04-26T12:30:55.184192+0000","last_fullsized":"2024-04-26T12:30:55.184192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.962314+0000","last_change":"2024-04-26T12:30:10.521621+0000","last_active":"2024-04-26T12:31:36.962314+0000","last_peered":"2024-04-26T12:31:36.962314+0000","last_clean":"2024-04-26T12:31:36.962314+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:31:36.962314+0000","last_undegraded":"2024-04-26T12:31:36.962314+0000","last_fullsized":"2024-04-26T12:31:36.962314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:00.153870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552309+0000","last_change":"2024-04-26T12:30:49.551612+0000","last_active":"2024-04-26T12:30:49.552309+0000","last_peered":"2024-04-26T12:30:49.552309+0000","last_clean":"2024-04-26T12:30:49.552309+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:30:49.552309+0000","last_undegraded":"2024-04-26T12:30:49.552309+0000","last_fullsized":"2024-04-26T12:30:49.552309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:14.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548162+0000","last_change":"2024-04-26T12:30:16.518414+0000","last_active":"2024-04-26T12:30:49.548162+0000","last_peered":"2024-04-26T12:30:49.548162+0000","last_clean":"2024-04-26T12:30:49.548162+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:30:49.548162+0000","last_undegraded":"2024-04-26T12:30:49.548162+0000","last_fullsized":"2024-04-26T12:30:49.548162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:21.610161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574526+0000","last_change":"2024-04-26T12:30:18.528239+0000","last_active":"2024-04-26T12:33:19.574526+0000","last_peered":"2024-04-26T12:33:19.574526+0000","last_clean":"2024-04-26T12:33:19.574526+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:19.574526+0000","last_undegraded":"2024-04-26T12:33:19.574526+0000","last_fullsized":"2024-04-26T12:33:19.574526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:47.632613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541970+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:30:49.541970+0000","last_peered":"2024-04-26T12:30:49.541970+0000","last_clean":"2024-04-26T12:30:49.541970+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:30:49.541970+0000","last_undegraded":"2024-04-26T12:30:49.541970+0000","last_fullsized":"2024-04-26T12:30:49.541970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:10.582606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532264+0000","last_change":"2024-04-26T12:30:12.489089+0000","last_active":"2024-04-26T12:33:21.532264+0000","last_peered":"2024-04-26T12:33:21.532264+0000","last_clean":"2024-04-26T12:33:21.532264+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:33:21.532264+0000","last_undegraded":"2024-04-26T12:33:21.532264+0000","last_fullsized":"2024-04-26T12:33:21.532264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:27.764119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540869+0000","last_change":"2024-04-26T12:30:10.510186+0000","last_active":"2024-04-26T12:30:49.540869+0000","last_peered":"2024-04-26T12:30:49.540869+0000","last_clean":"2024-04-26T12:30:49.540869+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:30:49.540869+0000","last_undegraded":"2024-04-26T12:30:49.540869+0000","last_fullsized":"2024-04-26T12:30:49.540869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:42.962774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539905+0000","last_change":"2024-04-26T12:30:14.494783+0000","last_active":"2024-04-26T12:30:49.539905+0000","last_peered":"2024-04-26T12:30:49.539905+0000","last_clean":"2024-04-26T12:30:49.539905+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:30:49.539905+0000","last_undegraded":"2024-04-26T12:30:49.539905+0000","last_fullsized":"2024-04-26T12:30:49.539905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.720169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513524+0000","last_change":"2024-04-26T12:30:16.512429+0000","last_active":"2024-04-26T12:32:43.513524+0000","last_peered":"2024-04-26T12:32:43.513524+0000","last_clean":"2024-04-26T12:32:43.513524+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:32:43.513524+0000","last_undegraded":"2024-04-26T12:32:43.513524+0000","last_fullsized":"2024-04-26T12:32:43.513524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:08.544396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694012+0000","last_change":"2024-04-26T12:30:18.523480+0000","last_active":"2024-04-26T12:30:49.694012+0000","last_peered":"2024-04-26T12:30:49.694012+0000","last_clean":"2024-04-26T12:30:49.694012+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:30:49.694012+0000","last_undegraded":"2024-04-26T12:30:49.694012+0000","last_fullsized":"2024-04-26T12:30:49.694012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.217886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.584682+0000","last_change":"2024-04-26T12:30:20.530957+0000","last_active":"2024-04-26T12:33:21.584682+0000","last_peered":"2024-04-26T12:33:21.584682+0000","last_clean":"2024-04-26T12:33:21.584682+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:21.584682+0000","last_undegraded":"2024-04-26T12:33:21.584682+0000","last_fullsized":"2024-04-26T12:33:21.584682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:59.026673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532275+0000","last_change":"2024-04-26T12:30:12.489703+0000","last_active":"2024-04-26T12:33:21.532275+0000","last_peered":"2024-04-26T12:33:21.532275+0000","last_clean":"2024-04-26T12:33:21.532275+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:33:21.532275+0000","last_undegraded":"2024-04-26T12:33:21.532275+0000","last_fullsized":"2024-04-26T12:33:21.532275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.458788+0000","last_change":"2024-04-26T12:30:10.524731+0000","last_active":"2024-04-26T12:33:21.458788+0000","last_peered":"2024-04-26T12:33:21.458788+0000","last_clean":"2024-04-26T12:33:21.458788+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:33:21.458788+0000","last_undegraded":"2024-04-26T12:33:21.458788+0000","last_fullsized":"2024-04-26T12:33:21.458788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:06.694451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547176+0000","last_change":"2024-04-26T12:30:14.488779+0000","last_active":"2024-04-26T12:30:49.547176+0000","last_peered":"2024-04-26T12:30:49.547176+0000","last_clean":"2024-04-26T12:30:49.547176+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:30:49.547176+0000","last_undegraded":"2024-04-26T12:30:49.547176+0000","last_fullsized":"2024-04-26T12:30:49.547176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:34.470851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.361600+0000","last_change":"2024-04-26T12:30:16.518549+0000","last_active":"2024-04-26T12:32:19.361600+0000","last_peered":"2024-04-26T12:32:19.361600+0000","last_clean":"2024-04-26T12:32:19.361600+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:32:19.361600+0000","last_undegraded":"2024-04-26T12:32:19.361600+0000","last_fullsized":"2024-04-26T12:32:19.361600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:28.849038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541960+0000","last_change":"2024-04-26T12:30:18.524599+0000","last_active":"2024-04-26T12:30:49.541960+0000","last_peered":"2024-04-26T12:30:49.541960+0000","last_clean":"2024-04-26T12:30:49.541960+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:30:49.541960+0000","last_undegraded":"2024-04-26T12:30:49.541960+0000","last_fullsized":"2024-04-26T12:30:49.541960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:26.643236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548824+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:30:49.548824+0000","last_peered":"2024-04-26T12:30:49.548824+0000","last_clean":"2024-04-26T12:30:49.548824+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:30:49.548824+0000","last_undegraded":"2024-04-26T12:30:49.548824+0000","last_fullsized":"2024-04-26T12:30:49.548824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:11.794456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503846+0000","last_change":"2024-04-26T12:30:12.489639+0000","last_active":"2024-04-26T12:33:21.503846+0000","last_peered":"2024-04-26T12:33:21.503846+0000","last_clean":"2024-04-26T12:33:21.503846+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:33:21.503846+0000","last_undegraded":"2024-04-26T12:33:21.503846+0000","last_fullsized":"2024-04-26T12:33:21.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:16.575048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.181506+0000","last_change":"2024-04-26T12:30:10.499110+0000","last_active":"2024-04-26T12:31:37.181506+0000","last_peered":"2024-04-26T12:31:37.181506+0000","last_clean":"2024-04-26T12:31:37.181506+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:31:37.181506+0000","last_undegraded":"2024-04-26T12:31:37.181506+0000","last_fullsized":"2024-04-26T12:31:37.181506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539490+0000","last_change":"2024-04-26T12:30:14.488627+0000","last_active":"2024-04-26T12:30:49.539490+0000","last_peered":"2024-04-26T12:30:49.539490+0000","last_clean":"2024-04-26T12:30:49.539490+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:30:49.539490+0000","last_undegraded":"2024-04-26T12:30:49.539490+0000","last_fullsized":"2024-04-26T12:30:49.539490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:28.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.384499+0000","last_change":"2024-04-26T12:30:16.515666+0000","last_active":"2024-04-26T12:32:19.384499+0000","last_peered":"2024-04-26T12:32:19.384499+0000","last_clean":"2024-04-26T12:32:19.384499+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:32:19.384499+0000","last_undegraded":"2024-04-26T12:32:19.384499+0000","last_fullsized":"2024-04-26T12:32:19.384499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:54.930500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543436+0000","last_change":"2024-04-26T12:30:18.524792+0000","last_active":"2024-04-26T12:30:49.543436+0000","last_peered":"2024-04-26T12:30:49.543436+0000","last_clean":"2024-04-26T12:30:49.543436+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:30:49.543436+0000","last_undegraded":"2024-04-26T12:30:49.543436+0000","last_fullsized":"2024-04-26T12:30:49.543436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:45.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.394040+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:19.394040+0000","last_peered":"2024-04-26T12:32:19.394040+0000","last_clean":"2024-04-26T12:32:19.394040+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:19.394040+0000","last_undegraded":"2024-04-26T12:32:19.394040+0000","last_fullsized":"2024-04-26T12:32:19.394040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:13.513806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971456+0000","last_change":"2024-04-26T12:30:12.482428+0000","last_active":"2024-04-26T12:31:36.971456+0000","last_peered":"2024-04-26T12:31:36.971456+0000","last_clean":"2024-04-26T12:31:36.971456+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:31:36.971456+0000","last_undegraded":"2024-04-26T12:31:36.971456+0000","last_fullsized":"2024-04-26T12:31:36.971456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.258549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544532+0000","last_change":"2024-04-26T12:30:10.515261+0000","last_active":"2024-04-26T12:30:49.544532+0000","last_peered":"2024-04-26T12:30:49.544532+0000","last_clean":"2024-04-26T12:30:49.544532+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:30:49.544532+0000","last_undegraded":"2024-04-26T12:30:49.544532+0000","last_fullsized":"2024-04-26T12:30:49.544532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:36.842504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.069122+0000","last_change":"2024-04-26T12:30:14.488530+0000","last_active":"2024-04-26T12:32:18.069122+0000","last_peered":"2024-04-26T12:32:18.069122+0000","last_clean":"2024-04-26T12:32:18.069122+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:32:18.069122+0000","last_undegraded":"2024-04-26T12:32:18.069122+0000","last_fullsized":"2024-04-26T12:32:18.069122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:22.546676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.894295+0000","last_change":"2024-04-26T12:30:16.516514+0000","last_active":"2024-04-26T12:33:20.894295+0000","last_peered":"2024-04-26T12:33:20.894295+0000","last_clean":"2024-04-26T12:33:20.894295+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:20.894295+0000","last_undegraded":"2024-04-26T12:33:20.894295+0000","last_fullsized":"2024-04-26T12:33:20.894295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:03.784951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695165+0000","last_change":"2024-04-26T12:30:18.526314+0000","last_active":"2024-04-26T12:30:49.695165+0000","last_peered":"2024-04-26T12:30:49.695165+0000","last_clean":"2024-04-26T12:30:49.695165+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:30:49.695165+0000","last_undegraded":"2024-04-26T12:30:49.695165+0000","last_fullsized":"2024-04-26T12:30:49.695165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:18.995256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.873981+0000","last_change":"2024-04-26T12:30:20.523635+0000","last_active":"2024-04-26T12:32:20.873981+0000","last_peered":"2024-04-26T12:32:20.873981+0000","last_clean":"2024-04-26T12:32:20.873981+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:32:20.873981+0000","last_undegraded":"2024-04-26T12:32:20.873981+0000","last_fullsized":"2024-04-26T12:32:20.873981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.904423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463404+0000","last_change":"2024-04-26T12:30:12.499038+0000","last_active":"2024-04-26T12:33:21.463404+0000","last_peered":"2024-04-26T12:33:21.463404+0000","last_clean":"2024-04-26T12:33:21.463404+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:21.463404+0000","last_undegraded":"2024-04-26T12:33:21.463404+0000","last_fullsized":"2024-04-26T12:33:21.463404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:46.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543304+0000","last_change":"2024-04-26T12:30:10.508462+0000","last_active":"2024-04-26T12:30:49.543304+0000","last_peered":"2024-04-26T12:30:49.543304+0000","last_clean":"2024-04-26T12:30:49.543304+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:30:49.543304+0000","last_undegraded":"2024-04-26T12:30:49.543304+0000","last_fullsized":"2024-04-26T12:30:49.543304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503030+0000","last_change":"2024-04-26T12:30:12.488793+0000","last_active":"2024-04-26T12:33:21.503030+0000","last_peered":"2024-04-26T12:33:21.503030+0000","last_clean":"2024-04-26T12:33:21.503030+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:33:21.503030+0000","last_undegraded":"2024-04-26T12:33:21.503030+0000","last_fullsized":"2024-04-26T12:33:21.503030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497835+0000","last_change":"2024-04-26T12:30:10.488944+0000","last_active":"2024-04-26T12:32:17.497835+0000","last_peered":"2024-04-26T12:32:17.497835+0000","last_clean":"2024-04-26T12:32:17.497835+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:32:17.497835+0000","last_undegraded":"2024-04-26T12:32:17.497835+0000","last_fullsized":"2024-04-26T12:32:17.497835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503142+0000","last_change":"2024-04-26T12:30:12.491523+0000","last_active":"2024-04-26T12:33:21.503142+0000","last_peered":"2024-04-26T12:33:21.503142+0000","last_clean":"2024-04-26T12:33:21.503142+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:33:21.503142+0000","last_undegraded":"2024-04-26T12:33:21.503142+0000","last_fullsized":"2024-04-26T12:33:21.503142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:49.059427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.784734+0000","last_change":"2024-04-26T12:30:10.515892+0000","last_active":"2024-04-26T12:32:20.784734+0000","last_peered":"2024-04-26T12:32:20.784734+0000","last_clean":"2024-04-26T12:32:20.784734+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:32:20.784734+0000","last_undegraded":"2024-04-26T12:32:20.784734+0000","last_fullsized":"2024-04-26T12:32:20.784734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:32.895105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531862+0000","last_change":"2024-04-26T12:30:12.491568+0000","last_active":"2024-04-26T12:33:21.531862+0000","last_peered":"2024-04-26T12:33:21.531862+0000","last_clean":"2024-04-26T12:33:21.531862+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:33:21.531862+0000","last_undegraded":"2024-04-26T12:33:21.531862+0000","last_fullsized":"2024-04-26T12:33:21.531862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696298+0000","last_change":"2024-04-26T12:30:10.498184+0000","last_active":"2024-04-26T12:30:49.696298+0000","last_peered":"2024-04-26T12:30:49.696298+0000","last_clean":"2024-04-26T12:30:49.696298+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:30:49.696298+0000","last_undegraded":"2024-04-26T12:30:49.696298+0000","last_fullsized":"2024-04-26T12:30:49.696298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335403+0000","last_change":"2024-04-26T12:30:12.477969+0000","last_active":"2024-04-26T12:33:21.335403+0000","last_peered":"2024-04-26T12:33:21.335403+0000","last_clean":"2024-04-26T12:33:21.335403+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:33:21.335403+0000","last_undegraded":"2024-04-26T12:33:21.335403+0000","last_fullsized":"2024-04-26T12:33:21.335403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696689+0000","last_change":"2024-04-26T12:30:10.505910+0000","last_active":"2024-04-26T12:30:49.696689+0000","last_peered":"2024-04-26T12:30:49.696689+0000","last_clean":"2024-04-26T12:30:49.696689+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:30:49.696689+0000","last_undegraded":"2024-04-26T12:30:49.696689+0000","last_fullsized":"2024-04-26T12:30:49.696689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245421+0000","last_change":"2024-04-26T12:30:12.497999+0000","last_active":"2024-04-26T12:33:21.245421+0000","last_peered":"2024-04-26T12:33:21.245421+0000","last_clean":"2024-04-26T12:33:21.245421+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:21.245421+0000","last_undegraded":"2024-04-26T12:33:21.245421+0000","last_fullsized":"2024-04-26T12:33:21.245421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:08.184825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545212+0000","last_change":"2024-04-26T12:30:10.507425+0000","last_active":"2024-04-26T12:30:49.545212+0000","last_peered":"2024-04-26T12:30:49.545212+0000","last_clean":"2024-04-26T12:30:49.545212+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:30:49.545212+0000","last_undegraded":"2024-04-26T12:30:49.545212+0000","last_fullsized":"2024-04-26T12:30:49.545212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:04.930580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184617+0000","last_change":"2024-04-26T12:30:12.496187+0000","last_active":"2024-04-26T12:30:55.184617+0000","last_peered":"2024-04-26T12:30:55.184617+0000","last_clean":"2024-04-26T12:30:55.184617+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:30:55.184617+0000","last_undegraded":"2024-04-26T12:30:55.184617+0000","last_fullsized":"2024-04-26T12:30:55.184617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546373+0000","last_change":"2024-04-26T12:30:10.504572+0000","last_active":"2024-04-26T12:30:49.546373+0000","last_peered":"2024-04-26T12:30:49.546373+0000","last_clean":"2024-04-26T12:30:49.546373+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:30:49.546373+0000","last_undegraded":"2024-04-26T12:30:49.546373+0000","last_fullsized":"2024-04-26T12:30:49.546373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335198+0000","last_change":"2024-04-26T12:30:12.495561+0000","last_active":"2024-04-26T12:33:21.335198+0000","last_peered":"2024-04-26T12:33:21.335198+0000","last_clean":"2024-04-26T12:33:21.335198+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:33:21.335198+0000","last_undegraded":"2024-04-26T12:33:21.335198+0000","last_fullsized":"2024-04-26T12:33:21.335198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:31.568494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498730+0000","last_change":"2024-04-26T12:30:10.498578+0000","last_active":"2024-04-26T12:32:22.498730+0000","last_peered":"2024-04-26T12:32:22.498730+0000","last_clean":"2024-04-26T12:32:22.498730+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:32:22.498730+0000","last_undegraded":"2024-04-26T12:32:22.498730+0000","last_fullsized":"2024-04-26T12:32:22.498730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:34.399017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503186+0000","last_change":"2024-04-26T12:30:12.496215+0000","last_active":"2024-04-26T12:33:21.503186+0000","last_peered":"2024-04-26T12:33:21.503186+0000","last_clean":"2024-04-26T12:33:21.503186+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:33:21.503186+0000","last_undegraded":"2024-04-26T12:33:21.503186+0000","last_fullsized":"2024-04-26T12:33:21.503186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:43.456916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543053+0000","last_change":"2024-04-26T12:30:10.521412+0000","last_active":"2024-04-26T12:30:49.543053+0000","last_peered":"2024-04-26T12:30:49.543053+0000","last_clean":"2024-04-26T12:30:49.543053+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:30:49.543053+0000","last_undegraded":"2024-04-26T12:30:49.543053+0000","last_fullsized":"2024-04-26T12:30:49.543053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:08.525460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538192+0000","last_change":"2024-04-26T12:30:12.493682+0000","last_active":"2024-04-26T12:33:21.538192+0000","last_peered":"2024-04-26T12:33:21.538192+0000","last_clean":"2024-04-26T12:33:21.538192+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:33:21.538192+0000","last_undegraded":"2024-04-26T12:33:21.538192+0000","last_fullsized":"2024-04-26T12:33:21.538192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.073143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599042+0000","last_change":"2024-04-26T12:30:10.498422+0000","last_active":"2024-04-26T12:30:53.599042+0000","last_peered":"2024-04-26T12:30:53.599042+0000","last_clean":"2024-04-26T12:30:53.599042+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:30:53.599042+0000","last_undegraded":"2024-04-26T12:30:53.599042+0000","last_fullsized":"2024-04-26T12:30:53.599042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502775+0000","last_change":"2024-04-26T12:30:12.484594+0000","last_active":"2024-04-26T12:33:21.502775+0000","last_peered":"2024-04-26T12:33:21.502775+0000","last_clean":"2024-04-26T12:33:21.502775+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:33:21.502775+0000","last_undegraded":"2024-04-26T12:33:21.502775+0000","last_fullsized":"2024-04-26T12:33:21.502775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:38.153666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540357+0000","last_change":"2024-04-26T12:30:10.514358+0000","last_active":"2024-04-26T12:30:49.540357+0000","last_peered":"2024-04-26T12:30:49.540357+0000","last_clean":"2024-04-26T12:30:49.540357+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:30:49.540357+0000","last_undegraded":"2024-04-26T12:30:49.540357+0000","last_fullsized":"2024-04-26T12:30:49.540357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:45.443501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531987+0000","last_change":"2024-04-26T12:30:12.496055+0000","last_active":"2024-04-26T12:33:21.531987+0000","last_peered":"2024-04-26T12:33:21.531987+0000","last_clean":"2024-04-26T12:33:21.531987+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:33:21.531987+0000","last_undegraded":"2024-04-26T12:33:21.531987+0000","last_fullsized":"2024-04-26T12:33:21.531987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:19.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599086+0000","last_change":"2024-04-26T12:30:10.507296+0000","last_active":"2024-04-26T12:30:53.599086+0000","last_peered":"2024-04-26T12:30:53.599086+0000","last_clean":"2024-04-26T12:30:53.599086+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:30:53.599086+0000","last_undegraded":"2024-04-26T12:30:53.599086+0000","last_fullsized":"2024-04-26T12:30:53.599086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:46.489435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246626+0000","last_change":"2024-04-26T12:30:12.494305+0000","last_active":"2024-04-26T12:33:21.246626+0000","last_peered":"2024-04-26T12:33:21.246626+0000","last_clean":"2024-04-26T12:33:21.246626+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:33:21.246626+0000","last_undegraded":"2024-04-26T12:33:21.246626+0000","last_fullsized":"2024-04-26T12:33:21.246626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:08.704032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547543+0000","last_change":"2024-04-26T12:30:10.523912+0000","last_active":"2024-04-26T12:30:49.547543+0000","last_peered":"2024-04-26T12:30:49.547543+0000","last_clean":"2024-04-26T12:30:49.547543+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:30:49.547543+0000","last_undegraded":"2024-04-26T12:30:49.547543+0000","last_fullsized":"2024-04-26T12:30:49.547543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:29.542497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510934+0000","last_change":"2024-04-26T12:30:12.497891+0000","last_active":"2024-04-26T12:32:28.510934+0000","last_peered":"2024-04-26T12:32:28.510934+0000","last_clean":"2024-04-26T12:32:28.510934+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:32:28.510934+0000","last_undegraded":"2024-04-26T12:32:28.510934+0000","last_fullsized":"2024-04-26T12:32:28.510934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:40.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.830958+0000","last_change":"2024-04-26T12:30:10.523924+0000","last_active":"2024-04-26T12:32:20.830958+0000","last_peered":"2024-04-26T12:32:20.830958+0000","last_clean":"2024-04-26T12:32:20.830958+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:32:20.830958+0000","last_undegraded":"2024-04-26T12:32:20.830958+0000","last_fullsized":"2024-04-26T12:32:20.830958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:59.395818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543474+0000","last_change":"2024-04-26T12:30:12.498180+0000","last_active":"2024-04-26T12:30:49.543474+0000","last_peered":"2024-04-26T12:30:49.543474+0000","last_clean":"2024-04-26T12:30:49.543474+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:30:49.543474+0000","last_undegraded":"2024-04-26T12:30:49.543474+0000","last_fullsized":"2024-04-26T12:30:49.543474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.633561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549751+0000","last_change":"2024-04-26T12:30:10.501961+0000","last_active":"2024-04-26T12:30:49.549751+0000","last_peered":"2024-04-26T12:30:49.549751+0000","last_clean":"2024-04-26T12:30:49.549751+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:30:49.549751+0000","last_undegraded":"2024-04-26T12:30:49.549751+0000","last_fullsized":"2024-04-26T12:30:49.549751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.244728+0000","last_change":"2024-04-26T12:30:12.493588+0000","last_active":"2024-04-26T12:33:21.244728+0000","last_peered":"2024-04-26T12:33:21.244728+0000","last_clean":"2024-04-26T12:33:21.244728+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:33:21.244728+0000","last_undegraded":"2024-04-26T12:33:21.244728+0000","last_fullsized":"2024-04-26T12:33:21.244728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:20.498299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549200+0000","last_change":"2024-04-26T12:30:10.513455+0000","last_active":"2024-04-26T12:30:49.549200+0000","last_peered":"2024-04-26T12:30:49.549200+0000","last_clean":"2024-04-26T12:30:49.549200+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:30:49.549200+0000","last_undegraded":"2024-04-26T12:30:49.549200+0000","last_fullsized":"2024-04-26T12:30:49.549200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:32.904261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.450276+0000","last_change":"2024-04-26T12:30:10.520879+0000","last_active":"2024-04-26T12:33:21.450276+0000","last_peered":"2024-04-26T12:33:21.450276+0000","last_clean":"2024-04-26T12:33:21.450276+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:33:21.450276+0000","last_undegraded":"2024-04-26T12:33:21.450276+0000","last_fullsized":"2024-04-26T12:33:21.450276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:22.136008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531885+0000","last_change":"2024-04-26T12:30:12.500495+0000","last_active":"2024-04-26T12:33:21.531885+0000","last_peered":"2024-04-26T12:33:21.531885+0000","last_clean":"2024-04-26T12:33:21.531885+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:21.531885+0000","last_undegraded":"2024-04-26T12:33:21.531885+0000","last_fullsized":"2024-04-26T12:33:21.531885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.554347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694784+0000","last_change":"2024-04-26T12:30:10.505951+0000","last_active":"2024-04-26T12:30:49.694784+0000","last_peered":"2024-04-26T12:30:49.694784+0000","last_clean":"2024-04-26T12:30:49.694784+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:30:49.694784+0000","last_undegraded":"2024-04-26T12:30:49.694784+0000","last_fullsized":"2024-04-26T12:30:49.694784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341621+0000","last_change":"2024-04-26T12:30:12.498902+0000","last_active":"2024-04-26T12:33:21.341621+0000","last_peered":"2024-04-26T12:33:21.341621+0000","last_clean":"2024-04-26T12:33:21.341621+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:21.341621+0000","last_undegraded":"2024-04-26T12:33:21.341621+0000","last_fullsized":"2024-04-26T12:33:21.341621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:34.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35872,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335968,"statfs":{"total":96636764160,"available":96600031232,"internally_reserved":0,"allocated":9068544,"data_stored":8752596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":9408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":9633792,"data_stored":9342879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48320,"kb_used_data":8824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323520,"statfs":{"total":96636764160,"available":96587284480,"internally_reserved":0,"allocated":9035776,"data_stored":8750874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:33:28.562 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f663e28c640 1 Processor -- start 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f663e28c640 1 -- start start 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f663e28c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f663812e490 0x7f6638130880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f663e28c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663806b3f0 con 0x7f66381280d0 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f663e28c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f6638127c80 con 0x7f663812e490 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f66377fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f663812e490 0x7f6638130880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f6637fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f66381280d0 0x7f66381284b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43210/0 (socket says 172.21.15.132:43210) 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.682+0000 7f6637fff640 1 -- 172.21.15.132:0/3275544223 learned_addr learned my addr 172.21.15.132:0/3275544223 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.683+0000 7f66377fe640 1 -- 172.21.15.132:0/3275544223 >> v1:172.21.15.132:6789/0 conn(0x7f66381280d0 legacy=0x7f66381284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.683+0000 7f66377fe640 1 -- 172.21.15.132:0/3275544223 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663806ef00 con 0x7f663812e490 2024-04-26T12:33:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.683+0000 7f6636ffd640 1 -- 172.21.15.132:0/3275544223 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992386807 0 0) 0x7f663806b3f0 con 0x7f66381280d0 2024-04-26T12:33:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.683+0000 7f66377fe640 1 --2- 172.21.15.132:0/3275544223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663812e490 0x7f6638130880 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f662c009720 tx=0x7f662c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8313bd90feb04b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.683+0000 7f6636ffd640 1 -- 172.21.15.132:0/3275544223 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f662c0316d0 con 0x7f663812e490 2024-04-26T12:33:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.683+0000 7f6636ffd640 1 -- 172.21.15.132:0/3275544223 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662c037070 con 0x7f663812e490 2024-04-26T12:33:28.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.683+0000 7f6636ffd640 1 -- 172.21.15.132:0/3275544223 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f662c0319c0 con 0x7f663812e490 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.684+0000 7f663e28c640 1 -- 172.21.15.132:0/3275544223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663812e490 msgr2=0x7f6638130880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.684+0000 7f663e28c640 1 --2- 172.21.15.132:0/3275544223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663812e490 0x7f6638130880 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f662c009720 tx=0x7f662c02b840 comp rx=0 tx=0).stop 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.684+0000 7f663e28c640 1 -- 172.21.15.132:0/3275544223 shutdown_connections 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.684+0000 7f663e28c640 1 --2- 172.21.15.132:0/3275544223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663812e490 0x7f6638130880 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.684+0000 7f663e28c640 1 -- 172.21.15.132:0/3275544223 >> 172.21.15.132:0/3275544223 conn(0x7f663809b7b0 msgr2=0x7f663809bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.684+0000 7f663e28c640 1 -- 172.21.15.132:0/3275544223 shutdown_connections 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.684+0000 7f663e28c640 1 -- 172.21.15.132:0/3275544223 wait complete. 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.685+0000 7f663e28c640 1 Processor -- start 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.685+0000 7f663e28c640 1 -- start start 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.685+0000 7f663e28c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66381280d0 0x7f663812b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.685+0000 7f663e28c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6638128bc0 con 0x7f66381280d0 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.685+0000 7f6637fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66381280d0 0x7f663812b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.685+0000 7f6637fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66381280d0 0x7f663812b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47340/0 (socket says 172.21.15.132:47340) 2024-04-26T12:33:28.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.685+0000 7f6637fff640 1 -- 172.21.15.132:0/918997482 learned_addr learned my addr 172.21.15.132:0/918997482 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.686+0000 7f6637fff640 1 -- 172.21.15.132:0/918997482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663808da80 con 0x7f66381280d0 2024-04-26T12:33:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.686+0000 7f6637fff640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66381280d0 0x7f663812b3c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f662800c420 tx=0x7f662800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.686+0000 7f6634ff9640 1 -- 172.21.15.132:0/918997482 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6628018070 con 0x7f66381280d0 2024-04-26T12:33:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.686+0000 7f6634ff9640 1 -- 172.21.15.132:0/918997482 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66280074d0 con 0x7f66381280d0 2024-04-26T12:33:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.686+0000 7f6634ff9640 1 -- 172.21.15.132:0/918997482 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6628004950 con 0x7f66381280d0 2024-04-26T12:33:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.686+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663812dbc0 con 0x7f66381280d0 2024-04-26T12:33:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.686+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663812d470 con 0x7f66381280d0 2024-04-26T12:33:28.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.687+0000 7f6634ff9640 1 -- 172.21.15.132:0/918997482 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f662801b070 con 0x7f66381280d0 2024-04-26T12:33:28.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.687+0000 7f6634ff9640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6624038060 0x7f662403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:28.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.687+0000 7f6634ff9640 1 -- 172.21.15.132:0/918997482 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f662804adb0 con 0x7f66381280d0 2024-04-26T12:33:28.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.687+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6638062ed0 con 0x7f66381280d0 2024-04-26T12:33:28.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.687+0000 7f66377fe640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6624038060 0x7f662403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:28.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.688+0000 7f66377fe640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6624038060 0x7f662403a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f662c036000 tx=0x7f662c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:28.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.692+0000 7f6634ff9640 1 -- 172.21.15.132:0/918997482 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6628011980 con 0x7f66381280d0 2024-04-26T12:33:28.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.861+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f663806c240 con 0x7f6624038060 2024-04-26T12:33:28.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.876+0000 7f6634ff9640 1 -- 172.21.15.132:0/918997482 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665923 (secure 0 0 0) 0x7f663806c240 con 0x7f6624038060 2024-04-26T12:33:28.884 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:33:28.889 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6624038060 msgr2=0x7f662403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6624038060 0x7f662403a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f662c036000 tx=0x7f662c008030 comp rx=0 tx=0).stop 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66381280d0 msgr2=0x7f663812b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66381280d0 0x7f663812b3c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f662800c420 tx=0x7f662800c8e0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 shutdown_connections 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f6624038060 0x7f662403a520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 --2- 172.21.15.132:0/918997482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66381280d0 0x7f663812b3c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 >> 172.21.15.132:0/918997482 conn(0x7f663809b7b0 msgr2=0x7f663808bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 shutdown_connections 2024-04-26T12:33:28.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:28.881+0000 7f663e28c640 1 -- 172.21.15.132:0/918997482 wait complete. 2024-04-26T12:33:28.893 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-26T12:33:28.487118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4879,"num_read_kb":4456,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":157008,"kb_used_data":36464,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377330352,"statfs":{"total":386547056640,"available":386386280448,"internally_reserved":0,"allocated":37339136,"data_stored":36186180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003882"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548520+0000","last_change":"2024-04-26T12:30:10.508974+0000","last_active":"2024-04-26T12:30:49.548520+0000","last_peered":"2024-04-26T12:30:49.548520+0000","last_clean":"2024-04-26T12:30:49.548520+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:30:49.548520+0000","last_undegraded":"2024-04-26T12:30:49.548520+0000","last_fullsized":"2024-04-26T12:30:49.548520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540674+0000","last_change":"2024-04-26T12:30:12.499017+0000","last_active":"2024-04-26T12:30:49.540674+0000","last_peered":"2024-04-26T12:30:49.540674+0000","last_clean":"2024-04-26T12:30:49.540674+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:30:49.540674+0000","last_undegraded":"2024-04-26T12:30:49.540674+0000","last_fullsized":"2024-04-26T12:30:49.540674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:04.180301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599043+0000","last_change":"2024-04-26T12:30:10.489909+0000","last_active":"2024-04-26T12:30:53.599043+0000","last_peered":"2024-04-26T12:30:53.599043+0000","last_clean":"2024-04-26T12:30:53.599043+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:30:53.599043+0000","last_undegraded":"2024-04-26T12:30:53.599043+0000","last_fullsized":"2024-04-26T12:30:53.599043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'17","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470254+0000","last_change":"2024-04-26T12:30:12.484427+0000","last_active":"2024-04-26T12:33:21.470254+0000","last_peered":"2024-04-26T12:33:21.470254+0000","last_clean":"2024-04-26T12:33:21.470254+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:33:21.470254+0000","last_undegraded":"2024-04-26T12:33:21.470254+0000","last_fullsized":"2024-04-26T12:33:21.470254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:44.161301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.447466+0000","last_change":"2024-04-26T12:30:10.524821+0000","last_active":"2024-04-26T12:33:21.447466+0000","last_peered":"2024-04-26T12:33:21.447466+0000","last_clean":"2024-04-26T12:33:21.447466+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:33:21.447466+0000","last_undegraded":"2024-04-26T12:33:21.447466+0000","last_fullsized":"2024-04-26T12:33:21.447466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:32.006623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246297+0000","last_change":"2024-04-26T12:30:12.493540+0000","last_active":"2024-04-26T12:33:21.246297+0000","last_peered":"2024-04-26T12:33:21.246297+0000","last_clean":"2024-04-26T12:33:21.246297+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:33:21.246297+0000","last_undegraded":"2024-04-26T12:33:21.246297+0000","last_fullsized":"2024-04-26T12:33:21.246297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:40.024999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543651+0000","last_change":"2024-04-26T12:30:10.501461+0000","last_active":"2024-04-26T12:30:49.543651+0000","last_peered":"2024-04-26T12:30:49.543651+0000","last_clean":"2024-04-26T12:30:49.543651+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:30:49.543651+0000","last_undegraded":"2024-04-26T12:30:49.543651+0000","last_fullsized":"2024-04-26T12:30:49.543651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.740937+0000","last_change":"2024-04-26T12:30:12.489894+0000","last_active":"2024-04-26T12:30:54.740937+0000","last_peered":"2024-04-26T12:30:54.740937+0000","last_clean":"2024-04-26T12:30:54.740937+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:30:54.740937+0000","last_undegraded":"2024-04-26T12:30:54.740937+0000","last_fullsized":"2024-04-26T12:30:54.740937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:10.496671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544940+0000","last_change":"2024-04-26T12:30:10.521268+0000","last_active":"2024-04-26T12:30:49.544940+0000","last_peered":"2024-04-26T12:30:49.544940+0000","last_clean":"2024-04-26T12:30:49.544940+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:30:49.544940+0000","last_undegraded":"2024-04-26T12:30:49.544940+0000","last_fullsized":"2024-04-26T12:30:49.544940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:47.412681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532137+0000","last_change":"2024-04-26T12:30:12.497804+0000","last_active":"2024-04-26T12:33:21.532137+0000","last_peered":"2024-04-26T12:33:21.532137+0000","last_clean":"2024-04-26T12:33:21.532137+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:33:21.532137+0000","last_undegraded":"2024-04-26T12:33:21.532137+0000","last_fullsized":"2024-04-26T12:33:21.532137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:34.016204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547675+0000","last_change":"2024-04-26T12:30:10.505875+0000","last_active":"2024-04-26T12:30:49.547675+0000","last_peered":"2024-04-26T12:30:49.547675+0000","last_clean":"2024-04-26T12:30:49.547675+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:30:49.547675+0000","last_undegraded":"2024-04-26T12:30:49.547675+0000","last_fullsized":"2024-04-26T12:30:49.547675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531924+0000","last_change":"2024-04-26T12:30:49.554267+0000","last_active":"2024-04-26T12:33:21.531924+0000","last_peered":"2024-04-26T12:33:21.531924+0000","last_clean":"2024-04-26T12:33:21.531924+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:33:21.531924+0000","last_undegraded":"2024-04-26T12:33:21.531924+0000","last_fullsized":"2024-04-26T12:33:21.531924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:32.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513928+0000","last_change":"2024-04-26T12:30:10.519048+0000","last_active":"2024-04-26T12:32:43.513928+0000","last_peered":"2024-04-26T12:32:43.513928+0000","last_clean":"2024-04-26T12:32:43.513928+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:32:43.513928+0000","last_undegraded":"2024-04-26T12:32:43.513928+0000","last_fullsized":"2024-04-26T12:32:43.513928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:28.446368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675537+0000","last_change":"2024-04-26T12:30:12.491137+0000","last_active":"2024-04-26T12:32:17.675537+0000","last_peered":"2024-04-26T12:32:17.675537+0000","last_clean":"2024-04-26T12:32:17.675537+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:32:17.675537+0000","last_undegraded":"2024-04-26T12:32:17.675537+0000","last_fullsized":"2024-04-26T12:32:17.675537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694288+0000","last_change":"2024-04-26T12:30:10.505714+0000","last_active":"2024-04-26T12:30:49.694288+0000","last_peered":"2024-04-26T12:30:49.694288+0000","last_clean":"2024-04-26T12:30:49.694288+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:30:49.694288+0000","last_undegraded":"2024-04-26T12:30:49.694288+0000","last_fullsized":"2024-04-26T12:30:49.694288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463709+0000","last_change":"2024-04-26T12:30:12.483230+0000","last_active":"2024-04-26T12:33:21.463709+0000","last_peered":"2024-04-26T12:33:21.463709+0000","last_clean":"2024-04-26T12:33:21.463709+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:21.463709+0000","last_undegraded":"2024-04-26T12:33:21.463709+0000","last_fullsized":"2024-04-26T12:33:21.463709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463505+0000","last_change":"2024-04-26T12:30:12.480460+0000","last_active":"2024-04-26T12:33:21.463505+0000","last_peered":"2024-04-26T12:33:21.463505+0000","last_clean":"2024-04-26T12:33:21.463505+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:33:21.463505+0000","last_undegraded":"2024-04-26T12:33:21.463505+0000","last_fullsized":"2024-04-26T12:33:21.463505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:34.798040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544770+0000","last_change":"2024-04-26T12:30:10.514263+0000","last_active":"2024-04-26T12:30:49.544770+0000","last_peered":"2024-04-26T12:30:49.544770+0000","last_clean":"2024-04-26T12:30:49.544770+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:30:49.544770+0000","last_undegraded":"2024-04-26T12:30:49.544770+0000","last_fullsized":"2024-04-26T12:30:49.544770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:17.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341367+0000","last_change":"2024-04-26T12:30:12.498685+0000","last_active":"2024-04-26T12:33:21.341367+0000","last_peered":"2024-04-26T12:33:21.341367+0000","last_clean":"2024-04-26T12:33:21.341367+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:21.341367+0000","last_undegraded":"2024-04-26T12:33:21.341367+0000","last_fullsized":"2024-04-26T12:33:21.341367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:28.769117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549354+0000","last_change":"2024-04-26T12:30:10.503403+0000","last_active":"2024-04-26T12:30:49.549354+0000","last_peered":"2024-04-26T12:30:49.549354+0000","last_clean":"2024-04-26T12:30:49.549354+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:30:49.549354+0000","last_undegraded":"2024-04-26T12:30:49.549354+0000","last_fullsized":"2024-04-26T12:30:49.549354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531887+0000","last_change":"2024-04-26T12:30:12.497749+0000","last_active":"2024-04-26T12:33:21.531887+0000","last_peered":"2024-04-26T12:33:21.531887+0000","last_clean":"2024-04-26T12:33:21.531887+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:33:21.531887+0000","last_undegraded":"2024-04-26T12:33:21.531887+0000","last_fullsized":"2024-04-26T12:33:21.531887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:16.569333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545533+0000","last_change":"2024-04-26T12:30:10.514510+0000","last_active":"2024-04-26T12:30:49.545533+0000","last_peered":"2024-04-26T12:30:49.545533+0000","last_clean":"2024-04-26T12:30:49.545533+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:30:49.545533+0000","last_undegraded":"2024-04-26T12:30:49.545533+0000","last_fullsized":"2024-04-26T12:30:49.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:19.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463231+0000","last_change":"2024-04-26T12:30:12.482516+0000","last_active":"2024-04-26T12:33:21.463231+0000","last_peered":"2024-04-26T12:33:21.463231+0000","last_clean":"2024-04-26T12:33:21.463231+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:33:21.463231+0000","last_undegraded":"2024-04-26T12:33:21.463231+0000","last_fullsized":"2024-04-26T12:33:21.463231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.209436+0000","last_change":"2024-04-26T12:30:10.513694+0000","last_active":"2024-04-26T12:33:21.209436+0000","last_peered":"2024-04-26T12:33:21.209436+0000","last_clean":"2024-04-26T12:33:21.209436+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:33:21.209436+0000","last_undegraded":"2024-04-26T12:33:21.209436+0000","last_fullsized":"2024-04-26T12:33:21.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:54.580399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505184+0000","last_change":"2024-04-26T12:30:12.484509+0000","last_active":"2024-04-26T12:32:37.505184+0000","last_peered":"2024-04-26T12:32:37.505184+0000","last_clean":"2024-04-26T12:32:37.505184+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:32:37.505184+0000","last_undegraded":"2024-04-26T12:32:37.505184+0000","last_fullsized":"2024-04-26T12:32:37.505184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.453057+0000","last_change":"2024-04-26T12:30:10.499600+0000","last_active":"2024-04-26T12:33:21.453057+0000","last_peered":"2024-04-26T12:33:21.453057+0000","last_clean":"2024-04-26T12:33:21.453057+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:33:21.453057+0000","last_undegraded":"2024-04-26T12:33:21.453057+0000","last_fullsized":"2024-04-26T12:33:21.453057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470960+0000","last_change":"2024-04-26T12:30:12.496161+0000","last_active":"2024-04-26T12:30:54.470960+0000","last_peered":"2024-04-26T12:30:54.470960+0000","last_clean":"2024-04-26T12:30:54.470960+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:30:54.470960+0000","last_undegraded":"2024-04-26T12:30:54.470960+0000","last_fullsized":"2024-04-26T12:30:54.470960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:32.006910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512341+0000","last_change":"2024-04-26T12:30:10.516884+0000","last_active":"2024-04-26T12:32:33.512341+0000","last_peered":"2024-04-26T12:32:33.512341+0000","last_clean":"2024-04-26T12:32:33.512341+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:32:33.512341+0000","last_undegraded":"2024-04-26T12:32:33.512341+0000","last_fullsized":"2024-04-26T12:32:33.512341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:01.370198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.484967+0000","last_change":"2024-04-26T12:30:20.535283+0000","last_active":"2024-04-26T12:33:21.484967+0000","last_peered":"2024-04-26T12:33:21.484967+0000","last_clean":"2024-04-26T12:33:21.484967+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:33:21.484967+0000","last_undegraded":"2024-04-26T12:33:21.484967+0000","last_fullsized":"2024-04-26T12:33:21.484967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:17.265170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971392+0000","last_change":"2024-04-26T12:30:12.490640+0000","last_active":"2024-04-26T12:31:36.971392+0000","last_peered":"2024-04-26T12:31:36.971392+0000","last_clean":"2024-04-26T12:31:36.971392+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:31:36.971392+0000","last_undegraded":"2024-04-26T12:31:36.971392+0000","last_fullsized":"2024-04-26T12:31:36.971392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:17.780262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544525+0000","last_change":"2024-04-26T12:30:10.524372+0000","last_active":"2024-04-26T12:30:49.544525+0000","last_peered":"2024-04-26T12:30:49.544525+0000","last_clean":"2024-04-26T12:30:49.544525+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:30:49.544525+0000","last_undegraded":"2024-04-26T12:30:49.544525+0000","last_fullsized":"2024-04-26T12:30:49.544525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:24.047246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550199+0000","last_change":"2024-04-26T12:30:14.491887+0000","last_active":"2024-04-26T12:30:49.550199+0000","last_peered":"2024-04-26T12:30:49.550199+0000","last_clean":"2024-04-26T12:30:49.550199+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:30:49.550199+0000","last_undegraded":"2024-04-26T12:30:49.550199+0000","last_fullsized":"2024-04-26T12:30:49.550199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:51.835729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.377483+0000","last_change":"2024-04-26T12:30:16.517097+0000","last_active":"2024-04-26T12:32:19.377483+0000","last_peered":"2024-04-26T12:32:19.377483+0000","last_clean":"2024-04-26T12:32:19.377483+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:32:19.377483+0000","last_undegraded":"2024-04-26T12:32:19.377483+0000","last_fullsized":"2024-04-26T12:32:19.377483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:39.359708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542379+0000","last_change":"2024-04-26T12:30:18.527594+0000","last_active":"2024-04-26T12:30:49.542379+0000","last_peered":"2024-04-26T12:30:49.542379+0000","last_clean":"2024-04-26T12:30:49.542379+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:30:49.542379+0000","last_undegraded":"2024-04-26T12:30:49.542379+0000","last_fullsized":"2024-04-26T12:30:49.542379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:00.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.976923+0000","last_change":"2024-04-26T12:30:20.530528+0000","last_active":"2024-04-26T12:31:36.976923+0000","last_peered":"2024-04-26T12:31:36.976923+0000","last_clean":"2024-04-26T12:31:36.976923+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:31:36.976923+0000","last_undegraded":"2024-04-26T12:31:36.976923+0000","last_fullsized":"2024-04-26T12:31:36.976923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.750584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531970+0000","last_change":"2024-04-26T12:30:12.491732+0000","last_active":"2024-04-26T12:33:21.531970+0000","last_peered":"2024-04-26T12:33:21.531970+0000","last_clean":"2024-04-26T12:33:21.531970+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:33:21.531970+0000","last_undegraded":"2024-04-26T12:33:21.531970+0000","last_fullsized":"2024-04-26T12:33:21.531970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.360440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.721856+0000","last_change":"2024-04-26T12:30:10.507052+0000","last_active":"2024-04-26T12:32:20.721856+0000","last_peered":"2024-04-26T12:32:20.721856+0000","last_clean":"2024-04-26T12:32:20.721856+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:32:20.721856+0000","last_undegraded":"2024-04-26T12:32:20.721856+0000","last_fullsized":"2024-04-26T12:32:20.721856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695639+0000","last_change":"2024-04-26T12:30:14.490693+0000","last_active":"2024-04-26T12:30:49.695639+0000","last_peered":"2024-04-26T12:30:49.695639+0000","last_clean":"2024-04-26T12:30:49.695639+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:30:49.695639+0000","last_undegraded":"2024-04-26T12:30:49.695639+0000","last_fullsized":"2024-04-26T12:30:49.695639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:24.002229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541715+0000","last_change":"2024-04-26T12:30:16.512671+0000","last_active":"2024-04-26T12:30:49.541715+0000","last_peered":"2024-04-26T12:30:49.541715+0000","last_clean":"2024-04-26T12:30:49.541715+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:30:49.541715+0000","last_undegraded":"2024-04-26T12:30:49.541715+0000","last_fullsized":"2024-04-26T12:30:49.541715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:56.174827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541431+0000","last_change":"2024-04-26T12:30:18.526535+0000","last_active":"2024-04-26T12:30:49.541431+0000","last_peered":"2024-04-26T12:30:49.541431+0000","last_clean":"2024-04-26T12:30:49.541431+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:30:49.541431+0000","last_undegraded":"2024-04-26T12:30:49.541431+0000","last_fullsized":"2024-04-26T12:30:49.541431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:47.825774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694295+0000","last_change":"2024-04-26T12:30:20.523683+0000","last_active":"2024-04-26T12:30:49.694295+0000","last_peered":"2024-04-26T12:30:49.694295+0000","last_clean":"2024-04-26T12:30:49.694295+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:30:49.694295+0000","last_undegraded":"2024-04-26T12:30:49.694295+0000","last_fullsized":"2024-04-26T12:30:49.694295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:12.874354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245067+0000","last_change":"2024-04-26T12:30:49.694875+0000","last_active":"2024-04-26T12:33:21.245067+0000","last_peered":"2024-04-26T12:33:21.245067+0000","last_clean":"2024-04-26T12:33:21.245067+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:33:21.245067+0000","last_undegraded":"2024-04-26T12:33:21.245067+0000","last_fullsized":"2024-04-26T12:33:21.245067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:41.776603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.729407+0000","last_change":"2024-04-26T12:30:10.523616+0000","last_active":"2024-04-26T12:30:54.729407+0000","last_peered":"2024-04-26T12:30:54.729407+0000","last_clean":"2024-04-26T12:30:54.729407+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:30:54.729407+0000","last_undegraded":"2024-04-26T12:30:54.729407+0000","last_fullsized":"2024-04-26T12:30:54.729407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:33.941949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.473479+0000","last_change":"2024-04-26T12:30:14.495445+0000","last_active":"2024-04-26T12:32:20.473479+0000","last_peered":"2024-04-26T12:32:20.473479+0000","last_clean":"2024-04-26T12:32:20.473479+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:32:20.473479+0000","last_undegraded":"2024-04-26T12:32:20.473479+0000","last_fullsized":"2024-04-26T12:32:20.473479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543479+0000","last_change":"2024-04-26T12:30:16.518014+0000","last_active":"2024-04-26T12:30:49.543479+0000","last_peered":"2024-04-26T12:30:49.543479+0000","last_clean":"2024-04-26T12:30:49.543479+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:30:49.543479+0000","last_undegraded":"2024-04-26T12:30:49.543479+0000","last_fullsized":"2024-04-26T12:30:49.543479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.152332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":381,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574516+0000","last_change":"2024-04-26T12:30:18.530920+0000","last_active":"2024-04-26T12:33:19.574516+0000","last_peered":"2024-04-26T12:33:19.574516+0000","last_clean":"2024-04-26T12:33:19.574516+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:33:19.574516+0000","last_undegraded":"2024-04-26T12:33:19.574516+0000","last_fullsized":"2024-04-26T12:33:19.574516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:42.827240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542674+0000","last_change":"2024-04-26T12:30:20.528257+0000","last_active":"2024-04-26T12:30:49.542674+0000","last_peered":"2024-04-26T12:30:49.542674+0000","last_clean":"2024-04-26T12:30:49.542674+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:30:49.542674+0000","last_undegraded":"2024-04-26T12:30:49.542674+0000","last_fullsized":"2024-04-26T12:30:49.542674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:16.184218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.192878+0000","last_change":"2024-04-26T12:30:12.500154+0000","last_active":"2024-04-26T12:31:37.192878+0000","last_peered":"2024-04-26T12:31:37.192878+0000","last_clean":"2024-04-26T12:31:37.192878+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:31:37.192878+0000","last_undegraded":"2024-04-26T12:31:37.192878+0000","last_fullsized":"2024-04-26T12:31:37.192878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:27.199714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540446+0000","last_change":"2024-04-26T12:30:10.512902+0000","last_active":"2024-04-26T12:30:49.540446+0000","last_peered":"2024-04-26T12:30:49.540446+0000","last_clean":"2024-04-26T12:30:49.540446+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:30:49.540446+0000","last_undegraded":"2024-04-26T12:30:49.540446+0000","last_fullsized":"2024-04-26T12:30:49.540446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:51.487985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547825+0000","last_change":"2024-04-26T12:30:14.492539+0000","last_active":"2024-04-26T12:30:49.547825+0000","last_peered":"2024-04-26T12:30:49.547825+0000","last_clean":"2024-04-26T12:30:49.547825+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:30:49.547825+0000","last_undegraded":"2024-04-26T12:30:49.547825+0000","last_fullsized":"2024-04-26T12:30:49.547825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.745596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.372407+0000","last_change":"2024-04-26T12:30:16.516605+0000","last_active":"2024-04-26T12:32:19.372407+0000","last_peered":"2024-04-26T12:32:19.372407+0000","last_clean":"2024-04-26T12:32:19.372407+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:32:19.372407+0000","last_undegraded":"2024-04-26T12:32:19.372407+0000","last_fullsized":"2024-04-26T12:32:19.372407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:12.674195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.534831+0000","last_change":"2024-04-26T12:30:18.513633+0000","last_active":"2024-04-26T12:33:21.534831+0000","last_peered":"2024-04-26T12:33:21.534831+0000","last_clean":"2024-04-26T12:33:21.534831+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:21.534831+0000","last_undegraded":"2024-04-26T12:33:21.534831+0000","last_fullsized":"2024-04-26T12:33:21.534831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:21.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876787+0000","last_change":"2024-04-26T12:30:12.493252+0000","last_active":"2024-04-26T12:32:20.876787+0000","last_peered":"2024-04-26T12:32:20.876787+0000","last_clean":"2024-04-26T12:32:20.876787+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:32:20.876787+0000","last_undegraded":"2024-04-26T12:32:20.876787+0000","last_fullsized":"2024-04-26T12:32:20.876787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:05.333696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547945+0000","last_change":"2024-04-26T12:30:10.508473+0000","last_active":"2024-04-26T12:30:49.547945+0000","last_peered":"2024-04-26T12:30:49.547945+0000","last_clean":"2024-04-26T12:30:49.547945+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:30:49.547945+0000","last_undegraded":"2024-04-26T12:30:49.547945+0000","last_fullsized":"2024-04-26T12:30:49.547945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540186+0000","last_change":"2024-04-26T12:30:14.488895+0000","last_active":"2024-04-26T12:30:49.540186+0000","last_peered":"2024-04-26T12:30:49.540186+0000","last_clean":"2024-04-26T12:30:49.540186+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:30:49.540186+0000","last_undegraded":"2024-04-26T12:30:49.540186+0000","last_fullsized":"2024-04-26T12:30:49.540186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:46.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.381746+0000","last_change":"2024-04-26T12:30:16.512244+0000","last_active":"2024-04-26T12:32:19.381746+0000","last_peered":"2024-04-26T12:32:19.381746+0000","last_clean":"2024-04-26T12:32:19.381746+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:32:19.381746+0000","last_undegraded":"2024-04-26T12:32:19.381746+0000","last_fullsized":"2024-04-26T12:32:19.381746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:44.659809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696627+0000","last_change":"2024-04-26T12:30:18.517298+0000","last_active":"2024-04-26T12:30:49.696627+0000","last_peered":"2024-04-26T12:30:49.696627+0000","last_clean":"2024-04-26T12:30:49.696627+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:30:49.696627+0000","last_undegraded":"2024-04-26T12:30:49.696627+0000","last_fullsized":"2024-04-26T12:30:49.696627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:08.568225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.978624+0000","last_change":"2024-04-26T12:30:20.529100+0000","last_active":"2024-04-26T12:31:36.978624+0000","last_peered":"2024-04-26T12:31:36.978624+0000","last_clean":"2024-04-26T12:31:36.978624+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:31:36.978624+0000","last_undegraded":"2024-04-26T12:31:36.978624+0000","last_fullsized":"2024-04-26T12:31:36.978624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.337272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247623+0000","last_change":"2024-04-26T12:30:12.496041+0000","last_active":"2024-04-26T12:33:21.247623+0000","last_peered":"2024-04-26T12:33:21.247623+0000","last_clean":"2024-04-26T12:33:21.247623+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:33:21.247623+0000","last_undegraded":"2024-04-26T12:33:21.247623+0000","last_fullsized":"2024-04-26T12:33:21.247623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:20.528504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546239+0000","last_change":"2024-04-26T12:30:10.501359+0000","last_active":"2024-04-26T12:30:49.546239+0000","last_peered":"2024-04-26T12:30:49.546239+0000","last_clean":"2024-04-26T12:30:49.546239+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:30:49.546239+0000","last_undegraded":"2024-04-26T12:30:49.546239+0000","last_fullsized":"2024-04-26T12:30:49.546239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694371+0000","last_change":"2024-04-26T12:30:14.491272+0000","last_active":"2024-04-26T12:30:49.694371+0000","last_peered":"2024-04-26T12:30:49.694371+0000","last_clean":"2024-04-26T12:30:49.694371+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:30:49.694371+0000","last_undegraded":"2024-04-26T12:30:49.694371+0000","last_fullsized":"2024-04-26T12:30:49.694371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:07.482770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512362+0000","last_change":"2024-04-26T12:30:16.517757+0000","last_active":"2024-04-26T12:32:33.512362+0000","last_peered":"2024-04-26T12:32:33.512362+0000","last_clean":"2024-04-26T12:32:33.512362+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:32:33.512362+0000","last_undegraded":"2024-04-26T12:32:33.512362+0000","last_fullsized":"2024-04-26T12:32:33.512362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:28.076471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695218+0000","last_change":"2024-04-26T12:30:18.522879+0000","last_active":"2024-04-26T12:30:49.695218+0000","last_peered":"2024-04-26T12:30:49.695218+0000","last_clean":"2024-04-26T12:30:49.695218+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:30:49.695218+0000","last_undegraded":"2024-04-26T12:30:49.695218+0000","last_fullsized":"2024-04-26T12:30:49.695218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:01.222542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.431404+0000","last_change":"2024-04-26T12:30:20.531982+0000","last_active":"2024-04-26T12:31:31.431404+0000","last_peered":"2024-04-26T12:31:31.431404+0000","last_clean":"2024-04-26T12:31:31.431404+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:31:31.431404+0000","last_undegraded":"2024-04-26T12:31:31.431404+0000","last_fullsized":"2024-04-26T12:31:31.431404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:39.756767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.509020+0000","last_change":"2024-04-26T12:30:12.483941+0000","last_active":"2024-04-26T12:33:21.509020+0000","last_peered":"2024-04-26T12:33:21.509020+0000","last_clean":"2024-04-26T12:33:21.509020+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:33:21.509020+0000","last_undegraded":"2024-04-26T12:33:21.509020+0000","last_fullsized":"2024-04-26T12:33:21.509020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.061530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'5","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511634+0000","last_change":"2024-04-26T12:30:10.524374+0000","last_active":"2024-04-26T12:32:28.511634+0000","last_peered":"2024-04-26T12:32:28.511634+0000","last_clean":"2024-04-26T12:32:28.511634+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:32:28.511634+0000","last_undegraded":"2024-04-26T12:32:28.511634+0000","last_fullsized":"2024-04-26T12:32:28.511634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:17.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695767+0000","last_change":"2024-04-26T12:30:14.491692+0000","last_active":"2024-04-26T12:30:49.695767+0000","last_peered":"2024-04-26T12:30:49.695767+0000","last_clean":"2024-04-26T12:30:49.695767+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:30:49.695767+0000","last_undegraded":"2024-04-26T12:30:49.695767+0000","last_fullsized":"2024-04-26T12:30:49.695767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:18.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.383610+0000","last_change":"2024-04-26T12:30:16.517072+0000","last_active":"2024-04-26T12:32:19.383610+0000","last_peered":"2024-04-26T12:32:19.383610+0000","last_clean":"2024-04-26T12:32:19.383610+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:32:19.383610+0000","last_undegraded":"2024-04-26T12:32:19.383610+0000","last_fullsized":"2024-04-26T12:32:19.383610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:35.697992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.649875+0000","last_change":"2024-04-26T12:30:18.526287+0000","last_active":"2024-04-26T12:33:21.649875+0000","last_peered":"2024-04-26T12:33:21.649875+0000","last_clean":"2024-04-26T12:33:21.649875+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:21.649875+0000","last_undegraded":"2024-04-26T12:33:21.649875+0000","last_fullsized":"2024-04-26T12:33:21.649875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:19.306792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695667+0000","last_change":"2024-04-26T12:30:20.531457+0000","last_active":"2024-04-26T12:30:49.695667+0000","last_peered":"2024-04-26T12:30:49.695667+0000","last_clean":"2024-04-26T12:30:49.695667+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:30:49.695667+0000","last_undegraded":"2024-04-26T12:30:49.695667+0000","last_fullsized":"2024-04-26T12:30:49.695667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:06.390024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546441+0000","last_change":"2024-04-26T12:30:12.490458+0000","last_active":"2024-04-26T12:30:49.546441+0000","last_peered":"2024-04-26T12:30:49.546441+0000","last_clean":"2024-04-26T12:30:49.546441+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:30:49.546441+0000","last_undegraded":"2024-04-26T12:30:49.546441+0000","last_fullsized":"2024-04-26T12:30:49.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547353+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:30:49.547353+0000","last_peered":"2024-04-26T12:30:49.547353+0000","last_clean":"2024-04-26T12:30:49.547353+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:30:49.547353+0000","last_undegraded":"2024-04-26T12:30:49.547353+0000","last_fullsized":"2024-04-26T12:30:49.547353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:24.660776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.491181+0000","last_change":"2024-04-26T12:30:49.553037+0000","last_active":"2024-04-26T12:30:52.491181+0000","last_peered":"2024-04-26T12:30:52.491181+0000","last_clean":"2024-04-26T12:30:52.491181+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:30:52.491181+0000","last_undegraded":"2024-04-26T12:30:52.491181+0000","last_fullsized":"2024-04-26T12:30:52.491181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:54.425258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.385402+0000","last_change":"2024-04-26T12:30:16.516843+0000","last_active":"2024-04-26T12:32:19.385402+0000","last_peered":"2024-04-26T12:32:19.385402+0000","last_clean":"2024-04-26T12:32:19.385402+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:32:19.385402+0000","last_undegraded":"2024-04-26T12:32:19.385402+0000","last_fullsized":"2024-04-26T12:32:19.385402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:04.838523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694139+0000","last_change":"2024-04-26T12:30:18.522525+0000","last_active":"2024-04-26T12:30:49.694139+0000","last_peered":"2024-04-26T12:30:49.694139+0000","last_clean":"2024-04-26T12:30:49.694139+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:30:49.694139+0000","last_undegraded":"2024-04-26T12:30:49.694139+0000","last_fullsized":"2024-04-26T12:30:49.694139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:59.330423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625284+0000","last_change":"2024-04-26T12:30:20.522951+0000","last_active":"2024-04-26T12:33:21.625284+0000","last_peered":"2024-04-26T12:33:21.625284+0000","last_clean":"2024-04-26T12:33:21.625284+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:33:21.625284+0000","last_undegraded":"2024-04-26T12:33:21.625284+0000","last_fullsized":"2024-04-26T12:33:21.625284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:10.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511024+0000","last_change":"2024-04-26T12:30:12.498504+0000","last_active":"2024-04-26T12:32:28.511024+0000","last_peered":"2024-04-26T12:32:28.511024+0000","last_clean":"2024-04-26T12:32:28.511024+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:32:28.511024+0000","last_undegraded":"2024-04-26T12:32:28.511024+0000","last_fullsized":"2024-04-26T12:32:28.511024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:01.405398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.853500+0000","last_change":"2024-04-26T12:30:10.499408+0000","last_active":"2024-04-26T12:32:20.853500+0000","last_peered":"2024-04-26T12:32:20.853500+0000","last_clean":"2024-04-26T12:32:20.853500+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:32:20.853500+0000","last_undegraded":"2024-04-26T12:32:20.853500+0000","last_fullsized":"2024-04-26T12:32:20.853500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543749+0000","last_change":"2024-04-26T12:30:14.488769+0000","last_active":"2024-04-26T12:30:49.543749+0000","last_peered":"2024-04-26T12:30:49.543749+0000","last_clean":"2024-04-26T12:30:49.543749+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:30:49.543749+0000","last_undegraded":"2024-04-26T12:30:49.543749+0000","last_fullsized":"2024-04-26T12:30:49.543749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:56.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.366761+0000","last_change":"2024-04-26T12:30:16.512181+0000","last_active":"2024-04-26T12:32:19.366761+0000","last_peered":"2024-04-26T12:32:19.366761+0000","last_clean":"2024-04-26T12:32:19.366761+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:32:19.366761+0000","last_undegraded":"2024-04-26T12:32:19.366761+0000","last_fullsized":"2024-04-26T12:32:19.366761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:05.265330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547995+0000","last_change":"2024-04-26T12:30:18.528738+0000","last_active":"2024-04-26T12:30:49.547995+0000","last_peered":"2024-04-26T12:30:49.547995+0000","last_clean":"2024-04-26T12:30:49.547995+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:30:49.547995+0000","last_undegraded":"2024-04-26T12:30:49.547995+0000","last_fullsized":"2024-04-26T12:30:49.547995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.890333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510646+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:32:23.510646+0000","last_peered":"2024-04-26T12:32:23.510646+0000","last_clean":"2024-04-26T12:32:23.510646+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:32:23.510646+0000","last_undegraded":"2024-04-26T12:32:23.510646+0000","last_fullsized":"2024-04-26T12:32:23.510646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:22.903178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550859+0000","last_change":"2024-04-26T12:30:12.501179+0000","last_active":"2024-04-26T12:30:49.550859+0000","last_peered":"2024-04-26T12:30:49.550859+0000","last_clean":"2024-04-26T12:30:49.550859+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:30:49.550859+0000","last_undegraded":"2024-04-26T12:30:49.550859+0000","last_fullsized":"2024-04-26T12:30:49.550859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:04.520788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.526847+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:21.526847+0000","last_peered":"2024-04-26T12:33:21.526847+0000","last_clean":"2024-04-26T12:33:21.526847+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:21.526847+0000","last_undegraded":"2024-04-26T12:33:21.526847+0000","last_fullsized":"2024-04-26T12:33:21.526847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.901139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695748+0000","last_change":"2024-04-26T12:30:14.491390+0000","last_active":"2024-04-26T12:30:49.695748+0000","last_peered":"2024-04-26T12:30:49.695748+0000","last_clean":"2024-04-26T12:30:49.695748+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:30:49.695748+0000","last_undegraded":"2024-04-26T12:30:49.695748+0000","last_fullsized":"2024-04-26T12:30:49.695748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:26.342488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.391961+0000","last_change":"2024-04-26T12:30:16.509310+0000","last_active":"2024-04-26T12:32:19.391961+0000","last_peered":"2024-04-26T12:32:19.391961+0000","last_clean":"2024-04-26T12:32:19.391961+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:32:19.391961+0000","last_undegraded":"2024-04-26T12:32:19.391961+0000","last_fullsized":"2024-04-26T12:32:19.391961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:24.483163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.629477+0000","last_change":"2024-04-26T12:30:18.526558+0000","last_active":"2024-04-26T12:33:21.629477+0000","last_peered":"2024-04-26T12:33:21.629477+0000","last_clean":"2024-04-26T12:33:21.629477+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:21.629477+0000","last_undegraded":"2024-04-26T12:33:21.629477+0000","last_fullsized":"2024-04-26T12:33:21.629477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:07.868452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499378+0000","last_change":"2024-04-26T12:30:20.523809+0000","last_active":"2024-04-26T12:32:27.499378+0000","last_peered":"2024-04-26T12:32:27.499378+0000","last_clean":"2024-04-26T12:32:27.499378+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:32:27.499378+0000","last_undegraded":"2024-04-26T12:32:27.499378+0000","last_fullsized":"2024-04-26T12:32:27.499378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:28.735728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503582+0000","last_change":"2024-04-26T12:30:12.484589+0000","last_active":"2024-04-26T12:33:21.503582+0000","last_peered":"2024-04-26T12:33:21.503582+0000","last_clean":"2024-04-26T12:33:21.503582+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:33:21.503582+0000","last_undegraded":"2024-04-26T12:33:21.503582+0000","last_fullsized":"2024-04-26T12:33:21.503582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544074+0000","last_change":"2024-04-26T12:30:10.524444+0000","last_active":"2024-04-26T12:30:49.544074+0000","last_peered":"2024-04-26T12:30:49.544074+0000","last_clean":"2024-04-26T12:30:49.544074+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:30:49.544074+0000","last_undegraded":"2024-04-26T12:30:49.544074+0000","last_fullsized":"2024-04-26T12:30:49.544074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:25.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.482598+0000","last_change":"2024-04-26T12:30:14.495065+0000","last_active":"2024-04-26T12:32:20.482598+0000","last_peered":"2024-04-26T12:32:20.482598+0000","last_clean":"2024-04-26T12:32:20.482598+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:32:20.482598+0000","last_undegraded":"2024-04-26T12:32:20.482598+0000","last_fullsized":"2024-04-26T12:32:20.482598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:42.031534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549960+0000","last_change":"2024-04-26T12:30:16.515078+0000","last_active":"2024-04-26T12:30:49.549960+0000","last_peered":"2024-04-26T12:30:49.549960+0000","last_clean":"2024-04-26T12:30:49.549960+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:30:49.549960+0000","last_undegraded":"2024-04-26T12:30:49.549960+0000","last_fullsized":"2024-04-26T12:30:49.549960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:38.268633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":499,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.587326+0000","last_change":"2024-04-26T12:30:18.519523+0000","last_active":"2024-04-26T12:33:21.587326+0000","last_peered":"2024-04-26T12:33:21.587326+0000","last_clean":"2024-04-26T12:33:21.587326+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:21.587326+0000","last_undegraded":"2024-04-26T12:33:21.587326+0000","last_fullsized":"2024-04-26T12:33:21.587326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:16.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.504960+0000","last_change":"2024-04-26T12:30:20.527644+0000","last_active":"2024-04-26T12:33:21.504960+0000","last_peered":"2024-04-26T12:33:21.504960+0000","last_clean":"2024-04-26T12:33:21.504960+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:21.504960+0000","last_undegraded":"2024-04-26T12:33:21.504960+0000","last_fullsized":"2024-04-26T12:33:21.504960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:21.313640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583012+0000","last_change":"2024-04-26T12:30:12.498024+0000","last_active":"2024-04-26T12:33:21.583012+0000","last_peered":"2024-04-26T12:33:21.583012+0000","last_clean":"2024-04-26T12:33:21.583012+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:21.583012+0000","last_undegraded":"2024-04-26T12:33:21.583012+0000","last_fullsized":"2024-04-26T12:33:21.583012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:50.998968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543235+0000","last_change":"2024-04-26T12:30:10.521698+0000","last_active":"2024-04-26T12:30:49.543235+0000","last_peered":"2024-04-26T12:30:49.543235+0000","last_clean":"2024-04-26T12:30:49.543235+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:30:49.543235+0000","last_undegraded":"2024-04-26T12:30:49.543235+0000","last_fullsized":"2024-04-26T12:30:49.543235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:17.318885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548138+0000","last_change":"2024-04-26T12:30:14.493082+0000","last_active":"2024-04-26T12:30:49.548138+0000","last_peered":"2024-04-26T12:30:49.548138+0000","last_clean":"2024-04-26T12:30:49.548138+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:30:49.548138+0000","last_undegraded":"2024-04-26T12:30:49.548138+0000","last_fullsized":"2024-04-26T12:30:49.548138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:53.061967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.378749+0000","last_change":"2024-04-26T12:30:16.512907+0000","last_active":"2024-04-26T12:32:19.378749+0000","last_peered":"2024-04-26T12:32:19.378749+0000","last_clean":"2024-04-26T12:32:19.378749+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:32:19.378749+0000","last_undegraded":"2024-04-26T12:32:19.378749+0000","last_fullsized":"2024-04-26T12:32:19.378749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:44.039858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543293+0000","last_change":"2024-04-26T12:30:18.525037+0000","last_active":"2024-04-26T12:30:49.543293+0000","last_peered":"2024-04-26T12:30:49.543293+0000","last_clean":"2024-04-26T12:30:49.543293+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:30:49.543293+0000","last_undegraded":"2024-04-26T12:30:49.543293+0000","last_fullsized":"2024-04-26T12:30:49.543293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:34.358080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.563122+0000","last_change":"2024-04-26T12:30:20.527103+0000","last_active":"2024-04-26T12:33:21.563122+0000","last_peered":"2024-04-26T12:33:21.563122+0000","last_clean":"2024-04-26T12:33:21.563122+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:21.563122+0000","last_undegraded":"2024-04-26T12:33:21.563122+0000","last_fullsized":"2024-04-26T12:33:21.563122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.874402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532058+0000","last_change":"2024-04-26T12:30:12.500664+0000","last_active":"2024-04-26T12:33:21.532058+0000","last_peered":"2024-04-26T12:33:21.532058+0000","last_clean":"2024-04-26T12:33:21.532058+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:21.532058+0000","last_undegraded":"2024-04-26T12:33:21.532058+0000","last_fullsized":"2024-04-26T12:33:21.532058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:30.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539702+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:30:49.539702+0000","last_peered":"2024-04-26T12:30:49.539702+0000","last_clean":"2024-04-26T12:30:49.539702+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:30:49.539702+0000","last_undegraded":"2024-04-26T12:30:49.539702+0000","last_fullsized":"2024-04-26T12:30:49.539702+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:34.223814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545163+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:30:49.545163+0000","last_peered":"2024-04-26T12:30:49.545163+0000","last_clean":"2024-04-26T12:30:49.545163+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:30:49.545163+0000","last_undegraded":"2024-04-26T12:30:49.545163+0000","last_fullsized":"2024-04-26T12:30:49.545163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.762234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544162+0000","last_change":"2024-04-26T12:30:10.518603+0000","last_active":"2024-04-26T12:30:49.544162+0000","last_peered":"2024-04-26T12:30:49.544162+0000","last_clean":"2024-04-26T12:30:49.544162+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:30:49.544162+0000","last_undegraded":"2024-04-26T12:30:49.544162+0000","last_fullsized":"2024-04-26T12:30:49.544162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:01.289832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541419+0000","last_change":"2024-04-26T12:30:14.493329+0000","last_active":"2024-04-26T12:30:49.541419+0000","last_peered":"2024-04-26T12:30:49.541419+0000","last_clean":"2024-04-26T12:30:49.541419+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:30:49.541419+0000","last_undegraded":"2024-04-26T12:30:49.541419+0000","last_fullsized":"2024-04-26T12:30:49.541419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.398590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":145,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.390018+0000","last_change":"2024-04-26T12:30:16.517527+0000","last_active":"2024-04-26T12:32:19.390018+0000","last_peered":"2024-04-26T12:32:19.390018+0000","last_clean":"2024-04-26T12:32:19.390018+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:32:19.390018+0000","last_undegraded":"2024-04-26T12:32:19.390018+0000","last_fullsized":"2024-04-26T12:32:19.390018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:40.510822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696149+0000","last_change":"2024-04-26T12:30:18.526193+0000","last_active":"2024-04-26T12:30:49.696149+0000","last_peered":"2024-04-26T12:30:49.696149+0000","last_clean":"2024-04-26T12:30:49.696149+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:30:49.696149+0000","last_undegraded":"2024-04-26T12:30:49.696149+0000","last_fullsized":"2024-04-26T12:30:49.696149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:25.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":164,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.540830+0000","last_change":"2024-04-26T12:30:20.526296+0000","last_active":"2024-04-26T12:33:21.540830+0000","last_peered":"2024-04-26T12:33:21.540830+0000","last_clean":"2024-04-26T12:33:21.540830+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:21.540830+0000","last_undegraded":"2024-04-26T12:33:21.540830+0000","last_fullsized":"2024-04-26T12:33:21.540830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:54.224734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675274+0000","last_change":"2024-04-26T12:30:12.488875+0000","last_active":"2024-04-26T12:32:17.675274+0000","last_peered":"2024-04-26T12:32:17.675274+0000","last_clean":"2024-04-26T12:32:17.675274+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:32:17.675274+0000","last_undegraded":"2024-04-26T12:32:17.675274+0000","last_fullsized":"2024-04-26T12:32:17.675274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:41.425033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542657+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:30:49.542657+0000","last_peered":"2024-04-26T12:30:49.542657+0000","last_clean":"2024-04-26T12:30:49.542657+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:30:49.542657+0000","last_undegraded":"2024-04-26T12:30:49.542657+0000","last_fullsized":"2024-04-26T12:30:49.542657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:20.023037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694359+0000","last_change":"2024-04-26T12:30:10.488700+0000","last_active":"2024-04-26T12:30:49.694359+0000","last_peered":"2024-04-26T12:30:49.694359+0000","last_clean":"2024-04-26T12:30:49.694359+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:30:49.694359+0000","last_undegraded":"2024-04-26T12:30:49.694359+0000","last_fullsized":"2024-04-26T12:30:49.694359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548136+0000","last_change":"2024-04-26T12:30:14.492528+0000","last_active":"2024-04-26T12:30:49.548136+0000","last_peered":"2024-04-26T12:30:49.548136+0000","last_clean":"2024-04-26T12:30:49.548136+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:30:49.548136+0000","last_undegraded":"2024-04-26T12:30:49.548136+0000","last_fullsized":"2024-04-26T12:30:49.548136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:32.660138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'273","reported_seq":476,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574678+0000","last_change":"2024-04-26T12:30:16.515291+0000","last_active":"2024-04-26T12:33:19.574678+0000","last_peered":"2024-04-26T12:33:19.574678+0000","last_clean":"2024-04-26T12:33:19.574678+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:19.574678+0000","last_undegraded":"2024-04-26T12:33:19.574678+0000","last_fullsized":"2024-04-26T12:33:19.574678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:16.639770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547578+0000","last_change":"2024-04-26T12:30:18.530303+0000","last_active":"2024-04-26T12:30:49.547578+0000","last_peered":"2024-04-26T12:30:49.547578+0000","last_clean":"2024-04-26T12:30:49.547578+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:30:49.547578+0000","last_undegraded":"2024-04-26T12:30:49.547578+0000","last_fullsized":"2024-04-26T12:30:49.547578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:17.619205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.975177+0000","last_change":"2024-04-26T12:30:20.532161+0000","last_active":"2024-04-26T12:31:36.975177+0000","last_peered":"2024-04-26T12:31:36.975177+0000","last_clean":"2024-04-26T12:31:36.975177+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:31:36.975177+0000","last_undegraded":"2024-04-26T12:31:36.975177+0000","last_fullsized":"2024-04-26T12:31:36.975177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:51.654625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498769+0000","last_change":"2024-04-26T12:30:12.500451+0000","last_active":"2024-04-26T12:32:22.498769+0000","last_peered":"2024-04-26T12:32:22.498769+0000","last_clean":"2024-04-26T12:32:22.498769+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:32:22.498769+0000","last_undegraded":"2024-04-26T12:32:22.498769+0000","last_fullsized":"2024-04-26T12:32:22.498769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:13.176012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542574+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:30:49.542574+0000","last_peered":"2024-04-26T12:30:49.542574+0000","last_clean":"2024-04-26T12:30:49.542574+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:30:49.542574+0000","last_undegraded":"2024-04-26T12:30:49.542574+0000","last_fullsized":"2024-04-26T12:30:49.542574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:40.531155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.693869+0000","last_change":"2024-04-26T12:30:10.489913+0000","last_active":"2024-04-26T12:30:49.693869+0000","last_peered":"2024-04-26T12:30:49.693869+0000","last_clean":"2024-04-26T12:30:49.693869+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:30:49.693869+0000","last_undegraded":"2024-04-26T12:30:49.693869+0000","last_fullsized":"2024-04-26T12:30:49.693869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546002+0000","last_change":"2024-04-26T12:30:14.492118+0000","last_active":"2024-04-26T12:30:49.546002+0000","last_peered":"2024-04-26T12:30:49.546002+0000","last_clean":"2024-04-26T12:30:49.546002+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:30:49.546002+0000","last_undegraded":"2024-04-26T12:30:49.546002+0000","last_fullsized":"2024-04-26T12:30:49.546002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:34.317162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574673+0000","last_change":"2024-04-26T12:30:16.509140+0000","last_active":"2024-04-26T12:33:19.574673+0000","last_peered":"2024-04-26T12:33:19.574673+0000","last_clean":"2024-04-26T12:33:19.574673+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:19.574673+0000","last_undegraded":"2024-04-26T12:33:19.574673+0000","last_fullsized":"2024-04-26T12:33:19.574673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:55.319866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696077+0000","last_change":"2024-04-26T12:30:18.526395+0000","last_active":"2024-04-26T12:30:49.696077+0000","last_peered":"2024-04-26T12:30:49.696077+0000","last_clean":"2024-04-26T12:30:49.696077+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:30:49.696077+0000","last_undegraded":"2024-04-26T12:30:49.696077+0000","last_fullsized":"2024-04-26T12:30:49.696077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:27.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.189438+0000","last_change":"2024-04-26T12:30:20.531432+0000","last_active":"2024-04-26T12:31:37.189438+0000","last_peered":"2024-04-26T12:31:37.189438+0000","last_clean":"2024-04-26T12:31:37.189438+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:31:37.189438+0000","last_undegraded":"2024-04-26T12:31:37.189438+0000","last_fullsized":"2024-04-26T12:31:37.189438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:35.605929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.697139+0000","last_change":"2024-04-26T12:30:12.489234+0000","last_active":"2024-04-26T12:30:49.697139+0000","last_peered":"2024-04-26T12:30:49.697139+0000","last_clean":"2024-04-26T12:30:49.697139+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:30:49.697139+0000","last_undegraded":"2024-04-26T12:30:49.697139+0000","last_fullsized":"2024-04-26T12:30:49.697139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.716751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543541+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:30:49.543541+0000","last_peered":"2024-04-26T12:30:49.543541+0000","last_clean":"2024-04-26T12:30:49.543541+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:30:49.543541+0000","last_undegraded":"2024-04-26T12:30:49.543541+0000","last_fullsized":"2024-04-26T12:30:49.543541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:36.069601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501863+0000","last_change":"2024-04-26T12:30:10.500548+0000","last_active":"2024-04-26T12:32:17.501863+0000","last_peered":"2024-04-26T12:32:17.501863+0000","last_clean":"2024-04-26T12:32:17.501863+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:32:17.501863+0000","last_undegraded":"2024-04-26T12:32:17.501863+0000","last_fullsized":"2024-04-26T12:32:17.501863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696292+0000","last_change":"2024-04-26T12:30:14.487929+0000","last_active":"2024-04-26T12:30:49.696292+0000","last_peered":"2024-04-26T12:30:49.696292+0000","last_clean":"2024-04-26T12:30:49.696292+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:30:49.696292+0000","last_undegraded":"2024-04-26T12:30:49.696292+0000","last_fullsized":"2024-04-26T12:30:49.696292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:52.557515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.889030+0000","last_change":"2024-04-26T12:30:16.517033+0000","last_active":"2024-04-26T12:33:20.889030+0000","last_peered":"2024-04-26T12:33:20.889030+0000","last_clean":"2024-04-26T12:33:20.889030+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:20.889030+0000","last_undegraded":"2024-04-26T12:33:20.889030+0000","last_fullsized":"2024-04-26T12:33:20.889030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:38.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549097+0000","last_change":"2024-04-26T12:30:18.529014+0000","last_active":"2024-04-26T12:30:49.549097+0000","last_peered":"2024-04-26T12:30:49.549097+0000","last_clean":"2024-04-26T12:30:49.549097+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:30:49.549097+0000","last_undegraded":"2024-04-26T12:30:49.549097+0000","last_fullsized":"2024-04-26T12:30:49.549097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:10.143592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.627536+0000","last_change":"2024-04-26T12:30:20.535350+0000","last_active":"2024-04-26T12:32:20.627536+0000","last_peered":"2024-04-26T12:32:20.627536+0000","last_clean":"2024-04-26T12:32:20.627536+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:32:20.627536+0000","last_undegraded":"2024-04-26T12:32:20.627536+0000","last_fullsized":"2024-04-26T12:32:20.627536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:44.849843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540587+0000","last_change":"2024-04-26T12:30:12.494538+0000","last_active":"2024-04-26T12:30:49.540587+0000","last_peered":"2024-04-26T12:30:49.540587+0000","last_clean":"2024-04-26T12:30:49.540587+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:30:49.540587+0000","last_undegraded":"2024-04-26T12:30:49.540587+0000","last_fullsized":"2024-04-26T12:30:49.540587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:34.559667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542876+0000","last_change":"2024-04-26T12:30:10.502077+0000","last_active":"2024-04-26T12:30:49.542876+0000","last_peered":"2024-04-26T12:30:49.542876+0000","last_clean":"2024-04-26T12:30:49.542876+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:30:49.542876+0000","last_undegraded":"2024-04-26T12:30:49.542876+0000","last_fullsized":"2024-04-26T12:30:49.542876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695937+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:30:49.695937+0000","last_peered":"2024-04-26T12:30:49.695937+0000","last_clean":"2024-04-26T12:30:49.695937+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.695937+0000","last_undegraded":"2024-04-26T12:30:49.695937+0000","last_fullsized":"2024-04-26T12:30:49.695937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:41.365768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498561+0000","last_change":"2024-04-26T12:30:14.490527+0000","last_active":"2024-04-26T12:32:22.498561+0000","last_peered":"2024-04-26T12:32:22.498561+0000","last_clean":"2024-04-26T12:32:22.498561+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:32:22.498561+0000","last_undegraded":"2024-04-26T12:32:22.498561+0000","last_fullsized":"2024-04-26T12:32:22.498561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:44.342932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.390913+0000","last_change":"2024-04-26T12:30:16.516144+0000","last_active":"2024-04-26T12:32:19.390913+0000","last_peered":"2024-04-26T12:32:19.390913+0000","last_clean":"2024-04-26T12:32:19.390913+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:32:19.390913+0000","last_undegraded":"2024-04-26T12:32:19.390913+0000","last_fullsized":"2024-04-26T12:32:19.390913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:35.964112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542090+0000","last_change":"2024-04-26T12:30:18.523448+0000","last_active":"2024-04-26T12:30:49.542090+0000","last_peered":"2024-04-26T12:30:49.542090+0000","last_clean":"2024-04-26T12:30:49.542090+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:30:49.542090+0000","last_undegraded":"2024-04-26T12:30:49.542090+0000","last_fullsized":"2024-04-26T12:30:49.542090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:00.948613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.817678+0000","last_change":"2024-04-26T12:30:20.527189+0000","last_active":"2024-04-26T12:32:20.817678+0000","last_peered":"2024-04-26T12:32:20.817678+0000","last_clean":"2024-04-26T12:32:20.817678+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:32:20.817678+0000","last_undegraded":"2024-04-26T12:32:20.817678+0000","last_fullsized":"2024-04-26T12:32:20.817678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:22.610410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247296+0000","last_change":"2024-04-26T12:30:12.493953+0000","last_active":"2024-04-26T12:33:21.247296+0000","last_peered":"2024-04-26T12:33:21.247296+0000","last_clean":"2024-04-26T12:33:21.247296+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:33:21.247296+0000","last_undegraded":"2024-04-26T12:33:21.247296+0000","last_fullsized":"2024-04-26T12:33:21.247296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:29.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696477+0000","last_change":"2024-04-26T12:30:10.499533+0000","last_active":"2024-04-26T12:30:49.696477+0000","last_peered":"2024-04-26T12:30:49.696477+0000","last_clean":"2024-04-26T12:30:49.696477+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:30:49.696477+0000","last_undegraded":"2024-04-26T12:30:49.696477+0000","last_fullsized":"2024-04-26T12:30:49.696477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549792+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:30:49.549792+0000","last_peered":"2024-04-26T12:30:49.549792+0000","last_clean":"2024-04-26T12:30:49.549792+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:30:49.549792+0000","last_undegraded":"2024-04-26T12:30:49.549792+0000","last_fullsized":"2024-04-26T12:30:49.549792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:20.349910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552858+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:30:49.552858+0000","last_peered":"2024-04-26T12:30:49.552858+0000","last_clean":"2024-04-26T12:30:49.552858+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:30:49.552858+0000","last_undegraded":"2024-04-26T12:30:49.552858+0000","last_fullsized":"2024-04-26T12:30:49.552858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:36.051479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541073+0000","last_change":"2024-04-26T12:30:16.519723+0000","last_active":"2024-04-26T12:30:49.541073+0000","last_peered":"2024-04-26T12:30:49.541073+0000","last_clean":"2024-04-26T12:30:49.541073+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:30:49.541073+0000","last_undegraded":"2024-04-26T12:30:49.541073+0000","last_fullsized":"2024-04-26T12:30:49.541073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:15.493662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574649+0000","last_change":"2024-04-26T12:30:18.522379+0000","last_active":"2024-04-26T12:33:19.574649+0000","last_peered":"2024-04-26T12:33:19.574649+0000","last_clean":"2024-04-26T12:33:19.574649+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:19.574649+0000","last_undegraded":"2024-04-26T12:33:19.574649+0000","last_fullsized":"2024-04-26T12:33:19.574649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:31.575194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.472108+0000","last_change":"2024-04-26T12:30:20.530218+0000","last_active":"2024-04-26T12:30:54.472108+0000","last_peered":"2024-04-26T12:30:54.472108+0000","last_clean":"2024-04-26T12:30:54.472108+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:30:54.472108+0000","last_undegraded":"2024-04-26T12:30:54.472108+0000","last_fullsized":"2024-04-26T12:30:54.472108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:19.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502925+0000","last_change":"2024-04-26T12:30:12.496796+0000","last_active":"2024-04-26T12:33:21.502925+0000","last_peered":"2024-04-26T12:33:21.502925+0000","last_clean":"2024-04-26T12:33:21.502925+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:21.502925+0000","last_undegraded":"2024-04-26T12:33:21.502925+0000","last_fullsized":"2024-04-26T12:33:21.502925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:20.540141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550102+0000","last_change":"2024-04-26T12:30:10.516983+0000","last_active":"2024-04-26T12:30:49.550102+0000","last_peered":"2024-04-26T12:30:49.550102+0000","last_clean":"2024-04-26T12:30:49.550102+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:30:49.550102+0000","last_undegraded":"2024-04-26T12:30:49.550102+0000","last_fullsized":"2024-04-26T12:30:49.550102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:02.170720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696304+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:30:49.696304+0000","last_peered":"2024-04-26T12:30:49.696304+0000","last_clean":"2024-04-26T12:30:49.696304+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.696304+0000","last_undegraded":"2024-04-26T12:30:49.696304+0000","last_fullsized":"2024-04-26T12:30:49.696304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:36.830729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542420+0000","last_change":"2024-04-26T12:30:14.491970+0000","last_active":"2024-04-26T12:30:49.542420+0000","last_peered":"2024-04-26T12:30:49.542420+0000","last_clean":"2024-04-26T12:30:49.542420+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:30:49.542420+0000","last_undegraded":"2024-04-26T12:30:49.542420+0000","last_fullsized":"2024-04-26T12:30:49.542420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.888576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'12","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510792+0000","last_change":"2024-04-26T12:30:16.517776+0000","last_active":"2024-04-26T12:32:23.510792+0000","last_peered":"2024-04-26T12:32:23.510792+0000","last_clean":"2024-04-26T12:32:23.510792+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:32:23.510792+0000","last_undegraded":"2024-04-26T12:32:23.510792+0000","last_fullsized":"2024-04-26T12:32:23.510792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:16.311902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625853+0000","last_change":"2024-04-26T12:30:18.513636+0000","last_active":"2024-04-26T12:33:21.625853+0000","last_peered":"2024-04-26T12:33:21.625853+0000","last_clean":"2024-04-26T12:33:21.625853+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:21.625853+0000","last_undegraded":"2024-04-26T12:33:21.625853+0000","last_fullsized":"2024-04-26T12:33:21.625853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:16.493488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540087+0000","last_change":"2024-04-26T12:30:20.532905+0000","last_active":"2024-04-26T12:30:49.540087+0000","last_peered":"2024-04-26T12:30:49.540087+0000","last_clean":"2024-04-26T12:30:49.540087+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:30:49.540087+0000","last_undegraded":"2024-04-26T12:30:49.540087+0000","last_fullsized":"2024-04-26T12:30:49.540087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:44.711542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463354+0000","last_change":"2024-04-26T12:30:12.481683+0000","last_active":"2024-04-26T12:33:21.463354+0000","last_peered":"2024-04-26T12:33:21.463354+0000","last_clean":"2024-04-26T12:33:21.463354+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:21.463354+0000","last_undegraded":"2024-04-26T12:33:21.463354+0000","last_fullsized":"2024-04-26T12:33:21.463354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:19.678454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510273+0000","last_change":"2024-04-26T12:30:10.507125+0000","last_active":"2024-04-26T12:32:23.510273+0000","last_peered":"2024-04-26T12:32:23.510273+0000","last_clean":"2024-04-26T12:32:23.510273+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:32:23.510273+0000","last_undegraded":"2024-04-26T12:32:23.510273+0000","last_fullsized":"2024-04-26T12:32:23.510273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:00.550498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549681+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:30:49.549681+0000","last_peered":"2024-04-26T12:30:49.549681+0000","last_clean":"2024-04-26T12:30:49.549681+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:30:49.549681+0000","last_undegraded":"2024-04-26T12:30:49.549681+0000","last_fullsized":"2024-04-26T12:30:49.549681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:40.435075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542501+0000","last_change":"2024-04-26T12:30:14.491299+0000","last_active":"2024-04-26T12:30:49.542501+0000","last_peered":"2024-04-26T12:30:49.542501+0000","last_clean":"2024-04-26T12:30:49.542501+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:30:49.542501+0000","last_undegraded":"2024-04-26T12:30:49.542501+0000","last_fullsized":"2024-04-26T12:30:49.542501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'84","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.376553+0000","last_change":"2024-04-26T12:30:16.518167+0000","last_active":"2024-04-26T12:32:19.376553+0000","last_peered":"2024-04-26T12:32:19.376553+0000","last_clean":"2024-04-26T12:32:19.376553+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:32:19.376553+0000","last_undegraded":"2024-04-26T12:32:19.376553+0000","last_fullsized":"2024-04-26T12:32:19.376553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:20.616941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694602+0000","last_change":"2024-04-26T12:30:18.522507+0000","last_active":"2024-04-26T12:30:49.694602+0000","last_peered":"2024-04-26T12:30:49.694602+0000","last_clean":"2024-04-26T12:30:49.694602+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:30:49.694602+0000","last_undegraded":"2024-04-26T12:30:49.694602+0000","last_fullsized":"2024-04-26T12:30:49.694602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:14.177370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.492214+0000","last_change":"2024-04-26T12:30:20.530332+0000","last_active":"2024-04-26T12:33:21.492214+0000","last_peered":"2024-04-26T12:33:21.492214+0000","last_clean":"2024-04-26T12:33:21.492214+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:33:21.492214+0000","last_undegraded":"2024-04-26T12:33:21.492214+0000","last_fullsized":"2024-04-26T12:33:21.492214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:21.002104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547852+0000","last_change":"2024-04-26T12:30:20.528129+0000","last_active":"2024-04-26T12:30:49.547852+0000","last_peered":"2024-04-26T12:30:49.547852+0000","last_clean":"2024-04-26T12:30:49.547852+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:30:49.547852+0000","last_undegraded":"2024-04-26T12:30:49.547852+0000","last_fullsized":"2024-04-26T12:30:49.547852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:23.397024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.741112+0000","last_change":"2024-04-26T12:30:12.480553+0000","last_active":"2024-04-26T12:30:54.741112+0000","last_peered":"2024-04-26T12:30:54.741112+0000","last_clean":"2024-04-26T12:30:54.741112+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:30:54.741112+0000","last_undegraded":"2024-04-26T12:30:54.741112+0000","last_fullsized":"2024-04-26T12:30:54.741112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.226828+0000","last_change":"2024-04-26T12:30:10.523769+0000","last_active":"2024-04-26T12:33:21.226828+0000","last_peered":"2024-04-26T12:33:21.226828+0000","last_clean":"2024-04-26T12:33:21.226828+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:33:21.226828+0000","last_undegraded":"2024-04-26T12:33:21.226828+0000","last_fullsized":"2024-04-26T12:33:21.226828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:54.971518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540221+0000","last_change":"2024-04-26T12:30:14.493380+0000","last_active":"2024-04-26T12:30:49.540221+0000","last_peered":"2024-04-26T12:30:49.540221+0000","last_clean":"2024-04-26T12:30:49.540221+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:30:49.540221+0000","last_undegraded":"2024-04-26T12:30:49.540221+0000","last_fullsized":"2024-04-26T12:30:49.540221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:18.581583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.382642+0000","last_change":"2024-04-26T12:30:16.518746+0000","last_active":"2024-04-26T12:32:19.382642+0000","last_peered":"2024-04-26T12:32:19.382642+0000","last_clean":"2024-04-26T12:32:19.382642+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:32:19.382642+0000","last_undegraded":"2024-04-26T12:32:19.382642+0000","last_fullsized":"2024-04-26T12:32:19.382642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:04.293139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544178+0000","last_change":"2024-04-26T12:30:18.529377+0000","last_active":"2024-04-26T12:30:49.544178+0000","last_peered":"2024-04-26T12:30:49.544178+0000","last_clean":"2024-04-26T12:30:49.544178+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:30:49.544178+0000","last_undegraded":"2024-04-26T12:30:49.544178+0000","last_fullsized":"2024-04-26T12:30:49.544178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:31.772676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.057676+0000","last_change":"2024-04-26T12:30:20.528724+0000","last_active":"2024-04-26T12:32:19.057676+0000","last_peered":"2024-04-26T12:32:19.057676+0000","last_clean":"2024-04-26T12:32:19.057676+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:32:19.057676+0000","last_undegraded":"2024-04-26T12:32:19.057676+0000","last_fullsized":"2024-04-26T12:32:19.057676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:50.736220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876246+0000","last_change":"2024-04-26T12:30:49.555701+0000","last_active":"2024-04-26T12:32:20.876246+0000","last_peered":"2024-04-26T12:32:20.876246+0000","last_clean":"2024-04-26T12:32:20.876246+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:32:20.876246+0000","last_undegraded":"2024-04-26T12:32:20.876246+0000","last_fullsized":"2024-04-26T12:32:20.876246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:34.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.600051+0000","last_change":"2024-04-26T12:30:10.502612+0000","last_active":"2024-04-26T12:30:53.600051+0000","last_peered":"2024-04-26T12:30:53.600051+0000","last_clean":"2024-04-26T12:30:53.600051+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:30:53.600051+0000","last_undegraded":"2024-04-26T12:30:53.600051+0000","last_fullsized":"2024-04-26T12:30:53.600051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:03.814159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544101+0000","last_change":"2024-04-26T12:30:14.491480+0000","last_active":"2024-04-26T12:30:49.544101+0000","last_peered":"2024-04-26T12:30:49.544101+0000","last_clean":"2024-04-26T12:30:49.544101+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:30:49.544101+0000","last_undegraded":"2024-04-26T12:30:49.544101+0000","last_fullsized":"2024-04-26T12:30:49.544101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:27.548981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.893403+0000","last_change":"2024-04-26T12:30:16.504440+0000","last_active":"2024-04-26T12:33:20.893403+0000","last_peered":"2024-04-26T12:33:20.893403+0000","last_clean":"2024-04-26T12:33:20.893403+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:20.893403+0000","last_undegraded":"2024-04-26T12:33:20.893403+0000","last_fullsized":"2024-04-26T12:33:20.893403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:12.728383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542390+0000","last_change":"2024-04-26T12:30:18.523667+0000","last_active":"2024-04-26T12:30:49.542390+0000","last_peered":"2024-04-26T12:30:49.542390+0000","last_clean":"2024-04-26T12:30:49.542390+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:30:49.542390+0000","last_undegraded":"2024-04-26T12:30:49.542390+0000","last_fullsized":"2024-04-26T12:30:49.542390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:23.693333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.263020+0000","last_change":"2024-04-26T12:30:20.531528+0000","last_active":"2024-04-26T12:33:21.263020+0000","last_peered":"2024-04-26T12:33:21.263020+0000","last_clean":"2024-04-26T12:33:21.263020+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:33:21.263020+0000","last_undegraded":"2024-04-26T12:33:21.263020+0000","last_fullsized":"2024-04-26T12:33:21.263020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:58.871702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876582+0000","last_change":"2024-04-26T12:30:12.482043+0000","last_active":"2024-04-26T12:32:20.876582+0000","last_peered":"2024-04-26T12:32:20.876582+0000","last_clean":"2024-04-26T12:32:20.876582+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:32:20.876582+0000","last_undegraded":"2024-04-26T12:32:20.876582+0000","last_fullsized":"2024-04-26T12:32:20.876582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546282+0000","last_change":"2024-04-26T12:30:10.493462+0000","last_active":"2024-04-26T12:30:49.546282+0000","last_peered":"2024-04-26T12:30:49.546282+0000","last_clean":"2024-04-26T12:30:49.546282+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:30:49.546282+0000","last_undegraded":"2024-04-26T12:30:49.546282+0000","last_fullsized":"2024-04-26T12:30:49.546282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.482873+0000","last_change":"2024-04-26T12:30:14.489635+0000","last_active":"2024-04-26T12:32:20.482873+0000","last_peered":"2024-04-26T12:32:20.482873+0000","last_clean":"2024-04-26T12:32:20.482873+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:32:20.482873+0000","last_undegraded":"2024-04-26T12:32:20.482873+0000","last_fullsized":"2024-04-26T12:32:20.482873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:54.728684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.957035+0000","last_change":"2024-04-26T12:30:16.507208+0000","last_active":"2024-04-26T12:33:20.957035+0000","last_peered":"2024-04-26T12:33:20.957035+0000","last_clean":"2024-04-26T12:33:20.957035+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:20.957035+0000","last_undegraded":"2024-04-26T12:33:20.957035+0000","last_fullsized":"2024-04-26T12:33:20.957035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:41.932885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539732+0000","last_change":"2024-04-26T12:30:18.521304+0000","last_active":"2024-04-26T12:30:49.539732+0000","last_peered":"2024-04-26T12:30:49.539732+0000","last_clean":"2024-04-26T12:30:49.539732+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:30:49.539732+0000","last_undegraded":"2024-04-26T12:30:49.539732+0000","last_fullsized":"2024-04-26T12:30:49.539732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:41.695559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545725+0000","last_change":"2024-04-26T12:30:20.524900+0000","last_active":"2024-04-26T12:30:49.545725+0000","last_peered":"2024-04-26T12:30:49.545725+0000","last_clean":"2024-04-26T12:30:49.545725+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:30:49.545725+0000","last_undegraded":"2024-04-26T12:30:49.545725+0000","last_fullsized":"2024-04-26T12:30:49.545725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:29.025840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463384+0000","last_change":"2024-04-26T12:30:12.502223+0000","last_active":"2024-04-26T12:33:21.463384+0000","last_peered":"2024-04-26T12:33:21.463384+0000","last_clean":"2024-04-26T12:33:21.463384+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:21.463384+0000","last_undegraded":"2024-04-26T12:33:21.463384+0000","last_fullsized":"2024-04-26T12:33:21.463384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:06.713634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542218+0000","last_change":"2024-04-26T12:30:10.513562+0000","last_active":"2024-04-26T12:30:49.542218+0000","last_peered":"2024-04-26T12:30:49.542218+0000","last_clean":"2024-04-26T12:30:49.542218+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:30:49.542218+0000","last_undegraded":"2024-04-26T12:30:49.542218+0000","last_fullsized":"2024-04-26T12:30:49.542218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:55.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542323+0000","last_change":"2024-04-26T12:30:14.490374+0000","last_active":"2024-04-26T12:30:49.542323+0000","last_peered":"2024-04-26T12:30:49.542323+0000","last_clean":"2024-04-26T12:30:49.542323+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:30:49.542323+0000","last_undegraded":"2024-04-26T12:30:49.542323+0000","last_fullsized":"2024-04-26T12:30:49.542323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:12.379331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.368648+0000","last_change":"2024-04-26T12:30:16.511513+0000","last_active":"2024-04-26T12:32:19.368648+0000","last_peered":"2024-04-26T12:32:19.368648+0000","last_clean":"2024-04-26T12:32:19.368648+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:32:19.368648+0000","last_undegraded":"2024-04-26T12:32:19.368648+0000","last_fullsized":"2024-04-26T12:32:19.368648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:54.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542848+0000","last_change":"2024-04-26T12:30:18.515934+0000","last_active":"2024-04-26T12:30:49.542848+0000","last_peered":"2024-04-26T12:30:49.542848+0000","last_clean":"2024-04-26T12:30:49.542848+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:30:49.542848+0000","last_undegraded":"2024-04-26T12:30:49.542848+0000","last_fullsized":"2024-04-26T12:30:49.542848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:25.200262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.185099+0000","last_change":"2024-04-26T12:30:12.490077+0000","last_active":"2024-04-26T12:30:55.185099+0000","last_peered":"2024-04-26T12:30:55.185099+0000","last_clean":"2024-04-26T12:30:55.185099+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:30:55.185099+0000","last_undegraded":"2024-04-26T12:30:55.185099+0000","last_fullsized":"2024-04-26T12:30:55.185099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:11.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542763+0000","last_change":"2024-04-26T12:30:10.523507+0000","last_active":"2024-04-26T12:30:49.542763+0000","last_peered":"2024-04-26T12:30:49.542763+0000","last_clean":"2024-04-26T12:30:49.542763+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:30:49.542763+0000","last_undegraded":"2024-04-26T12:30:49.542763+0000","last_fullsized":"2024-04-26T12:30:49.542763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:43.079489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696240+0000","last_change":"2024-04-26T12:30:14.487589+0000","last_active":"2024-04-26T12:30:49.696240+0000","last_peered":"2024-04-26T12:30:49.696240+0000","last_clean":"2024-04-26T12:30:49.696240+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:30:49.696240+0000","last_undegraded":"2024-04-26T12:30:49.696240+0000","last_fullsized":"2024-04-26T12:30:49.696240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:18.599868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.388968+0000","last_change":"2024-04-26T12:30:16.510514+0000","last_active":"2024-04-26T12:32:19.388968+0000","last_peered":"2024-04-26T12:32:19.388968+0000","last_clean":"2024-04-26T12:32:19.388968+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:32:19.388968+0000","last_undegraded":"2024-04-26T12:32:19.388968+0000","last_fullsized":"2024-04-26T12:32:19.388968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:58.939474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543187+0000","last_change":"2024-04-26T12:30:18.517450+0000","last_active":"2024-04-26T12:30:49.543187+0000","last_peered":"2024-04-26T12:30:49.543187+0000","last_clean":"2024-04-26T12:30:49.543187+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:30:49.543187+0000","last_undegraded":"2024-04-26T12:30:49.543187+0000","last_fullsized":"2024-04-26T12:30:49.543187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:21.795370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.814710+0000","last_change":"2024-04-26T12:30:20.523862+0000","last_active":"2024-04-26T12:32:20.814710+0000","last_peered":"2024-04-26T12:32:20.814710+0000","last_clean":"2024-04-26T12:32:20.814710+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:32:20.814710+0000","last_undegraded":"2024-04-26T12:32:20.814710+0000","last_fullsized":"2024-04-26T12:32:20.814710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:24.979123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470742+0000","last_change":"2024-04-26T12:30:12.496190+0000","last_active":"2024-04-26T12:30:54.470742+0000","last_peered":"2024-04-26T12:30:54.470742+0000","last_clean":"2024-04-26T12:30:54.470742+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:30:54.470742+0000","last_undegraded":"2024-04-26T12:30:54.470742+0000","last_fullsized":"2024-04-26T12:30:54.470742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:40.668373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.455964+0000","last_change":"2024-04-26T12:30:10.495713+0000","last_active":"2024-04-26T12:33:21.455964+0000","last_peered":"2024-04-26T12:33:21.455964+0000","last_clean":"2024-04-26T12:33:21.455964+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:33:21.455964+0000","last_undegraded":"2024-04-26T12:33:21.455964+0000","last_fullsized":"2024-04-26T12:33:21.455964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:07.560296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548625+0000","last_change":"2024-04-26T12:30:14.491780+0000","last_active":"2024-04-26T12:30:49.548625+0000","last_peered":"2024-04-26T12:30:49.548625+0000","last_clean":"2024-04-26T12:30:49.548625+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:30:49.548625+0000","last_undegraded":"2024-04-26T12:30:49.548625+0000","last_fullsized":"2024-04-26T12:30:49.548625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514934+0000","last_change":"2024-04-26T12:30:16.514001+0000","last_active":"2024-04-26T12:32:48.514934+0000","last_peered":"2024-04-26T12:32:48.514934+0000","last_clean":"2024-04-26T12:32:48.514934+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:32:48.514934+0000","last_undegraded":"2024-04-26T12:32:48.514934+0000","last_fullsized":"2024-04-26T12:32:48.514934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:45.982767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546565+0000","last_change":"2024-04-26T12:30:18.528125+0000","last_active":"2024-04-26T12:30:49.546565+0000","last_peered":"2024-04-26T12:30:49.546565+0000","last_clean":"2024-04-26T12:30:49.546565+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:30:49.546565+0000","last_undegraded":"2024-04-26T12:30:49.546565+0000","last_fullsized":"2024-04-26T12:30:49.546565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:27.914789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542587+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:30:49.542587+0000","last_peered":"2024-04-26T12:30:49.542587+0000","last_clean":"2024-04-26T12:30:49.542587+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:30:49.542587+0000","last_undegraded":"2024-04-26T12:30:49.542587+0000","last_fullsized":"2024-04-26T12:30:49.542587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:46.834895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246915+0000","last_change":"2024-04-26T12:30:12.501410+0000","last_active":"2024-04-26T12:33:21.246915+0000","last_peered":"2024-04-26T12:33:21.246915+0000","last_clean":"2024-04-26T12:33:21.246915+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:21.246915+0000","last_undegraded":"2024-04-26T12:33:21.246915+0000","last_fullsized":"2024-04-26T12:33:21.246915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:12.616162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540042+0000","last_change":"2024-04-26T12:30:10.511419+0000","last_active":"2024-04-26T12:30:49.540042+0000","last_peered":"2024-04-26T12:30:49.540042+0000","last_clean":"2024-04-26T12:30:49.540042+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:30:49.540042+0000","last_undegraded":"2024-04-26T12:30:49.540042+0000","last_fullsized":"2024-04-26T12:30:49.540042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.067840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545955+0000","last_change":"2024-04-26T12:30:14.492168+0000","last_active":"2024-04-26T12:30:49.545955+0000","last_peered":"2024-04-26T12:30:49.545955+0000","last_clean":"2024-04-26T12:30:49.545955+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:30:49.545955+0000","last_undegraded":"2024-04-26T12:30:49.545955+0000","last_fullsized":"2024-04-26T12:30:49.545955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:24.135193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.386930+0000","last_change":"2024-04-26T12:30:16.515815+0000","last_active":"2024-04-26T12:32:19.386930+0000","last_peered":"2024-04-26T12:32:19.386930+0000","last_clean":"2024-04-26T12:32:19.386930+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:32:19.386930+0000","last_undegraded":"2024-04-26T12:32:19.386930+0000","last_fullsized":"2024-04-26T12:32:19.386930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:21.684193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695869+0000","last_change":"2024-04-26T12:30:18.517414+0000","last_active":"2024-04-26T12:30:49.695869+0000","last_peered":"2024-04-26T12:30:49.695869+0000","last_clean":"2024-04-26T12:30:49.695869+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:30:49.695869+0000","last_undegraded":"2024-04-26T12:30:49.695869+0000","last_fullsized":"2024-04-26T12:30:49.695869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:01.210587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.872383+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:20.872383+0000","last_peered":"2024-04-26T12:32:20.872383+0000","last_clean":"2024-04-26T12:32:20.872383+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:20.872383+0000","last_undegraded":"2024-04-26T12:32:20.872383+0000","last_fullsized":"2024-04-26T12:32:20.872383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:23.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184192+0000","last_change":"2024-04-26T12:30:12.491493+0000","last_active":"2024-04-26T12:30:55.184192+0000","last_peered":"2024-04-26T12:30:55.184192+0000","last_clean":"2024-04-26T12:30:55.184192+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:30:55.184192+0000","last_undegraded":"2024-04-26T12:30:55.184192+0000","last_fullsized":"2024-04-26T12:30:55.184192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.962314+0000","last_change":"2024-04-26T12:30:10.521621+0000","last_active":"2024-04-26T12:31:36.962314+0000","last_peered":"2024-04-26T12:31:36.962314+0000","last_clean":"2024-04-26T12:31:36.962314+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:31:36.962314+0000","last_undegraded":"2024-04-26T12:31:36.962314+0000","last_fullsized":"2024-04-26T12:31:36.962314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:00.153870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552309+0000","last_change":"2024-04-26T12:30:49.551612+0000","last_active":"2024-04-26T12:30:49.552309+0000","last_peered":"2024-04-26T12:30:49.552309+0000","last_clean":"2024-04-26T12:30:49.552309+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:30:49.552309+0000","last_undegraded":"2024-04-26T12:30:49.552309+0000","last_fullsized":"2024-04-26T12:30:49.552309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:14.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548162+0000","last_change":"2024-04-26T12:30:16.518414+0000","last_active":"2024-04-26T12:30:49.548162+0000","last_peered":"2024-04-26T12:30:49.548162+0000","last_clean":"2024-04-26T12:30:49.548162+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:30:49.548162+0000","last_undegraded":"2024-04-26T12:30:49.548162+0000","last_fullsized":"2024-04-26T12:30:49.548162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:21.610161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574526+0000","last_change":"2024-04-26T12:30:18.528239+0000","last_active":"2024-04-26T12:33:19.574526+0000","last_peered":"2024-04-26T12:33:19.574526+0000","last_clean":"2024-04-26T12:33:19.574526+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:19.574526+0000","last_undegraded":"2024-04-26T12:33:19.574526+0000","last_fullsized":"2024-04-26T12:33:19.574526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:47.632613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541970+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:30:49.541970+0000","last_peered":"2024-04-26T12:30:49.541970+0000","last_clean":"2024-04-26T12:30:49.541970+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:30:49.541970+0000","last_undegraded":"2024-04-26T12:30:49.541970+0000","last_fullsized":"2024-04-26T12:30:49.541970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:10.582606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532264+0000","last_change":"2024-04-26T12:30:12.489089+0000","last_active":"2024-04-26T12:33:21.532264+0000","last_peered":"2024-04-26T12:33:21.532264+0000","last_clean":"2024-04-26T12:33:21.532264+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:33:21.532264+0000","last_undegraded":"2024-04-26T12:33:21.532264+0000","last_fullsized":"2024-04-26T12:33:21.532264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:27.764119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540869+0000","last_change":"2024-04-26T12:30:10.510186+0000","last_active":"2024-04-26T12:30:49.540869+0000","last_peered":"2024-04-26T12:30:49.540869+0000","last_clean":"2024-04-26T12:30:49.540869+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:30:49.540869+0000","last_undegraded":"2024-04-26T12:30:49.540869+0000","last_fullsized":"2024-04-26T12:30:49.540869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:42.962774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539905+0000","last_change":"2024-04-26T12:30:14.494783+0000","last_active":"2024-04-26T12:30:49.539905+0000","last_peered":"2024-04-26T12:30:49.539905+0000","last_clean":"2024-04-26T12:30:49.539905+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:30:49.539905+0000","last_undegraded":"2024-04-26T12:30:49.539905+0000","last_fullsized":"2024-04-26T12:30:49.539905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.720169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513524+0000","last_change":"2024-04-26T12:30:16.512429+0000","last_active":"2024-04-26T12:32:43.513524+0000","last_peered":"2024-04-26T12:32:43.513524+0000","last_clean":"2024-04-26T12:32:43.513524+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:32:43.513524+0000","last_undegraded":"2024-04-26T12:32:43.513524+0000","last_fullsized":"2024-04-26T12:32:43.513524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:08.544396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694012+0000","last_change":"2024-04-26T12:30:18.523480+0000","last_active":"2024-04-26T12:30:49.694012+0000","last_peered":"2024-04-26T12:30:49.694012+0000","last_clean":"2024-04-26T12:30:49.694012+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:30:49.694012+0000","last_undegraded":"2024-04-26T12:30:49.694012+0000","last_fullsized":"2024-04-26T12:30:49.694012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.217886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.584682+0000","last_change":"2024-04-26T12:30:20.530957+0000","last_active":"2024-04-26T12:33:21.584682+0000","last_peered":"2024-04-26T12:33:21.584682+0000","last_clean":"2024-04-26T12:33:21.584682+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:21.584682+0000","last_undegraded":"2024-04-26T12:33:21.584682+0000","last_fullsized":"2024-04-26T12:33:21.584682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:59.026673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532275+0000","last_change":"2024-04-26T12:30:12.489703+0000","last_active":"2024-04-26T12:33:21.532275+0000","last_peered":"2024-04-26T12:33:21.532275+0000","last_clean":"2024-04-26T12:33:21.532275+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:33:21.532275+0000","last_undegraded":"2024-04-26T12:33:21.532275+0000","last_fullsized":"2024-04-26T12:33:21.532275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.458788+0000","last_change":"2024-04-26T12:30:10.524731+0000","last_active":"2024-04-26T12:33:21.458788+0000","last_peered":"2024-04-26T12:33:21.458788+0000","last_clean":"2024-04-26T12:33:21.458788+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:33:21.458788+0000","last_undegraded":"2024-04-26T12:33:21.458788+0000","last_fullsized":"2024-04-26T12:33:21.458788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:06.694451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547176+0000","last_change":"2024-04-26T12:30:14.488779+0000","last_active":"2024-04-26T12:30:49.547176+0000","last_peered":"2024-04-26T12:30:49.547176+0000","last_clean":"2024-04-26T12:30:49.547176+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:30:49.547176+0000","last_undegraded":"2024-04-26T12:30:49.547176+0000","last_fullsized":"2024-04-26T12:30:49.547176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:34.470851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.361600+0000","last_change":"2024-04-26T12:30:16.518549+0000","last_active":"2024-04-26T12:32:19.361600+0000","last_peered":"2024-04-26T12:32:19.361600+0000","last_clean":"2024-04-26T12:32:19.361600+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:32:19.361600+0000","last_undegraded":"2024-04-26T12:32:19.361600+0000","last_fullsized":"2024-04-26T12:32:19.361600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:28.849038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541960+0000","last_change":"2024-04-26T12:30:18.524599+0000","last_active":"2024-04-26T12:30:49.541960+0000","last_peered":"2024-04-26T12:30:49.541960+0000","last_clean":"2024-04-26T12:30:49.541960+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:30:49.541960+0000","last_undegraded":"2024-04-26T12:30:49.541960+0000","last_fullsized":"2024-04-26T12:30:49.541960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:26.643236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548824+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:30:49.548824+0000","last_peered":"2024-04-26T12:30:49.548824+0000","last_clean":"2024-04-26T12:30:49.548824+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:30:49.548824+0000","last_undegraded":"2024-04-26T12:30:49.548824+0000","last_fullsized":"2024-04-26T12:30:49.548824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:11.794456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503846+0000","last_change":"2024-04-26T12:30:12.489639+0000","last_active":"2024-04-26T12:33:21.503846+0000","last_peered":"2024-04-26T12:33:21.503846+0000","last_clean":"2024-04-26T12:33:21.503846+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:33:21.503846+0000","last_undegraded":"2024-04-26T12:33:21.503846+0000","last_fullsized":"2024-04-26T12:33:21.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:16.575048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.181506+0000","last_change":"2024-04-26T12:30:10.499110+0000","last_active":"2024-04-26T12:31:37.181506+0000","last_peered":"2024-04-26T12:31:37.181506+0000","last_clean":"2024-04-26T12:31:37.181506+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:31:37.181506+0000","last_undegraded":"2024-04-26T12:31:37.181506+0000","last_fullsized":"2024-04-26T12:31:37.181506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539490+0000","last_change":"2024-04-26T12:30:14.488627+0000","last_active":"2024-04-26T12:30:49.539490+0000","last_peered":"2024-04-26T12:30:49.539490+0000","last_clean":"2024-04-26T12:30:49.539490+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:30:49.539490+0000","last_undegraded":"2024-04-26T12:30:49.539490+0000","last_fullsized":"2024-04-26T12:30:49.539490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:28.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.384499+0000","last_change":"2024-04-26T12:30:16.515666+0000","last_active":"2024-04-26T12:32:19.384499+0000","last_peered":"2024-04-26T12:32:19.384499+0000","last_clean":"2024-04-26T12:32:19.384499+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:32:19.384499+0000","last_undegraded":"2024-04-26T12:32:19.384499+0000","last_fullsized":"2024-04-26T12:32:19.384499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:54.930500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543436+0000","last_change":"2024-04-26T12:30:18.524792+0000","last_active":"2024-04-26T12:30:49.543436+0000","last_peered":"2024-04-26T12:30:49.543436+0000","last_clean":"2024-04-26T12:30:49.543436+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:30:49.543436+0000","last_undegraded":"2024-04-26T12:30:49.543436+0000","last_fullsized":"2024-04-26T12:30:49.543436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:45.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.394040+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:19.394040+0000","last_peered":"2024-04-26T12:32:19.394040+0000","last_clean":"2024-04-26T12:32:19.394040+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:19.394040+0000","last_undegraded":"2024-04-26T12:32:19.394040+0000","last_fullsized":"2024-04-26T12:32:19.394040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:13.513806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971456+0000","last_change":"2024-04-26T12:30:12.482428+0000","last_active":"2024-04-26T12:31:36.971456+0000","last_peered":"2024-04-26T12:31:36.971456+0000","last_clean":"2024-04-26T12:31:36.971456+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:31:36.971456+0000","last_undegraded":"2024-04-26T12:31:36.971456+0000","last_fullsized":"2024-04-26T12:31:36.971456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.258549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544532+0000","last_change":"2024-04-26T12:30:10.515261+0000","last_active":"2024-04-26T12:30:49.544532+0000","last_peered":"2024-04-26T12:30:49.544532+0000","last_clean":"2024-04-26T12:30:49.544532+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:30:49.544532+0000","last_undegraded":"2024-04-26T12:30:49.544532+0000","last_fullsized":"2024-04-26T12:30:49.544532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:36.842504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.069122+0000","last_change":"2024-04-26T12:30:14.488530+0000","last_active":"2024-04-26T12:32:18.069122+0000","last_peered":"2024-04-26T12:32:18.069122+0000","last_clean":"2024-04-26T12:32:18.069122+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:32:18.069122+0000","last_undegraded":"2024-04-26T12:32:18.069122+0000","last_fullsized":"2024-04-26T12:32:18.069122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:22.546676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.894295+0000","last_change":"2024-04-26T12:30:16.516514+0000","last_active":"2024-04-26T12:33:20.894295+0000","last_peered":"2024-04-26T12:33:20.894295+0000","last_clean":"2024-04-26T12:33:20.894295+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:20.894295+0000","last_undegraded":"2024-04-26T12:33:20.894295+0000","last_fullsized":"2024-04-26T12:33:20.894295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:03.784951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695165+0000","last_change":"2024-04-26T12:30:18.526314+0000","last_active":"2024-04-26T12:30:49.695165+0000","last_peered":"2024-04-26T12:30:49.695165+0000","last_clean":"2024-04-26T12:30:49.695165+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:30:49.695165+0000","last_undegraded":"2024-04-26T12:30:49.695165+0000","last_fullsized":"2024-04-26T12:30:49.695165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:18.995256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.873981+0000","last_change":"2024-04-26T12:30:20.523635+0000","last_active":"2024-04-26T12:32:20.873981+0000","last_peered":"2024-04-26T12:32:20.873981+0000","last_clean":"2024-04-26T12:32:20.873981+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:32:20.873981+0000","last_undegraded":"2024-04-26T12:32:20.873981+0000","last_fullsized":"2024-04-26T12:32:20.873981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.904423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463404+0000","last_change":"2024-04-26T12:30:12.499038+0000","last_active":"2024-04-26T12:33:21.463404+0000","last_peered":"2024-04-26T12:33:21.463404+0000","last_clean":"2024-04-26T12:33:21.463404+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:21.463404+0000","last_undegraded":"2024-04-26T12:33:21.463404+0000","last_fullsized":"2024-04-26T12:33:21.463404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:46.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543304+0000","last_change":"2024-04-26T12:30:10.508462+0000","last_active":"2024-04-26T12:30:49.543304+0000","last_peered":"2024-04-26T12:30:49.543304+0000","last_clean":"2024-04-26T12:30:49.543304+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:30:49.543304+0000","last_undegraded":"2024-04-26T12:30:49.543304+0000","last_fullsized":"2024-04-26T12:30:49.543304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503030+0000","last_change":"2024-04-26T12:30:12.488793+0000","last_active":"2024-04-26T12:33:21.503030+0000","last_peered":"2024-04-26T12:33:21.503030+0000","last_clean":"2024-04-26T12:33:21.503030+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:33:21.503030+0000","last_undegraded":"2024-04-26T12:33:21.503030+0000","last_fullsized":"2024-04-26T12:33:21.503030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497835+0000","last_change":"2024-04-26T12:30:10.488944+0000","last_active":"2024-04-26T12:32:17.497835+0000","last_peered":"2024-04-26T12:32:17.497835+0000","last_clean":"2024-04-26T12:32:17.497835+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:32:17.497835+0000","last_undegraded":"2024-04-26T12:32:17.497835+0000","last_fullsized":"2024-04-26T12:32:17.497835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503142+0000","last_change":"2024-04-26T12:30:12.491523+0000","last_active":"2024-04-26T12:33:21.503142+0000","last_peered":"2024-04-26T12:33:21.503142+0000","last_clean":"2024-04-26T12:33:21.503142+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:33:21.503142+0000","last_undegraded":"2024-04-26T12:33:21.503142+0000","last_fullsized":"2024-04-26T12:33:21.503142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:49.059427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.784734+0000","last_change":"2024-04-26T12:30:10.515892+0000","last_active":"2024-04-26T12:32:20.784734+0000","last_peered":"2024-04-26T12:32:20.784734+0000","last_clean":"2024-04-26T12:32:20.784734+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:32:20.784734+0000","last_undegraded":"2024-04-26T12:32:20.784734+0000","last_fullsized":"2024-04-26T12:32:20.784734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:32.895105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531862+0000","last_change":"2024-04-26T12:30:12.491568+0000","last_active":"2024-04-26T12:33:21.531862+0000","last_peered":"2024-04-26T12:33:21.531862+0000","last_clean":"2024-04-26T12:33:21.531862+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:33:21.531862+0000","last_undegraded":"2024-04-26T12:33:21.531862+0000","last_fullsized":"2024-04-26T12:33:21.531862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696298+0000","last_change":"2024-04-26T12:30:10.498184+0000","last_active":"2024-04-26T12:30:49.696298+0000","last_peered":"2024-04-26T12:30:49.696298+0000","last_clean":"2024-04-26T12:30:49.696298+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:30:49.696298+0000","last_undegraded":"2024-04-26T12:30:49.696298+0000","last_fullsized":"2024-04-26T12:30:49.696298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335403+0000","last_change":"2024-04-26T12:30:12.477969+0000","last_active":"2024-04-26T12:33:21.335403+0000","last_peered":"2024-04-26T12:33:21.335403+0000","last_clean":"2024-04-26T12:33:21.335403+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:33:21.335403+0000","last_undegraded":"2024-04-26T12:33:21.335403+0000","last_fullsized":"2024-04-26T12:33:21.335403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696689+0000","last_change":"2024-04-26T12:30:10.505910+0000","last_active":"2024-04-26T12:30:49.696689+0000","last_peered":"2024-04-26T12:30:49.696689+0000","last_clean":"2024-04-26T12:30:49.696689+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:30:49.696689+0000","last_undegraded":"2024-04-26T12:30:49.696689+0000","last_fullsized":"2024-04-26T12:30:49.696689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245421+0000","last_change":"2024-04-26T12:30:12.497999+0000","last_active":"2024-04-26T12:33:21.245421+0000","last_peered":"2024-04-26T12:33:21.245421+0000","last_clean":"2024-04-26T12:33:21.245421+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:21.245421+0000","last_undegraded":"2024-04-26T12:33:21.245421+0000","last_fullsized":"2024-04-26T12:33:21.245421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:08.184825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545212+0000","last_change":"2024-04-26T12:30:10.507425+0000","last_active":"2024-04-26T12:30:49.545212+0000","last_peered":"2024-04-26T12:30:49.545212+0000","last_clean":"2024-04-26T12:30:49.545212+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:30:49.545212+0000","last_undegraded":"2024-04-26T12:30:49.545212+0000","last_fullsized":"2024-04-26T12:30:49.545212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:04.930580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184617+0000","last_change":"2024-04-26T12:30:12.496187+0000","last_active":"2024-04-26T12:30:55.184617+0000","last_peered":"2024-04-26T12:30:55.184617+0000","last_clean":"2024-04-26T12:30:55.184617+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:30:55.184617+0000","last_undegraded":"2024-04-26T12:30:55.184617+0000","last_fullsized":"2024-04-26T12:30:55.184617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546373+0000","last_change":"2024-04-26T12:30:10.504572+0000","last_active":"2024-04-26T12:30:49.546373+0000","last_peered":"2024-04-26T12:30:49.546373+0000","last_clean":"2024-04-26T12:30:49.546373+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:30:49.546373+0000","last_undegraded":"2024-04-26T12:30:49.546373+0000","last_fullsized":"2024-04-26T12:30:49.546373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335198+0000","last_change":"2024-04-26T12:30:12.495561+0000","last_active":"2024-04-26T12:33:21.335198+0000","last_peered":"2024-04-26T12:33:21.335198+0000","last_clean":"2024-04-26T12:33:21.335198+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:33:21.335198+0000","last_undegraded":"2024-04-26T12:33:21.335198+0000","last_fullsized":"2024-04-26T12:33:21.335198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:31.568494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498730+0000","last_change":"2024-04-26T12:30:10.498578+0000","last_active":"2024-04-26T12:32:22.498730+0000","last_peered":"2024-04-26T12:32:22.498730+0000","last_clean":"2024-04-26T12:32:22.498730+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:32:22.498730+0000","last_undegraded":"2024-04-26T12:32:22.498730+0000","last_fullsized":"2024-04-26T12:32:22.498730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:34.399017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503186+0000","last_change":"2024-04-26T12:30:12.496215+0000","last_active":"2024-04-26T12:33:21.503186+0000","last_peered":"2024-04-26T12:33:21.503186+0000","last_clean":"2024-04-26T12:33:21.503186+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:33:21.503186+0000","last_undegraded":"2024-04-26T12:33:21.503186+0000","last_fullsized":"2024-04-26T12:33:21.503186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:43.456916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543053+0000","last_change":"2024-04-26T12:30:10.521412+0000","last_active":"2024-04-26T12:30:49.543053+0000","last_peered":"2024-04-26T12:30:49.543053+0000","last_clean":"2024-04-26T12:30:49.543053+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:30:49.543053+0000","last_undegraded":"2024-04-26T12:30:49.543053+0000","last_fullsized":"2024-04-26T12:30:49.543053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:08.525460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538192+0000","last_change":"2024-04-26T12:30:12.493682+0000","last_active":"2024-04-26T12:33:21.538192+0000","last_peered":"2024-04-26T12:33:21.538192+0000","last_clean":"2024-04-26T12:33:21.538192+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:33:21.538192+0000","last_undegraded":"2024-04-26T12:33:21.538192+0000","last_fullsized":"2024-04-26T12:33:21.538192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.073143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599042+0000","last_change":"2024-04-26T12:30:10.498422+0000","last_active":"2024-04-26T12:30:53.599042+0000","last_peered":"2024-04-26T12:30:53.599042+0000","last_clean":"2024-04-26T12:30:53.599042+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:30:53.599042+0000","last_undegraded":"2024-04-26T12:30:53.599042+0000","last_fullsized":"2024-04-26T12:30:53.599042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502775+0000","last_change":"2024-04-26T12:30:12.484594+0000","last_active":"2024-04-26T12:33:21.502775+0000","last_peered":"2024-04-26T12:33:21.502775+0000","last_clean":"2024-04-26T12:33:21.502775+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:33:21.502775+0000","last_undegraded":"2024-04-26T12:33:21.502775+0000","last_fullsized":"2024-04-26T12:33:21.502775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:38.153666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540357+0000","last_change":"2024-04-26T12:30:10.514358+0000","last_active":"2024-04-26T12:30:49.540357+0000","last_peered":"2024-04-26T12:30:49.540357+0000","last_clean":"2024-04-26T12:30:49.540357+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:30:49.540357+0000","last_undegraded":"2024-04-26T12:30:49.540357+0000","last_fullsized":"2024-04-26T12:30:49.540357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:45.443501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531987+0000","last_change":"2024-04-26T12:30:12.496055+0000","last_active":"2024-04-26T12:33:21.531987+0000","last_peered":"2024-04-26T12:33:21.531987+0000","last_clean":"2024-04-26T12:33:21.531987+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:33:21.531987+0000","last_undegraded":"2024-04-26T12:33:21.531987+0000","last_fullsized":"2024-04-26T12:33:21.531987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:19.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599086+0000","last_change":"2024-04-26T12:30:10.507296+0000","last_active":"2024-04-26T12:30:53.599086+0000","last_peered":"2024-04-26T12:30:53.599086+0000","last_clean":"2024-04-26T12:30:53.599086+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:30:53.599086+0000","last_undegraded":"2024-04-26T12:30:53.599086+0000","last_fullsized":"2024-04-26T12:30:53.599086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:46.489435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246626+0000","last_change":"2024-04-26T12:30:12.494305+0000","last_active":"2024-04-26T12:33:21.246626+0000","last_peered":"2024-04-26T12:33:21.246626+0000","last_clean":"2024-04-26T12:33:21.246626+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:33:21.246626+0000","last_undegraded":"2024-04-26T12:33:21.246626+0000","last_fullsized":"2024-04-26T12:33:21.246626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:08.704032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547543+0000","last_change":"2024-04-26T12:30:10.523912+0000","last_active":"2024-04-26T12:30:49.547543+0000","last_peered":"2024-04-26T12:30:49.547543+0000","last_clean":"2024-04-26T12:30:49.547543+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:30:49.547543+0000","last_undegraded":"2024-04-26T12:30:49.547543+0000","last_fullsized":"2024-04-26T12:30:49.547543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:29.542497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510934+0000","last_change":"2024-04-26T12:30:12.497891+0000","last_active":"2024-04-26T12:32:28.510934+0000","last_peered":"2024-04-26T12:32:28.510934+0000","last_clean":"2024-04-26T12:32:28.510934+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:32:28.510934+0000","last_undegraded":"2024-04-26T12:32:28.510934+0000","last_fullsized":"2024-04-26T12:32:28.510934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:40.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.830958+0000","last_change":"2024-04-26T12:30:10.523924+0000","last_active":"2024-04-26T12:32:20.830958+0000","last_peered":"2024-04-26T12:32:20.830958+0000","last_clean":"2024-04-26T12:32:20.830958+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:32:20.830958+0000","last_undegraded":"2024-04-26T12:32:20.830958+0000","last_fullsized":"2024-04-26T12:32:20.830958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:59.395818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543474+0000","last_change":"2024-04-26T12:30:12.498180+0000","last_active":"2024-04-26T12:30:49.543474+0000","last_peered":"2024-04-26T12:30:49.543474+0000","last_clean":"2024-04-26T12:30:49.543474+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:30:49.543474+0000","last_undegraded":"2024-04-26T12:30:49.543474+0000","last_fullsized":"2024-04-26T12:30:49.543474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.633561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549751+0000","last_change":"2024-04-26T12:30:10.501961+0000","last_active":"2024-04-26T12:30:49.549751+0000","last_peered":"2024-04-26T12:30:49.549751+0000","last_clean":"2024-04-26T12:30:49.549751+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:30:49.549751+0000","last_undegraded":"2024-04-26T12:30:49.549751+0000","last_fullsized":"2024-04-26T12:30:49.549751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.244728+0000","last_change":"2024-04-26T12:30:12.493588+0000","last_active":"2024-04-26T12:33:21.244728+0000","last_peered":"2024-04-26T12:33:21.244728+0000","last_clean":"2024-04-26T12:33:21.244728+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:33:21.244728+0000","last_undegraded":"2024-04-26T12:33:21.244728+0000","last_fullsized":"2024-04-26T12:33:21.244728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:20.498299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549200+0000","last_change":"2024-04-26T12:30:10.513455+0000","last_active":"2024-04-26T12:30:49.549200+0000","last_peered":"2024-04-26T12:30:49.549200+0000","last_clean":"2024-04-26T12:30:49.549200+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:30:49.549200+0000","last_undegraded":"2024-04-26T12:30:49.549200+0000","last_fullsized":"2024-04-26T12:30:49.549200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:32.904261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.450276+0000","last_change":"2024-04-26T12:30:10.520879+0000","last_active":"2024-04-26T12:33:21.450276+0000","last_peered":"2024-04-26T12:33:21.450276+0000","last_clean":"2024-04-26T12:33:21.450276+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:33:21.450276+0000","last_undegraded":"2024-04-26T12:33:21.450276+0000","last_fullsized":"2024-04-26T12:33:21.450276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:22.136008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531885+0000","last_change":"2024-04-26T12:30:12.500495+0000","last_active":"2024-04-26T12:33:21.531885+0000","last_peered":"2024-04-26T12:33:21.531885+0000","last_clean":"2024-04-26T12:33:21.531885+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:21.531885+0000","last_undegraded":"2024-04-26T12:33:21.531885+0000","last_fullsized":"2024-04-26T12:33:21.531885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.554347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694784+0000","last_change":"2024-04-26T12:30:10.505951+0000","last_active":"2024-04-26T12:30:49.694784+0000","last_peered":"2024-04-26T12:30:49.694784+0000","last_clean":"2024-04-26T12:30:49.694784+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:30:49.694784+0000","last_undegraded":"2024-04-26T12:30:49.694784+0000","last_fullsized":"2024-04-26T12:30:49.694784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341621+0000","last_change":"2024-04-26T12:30:12.498902+0000","last_active":"2024-04-26T12:33:21.341621+0000","last_peered":"2024-04-26T12:33:21.341621+0000","last_clean":"2024-04-26T12:33:21.341621+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:21.341621+0000","last_undegraded":"2024-04-26T12:33:21.341621+0000","last_fullsized":"2024-04-26T12:33:21.341621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:34.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35872,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335968,"statfs":{"total":96636764160,"available":96600031232,"internally_reserved":0,"allocated":9068544,"data_stored":8752596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":9408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":9633792,"data_stored":9342879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48320,"kb_used_data":8824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323520,"statfs":{"total":96636764160,"available":96587284480,"internally_reserved":0,"allocated":9035776,"data_stored":8750874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:33:28.902 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:33:28.903 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f537ec8c640 1 Processor -- start 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f537ec8c640 1 -- start start 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f537ec8c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53781280d0 0x7f53781284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f537ec8c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537806b3f0 con 0x7f537812b180 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f537ec8c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5378127c80 con 0x7f53781280d0 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f537ca28640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53781280d0 0x7f53781284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f5377fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f537812b180 0x7f537812b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43212/0 (socket says 172.21.15.132:43212) 2024-04-26T12:33:29.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.028+0000 7f5377fff640 1 -- 172.21.15.132:0/1987702435 learned_addr learned my addr 172.21.15.132:0/1987702435 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:29.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.029+0000 7f537ca28640 1 -- 172.21.15.132:0/1987702435 >> v1:172.21.15.132:6789/0 conn(0x7f537812b180 legacy=0x7f537812b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.029+0000 7f537ca28640 1 -- 172.21.15.132:0/1987702435 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537806ef00 con 0x7f53781280d0 2024-04-26T12:33:29.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.029+0000 7f537ca28640 1 --2- 172.21.15.132:0/1987702435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f53781284b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f536c009720 tx=0x7f536c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1af54c315121369 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:29.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.029+0000 7f53777fe640 1 -- 172.21.15.132:0/1987702435 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f536c0316d0 con 0x7f53781280d0 2024-04-26T12:33:29.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.029+0000 7f53777fe640 1 -- 172.21.15.132:0/1987702435 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c037070 con 0x7f53781280d0 2024-04-26T12:33:29.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.029+0000 7f53777fe640 1 -- 172.21.15.132:0/1987702435 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f536c0319c0 con 0x7f53781280d0 2024-04-26T12:33:29.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.030+0000 7f537ec8c640 1 -- 172.21.15.132:0/1987702435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 msgr2=0x7f53781284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.030+0000 7f537ec8c640 1 --2- 172.21.15.132:0/1987702435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f53781284b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f536c009720 tx=0x7f536c02b840 comp rx=0 tx=0).stop 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.030+0000 7f537ec8c640 1 -- 172.21.15.132:0/1987702435 shutdown_connections 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.030+0000 7f537ec8c640 1 --2- 172.21.15.132:0/1987702435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f53781284b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.030+0000 7f537ec8c640 1 -- 172.21.15.132:0/1987702435 >> 172.21.15.132:0/1987702435 conn(0x7f537809b7b0 msgr2=0x7f537809bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.030+0000 7f537ec8c640 1 -- 172.21.15.132:0/1987702435 shutdown_connections 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.030+0000 7f537ec8c640 1 -- 172.21.15.132:0/1987702435 wait complete. 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.031+0000 7f537ec8c640 1 Processor -- start 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.031+0000 7f537ec8c640 1 -- start start 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.031+0000 7f537ec8c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f5378123d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.031+0000 7f537ec8c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f537808d030 con 0x7f53781280d0 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.031+0000 7f537ca28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f5378123d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:29.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.031+0000 7f537ca28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f5378123d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47356/0 (socket says 172.21.15.132:47356) 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.031+0000 7f537ca28640 1 -- 172.21.15.132:0/3203932344 learned_addr learned my addr 172.21.15.132:0/3203932344 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.032+0000 7f537ca28640 1 -- 172.21.15.132:0/3203932344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537806f670 con 0x7f53781280d0 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.032+0000 7f537ca28640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f5378123d00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f536c034040 tx=0x7f536c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.032+0000 7f53757fa640 1 -- 172.21.15.132:0/3203932344 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f536c032770 con 0x7f53781280d0 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.032+0000 7f53757fa640 1 -- 172.21.15.132:0/3203932344 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c032910 con 0x7f53781280d0 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.032+0000 7f53757fa640 1 -- 172.21.15.132:0/3203932344 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f536c032bf0 con 0x7f53781280d0 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.032+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537808dfc0 con 0x7f53781280d0 2024-04-26T12:33:29.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.032+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5378099ef0 con 0x7f53781280d0 2024-04-26T12:33:29.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.033+0000 7f53757fa640 1 -- 172.21.15.132:0/3203932344 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f536c04c060 con 0x7f53781280d0 2024-04-26T12:33:29.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.033+0000 7f53757fa640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f535c038060 0x7f535c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:29.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.033+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5378062ed0 con 0x7f53781280d0 2024-04-26T12:33:29.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.033+0000 7f53757fa640 1 -- 172.21.15.132:0/3203932344 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f536c02f050 con 0x7f53781280d0 2024-04-26T12:33:29.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.034+0000 7f5377fff640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f535c038060 0x7f535c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:29.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.034+0000 7f5377fff640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f535c038060 0x7f535c03a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5364000f60 tx=0x7f5364007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:29.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.038+0000 7f53757fa640 1 -- 172.21.15.132:0/3203932344 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f536c040070 con 0x7f53781280d0 2024-04-26T12:33:29.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.206+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5378125320 con 0x7f535c038060 2024-04-26T12:33:29.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.222+0000 7f53757fa640 1 -- 172.21.15.132:0/3203932344 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665923 (secure 0 0 0) 0x7f53640058b0 con 0x7f535c038060 2024-04-26T12:33:29.230 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:33:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:33:29.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f535c038060 msgr2=0x7f535c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f535c038060 0x7f535c03a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5364000f60 tx=0x7f5364007a80 comp rx=0 tx=0).stop 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 msgr2=0x7f5378123d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f5378123d00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f536c034040 tx=0x7f536c0046c0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 shutdown_connections 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f535c038060 0x7f535c03a520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 --2- 172.21.15.132:0/3203932344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53781280d0 0x7f5378123d00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 >> 172.21.15.132:0/3203932344 conn(0x7f537809b7b0 msgr2=0x7f53781b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 shutdown_connections 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.227+0000 7f537ec8c640 1 -- 172.21.15.132:0/3203932344 wait complete. 2024-04-26T12:33:29.239 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-26T12:33:28.487118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4879,"num_read_kb":4456,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":157008,"kb_used_data":36464,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377330352,"statfs":{"total":386547056640,"available":386386280448,"internally_reserved":0,"allocated":37339136,"data_stored":36186180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003882"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548520+0000","last_change":"2024-04-26T12:30:10.508974+0000","last_active":"2024-04-26T12:30:49.548520+0000","last_peered":"2024-04-26T12:30:49.548520+0000","last_clean":"2024-04-26T12:30:49.548520+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:30:49.548520+0000","last_undegraded":"2024-04-26T12:30:49.548520+0000","last_fullsized":"2024-04-26T12:30:49.548520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540674+0000","last_change":"2024-04-26T12:30:12.499017+0000","last_active":"2024-04-26T12:30:49.540674+0000","last_peered":"2024-04-26T12:30:49.540674+0000","last_clean":"2024-04-26T12:30:49.540674+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:30:49.540674+0000","last_undegraded":"2024-04-26T12:30:49.540674+0000","last_fullsized":"2024-04-26T12:30:49.540674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:04.180301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599043+0000","last_change":"2024-04-26T12:30:10.489909+0000","last_active":"2024-04-26T12:30:53.599043+0000","last_peered":"2024-04-26T12:30:53.599043+0000","last_clean":"2024-04-26T12:30:53.599043+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:30:53.599043+0000","last_undegraded":"2024-04-26T12:30:53.599043+0000","last_fullsized":"2024-04-26T12:30:53.599043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'17","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470254+0000","last_change":"2024-04-26T12:30:12.484427+0000","last_active":"2024-04-26T12:33:21.470254+0000","last_peered":"2024-04-26T12:33:21.470254+0000","last_clean":"2024-04-26T12:33:21.470254+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:33:21.470254+0000","last_undegraded":"2024-04-26T12:33:21.470254+0000","last_fullsized":"2024-04-26T12:33:21.470254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:44.161301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.447466+0000","last_change":"2024-04-26T12:30:10.524821+0000","last_active":"2024-04-26T12:33:21.447466+0000","last_peered":"2024-04-26T12:33:21.447466+0000","last_clean":"2024-04-26T12:33:21.447466+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:33:21.447466+0000","last_undegraded":"2024-04-26T12:33:21.447466+0000","last_fullsized":"2024-04-26T12:33:21.447466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:32.006623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246297+0000","last_change":"2024-04-26T12:30:12.493540+0000","last_active":"2024-04-26T12:33:21.246297+0000","last_peered":"2024-04-26T12:33:21.246297+0000","last_clean":"2024-04-26T12:33:21.246297+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:33:21.246297+0000","last_undegraded":"2024-04-26T12:33:21.246297+0000","last_fullsized":"2024-04-26T12:33:21.246297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:40.024999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543651+0000","last_change":"2024-04-26T12:30:10.501461+0000","last_active":"2024-04-26T12:30:49.543651+0000","last_peered":"2024-04-26T12:30:49.543651+0000","last_clean":"2024-04-26T12:30:49.543651+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:30:49.543651+0000","last_undegraded":"2024-04-26T12:30:49.543651+0000","last_fullsized":"2024-04-26T12:30:49.543651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.740937+0000","last_change":"2024-04-26T12:30:12.489894+0000","last_active":"2024-04-26T12:30:54.740937+0000","last_peered":"2024-04-26T12:30:54.740937+0000","last_clean":"2024-04-26T12:30:54.740937+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:30:54.740937+0000","last_undegraded":"2024-04-26T12:30:54.740937+0000","last_fullsized":"2024-04-26T12:30:54.740937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:10.496671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544940+0000","last_change":"2024-04-26T12:30:10.521268+0000","last_active":"2024-04-26T12:30:49.544940+0000","last_peered":"2024-04-26T12:30:49.544940+0000","last_clean":"2024-04-26T12:30:49.544940+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:30:49.544940+0000","last_undegraded":"2024-04-26T12:30:49.544940+0000","last_fullsized":"2024-04-26T12:30:49.544940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:47.412681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532137+0000","last_change":"2024-04-26T12:30:12.497804+0000","last_active":"2024-04-26T12:33:21.532137+0000","last_peered":"2024-04-26T12:33:21.532137+0000","last_clean":"2024-04-26T12:33:21.532137+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:33:21.532137+0000","last_undegraded":"2024-04-26T12:33:21.532137+0000","last_fullsized":"2024-04-26T12:33:21.532137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:34.016204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547675+0000","last_change":"2024-04-26T12:30:10.505875+0000","last_active":"2024-04-26T12:30:49.547675+0000","last_peered":"2024-04-26T12:30:49.547675+0000","last_clean":"2024-04-26T12:30:49.547675+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:30:49.547675+0000","last_undegraded":"2024-04-26T12:30:49.547675+0000","last_fullsized":"2024-04-26T12:30:49.547675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531924+0000","last_change":"2024-04-26T12:30:49.554267+0000","last_active":"2024-04-26T12:33:21.531924+0000","last_peered":"2024-04-26T12:33:21.531924+0000","last_clean":"2024-04-26T12:33:21.531924+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:33:21.531924+0000","last_undegraded":"2024-04-26T12:33:21.531924+0000","last_fullsized":"2024-04-26T12:33:21.531924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:32.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513928+0000","last_change":"2024-04-26T12:30:10.519048+0000","last_active":"2024-04-26T12:32:43.513928+0000","last_peered":"2024-04-26T12:32:43.513928+0000","last_clean":"2024-04-26T12:32:43.513928+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:32:43.513928+0000","last_undegraded":"2024-04-26T12:32:43.513928+0000","last_fullsized":"2024-04-26T12:32:43.513928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:28.446368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675537+0000","last_change":"2024-04-26T12:30:12.491137+0000","last_active":"2024-04-26T12:32:17.675537+0000","last_peered":"2024-04-26T12:32:17.675537+0000","last_clean":"2024-04-26T12:32:17.675537+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:32:17.675537+0000","last_undegraded":"2024-04-26T12:32:17.675537+0000","last_fullsized":"2024-04-26T12:32:17.675537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694288+0000","last_change":"2024-04-26T12:30:10.505714+0000","last_active":"2024-04-26T12:30:49.694288+0000","last_peered":"2024-04-26T12:30:49.694288+0000","last_clean":"2024-04-26T12:30:49.694288+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:30:49.694288+0000","last_undegraded":"2024-04-26T12:30:49.694288+0000","last_fullsized":"2024-04-26T12:30:49.694288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463709+0000","last_change":"2024-04-26T12:30:12.483230+0000","last_active":"2024-04-26T12:33:21.463709+0000","last_peered":"2024-04-26T12:33:21.463709+0000","last_clean":"2024-04-26T12:33:21.463709+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:21.463709+0000","last_undegraded":"2024-04-26T12:33:21.463709+0000","last_fullsized":"2024-04-26T12:33:21.463709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463505+0000","last_change":"2024-04-26T12:30:12.480460+0000","last_active":"2024-04-26T12:33:21.463505+0000","last_peered":"2024-04-26T12:33:21.463505+0000","last_clean":"2024-04-26T12:33:21.463505+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:33:21.463505+0000","last_undegraded":"2024-04-26T12:33:21.463505+0000","last_fullsized":"2024-04-26T12:33:21.463505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:34.798040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544770+0000","last_change":"2024-04-26T12:30:10.514263+0000","last_active":"2024-04-26T12:30:49.544770+0000","last_peered":"2024-04-26T12:30:49.544770+0000","last_clean":"2024-04-26T12:30:49.544770+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:30:49.544770+0000","last_undegraded":"2024-04-26T12:30:49.544770+0000","last_fullsized":"2024-04-26T12:30:49.544770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:17.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341367+0000","last_change":"2024-04-26T12:30:12.498685+0000","last_active":"2024-04-26T12:33:21.341367+0000","last_peered":"2024-04-26T12:33:21.341367+0000","last_clean":"2024-04-26T12:33:21.341367+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:21.341367+0000","last_undegraded":"2024-04-26T12:33:21.341367+0000","last_fullsized":"2024-04-26T12:33:21.341367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:28.769117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549354+0000","last_change":"2024-04-26T12:30:10.503403+0000","last_active":"2024-04-26T12:30:49.549354+0000","last_peered":"2024-04-26T12:30:49.549354+0000","last_clean":"2024-04-26T12:30:49.549354+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:30:49.549354+0000","last_undegraded":"2024-04-26T12:30:49.549354+0000","last_fullsized":"2024-04-26T12:30:49.549354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531887+0000","last_change":"2024-04-26T12:30:12.497749+0000","last_active":"2024-04-26T12:33:21.531887+0000","last_peered":"2024-04-26T12:33:21.531887+0000","last_clean":"2024-04-26T12:33:21.531887+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:33:21.531887+0000","last_undegraded":"2024-04-26T12:33:21.531887+0000","last_fullsized":"2024-04-26T12:33:21.531887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:16.569333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545533+0000","last_change":"2024-04-26T12:30:10.514510+0000","last_active":"2024-04-26T12:30:49.545533+0000","last_peered":"2024-04-26T12:30:49.545533+0000","last_clean":"2024-04-26T12:30:49.545533+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:30:49.545533+0000","last_undegraded":"2024-04-26T12:30:49.545533+0000","last_fullsized":"2024-04-26T12:30:49.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:19.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463231+0000","last_change":"2024-04-26T12:30:12.482516+0000","last_active":"2024-04-26T12:33:21.463231+0000","last_peered":"2024-04-26T12:33:21.463231+0000","last_clean":"2024-04-26T12:33:21.463231+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:33:21.463231+0000","last_undegraded":"2024-04-26T12:33:21.463231+0000","last_fullsized":"2024-04-26T12:33:21.463231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.209436+0000","last_change":"2024-04-26T12:30:10.513694+0000","last_active":"2024-04-26T12:33:21.209436+0000","last_peered":"2024-04-26T12:33:21.209436+0000","last_clean":"2024-04-26T12:33:21.209436+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:33:21.209436+0000","last_undegraded":"2024-04-26T12:33:21.209436+0000","last_fullsized":"2024-04-26T12:33:21.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:54.580399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505184+0000","last_change":"2024-04-26T12:30:12.484509+0000","last_active":"2024-04-26T12:32:37.505184+0000","last_peered":"2024-04-26T12:32:37.505184+0000","last_clean":"2024-04-26T12:32:37.505184+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:32:37.505184+0000","last_undegraded":"2024-04-26T12:32:37.505184+0000","last_fullsized":"2024-04-26T12:32:37.505184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.453057+0000","last_change":"2024-04-26T12:30:10.499600+0000","last_active":"2024-04-26T12:33:21.453057+0000","last_peered":"2024-04-26T12:33:21.453057+0000","last_clean":"2024-04-26T12:33:21.453057+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:33:21.453057+0000","last_undegraded":"2024-04-26T12:33:21.453057+0000","last_fullsized":"2024-04-26T12:33:21.453057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470960+0000","last_change":"2024-04-26T12:30:12.496161+0000","last_active":"2024-04-26T12:30:54.470960+0000","last_peered":"2024-04-26T12:30:54.470960+0000","last_clean":"2024-04-26T12:30:54.470960+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:30:54.470960+0000","last_undegraded":"2024-04-26T12:30:54.470960+0000","last_fullsized":"2024-04-26T12:30:54.470960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:32.006910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512341+0000","last_change":"2024-04-26T12:30:10.516884+0000","last_active":"2024-04-26T12:32:33.512341+0000","last_peered":"2024-04-26T12:32:33.512341+0000","last_clean":"2024-04-26T12:32:33.512341+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:32:33.512341+0000","last_undegraded":"2024-04-26T12:32:33.512341+0000","last_fullsized":"2024-04-26T12:32:33.512341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:01.370198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.484967+0000","last_change":"2024-04-26T12:30:20.535283+0000","last_active":"2024-04-26T12:33:21.484967+0000","last_peered":"2024-04-26T12:33:21.484967+0000","last_clean":"2024-04-26T12:33:21.484967+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:33:21.484967+0000","last_undegraded":"2024-04-26T12:33:21.484967+0000","last_fullsized":"2024-04-26T12:33:21.484967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:17.265170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971392+0000","last_change":"2024-04-26T12:30:12.490640+0000","last_active":"2024-04-26T12:31:36.971392+0000","last_peered":"2024-04-26T12:31:36.971392+0000","last_clean":"2024-04-26T12:31:36.971392+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:31:36.971392+0000","last_undegraded":"2024-04-26T12:31:36.971392+0000","last_fullsized":"2024-04-26T12:31:36.971392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:17.780262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544525+0000","last_change":"2024-04-26T12:30:10.524372+0000","last_active":"2024-04-26T12:30:49.544525+0000","last_peered":"2024-04-26T12:30:49.544525+0000","last_clean":"2024-04-26T12:30:49.544525+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:30:49.544525+0000","last_undegraded":"2024-04-26T12:30:49.544525+0000","last_fullsized":"2024-04-26T12:30:49.544525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:24.047246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550199+0000","last_change":"2024-04-26T12:30:14.491887+0000","last_active":"2024-04-26T12:30:49.550199+0000","last_peered":"2024-04-26T12:30:49.550199+0000","last_clean":"2024-04-26T12:30:49.550199+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:30:49.550199+0000","last_undegraded":"2024-04-26T12:30:49.550199+0000","last_fullsized":"2024-04-26T12:30:49.550199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:51.835729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.377483+0000","last_change":"2024-04-26T12:30:16.517097+0000","last_active":"2024-04-26T12:32:19.377483+0000","last_peered":"2024-04-26T12:32:19.377483+0000","last_clean":"2024-04-26T12:32:19.377483+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:32:19.377483+0000","last_undegraded":"2024-04-26T12:32:19.377483+0000","last_fullsized":"2024-04-26T12:32:19.377483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:39.359708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542379+0000","last_change":"2024-04-26T12:30:18.527594+0000","last_active":"2024-04-26T12:30:49.542379+0000","last_peered":"2024-04-26T12:30:49.542379+0000","last_clean":"2024-04-26T12:30:49.542379+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:30:49.542379+0000","last_undegraded":"2024-04-26T12:30:49.542379+0000","last_fullsized":"2024-04-26T12:30:49.542379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:00.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.976923+0000","last_change":"2024-04-26T12:30:20.530528+0000","last_active":"2024-04-26T12:31:36.976923+0000","last_peered":"2024-04-26T12:31:36.976923+0000","last_clean":"2024-04-26T12:31:36.976923+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:31:36.976923+0000","last_undegraded":"2024-04-26T12:31:36.976923+0000","last_fullsized":"2024-04-26T12:31:36.976923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.750584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531970+0000","last_change":"2024-04-26T12:30:12.491732+0000","last_active":"2024-04-26T12:33:21.531970+0000","last_peered":"2024-04-26T12:33:21.531970+0000","last_clean":"2024-04-26T12:33:21.531970+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:33:21.531970+0000","last_undegraded":"2024-04-26T12:33:21.531970+0000","last_fullsized":"2024-04-26T12:33:21.531970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.360440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.721856+0000","last_change":"2024-04-26T12:30:10.507052+0000","last_active":"2024-04-26T12:32:20.721856+0000","last_peered":"2024-04-26T12:32:20.721856+0000","last_clean":"2024-04-26T12:32:20.721856+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:32:20.721856+0000","last_undegraded":"2024-04-26T12:32:20.721856+0000","last_fullsized":"2024-04-26T12:32:20.721856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695639+0000","last_change":"2024-04-26T12:30:14.490693+0000","last_active":"2024-04-26T12:30:49.695639+0000","last_peered":"2024-04-26T12:30:49.695639+0000","last_clean":"2024-04-26T12:30:49.695639+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:30:49.695639+0000","last_undegraded":"2024-04-26T12:30:49.695639+0000","last_fullsized":"2024-04-26T12:30:49.695639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:24.002229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541715+0000","last_change":"2024-04-26T12:30:16.512671+0000","last_active":"2024-04-26T12:30:49.541715+0000","last_peered":"2024-04-26T12:30:49.541715+0000","last_clean":"2024-04-26T12:30:49.541715+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:30:49.541715+0000","last_undegraded":"2024-04-26T12:30:49.541715+0000","last_fullsized":"2024-04-26T12:30:49.541715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:56.174827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541431+0000","last_change":"2024-04-26T12:30:18.526535+0000","last_active":"2024-04-26T12:30:49.541431+0000","last_peered":"2024-04-26T12:30:49.541431+0000","last_clean":"2024-04-26T12:30:49.541431+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:30:49.541431+0000","last_undegraded":"2024-04-26T12:30:49.541431+0000","last_fullsized":"2024-04-26T12:30:49.541431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:47.825774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694295+0000","last_change":"2024-04-26T12:30:20.523683+0000","last_active":"2024-04-26T12:30:49.694295+0000","last_peered":"2024-04-26T12:30:49.694295+0000","last_clean":"2024-04-26T12:30:49.694295+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:30:49.694295+0000","last_undegraded":"2024-04-26T12:30:49.694295+0000","last_fullsized":"2024-04-26T12:30:49.694295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:12.874354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245067+0000","last_change":"2024-04-26T12:30:49.694875+0000","last_active":"2024-04-26T12:33:21.245067+0000","last_peered":"2024-04-26T12:33:21.245067+0000","last_clean":"2024-04-26T12:33:21.245067+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:33:21.245067+0000","last_undegraded":"2024-04-26T12:33:21.245067+0000","last_fullsized":"2024-04-26T12:33:21.245067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:41.776603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.729407+0000","last_change":"2024-04-26T12:30:10.523616+0000","last_active":"2024-04-26T12:30:54.729407+0000","last_peered":"2024-04-26T12:30:54.729407+0000","last_clean":"2024-04-26T12:30:54.729407+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:30:54.729407+0000","last_undegraded":"2024-04-26T12:30:54.729407+0000","last_fullsized":"2024-04-26T12:30:54.729407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:33.941949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.473479+0000","last_change":"2024-04-26T12:30:14.495445+0000","last_active":"2024-04-26T12:32:20.473479+0000","last_peered":"2024-04-26T12:32:20.473479+0000","last_clean":"2024-04-26T12:32:20.473479+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:32:20.473479+0000","last_undegraded":"2024-04-26T12:32:20.473479+0000","last_fullsized":"2024-04-26T12:32:20.473479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543479+0000","last_change":"2024-04-26T12:30:16.518014+0000","last_active":"2024-04-26T12:30:49.543479+0000","last_peered":"2024-04-26T12:30:49.543479+0000","last_clean":"2024-04-26T12:30:49.543479+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:30:49.543479+0000","last_undegraded":"2024-04-26T12:30:49.543479+0000","last_fullsized":"2024-04-26T12:30:49.543479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.152332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":381,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574516+0000","last_change":"2024-04-26T12:30:18.530920+0000","last_active":"2024-04-26T12:33:19.574516+0000","last_peered":"2024-04-26T12:33:19.574516+0000","last_clean":"2024-04-26T12:33:19.574516+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:33:19.574516+0000","last_undegraded":"2024-04-26T12:33:19.574516+0000","last_fullsized":"2024-04-26T12:33:19.574516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:42.827240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542674+0000","last_change":"2024-04-26T12:30:20.528257+0000","last_active":"2024-04-26T12:30:49.542674+0000","last_peered":"2024-04-26T12:30:49.542674+0000","last_clean":"2024-04-26T12:30:49.542674+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:30:49.542674+0000","last_undegraded":"2024-04-26T12:30:49.542674+0000","last_fullsized":"2024-04-26T12:30:49.542674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:16.184218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.192878+0000","last_change":"2024-04-26T12:30:12.500154+0000","last_active":"2024-04-26T12:31:37.192878+0000","last_peered":"2024-04-26T12:31:37.192878+0000","last_clean":"2024-04-26T12:31:37.192878+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:31:37.192878+0000","last_undegraded":"2024-04-26T12:31:37.192878+0000","last_fullsized":"2024-04-26T12:31:37.192878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:27.199714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540446+0000","last_change":"2024-04-26T12:30:10.512902+0000","last_active":"2024-04-26T12:30:49.540446+0000","last_peered":"2024-04-26T12:30:49.540446+0000","last_clean":"2024-04-26T12:30:49.540446+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:30:49.540446+0000","last_undegraded":"2024-04-26T12:30:49.540446+0000","last_fullsized":"2024-04-26T12:30:49.540446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:51.487985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547825+0000","last_change":"2024-04-26T12:30:14.492539+0000","last_active":"2024-04-26T12:30:49.547825+0000","last_peered":"2024-04-26T12:30:49.547825+0000","last_clean":"2024-04-26T12:30:49.547825+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:30:49.547825+0000","last_undegraded":"2024-04-26T12:30:49.547825+0000","last_fullsized":"2024-04-26T12:30:49.547825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.745596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.372407+0000","last_change":"2024-04-26T12:30:16.516605+0000","last_active":"2024-04-26T12:32:19.372407+0000","last_peered":"2024-04-26T12:32:19.372407+0000","last_clean":"2024-04-26T12:32:19.372407+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:32:19.372407+0000","last_undegraded":"2024-04-26T12:32:19.372407+0000","last_fullsized":"2024-04-26T12:32:19.372407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:12.674195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.534831+0000","last_change":"2024-04-26T12:30:18.513633+0000","last_active":"2024-04-26T12:33:21.534831+0000","last_peered":"2024-04-26T12:33:21.534831+0000","last_clean":"2024-04-26T12:33:21.534831+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:21.534831+0000","last_undegraded":"2024-04-26T12:33:21.534831+0000","last_fullsized":"2024-04-26T12:33:21.534831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:21.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876787+0000","last_change":"2024-04-26T12:30:12.493252+0000","last_active":"2024-04-26T12:32:20.876787+0000","last_peered":"2024-04-26T12:32:20.876787+0000","last_clean":"2024-04-26T12:32:20.876787+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:32:20.876787+0000","last_undegraded":"2024-04-26T12:32:20.876787+0000","last_fullsized":"2024-04-26T12:32:20.876787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:05.333696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547945+0000","last_change":"2024-04-26T12:30:10.508473+0000","last_active":"2024-04-26T12:30:49.547945+0000","last_peered":"2024-04-26T12:30:49.547945+0000","last_clean":"2024-04-26T12:30:49.547945+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:30:49.547945+0000","last_undegraded":"2024-04-26T12:30:49.547945+0000","last_fullsized":"2024-04-26T12:30:49.547945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540186+0000","last_change":"2024-04-26T12:30:14.488895+0000","last_active":"2024-04-26T12:30:49.540186+0000","last_peered":"2024-04-26T12:30:49.540186+0000","last_clean":"2024-04-26T12:30:49.540186+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:30:49.540186+0000","last_undegraded":"2024-04-26T12:30:49.540186+0000","last_fullsized":"2024-04-26T12:30:49.540186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:46.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.381746+0000","last_change":"2024-04-26T12:30:16.512244+0000","last_active":"2024-04-26T12:32:19.381746+0000","last_peered":"2024-04-26T12:32:19.381746+0000","last_clean":"2024-04-26T12:32:19.381746+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:32:19.381746+0000","last_undegraded":"2024-04-26T12:32:19.381746+0000","last_fullsized":"2024-04-26T12:32:19.381746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:44.659809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696627+0000","last_change":"2024-04-26T12:30:18.517298+0000","last_active":"2024-04-26T12:30:49.696627+0000","last_peered":"2024-04-26T12:30:49.696627+0000","last_clean":"2024-04-26T12:30:49.696627+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:30:49.696627+0000","last_undegraded":"2024-04-26T12:30:49.696627+0000","last_fullsized":"2024-04-26T12:30:49.696627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:08.568225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.978624+0000","last_change":"2024-04-26T12:30:20.529100+0000","last_active":"2024-04-26T12:31:36.978624+0000","last_peered":"2024-04-26T12:31:36.978624+0000","last_clean":"2024-04-26T12:31:36.978624+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:31:36.978624+0000","last_undegraded":"2024-04-26T12:31:36.978624+0000","last_fullsized":"2024-04-26T12:31:36.978624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.337272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247623+0000","last_change":"2024-04-26T12:30:12.496041+0000","last_active":"2024-04-26T12:33:21.247623+0000","last_peered":"2024-04-26T12:33:21.247623+0000","last_clean":"2024-04-26T12:33:21.247623+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:33:21.247623+0000","last_undegraded":"2024-04-26T12:33:21.247623+0000","last_fullsized":"2024-04-26T12:33:21.247623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:20.528504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546239+0000","last_change":"2024-04-26T12:30:10.501359+0000","last_active":"2024-04-26T12:30:49.546239+0000","last_peered":"2024-04-26T12:30:49.546239+0000","last_clean":"2024-04-26T12:30:49.546239+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:30:49.546239+0000","last_undegraded":"2024-04-26T12:30:49.546239+0000","last_fullsized":"2024-04-26T12:30:49.546239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694371+0000","last_change":"2024-04-26T12:30:14.491272+0000","last_active":"2024-04-26T12:30:49.694371+0000","last_peered":"2024-04-26T12:30:49.694371+0000","last_clean":"2024-04-26T12:30:49.694371+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:30:49.694371+0000","last_undegraded":"2024-04-26T12:30:49.694371+0000","last_fullsized":"2024-04-26T12:30:49.694371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:07.482770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'32","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512362+0000","last_change":"2024-04-26T12:30:16.517757+0000","last_active":"2024-04-26T12:32:33.512362+0000","last_peered":"2024-04-26T12:32:33.512362+0000","last_clean":"2024-04-26T12:32:33.512362+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:32:33.512362+0000","last_undegraded":"2024-04-26T12:32:33.512362+0000","last_fullsized":"2024-04-26T12:32:33.512362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:28.076471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695218+0000","last_change":"2024-04-26T12:30:18.522879+0000","last_active":"2024-04-26T12:30:49.695218+0000","last_peered":"2024-04-26T12:30:49.695218+0000","last_clean":"2024-04-26T12:30:49.695218+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:30:49.695218+0000","last_undegraded":"2024-04-26T12:30:49.695218+0000","last_fullsized":"2024-04-26T12:30:49.695218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:01.222542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.431404+0000","last_change":"2024-04-26T12:30:20.531982+0000","last_active":"2024-04-26T12:31:31.431404+0000","last_peered":"2024-04-26T12:31:31.431404+0000","last_clean":"2024-04-26T12:31:31.431404+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:31:31.431404+0000","last_undegraded":"2024-04-26T12:31:31.431404+0000","last_fullsized":"2024-04-26T12:31:31.431404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:39.756767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.509020+0000","last_change":"2024-04-26T12:30:12.483941+0000","last_active":"2024-04-26T12:33:21.509020+0000","last_peered":"2024-04-26T12:33:21.509020+0000","last_clean":"2024-04-26T12:33:21.509020+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:33:21.509020+0000","last_undegraded":"2024-04-26T12:33:21.509020+0000","last_fullsized":"2024-04-26T12:33:21.509020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.061530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'5","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511634+0000","last_change":"2024-04-26T12:30:10.524374+0000","last_active":"2024-04-26T12:32:28.511634+0000","last_peered":"2024-04-26T12:32:28.511634+0000","last_clean":"2024-04-26T12:32:28.511634+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:32:28.511634+0000","last_undegraded":"2024-04-26T12:32:28.511634+0000","last_fullsized":"2024-04-26T12:32:28.511634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:17.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695767+0000","last_change":"2024-04-26T12:30:14.491692+0000","last_active":"2024-04-26T12:30:49.695767+0000","last_peered":"2024-04-26T12:30:49.695767+0000","last_clean":"2024-04-26T12:30:49.695767+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:30:49.695767+0000","last_undegraded":"2024-04-26T12:30:49.695767+0000","last_fullsized":"2024-04-26T12:30:49.695767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:18.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.383610+0000","last_change":"2024-04-26T12:30:16.517072+0000","last_active":"2024-04-26T12:32:19.383610+0000","last_peered":"2024-04-26T12:32:19.383610+0000","last_clean":"2024-04-26T12:32:19.383610+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:32:19.383610+0000","last_undegraded":"2024-04-26T12:32:19.383610+0000","last_fullsized":"2024-04-26T12:32:19.383610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:35.697992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.649875+0000","last_change":"2024-04-26T12:30:18.526287+0000","last_active":"2024-04-26T12:33:21.649875+0000","last_peered":"2024-04-26T12:33:21.649875+0000","last_clean":"2024-04-26T12:33:21.649875+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:21.649875+0000","last_undegraded":"2024-04-26T12:33:21.649875+0000","last_fullsized":"2024-04-26T12:33:21.649875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:19.306792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695667+0000","last_change":"2024-04-26T12:30:20.531457+0000","last_active":"2024-04-26T12:30:49.695667+0000","last_peered":"2024-04-26T12:30:49.695667+0000","last_clean":"2024-04-26T12:30:49.695667+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:30:49.695667+0000","last_undegraded":"2024-04-26T12:30:49.695667+0000","last_fullsized":"2024-04-26T12:30:49.695667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:06.390024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546441+0000","last_change":"2024-04-26T12:30:12.490458+0000","last_active":"2024-04-26T12:30:49.546441+0000","last_peered":"2024-04-26T12:30:49.546441+0000","last_clean":"2024-04-26T12:30:49.546441+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:30:49.546441+0000","last_undegraded":"2024-04-26T12:30:49.546441+0000","last_fullsized":"2024-04-26T12:30:49.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547353+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:30:49.547353+0000","last_peered":"2024-04-26T12:30:49.547353+0000","last_clean":"2024-04-26T12:30:49.547353+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:30:49.547353+0000","last_undegraded":"2024-04-26T12:30:49.547353+0000","last_fullsized":"2024-04-26T12:30:49.547353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:24.660776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.491181+0000","last_change":"2024-04-26T12:30:49.553037+0000","last_active":"2024-04-26T12:30:52.491181+0000","last_peered":"2024-04-26T12:30:52.491181+0000","last_clean":"2024-04-26T12:30:52.491181+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:30:52.491181+0000","last_undegraded":"2024-04-26T12:30:52.491181+0000","last_fullsized":"2024-04-26T12:30:52.491181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:54.425258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.385402+0000","last_change":"2024-04-26T12:30:16.516843+0000","last_active":"2024-04-26T12:32:19.385402+0000","last_peered":"2024-04-26T12:32:19.385402+0000","last_clean":"2024-04-26T12:32:19.385402+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:32:19.385402+0000","last_undegraded":"2024-04-26T12:32:19.385402+0000","last_fullsized":"2024-04-26T12:32:19.385402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:04.838523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694139+0000","last_change":"2024-04-26T12:30:18.522525+0000","last_active":"2024-04-26T12:30:49.694139+0000","last_peered":"2024-04-26T12:30:49.694139+0000","last_clean":"2024-04-26T12:30:49.694139+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:30:49.694139+0000","last_undegraded":"2024-04-26T12:30:49.694139+0000","last_fullsized":"2024-04-26T12:30:49.694139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:59.330423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625284+0000","last_change":"2024-04-26T12:30:20.522951+0000","last_active":"2024-04-26T12:33:21.625284+0000","last_peered":"2024-04-26T12:33:21.625284+0000","last_clean":"2024-04-26T12:33:21.625284+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:33:21.625284+0000","last_undegraded":"2024-04-26T12:33:21.625284+0000","last_fullsized":"2024-04-26T12:33:21.625284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:10.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511024+0000","last_change":"2024-04-26T12:30:12.498504+0000","last_active":"2024-04-26T12:32:28.511024+0000","last_peered":"2024-04-26T12:32:28.511024+0000","last_clean":"2024-04-26T12:32:28.511024+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:32:28.511024+0000","last_undegraded":"2024-04-26T12:32:28.511024+0000","last_fullsized":"2024-04-26T12:32:28.511024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:01.405398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.853500+0000","last_change":"2024-04-26T12:30:10.499408+0000","last_active":"2024-04-26T12:32:20.853500+0000","last_peered":"2024-04-26T12:32:20.853500+0000","last_clean":"2024-04-26T12:32:20.853500+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:32:20.853500+0000","last_undegraded":"2024-04-26T12:32:20.853500+0000","last_fullsized":"2024-04-26T12:32:20.853500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543749+0000","last_change":"2024-04-26T12:30:14.488769+0000","last_active":"2024-04-26T12:30:49.543749+0000","last_peered":"2024-04-26T12:30:49.543749+0000","last_clean":"2024-04-26T12:30:49.543749+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:30:49.543749+0000","last_undegraded":"2024-04-26T12:30:49.543749+0000","last_fullsized":"2024-04-26T12:30:49.543749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:56.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.366761+0000","last_change":"2024-04-26T12:30:16.512181+0000","last_active":"2024-04-26T12:32:19.366761+0000","last_peered":"2024-04-26T12:32:19.366761+0000","last_clean":"2024-04-26T12:32:19.366761+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:32:19.366761+0000","last_undegraded":"2024-04-26T12:32:19.366761+0000","last_fullsized":"2024-04-26T12:32:19.366761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:05.265330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547995+0000","last_change":"2024-04-26T12:30:18.528738+0000","last_active":"2024-04-26T12:30:49.547995+0000","last_peered":"2024-04-26T12:30:49.547995+0000","last_clean":"2024-04-26T12:30:49.547995+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:30:49.547995+0000","last_undegraded":"2024-04-26T12:30:49.547995+0000","last_fullsized":"2024-04-26T12:30:49.547995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.890333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510646+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:32:23.510646+0000","last_peered":"2024-04-26T12:32:23.510646+0000","last_clean":"2024-04-26T12:32:23.510646+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:32:23.510646+0000","last_undegraded":"2024-04-26T12:32:23.510646+0000","last_fullsized":"2024-04-26T12:32:23.510646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:22.903178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550859+0000","last_change":"2024-04-26T12:30:12.501179+0000","last_active":"2024-04-26T12:30:49.550859+0000","last_peered":"2024-04-26T12:30:49.550859+0000","last_clean":"2024-04-26T12:30:49.550859+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:30:49.550859+0000","last_undegraded":"2024-04-26T12:30:49.550859+0000","last_fullsized":"2024-04-26T12:30:49.550859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:04.520788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.526847+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:21.526847+0000","last_peered":"2024-04-26T12:33:21.526847+0000","last_clean":"2024-04-26T12:33:21.526847+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:21.526847+0000","last_undegraded":"2024-04-26T12:33:21.526847+0000","last_fullsized":"2024-04-26T12:33:21.526847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.901139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695748+0000","last_change":"2024-04-26T12:30:14.491390+0000","last_active":"2024-04-26T12:30:49.695748+0000","last_peered":"2024-04-26T12:30:49.695748+0000","last_clean":"2024-04-26T12:30:49.695748+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:30:49.695748+0000","last_undegraded":"2024-04-26T12:30:49.695748+0000","last_fullsized":"2024-04-26T12:30:49.695748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:26.342488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.391961+0000","last_change":"2024-04-26T12:30:16.509310+0000","last_active":"2024-04-26T12:32:19.391961+0000","last_peered":"2024-04-26T12:32:19.391961+0000","last_clean":"2024-04-26T12:32:19.391961+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:32:19.391961+0000","last_undegraded":"2024-04-26T12:32:19.391961+0000","last_fullsized":"2024-04-26T12:32:19.391961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:24.483163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.629477+0000","last_change":"2024-04-26T12:30:18.526558+0000","last_active":"2024-04-26T12:33:21.629477+0000","last_peered":"2024-04-26T12:33:21.629477+0000","last_clean":"2024-04-26T12:33:21.629477+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:21.629477+0000","last_undegraded":"2024-04-26T12:33:21.629477+0000","last_fullsized":"2024-04-26T12:33:21.629477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:07.868452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499378+0000","last_change":"2024-04-26T12:30:20.523809+0000","last_active":"2024-04-26T12:32:27.499378+0000","last_peered":"2024-04-26T12:32:27.499378+0000","last_clean":"2024-04-26T12:32:27.499378+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:32:27.499378+0000","last_undegraded":"2024-04-26T12:32:27.499378+0000","last_fullsized":"2024-04-26T12:32:27.499378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:28.735728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503582+0000","last_change":"2024-04-26T12:30:12.484589+0000","last_active":"2024-04-26T12:33:21.503582+0000","last_peered":"2024-04-26T12:33:21.503582+0000","last_clean":"2024-04-26T12:33:21.503582+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:33:21.503582+0000","last_undegraded":"2024-04-26T12:33:21.503582+0000","last_fullsized":"2024-04-26T12:33:21.503582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544074+0000","last_change":"2024-04-26T12:30:10.524444+0000","last_active":"2024-04-26T12:30:49.544074+0000","last_peered":"2024-04-26T12:30:49.544074+0000","last_clean":"2024-04-26T12:30:49.544074+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:30:49.544074+0000","last_undegraded":"2024-04-26T12:30:49.544074+0000","last_fullsized":"2024-04-26T12:30:49.544074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:25.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.482598+0000","last_change":"2024-04-26T12:30:14.495065+0000","last_active":"2024-04-26T12:32:20.482598+0000","last_peered":"2024-04-26T12:32:20.482598+0000","last_clean":"2024-04-26T12:32:20.482598+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:32:20.482598+0000","last_undegraded":"2024-04-26T12:32:20.482598+0000","last_fullsized":"2024-04-26T12:32:20.482598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:42.031534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549960+0000","last_change":"2024-04-26T12:30:16.515078+0000","last_active":"2024-04-26T12:30:49.549960+0000","last_peered":"2024-04-26T12:30:49.549960+0000","last_clean":"2024-04-26T12:30:49.549960+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:30:49.549960+0000","last_undegraded":"2024-04-26T12:30:49.549960+0000","last_fullsized":"2024-04-26T12:30:49.549960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:38.268633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":499,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.587326+0000","last_change":"2024-04-26T12:30:18.519523+0000","last_active":"2024-04-26T12:33:21.587326+0000","last_peered":"2024-04-26T12:33:21.587326+0000","last_clean":"2024-04-26T12:33:21.587326+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:21.587326+0000","last_undegraded":"2024-04-26T12:33:21.587326+0000","last_fullsized":"2024-04-26T12:33:21.587326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:16.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.504960+0000","last_change":"2024-04-26T12:30:20.527644+0000","last_active":"2024-04-26T12:33:21.504960+0000","last_peered":"2024-04-26T12:33:21.504960+0000","last_clean":"2024-04-26T12:33:21.504960+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:21.504960+0000","last_undegraded":"2024-04-26T12:33:21.504960+0000","last_fullsized":"2024-04-26T12:33:21.504960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:21.313640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583012+0000","last_change":"2024-04-26T12:30:12.498024+0000","last_active":"2024-04-26T12:33:21.583012+0000","last_peered":"2024-04-26T12:33:21.583012+0000","last_clean":"2024-04-26T12:33:21.583012+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:21.583012+0000","last_undegraded":"2024-04-26T12:33:21.583012+0000","last_fullsized":"2024-04-26T12:33:21.583012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:50.998968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543235+0000","last_change":"2024-04-26T12:30:10.521698+0000","last_active":"2024-04-26T12:30:49.543235+0000","last_peered":"2024-04-26T12:30:49.543235+0000","last_clean":"2024-04-26T12:30:49.543235+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:30:49.543235+0000","last_undegraded":"2024-04-26T12:30:49.543235+0000","last_fullsized":"2024-04-26T12:30:49.543235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:17.318885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548138+0000","last_change":"2024-04-26T12:30:14.493082+0000","last_active":"2024-04-26T12:30:49.548138+0000","last_peered":"2024-04-26T12:30:49.548138+0000","last_clean":"2024-04-26T12:30:49.548138+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:30:49.548138+0000","last_undegraded":"2024-04-26T12:30:49.548138+0000","last_fullsized":"2024-04-26T12:30:49.548138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:53.061967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.378749+0000","last_change":"2024-04-26T12:30:16.512907+0000","last_active":"2024-04-26T12:32:19.378749+0000","last_peered":"2024-04-26T12:32:19.378749+0000","last_clean":"2024-04-26T12:32:19.378749+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:32:19.378749+0000","last_undegraded":"2024-04-26T12:32:19.378749+0000","last_fullsized":"2024-04-26T12:32:19.378749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:44.039858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543293+0000","last_change":"2024-04-26T12:30:18.525037+0000","last_active":"2024-04-26T12:30:49.543293+0000","last_peered":"2024-04-26T12:30:49.543293+0000","last_clean":"2024-04-26T12:30:49.543293+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:30:49.543293+0000","last_undegraded":"2024-04-26T12:30:49.543293+0000","last_fullsized":"2024-04-26T12:30:49.543293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:34.358080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.563122+0000","last_change":"2024-04-26T12:30:20.527103+0000","last_active":"2024-04-26T12:33:21.563122+0000","last_peered":"2024-04-26T12:33:21.563122+0000","last_clean":"2024-04-26T12:33:21.563122+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:21.563122+0000","last_undegraded":"2024-04-26T12:33:21.563122+0000","last_fullsized":"2024-04-26T12:33:21.563122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.874402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532058+0000","last_change":"2024-04-26T12:30:12.500664+0000","last_active":"2024-04-26T12:33:21.532058+0000","last_peered":"2024-04-26T12:33:21.532058+0000","last_clean":"2024-04-26T12:33:21.532058+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:21.532058+0000","last_undegraded":"2024-04-26T12:33:21.532058+0000","last_fullsized":"2024-04-26T12:33:21.532058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:30.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539702+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:30:49.539702+0000","last_peered":"2024-04-26T12:30:49.539702+0000","last_clean":"2024-04-26T12:30:49.539702+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:30:49.539702+0000","last_undegraded":"2024-04-26T12:30:49.539702+0000","last_fullsized":"2024-04-26T12:30:49.539702+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:34.223814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545163+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:30:49.545163+0000","last_peered":"2024-04-26T12:30:49.545163+0000","last_clean":"2024-04-26T12:30:49.545163+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:30:49.545163+0000","last_undegraded":"2024-04-26T12:30:49.545163+0000","last_fullsized":"2024-04-26T12:30:49.545163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.762234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544162+0000","last_change":"2024-04-26T12:30:10.518603+0000","last_active":"2024-04-26T12:30:49.544162+0000","last_peered":"2024-04-26T12:30:49.544162+0000","last_clean":"2024-04-26T12:30:49.544162+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:30:49.544162+0000","last_undegraded":"2024-04-26T12:30:49.544162+0000","last_fullsized":"2024-04-26T12:30:49.544162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:01.289832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541419+0000","last_change":"2024-04-26T12:30:14.493329+0000","last_active":"2024-04-26T12:30:49.541419+0000","last_peered":"2024-04-26T12:30:49.541419+0000","last_clean":"2024-04-26T12:30:49.541419+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:30:49.541419+0000","last_undegraded":"2024-04-26T12:30:49.541419+0000","last_fullsized":"2024-04-26T12:30:49.541419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.398590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'76","reported_seq":145,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.390018+0000","last_change":"2024-04-26T12:30:16.517527+0000","last_active":"2024-04-26T12:32:19.390018+0000","last_peered":"2024-04-26T12:32:19.390018+0000","last_clean":"2024-04-26T12:32:19.390018+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:32:19.390018+0000","last_undegraded":"2024-04-26T12:32:19.390018+0000","last_fullsized":"2024-04-26T12:32:19.390018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:40.510822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696149+0000","last_change":"2024-04-26T12:30:18.526193+0000","last_active":"2024-04-26T12:30:49.696149+0000","last_peered":"2024-04-26T12:30:49.696149+0000","last_clean":"2024-04-26T12:30:49.696149+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:30:49.696149+0000","last_undegraded":"2024-04-26T12:30:49.696149+0000","last_fullsized":"2024-04-26T12:30:49.696149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:25.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":164,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.540830+0000","last_change":"2024-04-26T12:30:20.526296+0000","last_active":"2024-04-26T12:33:21.540830+0000","last_peered":"2024-04-26T12:33:21.540830+0000","last_clean":"2024-04-26T12:33:21.540830+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:21.540830+0000","last_undegraded":"2024-04-26T12:33:21.540830+0000","last_fullsized":"2024-04-26T12:33:21.540830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:54.224734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675274+0000","last_change":"2024-04-26T12:30:12.488875+0000","last_active":"2024-04-26T12:32:17.675274+0000","last_peered":"2024-04-26T12:32:17.675274+0000","last_clean":"2024-04-26T12:32:17.675274+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:32:17.675274+0000","last_undegraded":"2024-04-26T12:32:17.675274+0000","last_fullsized":"2024-04-26T12:32:17.675274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:41.425033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542657+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:30:49.542657+0000","last_peered":"2024-04-26T12:30:49.542657+0000","last_clean":"2024-04-26T12:30:49.542657+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:30:49.542657+0000","last_undegraded":"2024-04-26T12:30:49.542657+0000","last_fullsized":"2024-04-26T12:30:49.542657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:20.023037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694359+0000","last_change":"2024-04-26T12:30:10.488700+0000","last_active":"2024-04-26T12:30:49.694359+0000","last_peered":"2024-04-26T12:30:49.694359+0000","last_clean":"2024-04-26T12:30:49.694359+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:30:49.694359+0000","last_undegraded":"2024-04-26T12:30:49.694359+0000","last_fullsized":"2024-04-26T12:30:49.694359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548136+0000","last_change":"2024-04-26T12:30:14.492528+0000","last_active":"2024-04-26T12:30:49.548136+0000","last_peered":"2024-04-26T12:30:49.548136+0000","last_clean":"2024-04-26T12:30:49.548136+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:30:49.548136+0000","last_undegraded":"2024-04-26T12:30:49.548136+0000","last_fullsized":"2024-04-26T12:30:49.548136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:32.660138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'273","reported_seq":476,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574678+0000","last_change":"2024-04-26T12:30:16.515291+0000","last_active":"2024-04-26T12:33:19.574678+0000","last_peered":"2024-04-26T12:33:19.574678+0000","last_clean":"2024-04-26T12:33:19.574678+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:19.574678+0000","last_undegraded":"2024-04-26T12:33:19.574678+0000","last_fullsized":"2024-04-26T12:33:19.574678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:16.639770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547578+0000","last_change":"2024-04-26T12:30:18.530303+0000","last_active":"2024-04-26T12:30:49.547578+0000","last_peered":"2024-04-26T12:30:49.547578+0000","last_clean":"2024-04-26T12:30:49.547578+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:30:49.547578+0000","last_undegraded":"2024-04-26T12:30:49.547578+0000","last_fullsized":"2024-04-26T12:30:49.547578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:17.619205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.975177+0000","last_change":"2024-04-26T12:30:20.532161+0000","last_active":"2024-04-26T12:31:36.975177+0000","last_peered":"2024-04-26T12:31:36.975177+0000","last_clean":"2024-04-26T12:31:36.975177+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:31:36.975177+0000","last_undegraded":"2024-04-26T12:31:36.975177+0000","last_fullsized":"2024-04-26T12:31:36.975177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:51.654625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498769+0000","last_change":"2024-04-26T12:30:12.500451+0000","last_active":"2024-04-26T12:32:22.498769+0000","last_peered":"2024-04-26T12:32:22.498769+0000","last_clean":"2024-04-26T12:32:22.498769+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:32:22.498769+0000","last_undegraded":"2024-04-26T12:32:22.498769+0000","last_fullsized":"2024-04-26T12:32:22.498769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:13.176012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542574+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:30:49.542574+0000","last_peered":"2024-04-26T12:30:49.542574+0000","last_clean":"2024-04-26T12:30:49.542574+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:30:49.542574+0000","last_undegraded":"2024-04-26T12:30:49.542574+0000","last_fullsized":"2024-04-26T12:30:49.542574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:40.531155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.693869+0000","last_change":"2024-04-26T12:30:10.489913+0000","last_active":"2024-04-26T12:30:49.693869+0000","last_peered":"2024-04-26T12:30:49.693869+0000","last_clean":"2024-04-26T12:30:49.693869+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:30:49.693869+0000","last_undegraded":"2024-04-26T12:30:49.693869+0000","last_fullsized":"2024-04-26T12:30:49.693869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546002+0000","last_change":"2024-04-26T12:30:14.492118+0000","last_active":"2024-04-26T12:30:49.546002+0000","last_peered":"2024-04-26T12:30:49.546002+0000","last_clean":"2024-04-26T12:30:49.546002+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:30:49.546002+0000","last_undegraded":"2024-04-26T12:30:49.546002+0000","last_fullsized":"2024-04-26T12:30:49.546002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:34.317162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574673+0000","last_change":"2024-04-26T12:30:16.509140+0000","last_active":"2024-04-26T12:33:19.574673+0000","last_peered":"2024-04-26T12:33:19.574673+0000","last_clean":"2024-04-26T12:33:19.574673+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:19.574673+0000","last_undegraded":"2024-04-26T12:33:19.574673+0000","last_fullsized":"2024-04-26T12:33:19.574673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:55.319866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696077+0000","last_change":"2024-04-26T12:30:18.526395+0000","last_active":"2024-04-26T12:30:49.696077+0000","last_peered":"2024-04-26T12:30:49.696077+0000","last_clean":"2024-04-26T12:30:49.696077+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:30:49.696077+0000","last_undegraded":"2024-04-26T12:30:49.696077+0000","last_fullsized":"2024-04-26T12:30:49.696077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:27.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.189438+0000","last_change":"2024-04-26T12:30:20.531432+0000","last_active":"2024-04-26T12:31:37.189438+0000","last_peered":"2024-04-26T12:31:37.189438+0000","last_clean":"2024-04-26T12:31:37.189438+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:31:37.189438+0000","last_undegraded":"2024-04-26T12:31:37.189438+0000","last_fullsized":"2024-04-26T12:31:37.189438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:35.605929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.697139+0000","last_change":"2024-04-26T12:30:12.489234+0000","last_active":"2024-04-26T12:30:49.697139+0000","last_peered":"2024-04-26T12:30:49.697139+0000","last_clean":"2024-04-26T12:30:49.697139+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:30:49.697139+0000","last_undegraded":"2024-04-26T12:30:49.697139+0000","last_fullsized":"2024-04-26T12:30:49.697139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.716751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543541+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:30:49.543541+0000","last_peered":"2024-04-26T12:30:49.543541+0000","last_clean":"2024-04-26T12:30:49.543541+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:30:49.543541+0000","last_undegraded":"2024-04-26T12:30:49.543541+0000","last_fullsized":"2024-04-26T12:30:49.543541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:36.069601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501863+0000","last_change":"2024-04-26T12:30:10.500548+0000","last_active":"2024-04-26T12:32:17.501863+0000","last_peered":"2024-04-26T12:32:17.501863+0000","last_clean":"2024-04-26T12:32:17.501863+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:32:17.501863+0000","last_undegraded":"2024-04-26T12:32:17.501863+0000","last_fullsized":"2024-04-26T12:32:17.501863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696292+0000","last_change":"2024-04-26T12:30:14.487929+0000","last_active":"2024-04-26T12:30:49.696292+0000","last_peered":"2024-04-26T12:30:49.696292+0000","last_clean":"2024-04-26T12:30:49.696292+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:30:49.696292+0000","last_undegraded":"2024-04-26T12:30:49.696292+0000","last_fullsized":"2024-04-26T12:30:49.696292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:52.557515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.889030+0000","last_change":"2024-04-26T12:30:16.517033+0000","last_active":"2024-04-26T12:33:20.889030+0000","last_peered":"2024-04-26T12:33:20.889030+0000","last_clean":"2024-04-26T12:33:20.889030+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:20.889030+0000","last_undegraded":"2024-04-26T12:33:20.889030+0000","last_fullsized":"2024-04-26T12:33:20.889030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:38.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549097+0000","last_change":"2024-04-26T12:30:18.529014+0000","last_active":"2024-04-26T12:30:49.549097+0000","last_peered":"2024-04-26T12:30:49.549097+0000","last_clean":"2024-04-26T12:30:49.549097+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:30:49.549097+0000","last_undegraded":"2024-04-26T12:30:49.549097+0000","last_fullsized":"2024-04-26T12:30:49.549097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:10.143592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.627536+0000","last_change":"2024-04-26T12:30:20.535350+0000","last_active":"2024-04-26T12:32:20.627536+0000","last_peered":"2024-04-26T12:32:20.627536+0000","last_clean":"2024-04-26T12:32:20.627536+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:32:20.627536+0000","last_undegraded":"2024-04-26T12:32:20.627536+0000","last_fullsized":"2024-04-26T12:32:20.627536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:44.849843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540587+0000","last_change":"2024-04-26T12:30:12.494538+0000","last_active":"2024-04-26T12:30:49.540587+0000","last_peered":"2024-04-26T12:30:49.540587+0000","last_clean":"2024-04-26T12:30:49.540587+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:30:49.540587+0000","last_undegraded":"2024-04-26T12:30:49.540587+0000","last_fullsized":"2024-04-26T12:30:49.540587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:34.559667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542876+0000","last_change":"2024-04-26T12:30:10.502077+0000","last_active":"2024-04-26T12:30:49.542876+0000","last_peered":"2024-04-26T12:30:49.542876+0000","last_clean":"2024-04-26T12:30:49.542876+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:30:49.542876+0000","last_undegraded":"2024-04-26T12:30:49.542876+0000","last_fullsized":"2024-04-26T12:30:49.542876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695937+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:30:49.695937+0000","last_peered":"2024-04-26T12:30:49.695937+0000","last_clean":"2024-04-26T12:30:49.695937+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.695937+0000","last_undegraded":"2024-04-26T12:30:49.695937+0000","last_fullsized":"2024-04-26T12:30:49.695937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:41.365768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498561+0000","last_change":"2024-04-26T12:30:14.490527+0000","last_active":"2024-04-26T12:32:22.498561+0000","last_peered":"2024-04-26T12:32:22.498561+0000","last_clean":"2024-04-26T12:32:22.498561+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:32:22.498561+0000","last_undegraded":"2024-04-26T12:32:22.498561+0000","last_fullsized":"2024-04-26T12:32:22.498561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:44.342932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.390913+0000","last_change":"2024-04-26T12:30:16.516144+0000","last_active":"2024-04-26T12:32:19.390913+0000","last_peered":"2024-04-26T12:32:19.390913+0000","last_clean":"2024-04-26T12:32:19.390913+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:32:19.390913+0000","last_undegraded":"2024-04-26T12:32:19.390913+0000","last_fullsized":"2024-04-26T12:32:19.390913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:35.964112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542090+0000","last_change":"2024-04-26T12:30:18.523448+0000","last_active":"2024-04-26T12:30:49.542090+0000","last_peered":"2024-04-26T12:30:49.542090+0000","last_clean":"2024-04-26T12:30:49.542090+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:30:49.542090+0000","last_undegraded":"2024-04-26T12:30:49.542090+0000","last_fullsized":"2024-04-26T12:30:49.542090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:00.948613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.817678+0000","last_change":"2024-04-26T12:30:20.527189+0000","last_active":"2024-04-26T12:32:20.817678+0000","last_peered":"2024-04-26T12:32:20.817678+0000","last_clean":"2024-04-26T12:32:20.817678+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:32:20.817678+0000","last_undegraded":"2024-04-26T12:32:20.817678+0000","last_fullsized":"2024-04-26T12:32:20.817678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:22.610410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247296+0000","last_change":"2024-04-26T12:30:12.493953+0000","last_active":"2024-04-26T12:33:21.247296+0000","last_peered":"2024-04-26T12:33:21.247296+0000","last_clean":"2024-04-26T12:33:21.247296+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:33:21.247296+0000","last_undegraded":"2024-04-26T12:33:21.247296+0000","last_fullsized":"2024-04-26T12:33:21.247296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:29.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696477+0000","last_change":"2024-04-26T12:30:10.499533+0000","last_active":"2024-04-26T12:30:49.696477+0000","last_peered":"2024-04-26T12:30:49.696477+0000","last_clean":"2024-04-26T12:30:49.696477+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:30:49.696477+0000","last_undegraded":"2024-04-26T12:30:49.696477+0000","last_fullsized":"2024-04-26T12:30:49.696477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549792+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:30:49.549792+0000","last_peered":"2024-04-26T12:30:49.549792+0000","last_clean":"2024-04-26T12:30:49.549792+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:30:49.549792+0000","last_undegraded":"2024-04-26T12:30:49.549792+0000","last_fullsized":"2024-04-26T12:30:49.549792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:20.349910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552858+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:30:49.552858+0000","last_peered":"2024-04-26T12:30:49.552858+0000","last_clean":"2024-04-26T12:30:49.552858+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:30:49.552858+0000","last_undegraded":"2024-04-26T12:30:49.552858+0000","last_fullsized":"2024-04-26T12:30:49.552858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:36.051479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541073+0000","last_change":"2024-04-26T12:30:16.519723+0000","last_active":"2024-04-26T12:30:49.541073+0000","last_peered":"2024-04-26T12:30:49.541073+0000","last_clean":"2024-04-26T12:30:49.541073+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:30:49.541073+0000","last_undegraded":"2024-04-26T12:30:49.541073+0000","last_fullsized":"2024-04-26T12:30:49.541073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:15.493662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":346,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574649+0000","last_change":"2024-04-26T12:30:18.522379+0000","last_active":"2024-04-26T12:33:19.574649+0000","last_peered":"2024-04-26T12:33:19.574649+0000","last_clean":"2024-04-26T12:33:19.574649+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:19.574649+0000","last_undegraded":"2024-04-26T12:33:19.574649+0000","last_fullsized":"2024-04-26T12:33:19.574649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:31.575194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.472108+0000","last_change":"2024-04-26T12:30:20.530218+0000","last_active":"2024-04-26T12:30:54.472108+0000","last_peered":"2024-04-26T12:30:54.472108+0000","last_clean":"2024-04-26T12:30:54.472108+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:30:54.472108+0000","last_undegraded":"2024-04-26T12:30:54.472108+0000","last_fullsized":"2024-04-26T12:30:54.472108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:19.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502925+0000","last_change":"2024-04-26T12:30:12.496796+0000","last_active":"2024-04-26T12:33:21.502925+0000","last_peered":"2024-04-26T12:33:21.502925+0000","last_clean":"2024-04-26T12:33:21.502925+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:21.502925+0000","last_undegraded":"2024-04-26T12:33:21.502925+0000","last_fullsized":"2024-04-26T12:33:21.502925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:20.540141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550102+0000","last_change":"2024-04-26T12:30:10.516983+0000","last_active":"2024-04-26T12:30:49.550102+0000","last_peered":"2024-04-26T12:30:49.550102+0000","last_clean":"2024-04-26T12:30:49.550102+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:30:49.550102+0000","last_undegraded":"2024-04-26T12:30:49.550102+0000","last_fullsized":"2024-04-26T12:30:49.550102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:02.170720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696304+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:30:49.696304+0000","last_peered":"2024-04-26T12:30:49.696304+0000","last_clean":"2024-04-26T12:30:49.696304+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.696304+0000","last_undegraded":"2024-04-26T12:30:49.696304+0000","last_fullsized":"2024-04-26T12:30:49.696304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:36.830729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542420+0000","last_change":"2024-04-26T12:30:14.491970+0000","last_active":"2024-04-26T12:30:49.542420+0000","last_peered":"2024-04-26T12:30:49.542420+0000","last_clean":"2024-04-26T12:30:49.542420+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:30:49.542420+0000","last_undegraded":"2024-04-26T12:30:49.542420+0000","last_fullsized":"2024-04-26T12:30:49.542420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.888576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'12","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510792+0000","last_change":"2024-04-26T12:30:16.517776+0000","last_active":"2024-04-26T12:32:23.510792+0000","last_peered":"2024-04-26T12:32:23.510792+0000","last_clean":"2024-04-26T12:32:23.510792+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:32:23.510792+0000","last_undegraded":"2024-04-26T12:32:23.510792+0000","last_fullsized":"2024-04-26T12:32:23.510792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:16.311902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625853+0000","last_change":"2024-04-26T12:30:18.513636+0000","last_active":"2024-04-26T12:33:21.625853+0000","last_peered":"2024-04-26T12:33:21.625853+0000","last_clean":"2024-04-26T12:33:21.625853+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:21.625853+0000","last_undegraded":"2024-04-26T12:33:21.625853+0000","last_fullsized":"2024-04-26T12:33:21.625853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:16.493488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540087+0000","last_change":"2024-04-26T12:30:20.532905+0000","last_active":"2024-04-26T12:30:49.540087+0000","last_peered":"2024-04-26T12:30:49.540087+0000","last_clean":"2024-04-26T12:30:49.540087+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:30:49.540087+0000","last_undegraded":"2024-04-26T12:30:49.540087+0000","last_fullsized":"2024-04-26T12:30:49.540087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:44.711542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463354+0000","last_change":"2024-04-26T12:30:12.481683+0000","last_active":"2024-04-26T12:33:21.463354+0000","last_peered":"2024-04-26T12:33:21.463354+0000","last_clean":"2024-04-26T12:33:21.463354+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:21.463354+0000","last_undegraded":"2024-04-26T12:33:21.463354+0000","last_fullsized":"2024-04-26T12:33:21.463354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:19.678454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510273+0000","last_change":"2024-04-26T12:30:10.507125+0000","last_active":"2024-04-26T12:32:23.510273+0000","last_peered":"2024-04-26T12:32:23.510273+0000","last_clean":"2024-04-26T12:32:23.510273+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:32:23.510273+0000","last_undegraded":"2024-04-26T12:32:23.510273+0000","last_fullsized":"2024-04-26T12:32:23.510273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:00.550498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549681+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:30:49.549681+0000","last_peered":"2024-04-26T12:30:49.549681+0000","last_clean":"2024-04-26T12:30:49.549681+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:30:49.549681+0000","last_undegraded":"2024-04-26T12:30:49.549681+0000","last_fullsized":"2024-04-26T12:30:49.549681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:40.435075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542501+0000","last_change":"2024-04-26T12:30:14.491299+0000","last_active":"2024-04-26T12:30:49.542501+0000","last_peered":"2024-04-26T12:30:49.542501+0000","last_clean":"2024-04-26T12:30:49.542501+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:30:49.542501+0000","last_undegraded":"2024-04-26T12:30:49.542501+0000","last_fullsized":"2024-04-26T12:30:49.542501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'84","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.376553+0000","last_change":"2024-04-26T12:30:16.518167+0000","last_active":"2024-04-26T12:32:19.376553+0000","last_peered":"2024-04-26T12:32:19.376553+0000","last_clean":"2024-04-26T12:32:19.376553+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:32:19.376553+0000","last_undegraded":"2024-04-26T12:32:19.376553+0000","last_fullsized":"2024-04-26T12:32:19.376553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:20.616941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694602+0000","last_change":"2024-04-26T12:30:18.522507+0000","last_active":"2024-04-26T12:30:49.694602+0000","last_peered":"2024-04-26T12:30:49.694602+0000","last_clean":"2024-04-26T12:30:49.694602+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:30:49.694602+0000","last_undegraded":"2024-04-26T12:30:49.694602+0000","last_fullsized":"2024-04-26T12:30:49.694602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:14.177370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.492214+0000","last_change":"2024-04-26T12:30:20.530332+0000","last_active":"2024-04-26T12:33:21.492214+0000","last_peered":"2024-04-26T12:33:21.492214+0000","last_clean":"2024-04-26T12:33:21.492214+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:33:21.492214+0000","last_undegraded":"2024-04-26T12:33:21.492214+0000","last_fullsized":"2024-04-26T12:33:21.492214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:21.002104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547852+0000","last_change":"2024-04-26T12:30:20.528129+0000","last_active":"2024-04-26T12:30:49.547852+0000","last_peered":"2024-04-26T12:30:49.547852+0000","last_clean":"2024-04-26T12:30:49.547852+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:30:49.547852+0000","last_undegraded":"2024-04-26T12:30:49.547852+0000","last_fullsized":"2024-04-26T12:30:49.547852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:23.397024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.741112+0000","last_change":"2024-04-26T12:30:12.480553+0000","last_active":"2024-04-26T12:30:54.741112+0000","last_peered":"2024-04-26T12:30:54.741112+0000","last_clean":"2024-04-26T12:30:54.741112+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:30:54.741112+0000","last_undegraded":"2024-04-26T12:30:54.741112+0000","last_fullsized":"2024-04-26T12:30:54.741112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.226828+0000","last_change":"2024-04-26T12:30:10.523769+0000","last_active":"2024-04-26T12:33:21.226828+0000","last_peered":"2024-04-26T12:33:21.226828+0000","last_clean":"2024-04-26T12:33:21.226828+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:33:21.226828+0000","last_undegraded":"2024-04-26T12:33:21.226828+0000","last_fullsized":"2024-04-26T12:33:21.226828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:54.971518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540221+0000","last_change":"2024-04-26T12:30:14.493380+0000","last_active":"2024-04-26T12:30:49.540221+0000","last_peered":"2024-04-26T12:30:49.540221+0000","last_clean":"2024-04-26T12:30:49.540221+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:30:49.540221+0000","last_undegraded":"2024-04-26T12:30:49.540221+0000","last_fullsized":"2024-04-26T12:30:49.540221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:18.581583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.382642+0000","last_change":"2024-04-26T12:30:16.518746+0000","last_active":"2024-04-26T12:32:19.382642+0000","last_peered":"2024-04-26T12:32:19.382642+0000","last_clean":"2024-04-26T12:32:19.382642+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:32:19.382642+0000","last_undegraded":"2024-04-26T12:32:19.382642+0000","last_fullsized":"2024-04-26T12:32:19.382642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:04.293139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544178+0000","last_change":"2024-04-26T12:30:18.529377+0000","last_active":"2024-04-26T12:30:49.544178+0000","last_peered":"2024-04-26T12:30:49.544178+0000","last_clean":"2024-04-26T12:30:49.544178+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:30:49.544178+0000","last_undegraded":"2024-04-26T12:30:49.544178+0000","last_fullsized":"2024-04-26T12:30:49.544178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:31.772676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.057676+0000","last_change":"2024-04-26T12:30:20.528724+0000","last_active":"2024-04-26T12:32:19.057676+0000","last_peered":"2024-04-26T12:32:19.057676+0000","last_clean":"2024-04-26T12:32:19.057676+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:32:19.057676+0000","last_undegraded":"2024-04-26T12:32:19.057676+0000","last_fullsized":"2024-04-26T12:32:19.057676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:50.736220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876246+0000","last_change":"2024-04-26T12:30:49.555701+0000","last_active":"2024-04-26T12:32:20.876246+0000","last_peered":"2024-04-26T12:32:20.876246+0000","last_clean":"2024-04-26T12:32:20.876246+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:32:20.876246+0000","last_undegraded":"2024-04-26T12:32:20.876246+0000","last_fullsized":"2024-04-26T12:32:20.876246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:34.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.600051+0000","last_change":"2024-04-26T12:30:10.502612+0000","last_active":"2024-04-26T12:30:53.600051+0000","last_peered":"2024-04-26T12:30:53.600051+0000","last_clean":"2024-04-26T12:30:53.600051+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:30:53.600051+0000","last_undegraded":"2024-04-26T12:30:53.600051+0000","last_fullsized":"2024-04-26T12:30:53.600051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:03.814159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544101+0000","last_change":"2024-04-26T12:30:14.491480+0000","last_active":"2024-04-26T12:30:49.544101+0000","last_peered":"2024-04-26T12:30:49.544101+0000","last_clean":"2024-04-26T12:30:49.544101+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:30:49.544101+0000","last_undegraded":"2024-04-26T12:30:49.544101+0000","last_fullsized":"2024-04-26T12:30:49.544101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:27.548981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.893403+0000","last_change":"2024-04-26T12:30:16.504440+0000","last_active":"2024-04-26T12:33:20.893403+0000","last_peered":"2024-04-26T12:33:20.893403+0000","last_clean":"2024-04-26T12:33:20.893403+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:20.893403+0000","last_undegraded":"2024-04-26T12:33:20.893403+0000","last_fullsized":"2024-04-26T12:33:20.893403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:12.728383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542390+0000","last_change":"2024-04-26T12:30:18.523667+0000","last_active":"2024-04-26T12:30:49.542390+0000","last_peered":"2024-04-26T12:30:49.542390+0000","last_clean":"2024-04-26T12:30:49.542390+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:30:49.542390+0000","last_undegraded":"2024-04-26T12:30:49.542390+0000","last_fullsized":"2024-04-26T12:30:49.542390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:23.693333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.263020+0000","last_change":"2024-04-26T12:30:20.531528+0000","last_active":"2024-04-26T12:33:21.263020+0000","last_peered":"2024-04-26T12:33:21.263020+0000","last_clean":"2024-04-26T12:33:21.263020+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:33:21.263020+0000","last_undegraded":"2024-04-26T12:33:21.263020+0000","last_fullsized":"2024-04-26T12:33:21.263020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:58.871702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876582+0000","last_change":"2024-04-26T12:30:12.482043+0000","last_active":"2024-04-26T12:32:20.876582+0000","last_peered":"2024-04-26T12:32:20.876582+0000","last_clean":"2024-04-26T12:32:20.876582+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:32:20.876582+0000","last_undegraded":"2024-04-26T12:32:20.876582+0000","last_fullsized":"2024-04-26T12:32:20.876582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546282+0000","last_change":"2024-04-26T12:30:10.493462+0000","last_active":"2024-04-26T12:30:49.546282+0000","last_peered":"2024-04-26T12:30:49.546282+0000","last_clean":"2024-04-26T12:30:49.546282+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:30:49.546282+0000","last_undegraded":"2024-04-26T12:30:49.546282+0000","last_fullsized":"2024-04-26T12:30:49.546282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.482873+0000","last_change":"2024-04-26T12:30:14.489635+0000","last_active":"2024-04-26T12:32:20.482873+0000","last_peered":"2024-04-26T12:32:20.482873+0000","last_clean":"2024-04-26T12:32:20.482873+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:32:20.482873+0000","last_undegraded":"2024-04-26T12:32:20.482873+0000","last_fullsized":"2024-04-26T12:32:20.482873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:54.728684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.957035+0000","last_change":"2024-04-26T12:30:16.507208+0000","last_active":"2024-04-26T12:33:20.957035+0000","last_peered":"2024-04-26T12:33:20.957035+0000","last_clean":"2024-04-26T12:33:20.957035+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:20.957035+0000","last_undegraded":"2024-04-26T12:33:20.957035+0000","last_fullsized":"2024-04-26T12:33:20.957035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:41.932885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539732+0000","last_change":"2024-04-26T12:30:18.521304+0000","last_active":"2024-04-26T12:30:49.539732+0000","last_peered":"2024-04-26T12:30:49.539732+0000","last_clean":"2024-04-26T12:30:49.539732+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:30:49.539732+0000","last_undegraded":"2024-04-26T12:30:49.539732+0000","last_fullsized":"2024-04-26T12:30:49.539732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:41.695559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545725+0000","last_change":"2024-04-26T12:30:20.524900+0000","last_active":"2024-04-26T12:30:49.545725+0000","last_peered":"2024-04-26T12:30:49.545725+0000","last_clean":"2024-04-26T12:30:49.545725+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:30:49.545725+0000","last_undegraded":"2024-04-26T12:30:49.545725+0000","last_fullsized":"2024-04-26T12:30:49.545725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:29.025840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463384+0000","last_change":"2024-04-26T12:30:12.502223+0000","last_active":"2024-04-26T12:33:21.463384+0000","last_peered":"2024-04-26T12:33:21.463384+0000","last_clean":"2024-04-26T12:33:21.463384+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:21.463384+0000","last_undegraded":"2024-04-26T12:33:21.463384+0000","last_fullsized":"2024-04-26T12:33:21.463384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:06.713634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542218+0000","last_change":"2024-04-26T12:30:10.513562+0000","last_active":"2024-04-26T12:30:49.542218+0000","last_peered":"2024-04-26T12:30:49.542218+0000","last_clean":"2024-04-26T12:30:49.542218+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:30:49.542218+0000","last_undegraded":"2024-04-26T12:30:49.542218+0000","last_fullsized":"2024-04-26T12:30:49.542218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:55.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542323+0000","last_change":"2024-04-26T12:30:14.490374+0000","last_active":"2024-04-26T12:30:49.542323+0000","last_peered":"2024-04-26T12:30:49.542323+0000","last_clean":"2024-04-26T12:30:49.542323+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:30:49.542323+0000","last_undegraded":"2024-04-26T12:30:49.542323+0000","last_fullsized":"2024-04-26T12:30:49.542323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:12.379331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.368648+0000","last_change":"2024-04-26T12:30:16.511513+0000","last_active":"2024-04-26T12:32:19.368648+0000","last_peered":"2024-04-26T12:32:19.368648+0000","last_clean":"2024-04-26T12:32:19.368648+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:32:19.368648+0000","last_undegraded":"2024-04-26T12:32:19.368648+0000","last_fullsized":"2024-04-26T12:32:19.368648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:54.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542848+0000","last_change":"2024-04-26T12:30:18.515934+0000","last_active":"2024-04-26T12:30:49.542848+0000","last_peered":"2024-04-26T12:30:49.542848+0000","last_clean":"2024-04-26T12:30:49.542848+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:30:49.542848+0000","last_undegraded":"2024-04-26T12:30:49.542848+0000","last_fullsized":"2024-04-26T12:30:49.542848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:25.200262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.185099+0000","last_change":"2024-04-26T12:30:12.490077+0000","last_active":"2024-04-26T12:30:55.185099+0000","last_peered":"2024-04-26T12:30:55.185099+0000","last_clean":"2024-04-26T12:30:55.185099+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:30:55.185099+0000","last_undegraded":"2024-04-26T12:30:55.185099+0000","last_fullsized":"2024-04-26T12:30:55.185099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:11.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542763+0000","last_change":"2024-04-26T12:30:10.523507+0000","last_active":"2024-04-26T12:30:49.542763+0000","last_peered":"2024-04-26T12:30:49.542763+0000","last_clean":"2024-04-26T12:30:49.542763+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:30:49.542763+0000","last_undegraded":"2024-04-26T12:30:49.542763+0000","last_fullsized":"2024-04-26T12:30:49.542763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:43.079489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696240+0000","last_change":"2024-04-26T12:30:14.487589+0000","last_active":"2024-04-26T12:30:49.696240+0000","last_peered":"2024-04-26T12:30:49.696240+0000","last_clean":"2024-04-26T12:30:49.696240+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:30:49.696240+0000","last_undegraded":"2024-04-26T12:30:49.696240+0000","last_fullsized":"2024-04-26T12:30:49.696240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:18.599868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.388968+0000","last_change":"2024-04-26T12:30:16.510514+0000","last_active":"2024-04-26T12:32:19.388968+0000","last_peered":"2024-04-26T12:32:19.388968+0000","last_clean":"2024-04-26T12:32:19.388968+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:32:19.388968+0000","last_undegraded":"2024-04-26T12:32:19.388968+0000","last_fullsized":"2024-04-26T12:32:19.388968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:58.939474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543187+0000","last_change":"2024-04-26T12:30:18.517450+0000","last_active":"2024-04-26T12:30:49.543187+0000","last_peered":"2024-04-26T12:30:49.543187+0000","last_clean":"2024-04-26T12:30:49.543187+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:30:49.543187+0000","last_undegraded":"2024-04-26T12:30:49.543187+0000","last_fullsized":"2024-04-26T12:30:49.543187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:21.795370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.814710+0000","last_change":"2024-04-26T12:30:20.523862+0000","last_active":"2024-04-26T12:32:20.814710+0000","last_peered":"2024-04-26T12:32:20.814710+0000","last_clean":"2024-04-26T12:32:20.814710+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:32:20.814710+0000","last_undegraded":"2024-04-26T12:32:20.814710+0000","last_fullsized":"2024-04-26T12:32:20.814710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:24.979123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470742+0000","last_change":"2024-04-26T12:30:12.496190+0000","last_active":"2024-04-26T12:30:54.470742+0000","last_peered":"2024-04-26T12:30:54.470742+0000","last_clean":"2024-04-26T12:30:54.470742+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:30:54.470742+0000","last_undegraded":"2024-04-26T12:30:54.470742+0000","last_fullsized":"2024-04-26T12:30:54.470742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:40.668373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.455964+0000","last_change":"2024-04-26T12:30:10.495713+0000","last_active":"2024-04-26T12:33:21.455964+0000","last_peered":"2024-04-26T12:33:21.455964+0000","last_clean":"2024-04-26T12:33:21.455964+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:33:21.455964+0000","last_undegraded":"2024-04-26T12:33:21.455964+0000","last_fullsized":"2024-04-26T12:33:21.455964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:07.560296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548625+0000","last_change":"2024-04-26T12:30:14.491780+0000","last_active":"2024-04-26T12:30:49.548625+0000","last_peered":"2024-04-26T12:30:49.548625+0000","last_clean":"2024-04-26T12:30:49.548625+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:30:49.548625+0000","last_undegraded":"2024-04-26T12:30:49.548625+0000","last_fullsized":"2024-04-26T12:30:49.548625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514934+0000","last_change":"2024-04-26T12:30:16.514001+0000","last_active":"2024-04-26T12:32:48.514934+0000","last_peered":"2024-04-26T12:32:48.514934+0000","last_clean":"2024-04-26T12:32:48.514934+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:32:48.514934+0000","last_undegraded":"2024-04-26T12:32:48.514934+0000","last_fullsized":"2024-04-26T12:32:48.514934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:45.982767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546565+0000","last_change":"2024-04-26T12:30:18.528125+0000","last_active":"2024-04-26T12:30:49.546565+0000","last_peered":"2024-04-26T12:30:49.546565+0000","last_clean":"2024-04-26T12:30:49.546565+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:30:49.546565+0000","last_undegraded":"2024-04-26T12:30:49.546565+0000","last_fullsized":"2024-04-26T12:30:49.546565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:27.914789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542587+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:30:49.542587+0000","last_peered":"2024-04-26T12:30:49.542587+0000","last_clean":"2024-04-26T12:30:49.542587+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:30:49.542587+0000","last_undegraded":"2024-04-26T12:30:49.542587+0000","last_fullsized":"2024-04-26T12:30:49.542587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:46.834895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246915+0000","last_change":"2024-04-26T12:30:12.501410+0000","last_active":"2024-04-26T12:33:21.246915+0000","last_peered":"2024-04-26T12:33:21.246915+0000","last_clean":"2024-04-26T12:33:21.246915+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:21.246915+0000","last_undegraded":"2024-04-26T12:33:21.246915+0000","last_fullsized":"2024-04-26T12:33:21.246915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:12.616162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540042+0000","last_change":"2024-04-26T12:30:10.511419+0000","last_active":"2024-04-26T12:30:49.540042+0000","last_peered":"2024-04-26T12:30:49.540042+0000","last_clean":"2024-04-26T12:30:49.540042+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:30:49.540042+0000","last_undegraded":"2024-04-26T12:30:49.540042+0000","last_fullsized":"2024-04-26T12:30:49.540042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.067840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545955+0000","last_change":"2024-04-26T12:30:14.492168+0000","last_active":"2024-04-26T12:30:49.545955+0000","last_peered":"2024-04-26T12:30:49.545955+0000","last_clean":"2024-04-26T12:30:49.545955+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:30:49.545955+0000","last_undegraded":"2024-04-26T12:30:49.545955+0000","last_fullsized":"2024-04-26T12:30:49.545955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:24.135193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.386930+0000","last_change":"2024-04-26T12:30:16.515815+0000","last_active":"2024-04-26T12:32:19.386930+0000","last_peered":"2024-04-26T12:32:19.386930+0000","last_clean":"2024-04-26T12:32:19.386930+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:32:19.386930+0000","last_undegraded":"2024-04-26T12:32:19.386930+0000","last_fullsized":"2024-04-26T12:32:19.386930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:21.684193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695869+0000","last_change":"2024-04-26T12:30:18.517414+0000","last_active":"2024-04-26T12:30:49.695869+0000","last_peered":"2024-04-26T12:30:49.695869+0000","last_clean":"2024-04-26T12:30:49.695869+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:30:49.695869+0000","last_undegraded":"2024-04-26T12:30:49.695869+0000","last_fullsized":"2024-04-26T12:30:49.695869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:01.210587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.872383+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:20.872383+0000","last_peered":"2024-04-26T12:32:20.872383+0000","last_clean":"2024-04-26T12:32:20.872383+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:20.872383+0000","last_undegraded":"2024-04-26T12:32:20.872383+0000","last_fullsized":"2024-04-26T12:32:20.872383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:23.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184192+0000","last_change":"2024-04-26T12:30:12.491493+0000","last_active":"2024-04-26T12:30:55.184192+0000","last_peered":"2024-04-26T12:30:55.184192+0000","last_clean":"2024-04-26T12:30:55.184192+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:30:55.184192+0000","last_undegraded":"2024-04-26T12:30:55.184192+0000","last_fullsized":"2024-04-26T12:30:55.184192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.962314+0000","last_change":"2024-04-26T12:30:10.521621+0000","last_active":"2024-04-26T12:31:36.962314+0000","last_peered":"2024-04-26T12:31:36.962314+0000","last_clean":"2024-04-26T12:31:36.962314+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:31:36.962314+0000","last_undegraded":"2024-04-26T12:31:36.962314+0000","last_fullsized":"2024-04-26T12:31:36.962314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:00.153870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552309+0000","last_change":"2024-04-26T12:30:49.551612+0000","last_active":"2024-04-26T12:30:49.552309+0000","last_peered":"2024-04-26T12:30:49.552309+0000","last_clean":"2024-04-26T12:30:49.552309+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:30:49.552309+0000","last_undegraded":"2024-04-26T12:30:49.552309+0000","last_fullsized":"2024-04-26T12:30:49.552309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:14.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548162+0000","last_change":"2024-04-26T12:30:16.518414+0000","last_active":"2024-04-26T12:30:49.548162+0000","last_peered":"2024-04-26T12:30:49.548162+0000","last_clean":"2024-04-26T12:30:49.548162+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:30:49.548162+0000","last_undegraded":"2024-04-26T12:30:49.548162+0000","last_fullsized":"2024-04-26T12:30:49.548162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:21.610161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574526+0000","last_change":"2024-04-26T12:30:18.528239+0000","last_active":"2024-04-26T12:33:19.574526+0000","last_peered":"2024-04-26T12:33:19.574526+0000","last_clean":"2024-04-26T12:33:19.574526+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:19.574526+0000","last_undegraded":"2024-04-26T12:33:19.574526+0000","last_fullsized":"2024-04-26T12:33:19.574526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:47.632613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541970+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:30:49.541970+0000","last_peered":"2024-04-26T12:30:49.541970+0000","last_clean":"2024-04-26T12:30:49.541970+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:30:49.541970+0000","last_undegraded":"2024-04-26T12:30:49.541970+0000","last_fullsized":"2024-04-26T12:30:49.541970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:10.582606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532264+0000","last_change":"2024-04-26T12:30:12.489089+0000","last_active":"2024-04-26T12:33:21.532264+0000","last_peered":"2024-04-26T12:33:21.532264+0000","last_clean":"2024-04-26T12:33:21.532264+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:33:21.532264+0000","last_undegraded":"2024-04-26T12:33:21.532264+0000","last_fullsized":"2024-04-26T12:33:21.532264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:27.764119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540869+0000","last_change":"2024-04-26T12:30:10.510186+0000","last_active":"2024-04-26T12:30:49.540869+0000","last_peered":"2024-04-26T12:30:49.540869+0000","last_clean":"2024-04-26T12:30:49.540869+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:30:49.540869+0000","last_undegraded":"2024-04-26T12:30:49.540869+0000","last_fullsized":"2024-04-26T12:30:49.540869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:42.962774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539905+0000","last_change":"2024-04-26T12:30:14.494783+0000","last_active":"2024-04-26T12:30:49.539905+0000","last_peered":"2024-04-26T12:30:49.539905+0000","last_clean":"2024-04-26T12:30:49.539905+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:30:49.539905+0000","last_undegraded":"2024-04-26T12:30:49.539905+0000","last_fullsized":"2024-04-26T12:30:49.539905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.720169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513524+0000","last_change":"2024-04-26T12:30:16.512429+0000","last_active":"2024-04-26T12:32:43.513524+0000","last_peered":"2024-04-26T12:32:43.513524+0000","last_clean":"2024-04-26T12:32:43.513524+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:32:43.513524+0000","last_undegraded":"2024-04-26T12:32:43.513524+0000","last_fullsized":"2024-04-26T12:32:43.513524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:08.544396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694012+0000","last_change":"2024-04-26T12:30:18.523480+0000","last_active":"2024-04-26T12:30:49.694012+0000","last_peered":"2024-04-26T12:30:49.694012+0000","last_clean":"2024-04-26T12:30:49.694012+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:30:49.694012+0000","last_undegraded":"2024-04-26T12:30:49.694012+0000","last_fullsized":"2024-04-26T12:30:49.694012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.217886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.584682+0000","last_change":"2024-04-26T12:30:20.530957+0000","last_active":"2024-04-26T12:33:21.584682+0000","last_peered":"2024-04-26T12:33:21.584682+0000","last_clean":"2024-04-26T12:33:21.584682+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:21.584682+0000","last_undegraded":"2024-04-26T12:33:21.584682+0000","last_fullsized":"2024-04-26T12:33:21.584682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:59.026673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532275+0000","last_change":"2024-04-26T12:30:12.489703+0000","last_active":"2024-04-26T12:33:21.532275+0000","last_peered":"2024-04-26T12:33:21.532275+0000","last_clean":"2024-04-26T12:33:21.532275+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:33:21.532275+0000","last_undegraded":"2024-04-26T12:33:21.532275+0000","last_fullsized":"2024-04-26T12:33:21.532275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.458788+0000","last_change":"2024-04-26T12:30:10.524731+0000","last_active":"2024-04-26T12:33:21.458788+0000","last_peered":"2024-04-26T12:33:21.458788+0000","last_clean":"2024-04-26T12:33:21.458788+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:33:21.458788+0000","last_undegraded":"2024-04-26T12:33:21.458788+0000","last_fullsized":"2024-04-26T12:33:21.458788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:06.694451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547176+0000","last_change":"2024-04-26T12:30:14.488779+0000","last_active":"2024-04-26T12:30:49.547176+0000","last_peered":"2024-04-26T12:30:49.547176+0000","last_clean":"2024-04-26T12:30:49.547176+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:30:49.547176+0000","last_undegraded":"2024-04-26T12:30:49.547176+0000","last_fullsized":"2024-04-26T12:30:49.547176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:34.470851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.361600+0000","last_change":"2024-04-26T12:30:16.518549+0000","last_active":"2024-04-26T12:32:19.361600+0000","last_peered":"2024-04-26T12:32:19.361600+0000","last_clean":"2024-04-26T12:32:19.361600+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:32:19.361600+0000","last_undegraded":"2024-04-26T12:32:19.361600+0000","last_fullsized":"2024-04-26T12:32:19.361600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:28.849038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541960+0000","last_change":"2024-04-26T12:30:18.524599+0000","last_active":"2024-04-26T12:30:49.541960+0000","last_peered":"2024-04-26T12:30:49.541960+0000","last_clean":"2024-04-26T12:30:49.541960+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:30:49.541960+0000","last_undegraded":"2024-04-26T12:30:49.541960+0000","last_fullsized":"2024-04-26T12:30:49.541960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:26.643236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548824+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:30:49.548824+0000","last_peered":"2024-04-26T12:30:49.548824+0000","last_clean":"2024-04-26T12:30:49.548824+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:30:49.548824+0000","last_undegraded":"2024-04-26T12:30:49.548824+0000","last_fullsized":"2024-04-26T12:30:49.548824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:11.794456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503846+0000","last_change":"2024-04-26T12:30:12.489639+0000","last_active":"2024-04-26T12:33:21.503846+0000","last_peered":"2024-04-26T12:33:21.503846+0000","last_clean":"2024-04-26T12:33:21.503846+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:33:21.503846+0000","last_undegraded":"2024-04-26T12:33:21.503846+0000","last_fullsized":"2024-04-26T12:33:21.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:16.575048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.181506+0000","last_change":"2024-04-26T12:30:10.499110+0000","last_active":"2024-04-26T12:31:37.181506+0000","last_peered":"2024-04-26T12:31:37.181506+0000","last_clean":"2024-04-26T12:31:37.181506+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:31:37.181506+0000","last_undegraded":"2024-04-26T12:31:37.181506+0000","last_fullsized":"2024-04-26T12:31:37.181506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539490+0000","last_change":"2024-04-26T12:30:14.488627+0000","last_active":"2024-04-26T12:30:49.539490+0000","last_peered":"2024-04-26T12:30:49.539490+0000","last_clean":"2024-04-26T12:30:49.539490+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:30:49.539490+0000","last_undegraded":"2024-04-26T12:30:49.539490+0000","last_fullsized":"2024-04-26T12:30:49.539490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:28.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.384499+0000","last_change":"2024-04-26T12:30:16.515666+0000","last_active":"2024-04-26T12:32:19.384499+0000","last_peered":"2024-04-26T12:32:19.384499+0000","last_clean":"2024-04-26T12:32:19.384499+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:32:19.384499+0000","last_undegraded":"2024-04-26T12:32:19.384499+0000","last_fullsized":"2024-04-26T12:32:19.384499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:54.930500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543436+0000","last_change":"2024-04-26T12:30:18.524792+0000","last_active":"2024-04-26T12:30:49.543436+0000","last_peered":"2024-04-26T12:30:49.543436+0000","last_clean":"2024-04-26T12:30:49.543436+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:30:49.543436+0000","last_undegraded":"2024-04-26T12:30:49.543436+0000","last_fullsized":"2024-04-26T12:30:49.543436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:45.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.394040+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:19.394040+0000","last_peered":"2024-04-26T12:32:19.394040+0000","last_clean":"2024-04-26T12:32:19.394040+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:19.394040+0000","last_undegraded":"2024-04-26T12:32:19.394040+0000","last_fullsized":"2024-04-26T12:32:19.394040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:13.513806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971456+0000","last_change":"2024-04-26T12:30:12.482428+0000","last_active":"2024-04-26T12:31:36.971456+0000","last_peered":"2024-04-26T12:31:36.971456+0000","last_clean":"2024-04-26T12:31:36.971456+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:31:36.971456+0000","last_undegraded":"2024-04-26T12:31:36.971456+0000","last_fullsized":"2024-04-26T12:31:36.971456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.258549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544532+0000","last_change":"2024-04-26T12:30:10.515261+0000","last_active":"2024-04-26T12:30:49.544532+0000","last_peered":"2024-04-26T12:30:49.544532+0000","last_clean":"2024-04-26T12:30:49.544532+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:30:49.544532+0000","last_undegraded":"2024-04-26T12:30:49.544532+0000","last_fullsized":"2024-04-26T12:30:49.544532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:36.842504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.069122+0000","last_change":"2024-04-26T12:30:14.488530+0000","last_active":"2024-04-26T12:32:18.069122+0000","last_peered":"2024-04-26T12:32:18.069122+0000","last_clean":"2024-04-26T12:32:18.069122+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:32:18.069122+0000","last_undegraded":"2024-04-26T12:32:18.069122+0000","last_fullsized":"2024-04-26T12:32:18.069122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:22.546676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.894295+0000","last_change":"2024-04-26T12:30:16.516514+0000","last_active":"2024-04-26T12:33:20.894295+0000","last_peered":"2024-04-26T12:33:20.894295+0000","last_clean":"2024-04-26T12:33:20.894295+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:20.894295+0000","last_undegraded":"2024-04-26T12:33:20.894295+0000","last_fullsized":"2024-04-26T12:33:20.894295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:03.784951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695165+0000","last_change":"2024-04-26T12:30:18.526314+0000","last_active":"2024-04-26T12:30:49.695165+0000","last_peered":"2024-04-26T12:30:49.695165+0000","last_clean":"2024-04-26T12:30:49.695165+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:30:49.695165+0000","last_undegraded":"2024-04-26T12:30:49.695165+0000","last_fullsized":"2024-04-26T12:30:49.695165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:18.995256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.873981+0000","last_change":"2024-04-26T12:30:20.523635+0000","last_active":"2024-04-26T12:32:20.873981+0000","last_peered":"2024-04-26T12:32:20.873981+0000","last_clean":"2024-04-26T12:32:20.873981+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:32:20.873981+0000","last_undegraded":"2024-04-26T12:32:20.873981+0000","last_fullsized":"2024-04-26T12:32:20.873981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.904423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463404+0000","last_change":"2024-04-26T12:30:12.499038+0000","last_active":"2024-04-26T12:33:21.463404+0000","last_peered":"2024-04-26T12:33:21.463404+0000","last_clean":"2024-04-26T12:33:21.463404+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:21.463404+0000","last_undegraded":"2024-04-26T12:33:21.463404+0000","last_fullsized":"2024-04-26T12:33:21.463404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:46.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543304+0000","last_change":"2024-04-26T12:30:10.508462+0000","last_active":"2024-04-26T12:30:49.543304+0000","last_peered":"2024-04-26T12:30:49.543304+0000","last_clean":"2024-04-26T12:30:49.543304+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:30:49.543304+0000","last_undegraded":"2024-04-26T12:30:49.543304+0000","last_fullsized":"2024-04-26T12:30:49.543304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503030+0000","last_change":"2024-04-26T12:30:12.488793+0000","last_active":"2024-04-26T12:33:21.503030+0000","last_peered":"2024-04-26T12:33:21.503030+0000","last_clean":"2024-04-26T12:33:21.503030+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:33:21.503030+0000","last_undegraded":"2024-04-26T12:33:21.503030+0000","last_fullsized":"2024-04-26T12:33:21.503030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497835+0000","last_change":"2024-04-26T12:30:10.488944+0000","last_active":"2024-04-26T12:32:17.497835+0000","last_peered":"2024-04-26T12:32:17.497835+0000","last_clean":"2024-04-26T12:32:17.497835+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:32:17.497835+0000","last_undegraded":"2024-04-26T12:32:17.497835+0000","last_fullsized":"2024-04-26T12:32:17.497835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503142+0000","last_change":"2024-04-26T12:30:12.491523+0000","last_active":"2024-04-26T12:33:21.503142+0000","last_peered":"2024-04-26T12:33:21.503142+0000","last_clean":"2024-04-26T12:33:21.503142+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:33:21.503142+0000","last_undegraded":"2024-04-26T12:33:21.503142+0000","last_fullsized":"2024-04-26T12:33:21.503142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:49.059427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.784734+0000","last_change":"2024-04-26T12:30:10.515892+0000","last_active":"2024-04-26T12:32:20.784734+0000","last_peered":"2024-04-26T12:32:20.784734+0000","last_clean":"2024-04-26T12:32:20.784734+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:32:20.784734+0000","last_undegraded":"2024-04-26T12:32:20.784734+0000","last_fullsized":"2024-04-26T12:32:20.784734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:32.895105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531862+0000","last_change":"2024-04-26T12:30:12.491568+0000","last_active":"2024-04-26T12:33:21.531862+0000","last_peered":"2024-04-26T12:33:21.531862+0000","last_clean":"2024-04-26T12:33:21.531862+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:33:21.531862+0000","last_undegraded":"2024-04-26T12:33:21.531862+0000","last_fullsized":"2024-04-26T12:33:21.531862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696298+0000","last_change":"2024-04-26T12:30:10.498184+0000","last_active":"2024-04-26T12:30:49.696298+0000","last_peered":"2024-04-26T12:30:49.696298+0000","last_clean":"2024-04-26T12:30:49.696298+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:30:49.696298+0000","last_undegraded":"2024-04-26T12:30:49.696298+0000","last_fullsized":"2024-04-26T12:30:49.696298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335403+0000","last_change":"2024-04-26T12:30:12.477969+0000","last_active":"2024-04-26T12:33:21.335403+0000","last_peered":"2024-04-26T12:33:21.335403+0000","last_clean":"2024-04-26T12:33:21.335403+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:33:21.335403+0000","last_undegraded":"2024-04-26T12:33:21.335403+0000","last_fullsized":"2024-04-26T12:33:21.335403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696689+0000","last_change":"2024-04-26T12:30:10.505910+0000","last_active":"2024-04-26T12:30:49.696689+0000","last_peered":"2024-04-26T12:30:49.696689+0000","last_clean":"2024-04-26T12:30:49.696689+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:30:49.696689+0000","last_undegraded":"2024-04-26T12:30:49.696689+0000","last_fullsized":"2024-04-26T12:30:49.696689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245421+0000","last_change":"2024-04-26T12:30:12.497999+0000","last_active":"2024-04-26T12:33:21.245421+0000","last_peered":"2024-04-26T12:33:21.245421+0000","last_clean":"2024-04-26T12:33:21.245421+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:21.245421+0000","last_undegraded":"2024-04-26T12:33:21.245421+0000","last_fullsized":"2024-04-26T12:33:21.245421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:08.184825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545212+0000","last_change":"2024-04-26T12:30:10.507425+0000","last_active":"2024-04-26T12:30:49.545212+0000","last_peered":"2024-04-26T12:30:49.545212+0000","last_clean":"2024-04-26T12:30:49.545212+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:30:49.545212+0000","last_undegraded":"2024-04-26T12:30:49.545212+0000","last_fullsized":"2024-04-26T12:30:49.545212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:04.930580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184617+0000","last_change":"2024-04-26T12:30:12.496187+0000","last_active":"2024-04-26T12:30:55.184617+0000","last_peered":"2024-04-26T12:30:55.184617+0000","last_clean":"2024-04-26T12:30:55.184617+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:30:55.184617+0000","last_undegraded":"2024-04-26T12:30:55.184617+0000","last_fullsized":"2024-04-26T12:30:55.184617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546373+0000","last_change":"2024-04-26T12:30:10.504572+0000","last_active":"2024-04-26T12:30:49.546373+0000","last_peered":"2024-04-26T12:30:49.546373+0000","last_clean":"2024-04-26T12:30:49.546373+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:30:49.546373+0000","last_undegraded":"2024-04-26T12:30:49.546373+0000","last_fullsized":"2024-04-26T12:30:49.546373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335198+0000","last_change":"2024-04-26T12:30:12.495561+0000","last_active":"2024-04-26T12:33:21.335198+0000","last_peered":"2024-04-26T12:33:21.335198+0000","last_clean":"2024-04-26T12:33:21.335198+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:33:21.335198+0000","last_undegraded":"2024-04-26T12:33:21.335198+0000","last_fullsized":"2024-04-26T12:33:21.335198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:31.568494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498730+0000","last_change":"2024-04-26T12:30:10.498578+0000","last_active":"2024-04-26T12:32:22.498730+0000","last_peered":"2024-04-26T12:32:22.498730+0000","last_clean":"2024-04-26T12:32:22.498730+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:32:22.498730+0000","last_undegraded":"2024-04-26T12:32:22.498730+0000","last_fullsized":"2024-04-26T12:32:22.498730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:34.399017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503186+0000","last_change":"2024-04-26T12:30:12.496215+0000","last_active":"2024-04-26T12:33:21.503186+0000","last_peered":"2024-04-26T12:33:21.503186+0000","last_clean":"2024-04-26T12:33:21.503186+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:33:21.503186+0000","last_undegraded":"2024-04-26T12:33:21.503186+0000","last_fullsized":"2024-04-26T12:33:21.503186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:43.456916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543053+0000","last_change":"2024-04-26T12:30:10.521412+0000","last_active":"2024-04-26T12:30:49.543053+0000","last_peered":"2024-04-26T12:30:49.543053+0000","last_clean":"2024-04-26T12:30:49.543053+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:30:49.543053+0000","last_undegraded":"2024-04-26T12:30:49.543053+0000","last_fullsized":"2024-04-26T12:30:49.543053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:08.525460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538192+0000","last_change":"2024-04-26T12:30:12.493682+0000","last_active":"2024-04-26T12:33:21.538192+0000","last_peered":"2024-04-26T12:33:21.538192+0000","last_clean":"2024-04-26T12:33:21.538192+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:33:21.538192+0000","last_undegraded":"2024-04-26T12:33:21.538192+0000","last_fullsized":"2024-04-26T12:33:21.538192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.073143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599042+0000","last_change":"2024-04-26T12:30:10.498422+0000","last_active":"2024-04-26T12:30:53.599042+0000","last_peered":"2024-04-26T12:30:53.599042+0000","last_clean":"2024-04-26T12:30:53.599042+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:30:53.599042+0000","last_undegraded":"2024-04-26T12:30:53.599042+0000","last_fullsized":"2024-04-26T12:30:53.599042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502775+0000","last_change":"2024-04-26T12:30:12.484594+0000","last_active":"2024-04-26T12:33:21.502775+0000","last_peered":"2024-04-26T12:33:21.502775+0000","last_clean":"2024-04-26T12:33:21.502775+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:33:21.502775+0000","last_undegraded":"2024-04-26T12:33:21.502775+0000","last_fullsized":"2024-04-26T12:33:21.502775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:38.153666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540357+0000","last_change":"2024-04-26T12:30:10.514358+0000","last_active":"2024-04-26T12:30:49.540357+0000","last_peered":"2024-04-26T12:30:49.540357+0000","last_clean":"2024-04-26T12:30:49.540357+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:30:49.540357+0000","last_undegraded":"2024-04-26T12:30:49.540357+0000","last_fullsized":"2024-04-26T12:30:49.540357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:45.443501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531987+0000","last_change":"2024-04-26T12:30:12.496055+0000","last_active":"2024-04-26T12:33:21.531987+0000","last_peered":"2024-04-26T12:33:21.531987+0000","last_clean":"2024-04-26T12:33:21.531987+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:33:21.531987+0000","last_undegraded":"2024-04-26T12:33:21.531987+0000","last_fullsized":"2024-04-26T12:33:21.531987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:19.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599086+0000","last_change":"2024-04-26T12:30:10.507296+0000","last_active":"2024-04-26T12:30:53.599086+0000","last_peered":"2024-04-26T12:30:53.599086+0000","last_clean":"2024-04-26T12:30:53.599086+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:30:53.599086+0000","last_undegraded":"2024-04-26T12:30:53.599086+0000","last_fullsized":"2024-04-26T12:30:53.599086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:46.489435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246626+0000","last_change":"2024-04-26T12:30:12.494305+0000","last_active":"2024-04-26T12:33:21.246626+0000","last_peered":"2024-04-26T12:33:21.246626+0000","last_clean":"2024-04-26T12:33:21.246626+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:33:21.246626+0000","last_undegraded":"2024-04-26T12:33:21.246626+0000","last_fullsized":"2024-04-26T12:33:21.246626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:08.704032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547543+0000","last_change":"2024-04-26T12:30:10.523912+0000","last_active":"2024-04-26T12:30:49.547543+0000","last_peered":"2024-04-26T12:30:49.547543+0000","last_clean":"2024-04-26T12:30:49.547543+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:30:49.547543+0000","last_undegraded":"2024-04-26T12:30:49.547543+0000","last_fullsized":"2024-04-26T12:30:49.547543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:29.542497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510934+0000","last_change":"2024-04-26T12:30:12.497891+0000","last_active":"2024-04-26T12:32:28.510934+0000","last_peered":"2024-04-26T12:32:28.510934+0000","last_clean":"2024-04-26T12:32:28.510934+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:32:28.510934+0000","last_undegraded":"2024-04-26T12:32:28.510934+0000","last_fullsized":"2024-04-26T12:32:28.510934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:40.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.830958+0000","last_change":"2024-04-26T12:30:10.523924+0000","last_active":"2024-04-26T12:32:20.830958+0000","last_peered":"2024-04-26T12:32:20.830958+0000","last_clean":"2024-04-26T12:32:20.830958+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:32:20.830958+0000","last_undegraded":"2024-04-26T12:32:20.830958+0000","last_fullsized":"2024-04-26T12:32:20.830958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:59.395818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543474+0000","last_change":"2024-04-26T12:30:12.498180+0000","last_active":"2024-04-26T12:30:49.543474+0000","last_peered":"2024-04-26T12:30:49.543474+0000","last_clean":"2024-04-26T12:30:49.543474+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:30:49.543474+0000","last_undegraded":"2024-04-26T12:30:49.543474+0000","last_fullsized":"2024-04-26T12:30:49.543474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.633561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549751+0000","last_change":"2024-04-26T12:30:10.501961+0000","last_active":"2024-04-26T12:30:49.549751+0000","last_peered":"2024-04-26T12:30:49.549751+0000","last_clean":"2024-04-26T12:30:49.549751+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:30:49.549751+0000","last_undegraded":"2024-04-26T12:30:49.549751+0000","last_fullsized":"2024-04-26T12:30:49.549751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.244728+0000","last_change":"2024-04-26T12:30:12.493588+0000","last_active":"2024-04-26T12:33:21.244728+0000","last_peered":"2024-04-26T12:33:21.244728+0000","last_clean":"2024-04-26T12:33:21.244728+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:33:21.244728+0000","last_undegraded":"2024-04-26T12:33:21.244728+0000","last_fullsized":"2024-04-26T12:33:21.244728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:20.498299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549200+0000","last_change":"2024-04-26T12:30:10.513455+0000","last_active":"2024-04-26T12:30:49.549200+0000","last_peered":"2024-04-26T12:30:49.549200+0000","last_clean":"2024-04-26T12:30:49.549200+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:30:49.549200+0000","last_undegraded":"2024-04-26T12:30:49.549200+0000","last_fullsized":"2024-04-26T12:30:49.549200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:32.904261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.450276+0000","last_change":"2024-04-26T12:30:10.520879+0000","last_active":"2024-04-26T12:33:21.450276+0000","last_peered":"2024-04-26T12:33:21.450276+0000","last_clean":"2024-04-26T12:33:21.450276+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:33:21.450276+0000","last_undegraded":"2024-04-26T12:33:21.450276+0000","last_fullsized":"2024-04-26T12:33:21.450276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:22.136008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531885+0000","last_change":"2024-04-26T12:30:12.500495+0000","last_active":"2024-04-26T12:33:21.531885+0000","last_peered":"2024-04-26T12:33:21.531885+0000","last_clean":"2024-04-26T12:33:21.531885+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:21.531885+0000","last_undegraded":"2024-04-26T12:33:21.531885+0000","last_fullsized":"2024-04-26T12:33:21.531885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.554347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694784+0000","last_change":"2024-04-26T12:30:10.505951+0000","last_active":"2024-04-26T12:30:49.694784+0000","last_peered":"2024-04-26T12:30:49.694784+0000","last_clean":"2024-04-26T12:30:49.694784+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:30:49.694784+0000","last_undegraded":"2024-04-26T12:30:49.694784+0000","last_fullsized":"2024-04-26T12:30:49.694784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341621+0000","last_change":"2024-04-26T12:30:12.498902+0000","last_active":"2024-04-26T12:33:21.341621+0000","last_peered":"2024-04-26T12:33:21.341621+0000","last_clean":"2024-04-26T12:33:21.341621+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:21.341621+0000","last_undegraded":"2024-04-26T12:33:21.341621+0000","last_fullsized":"2024-04-26T12:33:21.341621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:34.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35872,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335968,"statfs":{"total":96636764160,"available":96600031232,"internally_reserved":0,"allocated":9068544,"data_stored":8752596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":9408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":9633792,"data_stored":9342879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48320,"kb_used_data":8824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323520,"statfs":{"total":96636764160,"available":96587284480,"internally_reserved":0,"allocated":9035776,"data_stored":8750874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:33:29.248 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:33:29.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.373+0000 7ffb185c2640 1 Processor -- start 2024-04-26T12:33:29.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb185c2640 1 -- start start 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb185c2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb1012c1e0 0x7ffb1012c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb185c2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1006b4b0 con 0x7ffb1012cc40 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb185c2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ffb10070360 con 0x7ffb1012c1e0 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb1635e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb1012c1e0 0x7ffb1012c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb15b5d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffb1012cc40 0x7ffb10128c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43226/0 (socket says 172.21.15.132:43226) 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb15b5d640 1 -- 172.21.15.132:0/1276284498 learned_addr learned my addr 172.21.15.132:0/1276284498 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb1635e640 1 -- 172.21.15.132:0/1276284498 >> v1:172.21.15.132:6789/0 conn(0x7ffb1012cc40 legacy=0x7ffb10128c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.374+0000 7ffb1635e640 1 -- 172.21.15.132:0/1276284498 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1008edd0 con 0x7ffb1012c1e0 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.375+0000 7ffb1635e640 1 --2- 172.21.15.132:0/1276284498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb1012c700 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009720 tx=0x7ffb0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c7763d8b2c5863 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.375+0000 7ffb1535c640 1 -- 172.21.15.132:0/1276284498 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb08035020 con 0x7ffb1012c1e0 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.375+0000 7ffb1535c640 1 -- 172.21.15.132:0/1276284498 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb08031760 con 0x7ffb1012c1e0 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.375+0000 7ffb1535c640 1 -- 172.21.15.132:0/1276284498 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb08031a60 con 0x7ffb1012c1e0 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.376+0000 7ffb185c2640 1 -- 172.21.15.132:0/1276284498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 msgr2=0x7ffb1012c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.376+0000 7ffb185c2640 1 --2- 172.21.15.132:0/1276284498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb1012c700 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009720 tx=0x7ffb0802b8d0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.376+0000 7ffb185c2640 1 -- 172.21.15.132:0/1276284498 shutdown_connections 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.376+0000 7ffb185c2640 1 --2- 172.21.15.132:0/1276284498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb1012c700 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.376+0000 7ffb185c2640 1 -- 172.21.15.132:0/1276284498 >> 172.21.15.132:0/1276284498 conn(0x7ffb1009b7b0 msgr2=0x7ffb1009bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:29.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.376+0000 7ffb185c2640 1 -- 172.21.15.132:0/1276284498 shutdown_connections 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.376+0000 7ffb185c2640 1 -- 172.21.15.132:0/1276284498 wait complete. 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb185c2640 1 Processor -- start 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb185c2640 1 -- start start 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb185c2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb101217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb185c2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1006ffc0 con 0x7ffb1012c1e0 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb1635e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb101217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb1635e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb101217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47374/0 (socket says 172.21.15.132:47374) 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb1635e640 1 -- 172.21.15.132:0/2050489957 learned_addr learned my addr 172.21.15.132:0/2050489957 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.377+0000 7ffb1635e640 1 -- 172.21.15.132:0/2050489957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb10072a20 con 0x7ffb1012c1e0 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.378+0000 7ffb1635e640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb101217e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ffb08034040 tx=0x7ffb080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:29.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.378+0000 7ffb06ffd640 1 -- 172.21.15.132:0/2050489957 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0803a970 con 0x7ffb1012c1e0 2024-04-26T12:33:29.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.378+0000 7ffb06ffd640 1 -- 172.21.15.132:0/2050489957 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0803ab30 con 0x7ffb1012c1e0 2024-04-26T12:33:29.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.378+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1008d6c0 con 0x7ffb1012c1e0 2024-04-26T12:33:29.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.378+0000 7ffb06ffd640 1 -- 172.21.15.132:0/2050489957 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0803ae50 con 0x7ffb1012c1e0 2024-04-26T12:33:29.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.378+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb10124390 con 0x7ffb1012c1e0 2024-04-26T12:33:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.379+0000 7ffb06ffd640 1 -- 172.21.15.132:0/2050489957 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb0804b060 con 0x7ffb1012c1e0 2024-04-26T12:33:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.379+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb10062ed0 con 0x7ffb1012c1e0 2024-04-26T12:33:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.379+0000 7ffb06ffd640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffaf4038200 0x7ffaf403a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.379+0000 7ffb06ffd640 1 -- 172.21.15.132:0/2050489957 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7ffb0806d7d0 con 0x7ffb1012c1e0 2024-04-26T12:33:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.379+0000 7ffb15b5d640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffaf4038200 0x7ffaf403a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:29.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.380+0000 7ffb15b5d640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffaf4038200 0x7ffaf403a6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffb00007fd0 tx=0x7ffb00007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:29.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.383+0000 7ffb06ffd640 1 -- 172.21.15.132:0/2050489957 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb10072a20 con 0x7ffb1012c1e0 2024-04-26T12:33:29.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.556+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb100008d0 con 0x7ffb1012c1e0 2024-04-26T12:33:29.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.558+0000 7ffb06ffd640 1 -- 172.21.15.132:0/2050489957 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+20949 (secure 0 0 0) 0x7ffb0803f070 con 0x7ffb1012c1e0 2024-04-26T12:33:29.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:33:29.559 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"fsid":"9f7de4b1-7365-4f06-b9fa-64d18aa7a81a","created":"2024-04-26T12:29:44.344147+0000","modified":"2024-04-26T12:30:49.535903+0000","last_up_change":"2024-04-26T12:29:53.417591+0000","last_in_change":"2024-04-26T12:29:45.365550+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:29:52.451035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:29:59.844405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T12:30:08.478726+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T12:30:10.806107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T12:30:12.759691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T12:30:14.576233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T12:30:16.537713+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T12:30:18.601083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8400be6-015a-46df-8e1a-eda2d0564826","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6801","nonce":965566727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6803","nonce":965566727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6807","nonce":965566727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":965566727},{"type":"v1","addr":"172.21.15.132:6805","nonce":965566727}]},"public_addr":"172.21.15.132:6801/965566727","cluster_addr":"172.21.15.132:6803/965566727","heartbeat_back_addr":"172.21.15.132:6807/965566727","heartbeat_front_addr":"172.21.15.132:6805/965566727","state":["exists","up"]},{"osd":1,"uuid":"09f70d93-7270-42cb-8c52-5450d8b43f08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6809","nonce":2372702203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6811","nonce":2372702203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6815","nonce":2372702203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2372702203},{"type":"v1","addr":"172.21.15.170:6813","nonce":2372702203}]},"public_addr":"172.21.15.170:6809/2372702203","cluster_addr":"172.21.15.170:6811/2372702203","heartbeat_back_addr":"172.21.15.170:6815/2372702203","heartbeat_front_addr":"172.21.15.170:6813/2372702203","state":["exists","up"]},{"osd":2,"uuid":"87ce142d-2672-47e3-a4fc-29bd7e850b2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6801","nonce":1189813177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6803","nonce":1189813177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6807","nonce":1189813177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":1189813177},{"type":"v1","addr":"172.21.15.170:6805","nonce":1189813177}]},"public_addr":"172.21.15.170:6801/1189813177","cluster_addr":"172.21.15.170:6803/1189813177","heartbeat_back_addr":"172.21.15.170:6807/1189813177","heartbeat_front_addr":"172.21.15.170:6805/1189813177","state":["exists","up"]},{"osd":3,"uuid":"10a2c4a7-0c41-40a3-a637-9ded1c128461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6817","nonce":2349137764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6819","nonce":2349137764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6823","nonce":2349137764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":2349137764},{"type":"v1","addr":"172.21.15.170:6821","nonce":2349137764}]},"public_addr":"172.21.15.170:6817/2349137764","cluster_addr":"172.21.15.170:6819/2349137764","heartbeat_back_addr":"172.21.15.170:6823/2349137764","heartbeat_front_addr":"172.21.15.170:6821/2349137764","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.386095+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.547314+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:51.195588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:29:50.528970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.2","mappings":[{"from":0,"to":2}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.1d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:33:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffaf4038200 msgr2=0x7ffaf403a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffaf4038200 0x7ffaf403a6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffb00007fd0 tx=0x7ffb00007ac0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 msgr2=0x7ffb101217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb101217e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ffb08034040 tx=0x7ffb080046c0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 shutdown_connections 2024-04-26T12:33:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7ffaf4038200 0x7ffaf403a6c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 --2- 172.21.15.132:0/2050489957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1012c1e0 0x7ffb101217e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 >> 172.21.15.132:0/2050489957 conn(0x7ffb1009b7b0 msgr2=0x7ffb101b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 shutdown_connections 2024-04-26T12:33:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:29.560+0000 7ffb185c2640 1 -- 172.21.15.132:0/2050489957 wait complete. 2024-04-26T12:33:30.572 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:33:30.573 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:33:30.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f1554df4640 1 Processor -- start 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f1554df4640 1 -- start start 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f1554df4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f155008d810 0x7f155008dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f1554df4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f155008e930 con 0x7f155008e130 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f1554df4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f155008ef10 con 0x7f155008d810 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f154e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f155008d810 0x7f155008dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f1547fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f155008e130 0x7f155012aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43238/0 (socket says 172.21.15.132:43238) 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f1547fff640 1 -- 172.21.15.132:0/26969147 learned_addr learned my addr 172.21.15.132:0/26969147 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f154e59c640 1 -- 172.21.15.132:0/26969147 >> v1:172.21.15.132:6789/0 conn(0x7f155008e130 legacy=0x7f155012aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.679+0000 7f154e59c640 1 -- 172.21.15.132:0/26969147 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155008e570 con 0x7f155008d810 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.680+0000 7f154e59c640 1 --2- 172.21.15.132:0/26969147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f155008dbf0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1540009720 tx=0x7f154002c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7539e10a811e1b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.680+0000 7f154dd9b640 1 -- 172.21.15.132:0/26969147 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1540035070 con 0x7f155008d810 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.680+0000 7f154dd9b640 1 -- 172.21.15.132:0/26969147 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1540031740 con 0x7f155008d810 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.680+0000 7f154dd9b640 1 -- 172.21.15.132:0/26969147 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1540031a40 con 0x7f155008d810 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.681+0000 7f1554df4640 1 -- 172.21.15.132:0/26969147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 msgr2=0x7f155008dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.681+0000 7f1554df4640 1 --2- 172.21.15.132:0/26969147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f155008dbf0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1540009720 tx=0x7f154002c950 comp rx=0 tx=0).stop 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.681+0000 7f1554df4640 1 -- 172.21.15.132:0/26969147 shutdown_connections 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.681+0000 7f1554df4640 1 --2- 172.21.15.132:0/26969147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f155008dbf0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.681+0000 7f1554df4640 1 -- 172.21.15.132:0/26969147 >> 172.21.15.132:0/26969147 conn(0x7f155009b610 msgr2=0x7f155009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.681+0000 7f1554df4640 1 -- 172.21.15.132:0/26969147 shutdown_connections 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.681+0000 7f1554df4640 1 -- 172.21.15.132:0/26969147 wait complete. 2024-04-26T12:33:30.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.682+0000 7f1554df4640 1 Processor -- start 2024-04-26T12:33:30.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.682+0000 7f1554df4640 1 -- start start 2024-04-26T12:33:30.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.682+0000 7f1554df4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f15501b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:30.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.682+0000 7f1554df4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f155006e120 con 0x7f155008d810 2024-04-26T12:33:30.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.682+0000 7f154e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f15501b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:30.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.682+0000 7f154e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f15501b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47388/0 (socket says 172.21.15.132:47388) 2024-04-26T12:33:30.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.682+0000 7f154e59c640 1 -- 172.21.15.132:0/1038977002 learned_addr learned my addr 172.21.15.132:0/1038977002 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:30.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.683+0000 7f154e59c640 1 -- 172.21.15.132:0/1038977002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15501b3ca0 con 0x7f155008d810 2024-04-26T12:33:30.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.683+0000 7f154e59c640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f15501b0b00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f154002c990 tx=0x7f15400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.683+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f154004a070 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.683+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1540031de0 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.683+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15501b2400 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.683+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1540035040 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.683+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15501b1040 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f154004d070 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15501b1cf0 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1546ffd640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1530038060 0x7f153003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f154002e040 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1546ffd640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7f1530044450 0x7f15300468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1540031740 con 0x7f1530044450 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f15400722a0 con 0x7f155008d810 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f154ed9d640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7f1530044450 0x7f15300468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:30.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.684+0000 7f1547fff640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1530038060 0x7f153003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:30.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.685+0000 7f154ed9d640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7f1530044450 0x7f15300468f0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:30.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.685+0000 7f1547fff640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1530038060 0x7f153003a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f15380015c0 tx=0x7f1538007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:30.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.685+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== osd.0 v2:172.21.15.132:6800/965566727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1540031740 con 0x7f1530044450 2024-04-26T12:33:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 --> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1550062ed0 con 0x7f1530044450 2024-04-26T12:33:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1546ffd640 1 -- 172.21.15.132:0/1038977002 <== osd.0 v2:172.21.15.132:6800/965566727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1550062ed0 con 0x7f1530044450 2024-04-26T12:33:30.699 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-26T12:33:30.700 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:33:30.700 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7f1530044450 msgr2=0x7f15300468f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7f1530044450 0x7f15300468f0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1530038060 msgr2=0x7f153003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1530038060 0x7f153003a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f15380015c0 tx=0x7f1538007a80 comp rx=0 tx=0).stop 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 msgr2=0x7f15501b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f15501b0b00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f154002c990 tx=0x7f15400046c0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 shutdown_connections 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:6800/965566727,v1:172.21.15.132:6801/965566727] conn(0x7f1530044450 0x7f15300468f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f1530038060 0x7f153003a520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 --2- 172.21.15.132:0/1038977002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f155008d810 0x7f15501b0b00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.698+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 >> 172.21.15.132:0/1038977002 conn(0x7f155009b610 msgr2=0x7f15501b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.699+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 shutdown_connections 2024-04-26T12:33:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.699+0000 7f1554df4640 1 -- 172.21.15.132:0/1038977002 wait complete. 2024-04-26T12:33:30.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:33:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd13093b640 1 Processor -- start 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd13093b640 1 -- start start 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd13093b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd12c12b570 0x7fd12c12b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd13093b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12c0969d0 con 0x7fd12c12a130 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd13093b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd12c12b1b0 con 0x7fd12c12b570 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd12a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd12c12b570 0x7fd12c12b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd129d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd12c12a130 0x7fd12c12a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43250/0 (socket says 172.21.15.132:43250) 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.806+0000 7fd129d9b640 1 -- 172.21.15.132:0/1197940052 learned_addr learned my addr 172.21.15.132:0/1197940052 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.807+0000 7fd12a59c640 1 -- 172.21.15.132:0/1197940052 >> v1:172.21.15.132:6789/0 conn(0x7fd12c12a130 legacy=0x7fd12c12a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.807+0000 7fd12a59c640 1 -- 172.21.15.132:0/1197940052 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c06b4a0 con 0x7fd12c12b570 2024-04-26T12:33:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.807+0000 7fd12959a640 1 -- 172.21.15.132:0/1197940052 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418635059 0 0) 0x7fd12c0969d0 con 0x7fd12c12a130 2024-04-26T12:33:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.807+0000 7fd12a59c640 1 --2- 172.21.15.132:0/1197940052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12b570 0x7fd12c12b950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd120009720 tx=0x7fd12002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3f8985f7bdb263 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:30.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.807+0000 7fd12959a640 1 -- 172.21.15.132:0/1197940052 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1200316d0 con 0x7fd12c12b570 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.807+0000 7fd12959a640 1 -- 172.21.15.132:0/1197940052 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd120037070 con 0x7fd12c12b570 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.807+0000 7fd12959a640 1 -- 172.21.15.132:0/1197940052 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1200319c0 con 0x7fd12c12b570 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.808+0000 7fd13093b640 1 -- 172.21.15.132:0/1197940052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12b570 msgr2=0x7fd12c12b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.808+0000 7fd13093b640 1 --2- 172.21.15.132:0/1197940052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12b570 0x7fd12c12b950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd120009720 tx=0x7fd12002b840 comp rx=0 tx=0).stop 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.808+0000 7fd13093b640 1 -- 172.21.15.132:0/1197940052 shutdown_connections 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.808+0000 7fd13093b640 1 --2- 172.21.15.132:0/1197940052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12b570 0x7fd12c12b950 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.808+0000 7fd13093b640 1 -- 172.21.15.132:0/1197940052 >> 172.21.15.132:0/1197940052 conn(0x7fd12c09d020 msgr2=0x7fd12c09d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.808+0000 7fd13093b640 1 -- 172.21.15.132:0/1197940052 shutdown_connections 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.808+0000 7fd13093b640 1 -- 172.21.15.132:0/1197940052 wait complete. 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.809+0000 7fd13093b640 1 Processor -- start 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.809+0000 7fd13093b640 1 -- start start 2024-04-26T12:33:30.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.809+0000 7fd13093b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12a130 0x7fd12c128440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.809+0000 7fd13093b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c095b10 con 0x7fd12c12a130 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd12a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12a130 0x7fd12c128440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd12a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12a130 0x7fd12c128440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47412/0 (socket says 172.21.15.132:47412) 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd12a59c640 1 -- 172.21.15.132:0/3543640761 learned_addr learned my addr 172.21.15.132:0/3543640761 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd12a59c640 1 -- 172.21.15.132:0/3543640761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c06f710 con 0x7fd12c12a130 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd12a59c640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12a130 0x7fd12c128440 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd120009720 tx=0x7fd1200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd11affd640 1 -- 172.21.15.132:0/3543640761 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd120004160 con 0x7fd12c12a130 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd11affd640 1 -- 172.21.15.132:0/3543640761 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd120004320 con 0x7fd12c12a130 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd11affd640 1 -- 172.21.15.132:0/3543640761 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd120032640 con 0x7fd12c12a130 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12c06e750 con 0x7fd12c12a130 2024-04-26T12:33:30.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.810+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd12c06f180 con 0x7fd12c12a130 2024-04-26T12:33:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.811+0000 7fd11affd640 1 -- 172.21.15.132:0/3543640761 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd1200327e0 con 0x7fd12c12a130 2024-04-26T12:33:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.811+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12c062ed0 con 0x7fd12c12a130 2024-04-26T12:33:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.811+0000 7fd11affd640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd10c038060 0x7fd10c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.811+0000 7fd11affd640 1 -- 172.21.15.132:0/3543640761 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fd12002f050 con 0x7fd12c12a130 2024-04-26T12:33:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.812+0000 7fd129d9b640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd10c038060 0x7fd10c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.812+0000 7fd129d9b640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd10c038060 0x7fd10c03a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.816+0000 7fd11affd640 1 -- 172.21.15.132:0/3543640761 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd12006fe20 con 0x7fd12c12a130 2024-04-26T12:33:30.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.989+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd12c1294a0 con 0x7fd10c038060 2024-04-26T12:33:30.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.990+0000 7fd11affd640 1 -- 172.21.15.132:0/3543640761 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd12c1294a0 con 0x7fd10c038060 2024-04-26T12:33:30.991 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:33:30.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd10c038060 msgr2=0x7fd10c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd10c038060 0x7fd10c03a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c007910 comp rx=0 tx=0).stop 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12a130 msgr2=0x7fd12c128440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12a130 0x7fd12c128440 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd120009720 tx=0x7fd1200046c0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 shutdown_connections 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fd10c038060 0x7fd10c03a520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 --2- 172.21.15.132:0/3543640761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd12c12a130 0x7fd12c128440 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 >> 172.21.15.132:0/3543640761 conn(0x7fd12c09d020 msgr2=0x7fd12c1b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 shutdown_connections 2024-04-26T12:33:30.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:30.992+0000 7fd13093b640 1 -- 172.21.15.132:0/3543640761 wait complete. 2024-04-26T12:33:31.004 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:33:31.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.102+0000 7f5eb0bf4640 1 Processor -- start 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.102+0000 7f5eb0bf4640 1 -- start start 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.102+0000 7f5eb0bf4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5eac12d010 0x7f5eac131620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.102+0000 7f5eb0bf4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eac070050 con 0x7f5eac12c300 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.102+0000 7f5eb0bf4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5eac12c6e0 con 0x7f5eac12d010 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.103+0000 7f5ea3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5eac12d010 0x7f5eac131620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.103+0000 7f5eaa59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5eac12c300 0x7f5eac12c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43254/0 (socket says 172.21.15.132:43254) 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.103+0000 7f5eaa59c640 1 -- 172.21.15.132:0/239024944 learned_addr learned my addr 172.21.15.132:0/239024944 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.103+0000 7f5ea3fff640 1 -- 172.21.15.132:0/239024944 >> v1:172.21.15.132:6789/0 conn(0x7f5eac12c300 legacy=0x7f5eac12c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.103+0000 7f5ea3fff640 1 -- 172.21.15.132:0/239024944 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eac08e3a0 con 0x7f5eac12d010 2024-04-26T12:33:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.103+0000 7f5ea3fff640 1 --2- 172.21.15.132:0/239024944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12d010 0x7f5eac131620 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009720 tx=0x7f5e9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c081b51f8530cf8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5ea9d9b640 1 -- 172.21.15.132:0/239024944 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e94035020 con 0x7f5eac12d010 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5ea9d9b640 1 -- 172.21.15.132:0/239024944 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e94031760 con 0x7f5eac12d010 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5ea9d9b640 1 -- 172.21.15.132:0/239024944 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e94031a60 con 0x7f5eac12d010 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/239024944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12d010 msgr2=0x7f5eac131620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/239024944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12d010 0x7f5eac131620 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009720 tx=0x7f5e9402b8d0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/239024944 shutdown_connections 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/239024944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12d010 0x7f5eac131620 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/239024944 >> 172.21.15.132:0/239024944 conn(0x7f5eac09b610 msgr2=0x7f5eac09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/239024944 shutdown_connections 2024-04-26T12:33:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.104+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/239024944 wait complete. 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.105+0000 7f5eb0bf4640 1 Processor -- start 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.105+0000 7f5eb0bf4640 1 -- start start 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.105+0000 7f5eb0bf4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12c300 0x7f5eac12e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.105+0000 7f5eb0bf4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5eac070220 con 0x7f5eac12c300 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5eaa59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12c300 0x7f5eac12e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5eaa59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12c300 0x7f5eac12e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47434/0 (socket says 172.21.15.132:47434) 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5eaa59c640 1 -- 172.21.15.132:0/526767569 learned_addr learned my addr 172.21.15.132:0/526767569 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5eaa59c640 1 -- 172.21.15.132:0/526767569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eac12f7c0 con 0x7f5eac12c300 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5eaa59c640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12c300 0x7f5eac12e910 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c4a0 tx=0x7f5e9c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c017070 con 0x7f5eac12c300 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c005c10 con 0x7f5eac12c300 2024-04-26T12:33:31.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eac08a360 con 0x7f5eac12c300 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e9c007070 con 0x7f5eac12c300 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.106+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eac12f030 con 0x7f5eac12c300 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.107+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5e9c01a070 con 0x7f5eac12c300 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.107+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5eac12ffd0 con 0x7f5eac12c300 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.107+0000 7f5ea2ffd640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5e8c038060 0x7f5e8c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.107+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f5e9c04acb0 con 0x7f5eac12c300 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.107+0000 7f5ea2ffd640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f5e8c044450 0x7f5e8c0468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.107+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e9c013e50 con 0x7f5e8c044450 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.107+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5e9c04d360 con 0x7f5eac12c300 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.108+0000 7f5ea3fff640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5e8c038060 0x7f5e8c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.108+0000 7f5eaad9d640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f5e8c044450 0x7f5e8c0468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.108+0000 7f5ea3fff640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5e8c038060 0x7f5e8c03a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5e94036000 tx=0x7f5e94008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.108+0000 7f5eaad9d640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f5e8c044450 0x7f5e8c0468f0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.109+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== osd.1 v2:172.21.15.170:6808/2372702203 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e9c013e50 con 0x7f5e8c044450 2024-04-26T12:33:31.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.122+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 --> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5eac08a700 con 0x7f5e8c044450 2024-04-26T12:33:31.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.122+0000 7f5ea2ffd640 1 -- 172.21.15.132:0/526767569 <== osd.1 v2:172.21.15.170:6808/2372702203 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5eac08a700 con 0x7f5e8c044450 2024-04-26T12:33:31.124 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-26T12:33:31.124 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:33:31.124 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f5e8c044450 msgr2=0x7f5e8c0468f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f5e8c044450 0x7f5e8c0468f0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5e8c038060 msgr2=0x7f5e8c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5e8c038060 0x7f5e8c03a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5e94036000 tx=0x7f5e94008030 comp rx=0 tx=0).stop 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12c300 msgr2=0x7f5eac12e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12c300 0x7f5eac12e910 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c4a0 tx=0x7f5e9c00c960 comp rx=0 tx=0).stop 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 shutdown_connections 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6808/2372702203,v1:172.21.15.170:6809/2372702203] conn(0x7f5e8c044450 0x7f5e8c0468f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5e8c038060 0x7f5e8c03a520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 --2- 172.21.15.132:0/526767569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eac12c300 0x7f5eac12e910 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 >> 172.21.15.132:0/526767569 conn(0x7f5eac09b610 msgr2=0x7f5eac123970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 shutdown_connections 2024-04-26T12:33:31.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.123+0000 7f5eb0bf4640 1 -- 172.21.15.132:0/526767569 wait complete. 2024-04-26T12:33:31.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.230+0000 7f721ef15640 1 Processor -- start 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.230+0000 7f721ef15640 1 -- start start 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.230+0000 7f721ef15640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f721812e3b0 0x7f72181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.230+0000 7f721ef15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721806ef30 con 0x7f721806dbb0 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.230+0000 7f721ef15640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f721806e8e0 con 0x7f721812e3b0 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.231+0000 7f7217fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f721812e3b0 0x7f72181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.231+0000 7f721ccb1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f721806dbb0 0x7f721806df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43264/0 (socket says 172.21.15.132:43264) 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.231+0000 7f721ccb1640 1 -- 172.21.15.132:0/2149477857 learned_addr learned my addr 172.21.15.132:0/2149477857 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.231+0000 7f7217fff640 1 -- 172.21.15.132:0/2149477857 >> v1:172.21.15.132:6789/0 conn(0x7f721806dbb0 legacy=0x7f721806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.231+0000 7f7217fff640 1 -- 172.21.15.132:0/2149477857 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721806d710 con 0x7f721812e3b0 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.231+0000 7f72177fe640 1 -- 172.21.15.132:0/2149477857 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469534764 0 0) 0x7f7208001110 con 0x7f721806dbb0 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f7217fff640 1 --2- 172.21.15.132:0/2149477857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721812e3b0 0x7f72181307a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f720c00b9c0 tx=0x7f720c02e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283629e1d7172c3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f72177fe640 1 -- 172.21.15.132:0/2149477857 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c03b070 con 0x7f721812e3b0 2024-04-26T12:33:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f72177fe640 1 -- 172.21.15.132:0/2149477857 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720c02ecf0 con 0x7f721812e3b0 2024-04-26T12:33:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f72177fe640 1 -- 172.21.15.132:0/2149477857 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c036440 con 0x7f721812e3b0 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f721ef15640 1 -- 172.21.15.132:0/2149477857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721812e3b0 msgr2=0x7f72181307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f721ef15640 1 --2- 172.21.15.132:0/2149477857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721812e3b0 0x7f72181307a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f720c00b9c0 tx=0x7f720c02e010 comp rx=0 tx=0).stop 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f721ef15640 1 -- 172.21.15.132:0/2149477857 shutdown_connections 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f721ef15640 1 --2- 172.21.15.132:0/2149477857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721812e3b0 0x7f72181307a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f721ef15640 1 -- 172.21.15.132:0/2149477857 >> 172.21.15.132:0/2149477857 conn(0x7f721809b560 msgr2=0x7f721809b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f721ef15640 1 -- 172.21.15.132:0/2149477857 shutdown_connections 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.232+0000 7f721ef15640 1 -- 172.21.15.132:0/2149477857 wait complete. 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.233+0000 7f721ef15640 1 Processor -- start 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.233+0000 7f721ef15640 1 -- start start 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ef15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721806dbb0 0x7f72181bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ef15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f721806f370 con 0x7f721806dbb0 2024-04-26T12:33:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ccb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721806dbb0 0x7f72181bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ccb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721806dbb0 0x7f72181bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47452/0 (socket says 172.21.15.132:47452) 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ccb1640 1 -- 172.21.15.132:0/238585539 learned_addr learned my addr 172.21.15.132:0/238585539 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ccb1640 1 -- 172.21.15.132:0/238585539 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7218072b30 con 0x7f721806dbb0 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ccb1640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721806dbb0 0x7f72181bf0b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f720800c370 tx=0x7f720800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f72157fa640 1 -- 172.21.15.132:0/238585539 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7208007410 con 0x7f721806dbb0 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f72157fa640 1 -- 172.21.15.132:0/238585539 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72080075d0 con 0x7f721806dbb0 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f72157fa640 1 -- 172.21.15.132:0/238585539 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7208004950 con 0x7f721806dbb0 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721812a4e0 con 0x7f721806dbb0 2024-04-26T12:33:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.234+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72180733f0 con 0x7f721806dbb0 2024-04-26T12:33:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.235+0000 7f72157fa640 1 -- 172.21.15.132:0/238585539 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7208011070 con 0x7f721806dbb0 2024-04-26T12:33:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.235+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7218062ed0 con 0x7f721806dbb0 2024-04-26T12:33:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.236+0000 7f72157fa640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7204038060 0x7f720403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.236+0000 7f72157fa640 1 -- 172.21.15.132:0/238585539 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f720804b5f0 con 0x7f721806dbb0 2024-04-26T12:33:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.236+0000 7f7217fff640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7204038060 0x7f720403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.236+0000 7f7217fff640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7204038060 0x7f720403a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f720c02efd0 tx=0x7f720c032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.240+0000 7f72157fa640 1 -- 172.21.15.132:0/238585539 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f721806ef30 con 0x7f721806dbb0 2024-04-26T12:33:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.415+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f721806c240 con 0x7f7204038060 2024-04-26T12:33:31.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.416+0000 7f72157fa640 1 -- 172.21.15.132:0/238585539 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f721806c240 con 0x7f7204038060 2024-04-26T12:33:31.417 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7204038060 msgr2=0x7f720403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7204038060 0x7f720403a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f720c02efd0 tx=0x7f720c032000 comp rx=0 tx=0).stop 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721806dbb0 msgr2=0x7f72181bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721806dbb0 0x7f72181bf0b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f720800c370 tx=0x7f720800c830 comp rx=0 tx=0).stop 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 shutdown_connections 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7204038060 0x7f720403a520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 --2- 172.21.15.132:0/238585539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721806dbb0 0x7f72181bf0b0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 >> 172.21.15.132:0/238585539 conn(0x7f721809b560 msgr2=0x7f7218127b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 shutdown_connections 2024-04-26T12:33:31.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.419+0000 7f721ef15640 1 -- 172.21.15.132:0/238585539 wait complete. 2024-04-26T12:33:31.430 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:33:31.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:33:31.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.529+0000 7f9d9d8cf640 1 Processor -- start 2024-04-26T12:33:31.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.529+0000 7f9d9d8cf640 1 -- start start 2024-04-26T12:33:31.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.529+0000 7f9d9d8cf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d9806de90 0x7f9d9806e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.529+0000 7f9d9d8cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9806d7a0 con 0x7f9d98121740 2024-04-26T12:33:31.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.529+0000 7f9d9d8cf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9806b230 con 0x7f9d9806de90 2024-04-26T12:33:31.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.530+0000 7f9d96ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d9806de90 0x7f9d9806e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.530+0000 7f9d967fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9d98121740 0x7f9d98121ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43278/0 (socket says 172.21.15.132:43278) 2024-04-26T12:33:31.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.530+0000 7f9d967fc640 1 -- 172.21.15.132:0/1117730705 learned_addr learned my addr 172.21.15.132:0/1117730705 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:31.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.530+0000 7f9d96ffd640 1 -- 172.21.15.132:0/1117730705 >> v1:172.21.15.132:6789/0 conn(0x7f9d98121740 legacy=0x7f9d98121ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.530+0000 7f9d96ffd640 1 -- 172.21.15.132:0/1117730705 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9806da40 con 0x7f9d9806de90 2024-04-26T12:33:31.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.530+0000 7f9d95ffb640 1 -- 172.21.15.132:0/1117730705 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264927081 0 0) 0x7f9d9806d7a0 con 0x7f9d98121740 2024-04-26T12:33:31.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d96ffd640 1 --2- 172.21.15.132:0/1117730705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9806e270 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009d90 tx=0x7f9d8802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39c434e819ff954 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d95ffb640 1 -- 172.21.15.132:0/1117730705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d88039070 con 0x7f9d9806de90 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d95ffb640 1 -- 172.21.15.132:0/1117730705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8802cb10 con 0x7f9d9806de90 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d95ffb640 1 -- 172.21.15.132:0/1117730705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d8802ce10 con 0x7f9d9806de90 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1117730705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 msgr2=0x7f9d9806e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1117730705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9806e270 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009d90 tx=0x7f9d8802beb0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1117730705 shutdown_connections 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1117730705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9806e270 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1117730705 >> 172.21.15.132:0/1117730705 conn(0x7f9d9809b610 msgr2=0x7f9d9809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1117730705 shutdown_connections 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.531+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1117730705 wait complete. 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.532+0000 7f9d9d8cf640 1 Processor -- start 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.532+0000 7f9d9d8cf640 1 -- start start 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d9d8cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9808b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d9d8cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9806efc0 con 0x7f9d9806de90 2024-04-26T12:33:31.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d96ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9808b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d96ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9808b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47474/0 (socket says 172.21.15.132:47474) 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d96ffd640 1 -- 172.21.15.132:0/1504913647 learned_addr learned my addr 172.21.15.132:0/1504913647 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d96ffd640 1 -- 172.21.15.132:0/1504913647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d98124db0 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d96ffd640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9808b660 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9d88037040 tx=0x7f9d88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d88044020 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8803f5a0 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9808c510 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d88039040 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.533+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d98070c10 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9d88047020 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d98062ed0 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d7ffff640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9d84038060 0x7f9d8403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9d8806e910 con 0x7f9d9806de90 2024-04-26T12:33:31.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d7ffff640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9d84044450 0x7f9d840468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d8803ce50 con 0x7f9d84044450 2024-04-26T12:33:31.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9d880732a0 con 0x7f9d9806de90 2024-04-26T12:33:31.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.534+0000 7f9d967fc640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9d84038060 0x7f9d8403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.535+0000 7f9d977fe640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9d84044450 0x7f9d840468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.535+0000 7f9d967fc640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9d84038060 0x7f9d8403a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c000c00 tx=0x7f9d8c007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.535+0000 7f9d977fe640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9d84044450 0x7f9d840468f0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.536+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== osd.2 v2:172.21.15.170:6800/1189813177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d8803ce50 con 0x7f9d84044450 2024-04-26T12:33:31.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 --> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9d98121990 con 0x7f9d84044450 2024-04-26T12:33:31.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d7ffff640 1 -- 172.21.15.132:0/1504913647 <== osd.2 v2:172.21.15.170:6800/1189813177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9d98121990 con 0x7f9d84044450 2024-04-26T12:33:31.550 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-26T12:33:31.550 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:33:31.550 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9d84044450 msgr2=0x7f9d840468f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9d84044450 0x7f9d840468f0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9d84038060 msgr2=0x7f9d8403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9d84038060 0x7f9d8403a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c000c00 tx=0x7f9d8c007970 comp rx=0 tx=0).stop 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 msgr2=0x7f9d9808b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9808b660 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9d88037040 tx=0x7f9d88004a40 comp rx=0 tx=0).stop 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 shutdown_connections 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6800/1189813177,v1:172.21.15.170:6801/1189813177] conn(0x7f9d84044450 0x7f9d840468f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9d84038060 0x7f9d8403a520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 --2- 172.21.15.132:0/1504913647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d9806de90 0x7f9d9808b660 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.549+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 >> 172.21.15.132:0/1504913647 conn(0x7f9d9809b610 msgr2=0x7f9d9808d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.550+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 shutdown_connections 2024-04-26T12:33:31.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.550+0000 7f9d9d8cf640 1 -- 172.21.15.132:0/1504913647 wait complete. 2024-04-26T12:33:31.561 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:33:31.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.657+0000 7f5ffc98a640 1 Processor -- start 2024-04-26T12:33:31.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.657+0000 7f5ffc98a640 1 -- start start 2024-04-26T12:33:31.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ffc98a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ff80996e0 0x7f5ff8133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ffc98a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff8099b00 con 0x7f5ff8098bf0 2024-04-26T12:33:31.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ffc98a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff809e050 con 0x7f5ff80996e0 2024-04-26T12:33:31.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ff659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5ff8098bf0 0x7f5ff8098fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43292/0 (socket says 172.21.15.132:43292) 2024-04-26T12:33:31.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ff5d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ff80996e0 0x7f5ff8133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ff659c640 1 -- 172.21.15.132:0/2024317853 learned_addr learned my addr 172.21.15.132:0/2024317853 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:31.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ff5d9b640 1 -- 172.21.15.132:0/2024317853 >> v1:172.21.15.132:6789/0 conn(0x7f5ff8098bf0 legacy=0x7f5ff8098fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ff5d9b640 1 -- 172.21.15.132:0/2024317853 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff809a790 con 0x7f5ff80996e0 2024-04-26T12:33:31.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.658+0000 7f5ff559a640 1 -- 172.21.15.132:0/2024317853 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721999984 0 0) 0x7f5ff8099b00 con 0x7f5ff8098bf0 2024-04-26T12:33:31.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.659+0000 7f5ff5d9b640 1 --2- 172.21.15.132:0/2024317853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff80996e0 0x7f5ff8133a70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009720 tx=0x7f5fec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cb54eeaf3d417b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.659+0000 7f5ff559a640 1 -- 172.21.15.132:0/2024317853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec0316d0 con 0x7f5ff80996e0 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.659+0000 7f5ff559a640 1 -- 172.21.15.132:0/2024317853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec037070 con 0x7f5ff80996e0 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.659+0000 7f5ff559a640 1 -- 172.21.15.132:0/2024317853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec0319c0 con 0x7f5ff80996e0 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.659+0000 7f5ffc98a640 1 -- 172.21.15.132:0/2024317853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff80996e0 msgr2=0x7f5ff8133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.659+0000 7f5ffc98a640 1 --2- 172.21.15.132:0/2024317853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff80996e0 0x7f5ff8133a70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009720 tx=0x7f5fec02b840 comp rx=0 tx=0).stop 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.660+0000 7f5ffc98a640 1 -- 172.21.15.132:0/2024317853 shutdown_connections 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.660+0000 7f5ffc98a640 1 --2- 172.21.15.132:0/2024317853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff80996e0 0x7f5ff8133a70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.660+0000 7f5ffc98a640 1 -- 172.21.15.132:0/2024317853 >> 172.21.15.132:0/2024317853 conn(0x7f5ff80a0d10 msgr2=0x7f5ff809d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.660+0000 7f5ffc98a640 1 -- 172.21.15.132:0/2024317853 shutdown_connections 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.660+0000 7f5ffc98a640 1 -- 172.21.15.132:0/2024317853 wait complete. 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.660+0000 7f5ffc98a640 1 Processor -- start 2024-04-26T12:33:31.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.660+0000 7f5ffc98a640 1 -- start start 2024-04-26T12:33:31.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5ffc98a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff8098bf0 0x7f5ff8132850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5ffc98a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff809a140 con 0x7f5ff8098bf0 2024-04-26T12:33:31.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5ff659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff8098bf0 0x7f5ff8132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5ff659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff8098bf0 0x7f5ff8132850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47484/0 (socket says 172.21.15.132:47484) 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5ff659c640 1 -- 172.21.15.132:0/982630559 learned_addr learned my addr 172.21.15.132:0/982630559 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5ff659c640 1 -- 172.21.15.132:0/982630559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80725a0 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5ff659c640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff8098bf0 0x7f5ff8132850 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c840 tx=0x7f5fe800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5fe6ffd640 1 -- 172.21.15.132:0/982630559 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8018070 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.661+0000 7f5fe6ffd640 1 -- 172.21.15.132:0/982630559 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe800a660 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.662+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff81261a0 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.662+0000 7f5fe6ffd640 1 -- 172.21.15.132:0/982630559 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe800a980 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.662+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff8132d90 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.662+0000 7f5fe6ffd640 1 -- 172.21.15.132:0/982630559 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5fe801b070 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.662+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff809bab0 con 0x7f5ff8098bf0 2024-04-26T12:33:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.662+0000 7f5fe6ffd640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5fd80380b0 0x7f5fd803a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.663+0000 7f5fe6ffd640 1 -- 172.21.15.132:0/982630559 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f5fe804b200 con 0x7f5ff8098bf0 2024-04-26T12:33:31.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.663+0000 7f5ff5d9b640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5fd80380b0 0x7f5fd803a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.663+0000 7f5ff5d9b640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5fd80380b0 0x7f5fd803a570 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009720 tx=0x7f5fec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.667+0000 7f5fe6ffd640 1 -- 172.21.15.132:0/982630559 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5ff809bab0 con 0x7f5ff8098bf0 2024-04-26T12:33:31.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.839+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5ff8062ed0 con 0x7f5fd80380b0 2024-04-26T12:33:31.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.840+0000 7f5fe6ffd640 1 -- 172.21.15.132:0/982630559 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5ff8062ed0 con 0x7f5fd80380b0 2024-04-26T12:33:31.842 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:33:31.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5fd80380b0 msgr2=0x7f5fd803a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5fd80380b0 0x7f5fd803a570 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009720 tx=0x7f5fec008030 comp rx=0 tx=0).stop 2024-04-26T12:33:31.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff8098bf0 msgr2=0x7f5ff8132850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff8098bf0 0x7f5ff8132850 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c840 tx=0x7f5fe800cd00 comp rx=0 tx=0).stop 2024-04-26T12:33:31.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 shutdown_connections 2024-04-26T12:33:31.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f5fd80380b0 0x7f5fd803a570 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 --2- 172.21.15.132:0/982630559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ff8098bf0 0x7f5ff8132850 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.842+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 >> 172.21.15.132:0/982630559 conn(0x7f5ff80a0d10 msgr2=0x7f5ff8090380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.843+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 shutdown_connections 2024-04-26T12:33:31.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.843+0000 7f5ffc98a640 1 -- 172.21.15.132:0/982630559 wait complete. 2024-04-26T12:33:31.854 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T12:33:31.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a28700640 1 Processor -- start 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a28700640 1 -- start start 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a28700640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a2006e270 0x7f7a20121e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a28700640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2006d7a0 con 0x7f7a2006de90 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a28700640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2006b230 con 0x7f7a2006e270 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a25c9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a2006e270 0x7f7a20121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a2649c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7a2006de90 0x7f7a20121740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43296/0 (socket says 172.21.15.132:43296) 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.954+0000 7f7a2649c640 1 -- 172.21.15.132:0/1368110816 learned_addr learned my addr 172.21.15.132:0/1368110816 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.955+0000 7f7a25c9b640 1 -- 172.21.15.132:0/1368110816 >> v1:172.21.15.132:6789/0 conn(0x7f7a2006de90 legacy=0x7f7a20121740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.955+0000 7f7a25c9b640 1 -- 172.21.15.132:0/1368110816 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2006da40 con 0x7f7a2006e270 2024-04-26T12:33:31.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.955+0000 7f7a2549a640 1 -- 172.21.15.132:0/1368110816 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4135747172 0 0) 0x7f7a2006d7a0 con 0x7f7a2006de90 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.955+0000 7f7a25c9b640 1 --2- 172.21.15.132:0/1368110816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006e270 0x7f7a20121e50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009720 tx=0x7f7a1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4355f9e1f5ba2cff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.955+0000 7f7a2549a640 1 -- 172.21.15.132:0/1368110816 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a140316d0 con 0x7f7a2006e270 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.955+0000 7f7a2549a640 1 -- 172.21.15.132:0/1368110816 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a14037070 con 0x7f7a2006e270 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.955+0000 7f7a2549a640 1 -- 172.21.15.132:0/1368110816 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a140319c0 con 0x7f7a2006e270 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.956+0000 7f7a28700640 1 -- 172.21.15.132:0/1368110816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006e270 msgr2=0x7f7a20121e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.956+0000 7f7a28700640 1 --2- 172.21.15.132:0/1368110816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006e270 0x7f7a20121e50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009720 tx=0x7f7a1402b840 comp rx=0 tx=0).stop 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.956+0000 7f7a28700640 1 -- 172.21.15.132:0/1368110816 shutdown_connections 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.956+0000 7f7a28700640 1 --2- 172.21.15.132:0/1368110816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006e270 0x7f7a20121e50 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.956+0000 7f7a28700640 1 -- 172.21.15.132:0/1368110816 >> 172.21.15.132:0/1368110816 conn(0x7f7a2009b610 msgr2=0x7f7a2009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.956+0000 7f7a28700640 1 -- 172.21.15.132:0/1368110816 shutdown_connections 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.956+0000 7f7a28700640 1 -- 172.21.15.132:0/1368110816 wait complete. 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.957+0000 7f7a28700640 1 Processor -- start 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.957+0000 7f7a28700640 1 -- start start 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.957+0000 7f7a28700640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006de90 0x7f7a20090830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.957+0000 7f7a28700640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2006efc0 con 0x7f7a2006de90 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.957+0000 7f7a2649c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006de90 0x7f7a20090830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.957+0000 7f7a2649c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006de90 0x7f7a20090830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47500/0 (socket says 172.21.15.132:47500) 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.957+0000 7f7a2649c640 1 -- 172.21.15.132:0/3458589588 learned_addr learned my addr 172.21.15.132:0/3458589588 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.958+0000 7f7a2649c640 1 -- 172.21.15.132:0/3458589588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2008da80 con 0x7f7a2006de90 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.958+0000 7f7a2649c640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006de90 0x7f7a20090830 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800c420 tx=0x7f7a1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.958+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a18018070 con 0x7f7a2006de90 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.958+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a180074d0 con 0x7f7a2006de90 2024-04-26T12:33:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.958+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a20091be0 con 0x7f7a2006de90 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.958+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a18004950 con 0x7f7a2006de90 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.958+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a20090f50 con 0x7f7a2006de90 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7a1801b070 con 0x7f7a2006de90 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a20062ed0 con 0x7f7a2006de90 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a1effd640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7a0c038060 0x7f7a0c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f7a1804add0 con 0x7f7a2006de90 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a1effd640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7f7a0c044430 0x7f7a0c0468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a0c046fa0 con 0x7f7a0c044430 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7a18004af0 con 0x7f7a2006de90 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a25c9b640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7a0c038060 0x7f7a0c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.959+0000 7f7a26c9d640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7f7a0c044430 0x7f7a0c0468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.960+0000 7f7a25c9b640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7a0c038060 0x7f7a0c03a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7a14036000 tx=0x7f7a14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.960+0000 7f7a26c9d640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7f7a0c044430 0x7f7a0c0468d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:31.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.960+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== osd.3 v2:172.21.15.170:6816/2349137764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a0c046fa0 con 0x7f7a0c044430 2024-04-26T12:33:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.973+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 --> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7a20091f00 con 0x7f7a0c044430 2024-04-26T12:33:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a1effd640 1 -- 172.21.15.132:0/3458589588 <== osd.3 v2:172.21.15.170:6816/2349137764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7a20091f00 con 0x7f7a0c044430 2024-04-26T12:33:31.975 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-26T12:33:31.975 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:33:31.975 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-26T12:33:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7f7a0c044430 msgr2=0x7f7a0c0468d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7f7a0c044430 0x7f7a0c0468d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7a0c038060 msgr2=0x7f7a0c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7a0c038060 0x7f7a0c03a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7a14036000 tx=0x7f7a14008030 comp rx=0 tx=0).stop 2024-04-26T12:33:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006de90 msgr2=0x7f7a20090830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006de90 0x7f7a20090830 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800c420 tx=0x7f7a1800c8e0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 shutdown_connections 2024-04-26T12:33:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6816/2349137764,v1:172.21.15.170:6817/2349137764] conn(0x7f7a0c044430 0x7f7a0c0468d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f7a0c038060 0x7f7a0c03a520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 --2- 172.21.15.132:0/3458589588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2006de90 0x7f7a20090830 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 >> 172.21.15.132:0/3458589588 conn(0x7f7a2009b610 msgr2=0x7f7a201278e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 shutdown_connections 2024-04-26T12:33:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:31.974+0000 7f7a28700640 1 -- 172.21.15.132:0/3458589588 wait complete. 2024-04-26T12:33:31.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T12:33:32.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.082+0000 7f9e9afa0640 1 Processor -- start 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e9afa0640 1 -- start start 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e9afa0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e94095f10 0x7f9e941306c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e9afa0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9406dc70 con 0x7f9e94095420 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e9afa0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9406d5f0 con 0x7f9e94095f10 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e9979d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e94095f10 0x7f9e941306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e99f9e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9e94095420 0x7f9e94095800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43300/0 (socket says 172.21.15.132:43300) 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e99f9e640 1 -- 172.21.15.132:0/4138077702 learned_addr learned my addr 172.21.15.132:0/4138077702 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e9979d640 1 -- 172.21.15.132:0/4138077702 >> v1:172.21.15.132:6789/0 conn(0x7f9e94095420 legacy=0x7f9e94095800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e9979d640 1 -- 172.21.15.132:0/4138077702 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9406e5e0 con 0x7f9e94095f10 2024-04-26T12:33:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.083+0000 7f9e98f9c640 1 -- 172.21.15.132:0/4138077702 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325687404 0 0) 0x7f9e9406dc70 con 0x7f9e94095420 2024-04-26T12:33:32.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.084+0000 7f9e9979d640 1 --2- 172.21.15.132:0/4138077702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095f10 0x7f9e941306c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009720 tx=0x7f9e9002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2860573af87d14c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.084+0000 7f9e98f9c640 1 -- 172.21.15.132:0/4138077702 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e900316d0 con 0x7f9e94095f10 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.084+0000 7f9e98f9c640 1 -- 172.21.15.132:0/4138077702 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e90037070 con 0x7f9e94095f10 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.084+0000 7f9e98f9c640 1 -- 172.21.15.132:0/4138077702 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e900319c0 con 0x7f9e94095f10 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.085+0000 7f9e9afa0640 1 -- 172.21.15.132:0/4138077702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095f10 msgr2=0x7f9e941306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.085+0000 7f9e9afa0640 1 --2- 172.21.15.132:0/4138077702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095f10 0x7f9e941306c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009720 tx=0x7f9e9002b840 comp rx=0 tx=0).stop 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.085+0000 7f9e9afa0640 1 -- 172.21.15.132:0/4138077702 shutdown_connections 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.085+0000 7f9e9afa0640 1 --2- 172.21.15.132:0/4138077702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095f10 0x7f9e941306c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.085+0000 7f9e9afa0640 1 -- 172.21.15.132:0/4138077702 >> 172.21.15.132:0/4138077702 conn(0x7f9e9409a4f0 msgr2=0x7f9e9409a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.085+0000 7f9e9afa0640 1 -- 172.21.15.132:0/4138077702 shutdown_connections 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.085+0000 7f9e9afa0640 1 -- 172.21.15.132:0/4138077702 wait complete. 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e9afa0640 1 Processor -- start 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e9afa0640 1 -- start start 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e9afa0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095420 0x7f9e941be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e9afa0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94094490 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e99f9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095420 0x7f9e941be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e99f9e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095420 0x7f9e941be970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47514/0 (socket says 172.21.15.132:47514) 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e99f9e640 1 -- 172.21.15.132:0/2144381487 learned_addr learned my addr 172.21.15.132:0/2144381487 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e99f9e640 1 -- 172.21.15.132:0/2144381487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9408ed70 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e99f9e640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095420 0x7f9e941be970 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c420 tx=0x7f9e8400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e8a7fc640 1 -- 172.21.15.132:0/2144381487 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e84018070 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e8a7fc640 1 -- 172.21.15.132:0/2144381487 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840074d0 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e8a7fc640 1 -- 172.21.15.132:0/2144381487 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e84004950 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.086+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e94090a50 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.087+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9408e430 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.087+0000 7f9e8a7fc640 1 -- 172.21.15.132:0/2144381487 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9e8401b070 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.087+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e94062ed0 con 0x7f9e94095420 2024-04-26T12:33:32.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.087+0000 7f9e8a7fc640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e78038060 0x7f9e7803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:32.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.088+0000 7f9e8a7fc640 1 -- 172.21.15.132:0/2144381487 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f9e8404add0 con 0x7f9e94095420 2024-04-26T12:33:32.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.088+0000 7f9e9979d640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e78038060 0x7f9e7803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:32.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.088+0000 7f9e9979d640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e78038060 0x7f9e7803a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e90036000 tx=0x7f9e90008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:32.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.092+0000 7f9e8a7fc640 1 -- 172.21.15.132:0/2144381487 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9e8404f070 con 0x7f9e94095420 2024-04-26T12:33:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.267+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f9e94072630 con 0x7f9e78038060 2024-04-26T12:33:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.268+0000 7f9e8a7fc640 1 -- 172.21.15.132:0/2144381487 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9e94072630 con 0x7f9e78038060 2024-04-26T12:33:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T12:33:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e78038060 msgr2=0x7f9e7803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e78038060 0x7f9e7803a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e90036000 tx=0x7f9e90008030 comp rx=0 tx=0).stop 2024-04-26T12:33:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095420 msgr2=0x7f9e941be970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095420 0x7f9e941be970 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c420 tx=0x7f9e8400c8e0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 shutdown_connections 2024-04-26T12:33:32.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f9e78038060 0x7f9e7803a520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 --2- 172.21.15.132:0/2144381487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e94095420 0x7f9e941be970 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 >> 172.21.15.132:0/2144381487 conn(0x7f9e9409a4f0 msgr2=0x7f9e941b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:32.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 shutdown_connections 2024-04-26T12:33:32.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.270+0000 7f9e9afa0640 1 -- 172.21.15.132:0/2144381487 wait complete. 2024-04-26T12:33:32.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe02b1e1640 1 Processor -- start 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe02b1e1640 1 -- start start 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe02b1e1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe02408d810 0x7fe02408dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe02b1e1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02406d7a0 con 0x7fe02408e130 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe02b1e1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe0240730d0 con 0x7fe02408d810 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe028f7d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe02408d810 0x7fe02408dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe01bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe02408e130 0x7fe02412a9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43316/0 (socket says 172.21.15.132:43316) 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.376+0000 7fe01bfff640 1 -- 172.21.15.132:0/115813603 learned_addr learned my addr 172.21.15.132:0/115813603 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.377+0000 7fe028f7d640 1 -- 172.21.15.132:0/115813603 >> v1:172.21.15.132:6789/0 conn(0x7fe02408e130 legacy=0x7fe02412a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.377+0000 7fe028f7d640 1 -- 172.21.15.132:0/115813603 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02406e620 con 0x7fe02408d810 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.377+0000 7fe028f7d640 1 --2- 172.21.15.132:0/115813603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408dbf0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe020009720 tx=0x7fe02002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3f2301852a9191 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.377+0000 7fe01b7fe640 1 -- 172.21.15.132:0/115813603 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200316d0 con 0x7fe02408d810 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe01b7fe640 1 -- 172.21.15.132:0/115813603 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020037070 con 0x7fe02408d810 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe01b7fe640 1 -- 172.21.15.132:0/115813603 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200319c0 con 0x7fe02408d810 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe02b1e1640 1 -- 172.21.15.132:0/115813603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 msgr2=0x7fe02408dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe02b1e1640 1 --2- 172.21.15.132:0/115813603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408dbf0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe020009720 tx=0x7fe02002b840 comp rx=0 tx=0).stop 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe02b1e1640 1 -- 172.21.15.132:0/115813603 shutdown_connections 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe02b1e1640 1 --2- 172.21.15.132:0/115813603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408dbf0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe02b1e1640 1 -- 172.21.15.132:0/115813603 >> 172.21.15.132:0/115813603 conn(0x7fe02409b7b0 msgr2=0x7fe02409bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:32.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe02b1e1640 1 -- 172.21.15.132:0/115813603 shutdown_connections 2024-04-26T12:33:32.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.378+0000 7fe02b1e1640 1 -- 172.21.15.132:0/115813603 wait complete. 2024-04-26T12:33:32.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.379+0000 7fe02b1e1640 1 Processor -- start 2024-04-26T12:33:32.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.379+0000 7fe02b1e1640 1 -- start start 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.379+0000 7fe02b1e1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.379+0000 7fe02b1e1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe02412b0f0 con 0x7fe02408d810 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.379+0000 7fe028f7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe028f7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47528/0 (socket says 172.21.15.132:47528) 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe028f7d640 1 -- 172.21.15.132:0/2739653848 learned_addr learned my addr 172.21.15.132:0/2739653848 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe028f7d640 1 -- 172.21.15.132:0/2739653848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0240927f0 con 0x7fe02408d810 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe028f7d640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408ffc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe020034040 tx=0x7fe0200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe0197fa640 1 -- 172.21.15.132:0/2739653848 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020032640 con 0x7fe02408d810 2024-04-26T12:33:32.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe0197fa640 1 -- 172.21.15.132:0/2739653848 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0200327e0 con 0x7fe02408d810 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe024129e90 con 0x7fe02408d810 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe0197fa640 1 -- 172.21.15.132:0/2739653848 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020032ae0 con 0x7fe02408d810 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.380+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe024092170 con 0x7fe02408d810 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.381+0000 7fe0197fa640 1 -- 172.21.15.132:0/2739653848 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe02004c060 con 0x7fe02408d810 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.381+0000 7fe0197fa640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe010038060 0x7fe01003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.381+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe024062ed0 con 0x7fe02408d810 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.381+0000 7fe0197fa640 1 -- 172.21.15.132:0/2739653848 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fe02002f050 con 0x7fe02408d810 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.381+0000 7fe01bfff640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe010038060 0x7fe01003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.382+0000 7fe01bfff640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe010038060 0x7fe01003a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe014007fd0 tx=0x7fe014007ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:32.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.386+0000 7fe0197fa640 1 -- 172.21.15.132:0/2739653848 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe02009b2d0 con 0x7fe02408d810 2024-04-26T12:33:32.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.559+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe02412ab90 con 0x7fe010038060 2024-04-26T12:33:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.574+0000 7fe0197fa640 1 -- 172.21.15.132:0/2739653848 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665874 (secure 0 0 0) 0x7fe02412ab90 con 0x7fe010038060 2024-04-26T12:33:32.582 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:33:32.590 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:33:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe010038060 msgr2=0x7fe01003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe010038060 0x7fe01003a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe014007fd0 tx=0x7fe014007ac0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 msgr2=0x7fe02408ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408ffc0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe020034040 tx=0x7fe0200046c0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 shutdown_connections 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe010038060 0x7fe01003a520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 --2- 172.21.15.132:0/2739653848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02408d810 0x7fe02408ffc0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 >> 172.21.15.132:0/2739653848 conn(0x7fe02409b7b0 msgr2=0x7fe02408b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 shutdown_connections 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:32.578+0000 7fe02b1e1640 1 -- 172.21.15.132:0/2739653848 wait complete. 2024-04-26T12:33:32.593 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-04-26T12:33:32.488421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13176007,"num_objects":223,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":5001,"num_read_kb":4582,"num_write":2146,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4546,"ondisk_log_size":4546,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148604,"kb_used_data":28056,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377338756,"statfs":{"total":386547056640,"available":386394886144,"internally_reserved":0,"allocated":28729344,"data_stored":27578773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12574905,"num_objects":5,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":619,"num_read_kb":578,"num_write":426,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548520+0000","last_change":"2024-04-26T12:30:10.508974+0000","last_active":"2024-04-26T12:30:49.548520+0000","last_peered":"2024-04-26T12:30:49.548520+0000","last_clean":"2024-04-26T12:30:49.548520+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:30:49.548520+0000","last_undegraded":"2024-04-26T12:30:49.548520+0000","last_fullsized":"2024-04-26T12:30:49.548520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540674+0000","last_change":"2024-04-26T12:30:12.499017+0000","last_active":"2024-04-26T12:30:49.540674+0000","last_peered":"2024-04-26T12:30:49.540674+0000","last_clean":"2024-04-26T12:30:49.540674+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:30:49.540674+0000","last_undegraded":"2024-04-26T12:30:49.540674+0000","last_fullsized":"2024-04-26T12:30:49.540674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:04.180301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599043+0000","last_change":"2024-04-26T12:30:10.489909+0000","last_active":"2024-04-26T12:30:53.599043+0000","last_peered":"2024-04-26T12:30:53.599043+0000","last_clean":"2024-04-26T12:30:53.599043+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:30:53.599043+0000","last_undegraded":"2024-04-26T12:30:53.599043+0000","last_fullsized":"2024-04-26T12:30:53.599043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'17","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470254+0000","last_change":"2024-04-26T12:30:12.484427+0000","last_active":"2024-04-26T12:33:21.470254+0000","last_peered":"2024-04-26T12:33:21.470254+0000","last_clean":"2024-04-26T12:33:21.470254+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:33:21.470254+0000","last_undegraded":"2024-04-26T12:33:21.470254+0000","last_fullsized":"2024-04-26T12:33:21.470254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:44.161301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.447466+0000","last_change":"2024-04-26T12:30:10.524821+0000","last_active":"2024-04-26T12:33:21.447466+0000","last_peered":"2024-04-26T12:33:21.447466+0000","last_clean":"2024-04-26T12:33:21.447466+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:33:21.447466+0000","last_undegraded":"2024-04-26T12:33:21.447466+0000","last_fullsized":"2024-04-26T12:33:21.447466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:32.006623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246297+0000","last_change":"2024-04-26T12:30:12.493540+0000","last_active":"2024-04-26T12:33:21.246297+0000","last_peered":"2024-04-26T12:33:21.246297+0000","last_clean":"2024-04-26T12:33:21.246297+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:33:21.246297+0000","last_undegraded":"2024-04-26T12:33:21.246297+0000","last_fullsized":"2024-04-26T12:33:21.246297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:40.024999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543651+0000","last_change":"2024-04-26T12:30:10.501461+0000","last_active":"2024-04-26T12:30:49.543651+0000","last_peered":"2024-04-26T12:30:49.543651+0000","last_clean":"2024-04-26T12:30:49.543651+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:30:49.543651+0000","last_undegraded":"2024-04-26T12:30:49.543651+0000","last_fullsized":"2024-04-26T12:30:49.543651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.740937+0000","last_change":"2024-04-26T12:30:12.489894+0000","last_active":"2024-04-26T12:30:54.740937+0000","last_peered":"2024-04-26T12:30:54.740937+0000","last_clean":"2024-04-26T12:30:54.740937+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:30:54.740937+0000","last_undegraded":"2024-04-26T12:30:54.740937+0000","last_fullsized":"2024-04-26T12:30:54.740937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:10.496671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544940+0000","last_change":"2024-04-26T12:30:10.521268+0000","last_active":"2024-04-26T12:30:49.544940+0000","last_peered":"2024-04-26T12:30:49.544940+0000","last_clean":"2024-04-26T12:30:49.544940+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:30:49.544940+0000","last_undegraded":"2024-04-26T12:30:49.544940+0000","last_fullsized":"2024-04-26T12:30:49.544940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:47.412681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532137+0000","last_change":"2024-04-26T12:30:12.497804+0000","last_active":"2024-04-26T12:33:21.532137+0000","last_peered":"2024-04-26T12:33:21.532137+0000","last_clean":"2024-04-26T12:33:21.532137+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:33:21.532137+0000","last_undegraded":"2024-04-26T12:33:21.532137+0000","last_fullsized":"2024-04-26T12:33:21.532137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:34.016204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547675+0000","last_change":"2024-04-26T12:30:10.505875+0000","last_active":"2024-04-26T12:30:49.547675+0000","last_peered":"2024-04-26T12:30:49.547675+0000","last_clean":"2024-04-26T12:30:49.547675+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:30:49.547675+0000","last_undegraded":"2024-04-26T12:30:49.547675+0000","last_fullsized":"2024-04-26T12:30:49.547675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531924+0000","last_change":"2024-04-26T12:30:49.554267+0000","last_active":"2024-04-26T12:33:21.531924+0000","last_peered":"2024-04-26T12:33:21.531924+0000","last_clean":"2024-04-26T12:33:21.531924+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:33:21.531924+0000","last_undegraded":"2024-04-26T12:33:21.531924+0000","last_fullsized":"2024-04-26T12:33:21.531924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:32.945426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.167218+0000","last_change":"2024-04-26T12:30:10.519048+0000","last_active":"2024-04-26T12:33:21.167218+0000","last_peered":"2024-04-26T12:33:21.167218+0000","last_clean":"2024-04-26T12:33:21.167218+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:33:21.167218+0000","last_undegraded":"2024-04-26T12:33:21.167218+0000","last_fullsized":"2024-04-26T12:33:21.167218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:28.446368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675537+0000","last_change":"2024-04-26T12:30:12.491137+0000","last_active":"2024-04-26T12:32:17.675537+0000","last_peered":"2024-04-26T12:32:17.675537+0000","last_clean":"2024-04-26T12:32:17.675537+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:32:17.675537+0000","last_undegraded":"2024-04-26T12:32:17.675537+0000","last_fullsized":"2024-04-26T12:32:17.675537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694288+0000","last_change":"2024-04-26T12:30:10.505714+0000","last_active":"2024-04-26T12:30:49.694288+0000","last_peered":"2024-04-26T12:30:49.694288+0000","last_clean":"2024-04-26T12:30:49.694288+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:30:49.694288+0000","last_undegraded":"2024-04-26T12:30:49.694288+0000","last_fullsized":"2024-04-26T12:30:49.694288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463709+0000","last_change":"2024-04-26T12:30:12.483230+0000","last_active":"2024-04-26T12:33:21.463709+0000","last_peered":"2024-04-26T12:33:21.463709+0000","last_clean":"2024-04-26T12:33:21.463709+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:21.463709+0000","last_undegraded":"2024-04-26T12:33:21.463709+0000","last_fullsized":"2024-04-26T12:33:21.463709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463505+0000","last_change":"2024-04-26T12:30:12.480460+0000","last_active":"2024-04-26T12:33:21.463505+0000","last_peered":"2024-04-26T12:33:21.463505+0000","last_clean":"2024-04-26T12:33:21.463505+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:33:21.463505+0000","last_undegraded":"2024-04-26T12:33:21.463505+0000","last_fullsized":"2024-04-26T12:33:21.463505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:34.798040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544770+0000","last_change":"2024-04-26T12:30:10.514263+0000","last_active":"2024-04-26T12:30:49.544770+0000","last_peered":"2024-04-26T12:30:49.544770+0000","last_clean":"2024-04-26T12:30:49.544770+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:30:49.544770+0000","last_undegraded":"2024-04-26T12:30:49.544770+0000","last_fullsized":"2024-04-26T12:30:49.544770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:17.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341367+0000","last_change":"2024-04-26T12:30:12.498685+0000","last_active":"2024-04-26T12:33:21.341367+0000","last_peered":"2024-04-26T12:33:21.341367+0000","last_clean":"2024-04-26T12:33:21.341367+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:21.341367+0000","last_undegraded":"2024-04-26T12:33:21.341367+0000","last_fullsized":"2024-04-26T12:33:21.341367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:28.769117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549354+0000","last_change":"2024-04-26T12:30:10.503403+0000","last_active":"2024-04-26T12:30:49.549354+0000","last_peered":"2024-04-26T12:30:49.549354+0000","last_clean":"2024-04-26T12:30:49.549354+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:30:49.549354+0000","last_undegraded":"2024-04-26T12:30:49.549354+0000","last_fullsized":"2024-04-26T12:30:49.549354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531887+0000","last_change":"2024-04-26T12:30:12.497749+0000","last_active":"2024-04-26T12:33:21.531887+0000","last_peered":"2024-04-26T12:33:21.531887+0000","last_clean":"2024-04-26T12:33:21.531887+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:33:21.531887+0000","last_undegraded":"2024-04-26T12:33:21.531887+0000","last_fullsized":"2024-04-26T12:33:21.531887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:16.569333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545533+0000","last_change":"2024-04-26T12:30:10.514510+0000","last_active":"2024-04-26T12:30:49.545533+0000","last_peered":"2024-04-26T12:30:49.545533+0000","last_clean":"2024-04-26T12:30:49.545533+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:30:49.545533+0000","last_undegraded":"2024-04-26T12:30:49.545533+0000","last_fullsized":"2024-04-26T12:30:49.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:19.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463231+0000","last_change":"2024-04-26T12:30:12.482516+0000","last_active":"2024-04-26T12:33:21.463231+0000","last_peered":"2024-04-26T12:33:21.463231+0000","last_clean":"2024-04-26T12:33:21.463231+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:33:21.463231+0000","last_undegraded":"2024-04-26T12:33:21.463231+0000","last_fullsized":"2024-04-26T12:33:21.463231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.209436+0000","last_change":"2024-04-26T12:30:10.513694+0000","last_active":"2024-04-26T12:33:21.209436+0000","last_peered":"2024-04-26T12:33:21.209436+0000","last_clean":"2024-04-26T12:33:21.209436+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:33:21.209436+0000","last_undegraded":"2024-04-26T12:33:21.209436+0000","last_fullsized":"2024-04-26T12:33:21.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:54.580399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505184+0000","last_change":"2024-04-26T12:30:12.484509+0000","last_active":"2024-04-26T12:32:37.505184+0000","last_peered":"2024-04-26T12:32:37.505184+0000","last_clean":"2024-04-26T12:32:37.505184+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:32:37.505184+0000","last_undegraded":"2024-04-26T12:32:37.505184+0000","last_fullsized":"2024-04-26T12:32:37.505184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.453057+0000","last_change":"2024-04-26T12:30:10.499600+0000","last_active":"2024-04-26T12:33:21.453057+0000","last_peered":"2024-04-26T12:33:21.453057+0000","last_clean":"2024-04-26T12:33:21.453057+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:33:21.453057+0000","last_undegraded":"2024-04-26T12:33:21.453057+0000","last_fullsized":"2024-04-26T12:33:21.453057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470960+0000","last_change":"2024-04-26T12:30:12.496161+0000","last_active":"2024-04-26T12:30:54.470960+0000","last_peered":"2024-04-26T12:30:54.470960+0000","last_clean":"2024-04-26T12:30:54.470960+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:30:54.470960+0000","last_undegraded":"2024-04-26T12:30:54.470960+0000","last_fullsized":"2024-04-26T12:30:54.470960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:32.006910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.194205+0000","last_change":"2024-04-26T12:30:10.516884+0000","last_active":"2024-04-26T12:33:21.194205+0000","last_peered":"2024-04-26T12:33:21.194205+0000","last_clean":"2024-04-26T12:33:21.194205+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:33:21.194205+0000","last_undegraded":"2024-04-26T12:33:21.194205+0000","last_fullsized":"2024-04-26T12:33:21.194205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:01.370198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.484967+0000","last_change":"2024-04-26T12:30:20.535283+0000","last_active":"2024-04-26T12:33:21.484967+0000","last_peered":"2024-04-26T12:33:21.484967+0000","last_clean":"2024-04-26T12:33:21.484967+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:33:21.484967+0000","last_undegraded":"2024-04-26T12:33:21.484967+0000","last_fullsized":"2024-04-26T12:33:21.484967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:17.265170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971392+0000","last_change":"2024-04-26T12:30:12.490640+0000","last_active":"2024-04-26T12:31:36.971392+0000","last_peered":"2024-04-26T12:31:36.971392+0000","last_clean":"2024-04-26T12:31:36.971392+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:31:36.971392+0000","last_undegraded":"2024-04-26T12:31:36.971392+0000","last_fullsized":"2024-04-26T12:31:36.971392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:17.780262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544525+0000","last_change":"2024-04-26T12:30:10.524372+0000","last_active":"2024-04-26T12:30:49.544525+0000","last_peered":"2024-04-26T12:30:49.544525+0000","last_clean":"2024-04-26T12:30:49.544525+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:30:49.544525+0000","last_undegraded":"2024-04-26T12:30:49.544525+0000","last_fullsized":"2024-04-26T12:30:49.544525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:24.047246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550199+0000","last_change":"2024-04-26T12:30:14.491887+0000","last_active":"2024-04-26T12:30:49.550199+0000","last_peered":"2024-04-26T12:30:49.550199+0000","last_clean":"2024-04-26T12:30:49.550199+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:30:49.550199+0000","last_undegraded":"2024-04-26T12:30:49.550199+0000","last_fullsized":"2024-04-26T12:30:49.550199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:51.835729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.165183+0000","last_change":"2024-04-26T12:30:16.517097+0000","last_active":"2024-04-26T12:33:28.165183+0000","last_peered":"2024-04-26T12:33:28.165183+0000","last_clean":"2024-04-26T12:33:28.165183+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:33:28.165183+0000","last_undegraded":"2024-04-26T12:33:28.165183+0000","last_fullsized":"2024-04-26T12:33:28.165183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:39.359708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542379+0000","last_change":"2024-04-26T12:30:18.527594+0000","last_active":"2024-04-26T12:30:49.542379+0000","last_peered":"2024-04-26T12:30:49.542379+0000","last_clean":"2024-04-26T12:30:49.542379+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:30:49.542379+0000","last_undegraded":"2024-04-26T12:30:49.542379+0000","last_fullsized":"2024-04-26T12:30:49.542379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:00.612199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.976923+0000","last_change":"2024-04-26T12:30:20.530528+0000","last_active":"2024-04-26T12:31:36.976923+0000","last_peered":"2024-04-26T12:31:36.976923+0000","last_clean":"2024-04-26T12:31:36.976923+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:31:36.976923+0000","last_undegraded":"2024-04-26T12:31:36.976923+0000","last_fullsized":"2024-04-26T12:31:36.976923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:39.750584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531970+0000","last_change":"2024-04-26T12:30:12.491732+0000","last_active":"2024-04-26T12:33:21.531970+0000","last_peered":"2024-04-26T12:33:21.531970+0000","last_clean":"2024-04-26T12:33:21.531970+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:33:21.531970+0000","last_undegraded":"2024-04-26T12:33:21.531970+0000","last_fullsized":"2024-04-26T12:33:21.531970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:32.360440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.721856+0000","last_change":"2024-04-26T12:30:10.507052+0000","last_active":"2024-04-26T12:32:20.721856+0000","last_peered":"2024-04-26T12:32:20.721856+0000","last_clean":"2024-04-26T12:32:20.721856+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:32:20.721856+0000","last_undegraded":"2024-04-26T12:32:20.721856+0000","last_fullsized":"2024-04-26T12:32:20.721856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695639+0000","last_change":"2024-04-26T12:30:14.490693+0000","last_active":"2024-04-26T12:30:49.695639+0000","last_peered":"2024-04-26T12:30:49.695639+0000","last_clean":"2024-04-26T12:30:49.695639+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:30:49.695639+0000","last_undegraded":"2024-04-26T12:30:49.695639+0000","last_fullsized":"2024-04-26T12:30:49.695639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:24.002229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541715+0000","last_change":"2024-04-26T12:30:16.512671+0000","last_active":"2024-04-26T12:30:49.541715+0000","last_peered":"2024-04-26T12:30:49.541715+0000","last_clean":"2024-04-26T12:30:49.541715+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:30:49.541715+0000","last_undegraded":"2024-04-26T12:30:49.541715+0000","last_fullsized":"2024-04-26T12:30:49.541715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:56.174827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541431+0000","last_change":"2024-04-26T12:30:18.526535+0000","last_active":"2024-04-26T12:30:49.541431+0000","last_peered":"2024-04-26T12:30:49.541431+0000","last_clean":"2024-04-26T12:30:49.541431+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:30:49.541431+0000","last_undegraded":"2024-04-26T12:30:49.541431+0000","last_fullsized":"2024-04-26T12:30:49.541431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:47.825774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694295+0000","last_change":"2024-04-26T12:30:20.523683+0000","last_active":"2024-04-26T12:30:49.694295+0000","last_peered":"2024-04-26T12:30:49.694295+0000","last_clean":"2024-04-26T12:30:49.694295+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:30:49.694295+0000","last_undegraded":"2024-04-26T12:30:49.694295+0000","last_fullsized":"2024-04-26T12:30:49.694295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:12.874354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245067+0000","last_change":"2024-04-26T12:30:49.694875+0000","last_active":"2024-04-26T12:33:21.245067+0000","last_peered":"2024-04-26T12:33:21.245067+0000","last_clean":"2024-04-26T12:33:21.245067+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:33:21.245067+0000","last_undegraded":"2024-04-26T12:33:21.245067+0000","last_fullsized":"2024-04-26T12:33:21.245067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:41.776603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.729407+0000","last_change":"2024-04-26T12:30:10.523616+0000","last_active":"2024-04-26T12:30:54.729407+0000","last_peered":"2024-04-26T12:30:54.729407+0000","last_clean":"2024-04-26T12:30:54.729407+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:30:54.729407+0000","last_undegraded":"2024-04-26T12:30:54.729407+0000","last_fullsized":"2024-04-26T12:30:54.729407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:33.941949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.473479+0000","last_change":"2024-04-26T12:30:14.495445+0000","last_active":"2024-04-26T12:32:20.473479+0000","last_peered":"2024-04-26T12:32:20.473479+0000","last_clean":"2024-04-26T12:32:20.473479+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:32:20.473479+0000","last_undegraded":"2024-04-26T12:32:20.473479+0000","last_fullsized":"2024-04-26T12:32:20.473479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543479+0000","last_change":"2024-04-26T12:30:16.518014+0000","last_active":"2024-04-26T12:30:49.543479+0000","last_peered":"2024-04-26T12:30:49.543479+0000","last_clean":"2024-04-26T12:30:49.543479+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:30:49.543479+0000","last_undegraded":"2024-04-26T12:30:49.543479+0000","last_fullsized":"2024-04-26T12:30:49.543479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:35.152332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.064127+0000","last_change":"2024-04-26T12:30:18.530920+0000","last_active":"2024-04-26T12:33:28.064127+0000","last_peered":"2024-04-26T12:33:28.064127+0000","last_clean":"2024-04-26T12:33:28.064127+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:33:28.064127+0000","last_undegraded":"2024-04-26T12:33:28.064127+0000","last_fullsized":"2024-04-26T12:33:28.064127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:42.827240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542674+0000","last_change":"2024-04-26T12:30:20.528257+0000","last_active":"2024-04-26T12:30:49.542674+0000","last_peered":"2024-04-26T12:30:49.542674+0000","last_clean":"2024-04-26T12:30:49.542674+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:30:49.542674+0000","last_undegraded":"2024-04-26T12:30:49.542674+0000","last_fullsized":"2024-04-26T12:30:49.542674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:16.184218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.192878+0000","last_change":"2024-04-26T12:30:12.500154+0000","last_active":"2024-04-26T12:31:37.192878+0000","last_peered":"2024-04-26T12:31:37.192878+0000","last_clean":"2024-04-26T12:31:37.192878+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:31:37.192878+0000","last_undegraded":"2024-04-26T12:31:37.192878+0000","last_fullsized":"2024-04-26T12:31:37.192878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:27.199714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540446+0000","last_change":"2024-04-26T12:30:10.512902+0000","last_active":"2024-04-26T12:30:49.540446+0000","last_peered":"2024-04-26T12:30:49.540446+0000","last_clean":"2024-04-26T12:30:49.540446+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:30:49.540446+0000","last_undegraded":"2024-04-26T12:30:49.540446+0000","last_fullsized":"2024-04-26T12:30:49.540446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:51.487985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547825+0000","last_change":"2024-04-26T12:30:14.492539+0000","last_active":"2024-04-26T12:30:49.547825+0000","last_peered":"2024-04-26T12:30:49.547825+0000","last_clean":"2024-04-26T12:30:49.547825+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:30:49.547825+0000","last_undegraded":"2024-04-26T12:30:49.547825+0000","last_fullsized":"2024-04-26T12:30:49.547825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:46.745596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.372407+0000","last_change":"2024-04-26T12:30:16.516605+0000","last_active":"2024-04-26T12:32:19.372407+0000","last_peered":"2024-04-26T12:32:19.372407+0000","last_clean":"2024-04-26T12:32:19.372407+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:32:19.372407+0000","last_undegraded":"2024-04-26T12:32:19.372407+0000","last_fullsized":"2024-04-26T12:32:19.372407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:12.674195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.534831+0000","last_change":"2024-04-26T12:30:18.513633+0000","last_active":"2024-04-26T12:33:21.534831+0000","last_peered":"2024-04-26T12:33:21.534831+0000","last_clean":"2024-04-26T12:33:21.534831+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:21.534831+0000","last_undegraded":"2024-04-26T12:33:21.534831+0000","last_fullsized":"2024-04-26T12:33:21.534831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:21.390176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876787+0000","last_change":"2024-04-26T12:30:12.493252+0000","last_active":"2024-04-26T12:32:20.876787+0000","last_peered":"2024-04-26T12:32:20.876787+0000","last_clean":"2024-04-26T12:32:20.876787+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:32:20.876787+0000","last_undegraded":"2024-04-26T12:32:20.876787+0000","last_fullsized":"2024-04-26T12:32:20.876787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:05.333696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547945+0000","last_change":"2024-04-26T12:30:10.508473+0000","last_active":"2024-04-26T12:30:49.547945+0000","last_peered":"2024-04-26T12:30:49.547945+0000","last_clean":"2024-04-26T12:30:49.547945+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:30:49.547945+0000","last_undegraded":"2024-04-26T12:30:49.547945+0000","last_fullsized":"2024-04-26T12:30:49.547945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540186+0000","last_change":"2024-04-26T12:30:14.488895+0000","last_active":"2024-04-26T12:30:49.540186+0000","last_peered":"2024-04-26T12:30:49.540186+0000","last_clean":"2024-04-26T12:30:49.540186+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:30:49.540186+0000","last_undegraded":"2024-04-26T12:30:49.540186+0000","last_fullsized":"2024-04-26T12:30:49.540186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:46.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.381746+0000","last_change":"2024-04-26T12:30:16.512244+0000","last_active":"2024-04-26T12:32:19.381746+0000","last_peered":"2024-04-26T12:32:19.381746+0000","last_clean":"2024-04-26T12:32:19.381746+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:32:19.381746+0000","last_undegraded":"2024-04-26T12:32:19.381746+0000","last_fullsized":"2024-04-26T12:32:19.381746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:44.659809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696627+0000","last_change":"2024-04-26T12:30:18.517298+0000","last_active":"2024-04-26T12:30:49.696627+0000","last_peered":"2024-04-26T12:30:49.696627+0000","last_clean":"2024-04-26T12:30:49.696627+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:30:49.696627+0000","last_undegraded":"2024-04-26T12:30:49.696627+0000","last_fullsized":"2024-04-26T12:30:49.696627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:08.568225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.978624+0000","last_change":"2024-04-26T12:30:20.529100+0000","last_active":"2024-04-26T12:31:36.978624+0000","last_peered":"2024-04-26T12:31:36.978624+0000","last_clean":"2024-04-26T12:31:36.978624+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:31:36.978624+0000","last_undegraded":"2024-04-26T12:31:36.978624+0000","last_fullsized":"2024-04-26T12:31:36.978624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.337272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247623+0000","last_change":"2024-04-26T12:30:12.496041+0000","last_active":"2024-04-26T12:33:21.247623+0000","last_peered":"2024-04-26T12:33:21.247623+0000","last_clean":"2024-04-26T12:33:21.247623+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:33:21.247623+0000","last_undegraded":"2024-04-26T12:33:21.247623+0000","last_fullsized":"2024-04-26T12:33:21.247623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:20.528504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546239+0000","last_change":"2024-04-26T12:30:10.501359+0000","last_active":"2024-04-26T12:30:49.546239+0000","last_peered":"2024-04-26T12:30:49.546239+0000","last_clean":"2024-04-26T12:30:49.546239+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:30:49.546239+0000","last_undegraded":"2024-04-26T12:30:49.546239+0000","last_fullsized":"2024-04-26T12:30:49.546239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694371+0000","last_change":"2024-04-26T12:30:14.491272+0000","last_active":"2024-04-26T12:30:49.694371+0000","last_peered":"2024-04-26T12:30:49.694371+0000","last_clean":"2024-04-26T12:30:49.694371+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:30:49.694371+0000","last_undegraded":"2024-04-26T12:30:49.694371+0000","last_fullsized":"2024-04-26T12:30:49.694371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:07.482770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.119819+0000","last_change":"2024-04-26T12:30:16.517757+0000","last_active":"2024-04-26T12:33:28.119819+0000","last_peered":"2024-04-26T12:33:28.119819+0000","last_clean":"2024-04-26T12:33:28.119819+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:33:28.119819+0000","last_undegraded":"2024-04-26T12:33:28.119819+0000","last_fullsized":"2024-04-26T12:33:28.119819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:28.076471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695218+0000","last_change":"2024-04-26T12:30:18.522879+0000","last_active":"2024-04-26T12:30:49.695218+0000","last_peered":"2024-04-26T12:30:49.695218+0000","last_clean":"2024-04-26T12:30:49.695218+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:30:49.695218+0000","last_undegraded":"2024-04-26T12:30:49.695218+0000","last_fullsized":"2024-04-26T12:30:49.695218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:01.222542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.431404+0000","last_change":"2024-04-26T12:30:20.531982+0000","last_active":"2024-04-26T12:31:31.431404+0000","last_peered":"2024-04-26T12:31:31.431404+0000","last_clean":"2024-04-26T12:31:31.431404+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:31:31.431404+0000","last_undegraded":"2024-04-26T12:31:31.431404+0000","last_fullsized":"2024-04-26T12:31:31.431404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:39.756767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.509020+0000","last_change":"2024-04-26T12:30:12.483941+0000","last_active":"2024-04-26T12:33:21.509020+0000","last_peered":"2024-04-26T12:33:21.509020+0000","last_clean":"2024-04-26T12:33:21.509020+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:33:21.509020+0000","last_undegraded":"2024-04-26T12:33:21.509020+0000","last_fullsized":"2024-04-26T12:33:21.509020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.061530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.197078+0000","last_change":"2024-04-26T12:30:10.524374+0000","last_active":"2024-04-26T12:33:21.197078+0000","last_peered":"2024-04-26T12:33:21.197078+0000","last_clean":"2024-04-26T12:33:21.197078+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:33:21.197078+0000","last_undegraded":"2024-04-26T12:33:21.197078+0000","last_fullsized":"2024-04-26T12:33:21.197078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:17.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695767+0000","last_change":"2024-04-26T12:30:14.491692+0000","last_active":"2024-04-26T12:30:49.695767+0000","last_peered":"2024-04-26T12:30:49.695767+0000","last_clean":"2024-04-26T12:30:49.695767+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:30:49.695767+0000","last_undegraded":"2024-04-26T12:30:49.695767+0000","last_fullsized":"2024-04-26T12:30:49.695767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:18.208474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.182865+0000","last_change":"2024-04-26T12:30:16.517072+0000","last_active":"2024-04-26T12:33:28.182865+0000","last_peered":"2024-04-26T12:33:28.182865+0000","last_clean":"2024-04-26T12:33:28.182865+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:33:28.182865+0000","last_undegraded":"2024-04-26T12:33:28.182865+0000","last_fullsized":"2024-04-26T12:33:28.182865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:35.697992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.649875+0000","last_change":"2024-04-26T12:30:18.526287+0000","last_active":"2024-04-26T12:33:21.649875+0000","last_peered":"2024-04-26T12:33:21.649875+0000","last_clean":"2024-04-26T12:33:21.649875+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:21.649875+0000","last_undegraded":"2024-04-26T12:33:21.649875+0000","last_fullsized":"2024-04-26T12:33:21.649875+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:19.306792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695667+0000","last_change":"2024-04-26T12:30:20.531457+0000","last_active":"2024-04-26T12:30:49.695667+0000","last_peered":"2024-04-26T12:30:49.695667+0000","last_clean":"2024-04-26T12:30:49.695667+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:30:49.695667+0000","last_undegraded":"2024-04-26T12:30:49.695667+0000","last_fullsized":"2024-04-26T12:30:49.695667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:06.390024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546441+0000","last_change":"2024-04-26T12:30:12.490458+0000","last_active":"2024-04-26T12:30:49.546441+0000","last_peered":"2024-04-26T12:30:49.546441+0000","last_clean":"2024-04-26T12:30:49.546441+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:30:49.546441+0000","last_undegraded":"2024-04-26T12:30:49.546441+0000","last_fullsized":"2024-04-26T12:30:49.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547353+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:30:49.547353+0000","last_peered":"2024-04-26T12:30:49.547353+0000","last_clean":"2024-04-26T12:30:49.547353+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:30:49.547353+0000","last_undegraded":"2024-04-26T12:30:49.547353+0000","last_fullsized":"2024-04-26T12:30:49.547353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:24.660776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.491181+0000","last_change":"2024-04-26T12:30:49.553037+0000","last_active":"2024-04-26T12:30:52.491181+0000","last_peered":"2024-04-26T12:30:52.491181+0000","last_clean":"2024-04-26T12:30:52.491181+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:30:52.491181+0000","last_undegraded":"2024-04-26T12:30:52.491181+0000","last_fullsized":"2024-04-26T12:30:52.491181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:54.425258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'60","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.188148+0000","last_change":"2024-04-26T12:30:16.516843+0000","last_active":"2024-04-26T12:33:28.188148+0000","last_peered":"2024-04-26T12:33:28.188148+0000","last_clean":"2024-04-26T12:33:28.188148+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:33:28.188148+0000","last_undegraded":"2024-04-26T12:33:28.188148+0000","last_fullsized":"2024-04-26T12:33:28.188148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:04.838523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694139+0000","last_change":"2024-04-26T12:30:18.522525+0000","last_active":"2024-04-26T12:30:49.694139+0000","last_peered":"2024-04-26T12:30:49.694139+0000","last_clean":"2024-04-26T12:30:49.694139+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:30:49.694139+0000","last_undegraded":"2024-04-26T12:30:49.694139+0000","last_fullsized":"2024-04-26T12:30:49.694139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:59.330423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625284+0000","last_change":"2024-04-26T12:30:20.522951+0000","last_active":"2024-04-26T12:33:21.625284+0000","last_peered":"2024-04-26T12:33:21.625284+0000","last_clean":"2024-04-26T12:33:21.625284+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:33:21.625284+0000","last_undegraded":"2024-04-26T12:33:21.625284+0000","last_fullsized":"2024-04-26T12:33:21.625284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:10.643445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511024+0000","last_change":"2024-04-26T12:30:12.498504+0000","last_active":"2024-04-26T12:32:28.511024+0000","last_peered":"2024-04-26T12:32:28.511024+0000","last_clean":"2024-04-26T12:32:28.511024+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:32:28.511024+0000","last_undegraded":"2024-04-26T12:32:28.511024+0000","last_fullsized":"2024-04-26T12:32:28.511024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:01.405398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.853500+0000","last_change":"2024-04-26T12:30:10.499408+0000","last_active":"2024-04-26T12:32:20.853500+0000","last_peered":"2024-04-26T12:32:20.853500+0000","last_clean":"2024-04-26T12:32:20.853500+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:32:20.853500+0000","last_undegraded":"2024-04-26T12:32:20.853500+0000","last_fullsized":"2024-04-26T12:32:20.853500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:23.808923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543749+0000","last_change":"2024-04-26T12:30:14.488769+0000","last_active":"2024-04-26T12:30:49.543749+0000","last_peered":"2024-04-26T12:30:49.543749+0000","last_clean":"2024-04-26T12:30:49.543749+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:30:49.543749+0000","last_undegraded":"2024-04-26T12:30:49.543749+0000","last_fullsized":"2024-04-26T12:30:49.543749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:56.138596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'35","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.131418+0000","last_change":"2024-04-26T12:30:16.512181+0000","last_active":"2024-04-26T12:33:28.131418+0000","last_peered":"2024-04-26T12:33:28.131418+0000","last_clean":"2024-04-26T12:33:28.131418+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:33:28.131418+0000","last_undegraded":"2024-04-26T12:33:28.131418+0000","last_fullsized":"2024-04-26T12:33:28.131418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:05.265330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547995+0000","last_change":"2024-04-26T12:30:18.528738+0000","last_active":"2024-04-26T12:30:49.547995+0000","last_peered":"2024-04-26T12:30:49.547995+0000","last_clean":"2024-04-26T12:30:49.547995+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:30:49.547995+0000","last_undegraded":"2024-04-26T12:30:49.547995+0000","last_fullsized":"2024-04-26T12:30:49.547995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.890333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510646+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:32:23.510646+0000","last_peered":"2024-04-26T12:32:23.510646+0000","last_clean":"2024-04-26T12:32:23.510646+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:32:23.510646+0000","last_undegraded":"2024-04-26T12:32:23.510646+0000","last_fullsized":"2024-04-26T12:32:23.510646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:22.903178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550859+0000","last_change":"2024-04-26T12:30:12.501179+0000","last_active":"2024-04-26T12:30:49.550859+0000","last_peered":"2024-04-26T12:30:49.550859+0000","last_clean":"2024-04-26T12:30:49.550859+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:30:49.550859+0000","last_undegraded":"2024-04-26T12:30:49.550859+0000","last_fullsized":"2024-04-26T12:30:49.550859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:04.520788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.526847+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:21.526847+0000","last_peered":"2024-04-26T12:33:21.526847+0000","last_clean":"2024-04-26T12:33:21.526847+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:21.526847+0000","last_undegraded":"2024-04-26T12:33:21.526847+0000","last_fullsized":"2024-04-26T12:33:21.526847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.901139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695748+0000","last_change":"2024-04-26T12:30:14.491390+0000","last_active":"2024-04-26T12:30:49.695748+0000","last_peered":"2024-04-26T12:30:49.695748+0000","last_clean":"2024-04-26T12:30:49.695748+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:30:49.695748+0000","last_undegraded":"2024-04-26T12:30:49.695748+0000","last_fullsized":"2024-04-26T12:30:49.695748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:26.342488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.391961+0000","last_change":"2024-04-26T12:30:16.509310+0000","last_active":"2024-04-26T12:32:19.391961+0000","last_peered":"2024-04-26T12:32:19.391961+0000","last_clean":"2024-04-26T12:32:19.391961+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:32:19.391961+0000","last_undegraded":"2024-04-26T12:32:19.391961+0000","last_fullsized":"2024-04-26T12:32:19.391961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:24.483163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":409,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.629477+0000","last_change":"2024-04-26T12:30:18.526558+0000","last_active":"2024-04-26T12:33:21.629477+0000","last_peered":"2024-04-26T12:33:21.629477+0000","last_clean":"2024-04-26T12:33:21.629477+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:21.629477+0000","last_undegraded":"2024-04-26T12:33:21.629477+0000","last_fullsized":"2024-04-26T12:33:21.629477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:07.868452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499378+0000","last_change":"2024-04-26T12:30:20.523809+0000","last_active":"2024-04-26T12:32:27.499378+0000","last_peered":"2024-04-26T12:32:27.499378+0000","last_clean":"2024-04-26T12:32:27.499378+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:32:27.499378+0000","last_undegraded":"2024-04-26T12:32:27.499378+0000","last_fullsized":"2024-04-26T12:32:27.499378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:28.735728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503582+0000","last_change":"2024-04-26T12:30:12.484589+0000","last_active":"2024-04-26T12:33:21.503582+0000","last_peered":"2024-04-26T12:33:21.503582+0000","last_clean":"2024-04-26T12:33:21.503582+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:33:21.503582+0000","last_undegraded":"2024-04-26T12:33:21.503582+0000","last_fullsized":"2024-04-26T12:33:21.503582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:06.351952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544074+0000","last_change":"2024-04-26T12:30:10.524444+0000","last_active":"2024-04-26T12:30:49.544074+0000","last_peered":"2024-04-26T12:30:49.544074+0000","last_clean":"2024-04-26T12:30:49.544074+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:30:49.544074+0000","last_undegraded":"2024-04-26T12:30:49.544074+0000","last_fullsized":"2024-04-26T12:30:49.544074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:25.300641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.045581+0000","last_change":"2024-04-26T12:30:14.495065+0000","last_active":"2024-04-26T12:33:28.045581+0000","last_peered":"2024-04-26T12:33:28.045581+0000","last_clean":"2024-04-26T12:33:28.045581+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:33:28.045581+0000","last_undegraded":"2024-04-26T12:33:28.045581+0000","last_fullsized":"2024-04-26T12:33:28.045581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:42.031534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549960+0000","last_change":"2024-04-26T12:30:16.515078+0000","last_active":"2024-04-26T12:30:49.549960+0000","last_peered":"2024-04-26T12:30:49.549960+0000","last_clean":"2024-04-26T12:30:49.549960+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:30:49.549960+0000","last_undegraded":"2024-04-26T12:30:49.549960+0000","last_fullsized":"2024-04-26T12:30:49.549960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:38.268633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":502,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.066529+0000","last_change":"2024-04-26T12:30:18.519523+0000","last_active":"2024-04-26T12:33:28.066529+0000","last_peered":"2024-04-26T12:33:28.066529+0000","last_clean":"2024-04-26T12:33:28.066529+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:28.066529+0000","last_undegraded":"2024-04-26T12:33:28.066529+0000","last_fullsized":"2024-04-26T12:33:28.066529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:16.405544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.504960+0000","last_change":"2024-04-26T12:30:20.527644+0000","last_active":"2024-04-26T12:33:21.504960+0000","last_peered":"2024-04-26T12:33:21.504960+0000","last_clean":"2024-04-26T12:33:21.504960+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:21.504960+0000","last_undegraded":"2024-04-26T12:33:21.504960+0000","last_fullsized":"2024-04-26T12:33:21.504960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:21.313640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583012+0000","last_change":"2024-04-26T12:30:12.498024+0000","last_active":"2024-04-26T12:33:21.583012+0000","last_peered":"2024-04-26T12:33:21.583012+0000","last_clean":"2024-04-26T12:33:21.583012+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:21.583012+0000","last_undegraded":"2024-04-26T12:33:21.583012+0000","last_fullsized":"2024-04-26T12:33:21.583012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:50.998968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543235+0000","last_change":"2024-04-26T12:30:10.521698+0000","last_active":"2024-04-26T12:30:49.543235+0000","last_peered":"2024-04-26T12:30:49.543235+0000","last_clean":"2024-04-26T12:30:49.543235+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:30:49.543235+0000","last_undegraded":"2024-04-26T12:30:49.543235+0000","last_fullsized":"2024-04-26T12:30:49.543235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:17.318885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548138+0000","last_change":"2024-04-26T12:30:14.493082+0000","last_active":"2024-04-26T12:30:49.548138+0000","last_peered":"2024-04-26T12:30:49.548138+0000","last_clean":"2024-04-26T12:30:49.548138+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:30:49.548138+0000","last_undegraded":"2024-04-26T12:30:49.548138+0000","last_fullsized":"2024-04-26T12:30:49.548138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:53.061967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.168256+0000","last_change":"2024-04-26T12:30:16.512907+0000","last_active":"2024-04-26T12:33:28.168256+0000","last_peered":"2024-04-26T12:33:28.168256+0000","last_clean":"2024-04-26T12:33:28.168256+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:33:28.168256+0000","last_undegraded":"2024-04-26T12:33:28.168256+0000","last_fullsized":"2024-04-26T12:33:28.168256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:44.039858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543293+0000","last_change":"2024-04-26T12:30:18.525037+0000","last_active":"2024-04-26T12:30:49.543293+0000","last_peered":"2024-04-26T12:30:49.543293+0000","last_clean":"2024-04-26T12:30:49.543293+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:30:49.543293+0000","last_undegraded":"2024-04-26T12:30:49.543293+0000","last_fullsized":"2024-04-26T12:30:49.543293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:34.358080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.563122+0000","last_change":"2024-04-26T12:30:20.527103+0000","last_active":"2024-04-26T12:33:21.563122+0000","last_peered":"2024-04-26T12:33:21.563122+0000","last_clean":"2024-04-26T12:33:21.563122+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:21.563122+0000","last_undegraded":"2024-04-26T12:33:21.563122+0000","last_fullsized":"2024-04-26T12:33:21.563122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:57.874402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532058+0000","last_change":"2024-04-26T12:30:12.500664+0000","last_active":"2024-04-26T12:33:21.532058+0000","last_peered":"2024-04-26T12:33:21.532058+0000","last_clean":"2024-04-26T12:33:21.532058+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:21.532058+0000","last_undegraded":"2024-04-26T12:33:21.532058+0000","last_fullsized":"2024-04-26T12:33:21.532058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:30.601274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539702+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:30:49.539702+0000","last_peered":"2024-04-26T12:30:49.539702+0000","last_clean":"2024-04-26T12:30:49.539702+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:30:49.539702+0000","last_undegraded":"2024-04-26T12:30:49.539702+0000","last_fullsized":"2024-04-26T12:30:49.539702+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:34.223814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545163+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:30:49.545163+0000","last_peered":"2024-04-26T12:30:49.545163+0000","last_clean":"2024-04-26T12:30:49.545163+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:30:49.545163+0000","last_undegraded":"2024-04-26T12:30:49.545163+0000","last_fullsized":"2024-04-26T12:30:49.545163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:04.762234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544162+0000","last_change":"2024-04-26T12:30:10.518603+0000","last_active":"2024-04-26T12:30:49.544162+0000","last_peered":"2024-04-26T12:30:49.544162+0000","last_clean":"2024-04-26T12:30:49.544162+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:30:49.544162+0000","last_undegraded":"2024-04-26T12:30:49.544162+0000","last_fullsized":"2024-04-26T12:30:49.544162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:01.289832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541419+0000","last_change":"2024-04-26T12:30:14.493329+0000","last_active":"2024-04-26T12:30:49.541419+0000","last_peered":"2024-04-26T12:30:49.541419+0000","last_clean":"2024-04-26T12:30:49.541419+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:30:49.541419+0000","last_undegraded":"2024-04-26T12:30:49.541419+0000","last_fullsized":"2024-04-26T12:30:49.541419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.398590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.200218+0000","last_change":"2024-04-26T12:30:16.517527+0000","last_active":"2024-04-26T12:33:28.200218+0000","last_peered":"2024-04-26T12:33:28.200218+0000","last_clean":"2024-04-26T12:33:28.200218+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:33:28.200218+0000","last_undegraded":"2024-04-26T12:33:28.200218+0000","last_fullsized":"2024-04-26T12:33:28.200218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:40.510822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696149+0000","last_change":"2024-04-26T12:30:18.526193+0000","last_active":"2024-04-26T12:30:49.696149+0000","last_peered":"2024-04-26T12:30:49.696149+0000","last_clean":"2024-04-26T12:30:49.696149+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:30:49.696149+0000","last_undegraded":"2024-04-26T12:30:49.696149+0000","last_fullsized":"2024-04-26T12:30:49.696149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:25.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":164,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.540830+0000","last_change":"2024-04-26T12:30:20.526296+0000","last_active":"2024-04-26T12:33:21.540830+0000","last_peered":"2024-04-26T12:33:21.540830+0000","last_clean":"2024-04-26T12:33:21.540830+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:21.540830+0000","last_undegraded":"2024-04-26T12:33:21.540830+0000","last_fullsized":"2024-04-26T12:33:21.540830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:54.224734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.675274+0000","last_change":"2024-04-26T12:30:12.488875+0000","last_active":"2024-04-26T12:32:17.675274+0000","last_peered":"2024-04-26T12:32:17.675274+0000","last_clean":"2024-04-26T12:32:17.675274+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:32:17.675274+0000","last_undegraded":"2024-04-26T12:32:17.675274+0000","last_fullsized":"2024-04-26T12:32:17.675274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:41.425033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542657+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:30:49.542657+0000","last_peered":"2024-04-26T12:30:49.542657+0000","last_clean":"2024-04-26T12:30:49.542657+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:30:49.542657+0000","last_undegraded":"2024-04-26T12:30:49.542657+0000","last_fullsized":"2024-04-26T12:30:49.542657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:20.023037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694359+0000","last_change":"2024-04-26T12:30:10.488700+0000","last_active":"2024-04-26T12:30:49.694359+0000","last_peered":"2024-04-26T12:30:49.694359+0000","last_clean":"2024-04-26T12:30:49.694359+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:30:49.694359+0000","last_undegraded":"2024-04-26T12:30:49.694359+0000","last_fullsized":"2024-04-26T12:30:49.694359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548136+0000","last_change":"2024-04-26T12:30:14.492528+0000","last_active":"2024-04-26T12:30:49.548136+0000","last_peered":"2024-04-26T12:30:49.548136+0000","last_clean":"2024-04-26T12:30:49.548136+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:30:49.548136+0000","last_undegraded":"2024-04-26T12:30:49.548136+0000","last_fullsized":"2024-04-26T12:30:49.548136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:32.660138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'284","reported_seq":500,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.172127+0000","last_change":"2024-04-26T12:30:16.515291+0000","last_active":"2024-04-26T12:33:28.172127+0000","last_peered":"2024-04-26T12:33:28.172127+0000","last_clean":"2024-04-26T12:33:28.172127+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:28.172127+0000","last_undegraded":"2024-04-26T12:33:28.172127+0000","last_fullsized":"2024-04-26T12:33:28.172127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:16.639770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547578+0000","last_change":"2024-04-26T12:30:18.530303+0000","last_active":"2024-04-26T12:30:49.547578+0000","last_peered":"2024-04-26T12:30:49.547578+0000","last_clean":"2024-04-26T12:30:49.547578+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:30:49.547578+0000","last_undegraded":"2024-04-26T12:30:49.547578+0000","last_fullsized":"2024-04-26T12:30:49.547578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:17.619205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.975177+0000","last_change":"2024-04-26T12:30:20.532161+0000","last_active":"2024-04-26T12:31:36.975177+0000","last_peered":"2024-04-26T12:31:36.975177+0000","last_clean":"2024-04-26T12:31:36.975177+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:31:36.975177+0000","last_undegraded":"2024-04-26T12:31:36.975177+0000","last_fullsized":"2024-04-26T12:31:36.975177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:51.654625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498769+0000","last_change":"2024-04-26T12:30:12.500451+0000","last_active":"2024-04-26T12:32:22.498769+0000","last_peered":"2024-04-26T12:32:22.498769+0000","last_clean":"2024-04-26T12:32:22.498769+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:32:22.498769+0000","last_undegraded":"2024-04-26T12:32:22.498769+0000","last_fullsized":"2024-04-26T12:32:22.498769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:13.176012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542574+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:30:49.542574+0000","last_peered":"2024-04-26T12:30:49.542574+0000","last_clean":"2024-04-26T12:30:49.542574+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:30:49.542574+0000","last_undegraded":"2024-04-26T12:30:49.542574+0000","last_fullsized":"2024-04-26T12:30:49.542574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:40.531155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.693869+0000","last_change":"2024-04-26T12:30:10.489913+0000","last_active":"2024-04-26T12:30:49.693869+0000","last_peered":"2024-04-26T12:30:49.693869+0000","last_clean":"2024-04-26T12:30:49.693869+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:30:49.693869+0000","last_undegraded":"2024-04-26T12:30:49.693869+0000","last_fullsized":"2024-04-26T12:30:49.693869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.753510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546002+0000","last_change":"2024-04-26T12:30:14.492118+0000","last_active":"2024-04-26T12:30:49.546002+0000","last_peered":"2024-04-26T12:30:49.546002+0000","last_clean":"2024-04-26T12:30:49.546002+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:30:49.546002+0000","last_undegraded":"2024-04-26T12:30:49.546002+0000","last_fullsized":"2024-04-26T12:30:49.546002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:34.317162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574673+0000","last_change":"2024-04-26T12:30:16.509140+0000","last_active":"2024-04-26T12:33:19.574673+0000","last_peered":"2024-04-26T12:33:19.574673+0000","last_clean":"2024-04-26T12:33:19.574673+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:19.574673+0000","last_undegraded":"2024-04-26T12:33:19.574673+0000","last_fullsized":"2024-04-26T12:33:19.574673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:55.319866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696077+0000","last_change":"2024-04-26T12:30:18.526395+0000","last_active":"2024-04-26T12:30:49.696077+0000","last_peered":"2024-04-26T12:30:49.696077+0000","last_clean":"2024-04-26T12:30:49.696077+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:30:49.696077+0000","last_undegraded":"2024-04-26T12:30:49.696077+0000","last_fullsized":"2024-04-26T12:30:49.696077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:27.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.189438+0000","last_change":"2024-04-26T12:30:20.531432+0000","last_active":"2024-04-26T12:31:37.189438+0000","last_peered":"2024-04-26T12:31:37.189438+0000","last_clean":"2024-04-26T12:31:37.189438+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:31:37.189438+0000","last_undegraded":"2024-04-26T12:31:37.189438+0000","last_fullsized":"2024-04-26T12:31:37.189438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:35.605929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.697139+0000","last_change":"2024-04-26T12:30:12.489234+0000","last_active":"2024-04-26T12:30:49.697139+0000","last_peered":"2024-04-26T12:30:49.697139+0000","last_clean":"2024-04-26T12:30:49.697139+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:30:49.697139+0000","last_undegraded":"2024-04-26T12:30:49.697139+0000","last_fullsized":"2024-04-26T12:30:49.697139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:08.716751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543541+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:30:49.543541+0000","last_peered":"2024-04-26T12:30:49.543541+0000","last_clean":"2024-04-26T12:30:49.543541+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:30:49.543541+0000","last_undegraded":"2024-04-26T12:30:49.543541+0000","last_fullsized":"2024-04-26T12:30:49.543541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:36.069601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501863+0000","last_change":"2024-04-26T12:30:10.500548+0000","last_active":"2024-04-26T12:32:17.501863+0000","last_peered":"2024-04-26T12:32:17.501863+0000","last_clean":"2024-04-26T12:32:17.501863+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:32:17.501863+0000","last_undegraded":"2024-04-26T12:32:17.501863+0000","last_fullsized":"2024-04-26T12:32:17.501863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:21.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":13,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696292+0000","last_change":"2024-04-26T12:30:14.487929+0000","last_active":"2024-04-26T12:30:49.696292+0000","last_peered":"2024-04-26T12:30:49.696292+0000","last_clean":"2024-04-26T12:30:49.696292+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:30:49.696292+0000","last_undegraded":"2024-04-26T12:30:49.696292+0000","last_fullsized":"2024-04-26T12:30:49.696292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:52.557515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.889030+0000","last_change":"2024-04-26T12:30:16.517033+0000","last_active":"2024-04-26T12:33:20.889030+0000","last_peered":"2024-04-26T12:33:20.889030+0000","last_clean":"2024-04-26T12:33:20.889030+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:20.889030+0000","last_undegraded":"2024-04-26T12:33:20.889030+0000","last_fullsized":"2024-04-26T12:33:20.889030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:38.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549097+0000","last_change":"2024-04-26T12:30:18.529014+0000","last_active":"2024-04-26T12:30:49.549097+0000","last_peered":"2024-04-26T12:30:49.549097+0000","last_clean":"2024-04-26T12:30:49.549097+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:30:49.549097+0000","last_undegraded":"2024-04-26T12:30:49.549097+0000","last_fullsized":"2024-04-26T12:30:49.549097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:10.143592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.627536+0000","last_change":"2024-04-26T12:30:20.535350+0000","last_active":"2024-04-26T12:32:20.627536+0000","last_peered":"2024-04-26T12:32:20.627536+0000","last_clean":"2024-04-26T12:32:20.627536+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:32:20.627536+0000","last_undegraded":"2024-04-26T12:32:20.627536+0000","last_fullsized":"2024-04-26T12:32:20.627536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:44.849843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540587+0000","last_change":"2024-04-26T12:30:12.494538+0000","last_active":"2024-04-26T12:30:49.540587+0000","last_peered":"2024-04-26T12:30:49.540587+0000","last_clean":"2024-04-26T12:30:49.540587+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:30:49.540587+0000","last_undegraded":"2024-04-26T12:30:49.540587+0000","last_fullsized":"2024-04-26T12:30:49.540587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:34.559667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542876+0000","last_change":"2024-04-26T12:30:10.502077+0000","last_active":"2024-04-26T12:30:49.542876+0000","last_peered":"2024-04-26T12:30:49.542876+0000","last_clean":"2024-04-26T12:30:49.542876+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:30:49.542876+0000","last_undegraded":"2024-04-26T12:30:49.542876+0000","last_fullsized":"2024-04-26T12:30:49.542876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:18.207398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695937+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:30:49.695937+0000","last_peered":"2024-04-26T12:30:49.695937+0000","last_clean":"2024-04-26T12:30:49.695937+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.695937+0000","last_undegraded":"2024-04-26T12:30:49.695937+0000","last_fullsized":"2024-04-26T12:30:49.695937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:41.365768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498561+0000","last_change":"2024-04-26T12:30:14.490527+0000","last_active":"2024-04-26T12:32:22.498561+0000","last_peered":"2024-04-26T12:32:22.498561+0000","last_clean":"2024-04-26T12:32:22.498561+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:32:22.498561+0000","last_undegraded":"2024-04-26T12:32:22.498561+0000","last_fullsized":"2024-04-26T12:32:22.498561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:44.342932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.390913+0000","last_change":"2024-04-26T12:30:16.516144+0000","last_active":"2024-04-26T12:32:19.390913+0000","last_peered":"2024-04-26T12:32:19.390913+0000","last_clean":"2024-04-26T12:32:19.390913+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:32:19.390913+0000","last_undegraded":"2024-04-26T12:32:19.390913+0000","last_fullsized":"2024-04-26T12:32:19.390913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:35.964112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542090+0000","last_change":"2024-04-26T12:30:18.523448+0000","last_active":"2024-04-26T12:30:49.542090+0000","last_peered":"2024-04-26T12:30:49.542090+0000","last_clean":"2024-04-26T12:30:49.542090+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:30:49.542090+0000","last_undegraded":"2024-04-26T12:30:49.542090+0000","last_fullsized":"2024-04-26T12:30:49.542090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:00.948613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.817678+0000","last_change":"2024-04-26T12:30:20.527189+0000","last_active":"2024-04-26T12:32:20.817678+0000","last_peered":"2024-04-26T12:32:20.817678+0000","last_clean":"2024-04-26T12:32:20.817678+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:32:20.817678+0000","last_undegraded":"2024-04-26T12:32:20.817678+0000","last_fullsized":"2024-04-26T12:32:20.817678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:22.610410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.247296+0000","last_change":"2024-04-26T12:30:12.493953+0000","last_active":"2024-04-26T12:33:21.247296+0000","last_peered":"2024-04-26T12:33:21.247296+0000","last_clean":"2024-04-26T12:33:21.247296+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:33:21.247296+0000","last_undegraded":"2024-04-26T12:33:21.247296+0000","last_fullsized":"2024-04-26T12:33:21.247296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:29.432297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696477+0000","last_change":"2024-04-26T12:30:10.499533+0000","last_active":"2024-04-26T12:30:49.696477+0000","last_peered":"2024-04-26T12:30:49.696477+0000","last_clean":"2024-04-26T12:30:49.696477+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:30:49.696477+0000","last_undegraded":"2024-04-26T12:30:49.696477+0000","last_fullsized":"2024-04-26T12:30:49.696477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549792+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:30:49.549792+0000","last_peered":"2024-04-26T12:30:49.549792+0000","last_clean":"2024-04-26T12:30:49.549792+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:30:49.549792+0000","last_undegraded":"2024-04-26T12:30:49.549792+0000","last_fullsized":"2024-04-26T12:30:49.549792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:20.349910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552858+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:30:49.552858+0000","last_peered":"2024-04-26T12:30:49.552858+0000","last_clean":"2024-04-26T12:30:49.552858+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:30:49.552858+0000","last_undegraded":"2024-04-26T12:30:49.552858+0000","last_fullsized":"2024-04-26T12:30:49.552858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:36.051479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'15","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541073+0000","last_change":"2024-04-26T12:30:16.519723+0000","last_active":"2024-04-26T12:30:49.541073+0000","last_peered":"2024-04-26T12:30:49.541073+0000","last_clean":"2024-04-26T12:30:49.541073+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:30:49.541073+0000","last_undegraded":"2024-04-26T12:30:49.541073+0000","last_fullsized":"2024-04-26T12:30:49.541073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:15.493662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":349,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.062638+0000","last_change":"2024-04-26T12:30:18.522379+0000","last_active":"2024-04-26T12:33:28.062638+0000","last_peered":"2024-04-26T12:33:28.062638+0000","last_clean":"2024-04-26T12:33:28.062638+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:28.062638+0000","last_undegraded":"2024-04-26T12:33:28.062638+0000","last_fullsized":"2024-04-26T12:33:28.062638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:31.575194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.472108+0000","last_change":"2024-04-26T12:30:20.530218+0000","last_active":"2024-04-26T12:30:54.472108+0000","last_peered":"2024-04-26T12:30:54.472108+0000","last_clean":"2024-04-26T12:30:54.472108+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:30:54.472108+0000","last_undegraded":"2024-04-26T12:30:54.472108+0000","last_fullsized":"2024-04-26T12:30:54.472108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:19.744006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502925+0000","last_change":"2024-04-26T12:30:12.496796+0000","last_active":"2024-04-26T12:33:21.502925+0000","last_peered":"2024-04-26T12:33:21.502925+0000","last_clean":"2024-04-26T12:33:21.502925+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:21.502925+0000","last_undegraded":"2024-04-26T12:33:21.502925+0000","last_fullsized":"2024-04-26T12:33:21.502925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:20.540141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.550102+0000","last_change":"2024-04-26T12:30:10.516983+0000","last_active":"2024-04-26T12:30:49.550102+0000","last_peered":"2024-04-26T12:30:49.550102+0000","last_clean":"2024-04-26T12:30:49.550102+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:30:49.550102+0000","last_undegraded":"2024-04-26T12:30:49.550102+0000","last_fullsized":"2024-04-26T12:30:49.550102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:02.170720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696304+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:30:49.696304+0000","last_peered":"2024-04-26T12:30:49.696304+0000","last_clean":"2024-04-26T12:30:49.696304+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:30:49.696304+0000","last_undegraded":"2024-04-26T12:30:49.696304+0000","last_fullsized":"2024-04-26T12:30:49.696304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:36.830729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542420+0000","last_change":"2024-04-26T12:30:14.491970+0000","last_active":"2024-04-26T12:30:49.542420+0000","last_peered":"2024-04-26T12:30:49.542420+0000","last_clean":"2024-04-26T12:30:49.542420+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:30:49.542420+0000","last_undegraded":"2024-04-26T12:30:49.542420+0000","last_fullsized":"2024-04-26T12:30:49.542420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:23.888576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'12","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510792+0000","last_change":"2024-04-26T12:30:16.517776+0000","last_active":"2024-04-26T12:32:23.510792+0000","last_peered":"2024-04-26T12:32:23.510792+0000","last_clean":"2024-04-26T12:32:23.510792+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:32:23.510792+0000","last_undegraded":"2024-04-26T12:32:23.510792+0000","last_fullsized":"2024-04-26T12:32:23.510792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:16.311902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.625853+0000","last_change":"2024-04-26T12:30:18.513636+0000","last_active":"2024-04-26T12:33:21.625853+0000","last_peered":"2024-04-26T12:33:21.625853+0000","last_clean":"2024-04-26T12:33:21.625853+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:21.625853+0000","last_undegraded":"2024-04-26T12:33:21.625853+0000","last_fullsized":"2024-04-26T12:33:21.625853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:16.493488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540087+0000","last_change":"2024-04-26T12:30:20.532905+0000","last_active":"2024-04-26T12:30:49.540087+0000","last_peered":"2024-04-26T12:30:49.540087+0000","last_clean":"2024-04-26T12:30:49.540087+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:30:49.540087+0000","last_undegraded":"2024-04-26T12:30:49.540087+0000","last_fullsized":"2024-04-26T12:30:49.540087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:44.711542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463354+0000","last_change":"2024-04-26T12:30:12.481683+0000","last_active":"2024-04-26T12:33:21.463354+0000","last_peered":"2024-04-26T12:33:21.463354+0000","last_clean":"2024-04-26T12:33:21.463354+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:21.463354+0000","last_undegraded":"2024-04-26T12:33:21.463354+0000","last_fullsized":"2024-04-26T12:33:21.463354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:19.678454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.178143+0000","last_change":"2024-04-26T12:30:10.507125+0000","last_active":"2024-04-26T12:33:21.178143+0000","last_peered":"2024-04-26T12:33:21.178143+0000","last_clean":"2024-04-26T12:33:21.178143+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:33:21.178143+0000","last_undegraded":"2024-04-26T12:33:21.178143+0000","last_fullsized":"2024-04-26T12:33:21.178143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:00.550498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549681+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:30:49.549681+0000","last_peered":"2024-04-26T12:30:49.549681+0000","last_clean":"2024-04-26T12:30:49.549681+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:30:49.549681+0000","last_undegraded":"2024-04-26T12:30:49.549681+0000","last_fullsized":"2024-04-26T12:30:49.549681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:40.435075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542501+0000","last_change":"2024-04-26T12:30:14.491299+0000","last_active":"2024-04-26T12:30:49.542501+0000","last_peered":"2024-04-26T12:30:49.542501+0000","last_clean":"2024-04-26T12:30:49.542501+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:30:49.542501+0000","last_undegraded":"2024-04-26T12:30:49.542501+0000","last_fullsized":"2024-04-26T12:30:49.542501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:37.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'84","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.376553+0000","last_change":"2024-04-26T12:30:16.518167+0000","last_active":"2024-04-26T12:32:19.376553+0000","last_peered":"2024-04-26T12:32:19.376553+0000","last_clean":"2024-04-26T12:32:19.376553+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:32:19.376553+0000","last_undegraded":"2024-04-26T12:32:19.376553+0000","last_fullsized":"2024-04-26T12:32:19.376553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:20.616941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":81,"num_read_kb":82,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694602+0000","last_change":"2024-04-26T12:30:18.522507+0000","last_active":"2024-04-26T12:30:49.694602+0000","last_peered":"2024-04-26T12:30:49.694602+0000","last_clean":"2024-04-26T12:30:49.694602+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:30:49.694602+0000","last_undegraded":"2024-04-26T12:30:49.694602+0000","last_fullsized":"2024-04-26T12:30:49.694602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:14.177370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.492214+0000","last_change":"2024-04-26T12:30:20.530332+0000","last_active":"2024-04-26T12:33:21.492214+0000","last_peered":"2024-04-26T12:33:21.492214+0000","last_clean":"2024-04-26T12:33:21.492214+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:33:21.492214+0000","last_undegraded":"2024-04-26T12:33:21.492214+0000","last_fullsized":"2024-04-26T12:33:21.492214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:21.002104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547852+0000","last_change":"2024-04-26T12:30:20.528129+0000","last_active":"2024-04-26T12:30:49.547852+0000","last_peered":"2024-04-26T12:30:49.547852+0000","last_clean":"2024-04-26T12:30:49.547852+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:30:49.547852+0000","last_undegraded":"2024-04-26T12:30:49.547852+0000","last_fullsized":"2024-04-26T12:30:49.547852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:23.397024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.741112+0000","last_change":"2024-04-26T12:30:12.480553+0000","last_active":"2024-04-26T12:30:54.741112+0000","last_peered":"2024-04-26T12:30:54.741112+0000","last_clean":"2024-04-26T12:30:54.741112+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:30:54.741112+0000","last_undegraded":"2024-04-26T12:30:54.741112+0000","last_fullsized":"2024-04-26T12:30:54.741112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.226828+0000","last_change":"2024-04-26T12:30:10.523769+0000","last_active":"2024-04-26T12:33:21.226828+0000","last_peered":"2024-04-26T12:33:21.226828+0000","last_clean":"2024-04-26T12:33:21.226828+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:33:21.226828+0000","last_undegraded":"2024-04-26T12:33:21.226828+0000","last_fullsized":"2024-04-26T12:33:21.226828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:54.971518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540221+0000","last_change":"2024-04-26T12:30:14.493380+0000","last_active":"2024-04-26T12:30:49.540221+0000","last_peered":"2024-04-26T12:30:49.540221+0000","last_clean":"2024-04-26T12:30:49.540221+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:30:49.540221+0000","last_undegraded":"2024-04-26T12:30:49.540221+0000","last_fullsized":"2024-04-26T12:30:49.540221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:18.581583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'35","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.180140+0000","last_change":"2024-04-26T12:30:16.518746+0000","last_active":"2024-04-26T12:33:28.180140+0000","last_peered":"2024-04-26T12:33:28.180140+0000","last_clean":"2024-04-26T12:33:28.180140+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:33:28.180140+0000","last_undegraded":"2024-04-26T12:33:28.180140+0000","last_fullsized":"2024-04-26T12:33:28.180140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:04.293139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544178+0000","last_change":"2024-04-26T12:30:18.529377+0000","last_active":"2024-04-26T12:30:49.544178+0000","last_peered":"2024-04-26T12:30:49.544178+0000","last_clean":"2024-04-26T12:30:49.544178+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:30:49.544178+0000","last_undegraded":"2024-04-26T12:30:49.544178+0000","last_fullsized":"2024-04-26T12:30:49.544178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:31.772676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.057676+0000","last_change":"2024-04-26T12:30:20.528724+0000","last_active":"2024-04-26T12:32:19.057676+0000","last_peered":"2024-04-26T12:32:19.057676+0000","last_clean":"2024-04-26T12:32:19.057676+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:32:19.057676+0000","last_undegraded":"2024-04-26T12:32:19.057676+0000","last_fullsized":"2024-04-26T12:32:19.057676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:50.736220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876246+0000","last_change":"2024-04-26T12:30:49.555701+0000","last_active":"2024-04-26T12:32:20.876246+0000","last_peered":"2024-04-26T12:32:20.876246+0000","last_clean":"2024-04-26T12:32:20.876246+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:32:20.876246+0000","last_undegraded":"2024-04-26T12:32:20.876246+0000","last_fullsized":"2024-04-26T12:32:20.876246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:34.471013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.600051+0000","last_change":"2024-04-26T12:30:10.502612+0000","last_active":"2024-04-26T12:30:53.600051+0000","last_peered":"2024-04-26T12:30:53.600051+0000","last_clean":"2024-04-26T12:30:53.600051+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:30:53.600051+0000","last_undegraded":"2024-04-26T12:30:53.600051+0000","last_fullsized":"2024-04-26T12:30:53.600051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:03.814159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544101+0000","last_change":"2024-04-26T12:30:14.491480+0000","last_active":"2024-04-26T12:30:49.544101+0000","last_peered":"2024-04-26T12:30:49.544101+0000","last_clean":"2024-04-26T12:30:49.544101+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:30:49.544101+0000","last_undegraded":"2024-04-26T12:30:49.544101+0000","last_fullsized":"2024-04-26T12:30:49.544101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:27.548981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.893403+0000","last_change":"2024-04-26T12:30:16.504440+0000","last_active":"2024-04-26T12:33:20.893403+0000","last_peered":"2024-04-26T12:33:20.893403+0000","last_clean":"2024-04-26T12:33:20.893403+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:20.893403+0000","last_undegraded":"2024-04-26T12:33:20.893403+0000","last_fullsized":"2024-04-26T12:33:20.893403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:12.728383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542390+0000","last_change":"2024-04-26T12:30:18.523667+0000","last_active":"2024-04-26T12:30:49.542390+0000","last_peered":"2024-04-26T12:30:49.542390+0000","last_clean":"2024-04-26T12:30:49.542390+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:30:49.542390+0000","last_undegraded":"2024-04-26T12:30:49.542390+0000","last_fullsized":"2024-04-26T12:30:49.542390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:23.693333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.263020+0000","last_change":"2024-04-26T12:30:20.531528+0000","last_active":"2024-04-26T12:33:21.263020+0000","last_peered":"2024-04-26T12:33:21.263020+0000","last_clean":"2024-04-26T12:33:21.263020+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:33:21.263020+0000","last_undegraded":"2024-04-26T12:33:21.263020+0000","last_fullsized":"2024-04-26T12:33:21.263020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:58.871702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.876582+0000","last_change":"2024-04-26T12:30:12.482043+0000","last_active":"2024-04-26T12:32:20.876582+0000","last_peered":"2024-04-26T12:32:20.876582+0000","last_clean":"2024-04-26T12:32:20.876582+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:32:20.876582+0000","last_undegraded":"2024-04-26T12:32:20.876582+0000","last_fullsized":"2024-04-26T12:32:20.876582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546282+0000","last_change":"2024-04-26T12:30:10.493462+0000","last_active":"2024-04-26T12:30:49.546282+0000","last_peered":"2024-04-26T12:30:49.546282+0000","last_clean":"2024-04-26T12:30:49.546282+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:30:49.546282+0000","last_undegraded":"2024-04-26T12:30:49.546282+0000","last_fullsized":"2024-04-26T12:30:49.546282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:36.560123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.482873+0000","last_change":"2024-04-26T12:30:14.489635+0000","last_active":"2024-04-26T12:32:20.482873+0000","last_peered":"2024-04-26T12:32:20.482873+0000","last_clean":"2024-04-26T12:32:20.482873+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:32:20.482873+0000","last_undegraded":"2024-04-26T12:32:20.482873+0000","last_fullsized":"2024-04-26T12:32:20.482873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:54.728684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:20.957035+0000","last_change":"2024-04-26T12:30:16.507208+0000","last_active":"2024-04-26T12:33:20.957035+0000","last_peered":"2024-04-26T12:33:20.957035+0000","last_clean":"2024-04-26T12:33:20.957035+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:20.957035+0000","last_undegraded":"2024-04-26T12:33:20.957035+0000","last_fullsized":"2024-04-26T12:33:20.957035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:41.932885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539732+0000","last_change":"2024-04-26T12:30:18.521304+0000","last_active":"2024-04-26T12:30:49.539732+0000","last_peered":"2024-04-26T12:30:49.539732+0000","last_clean":"2024-04-26T12:30:49.539732+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:30:49.539732+0000","last_undegraded":"2024-04-26T12:30:49.539732+0000","last_fullsized":"2024-04-26T12:30:49.539732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:41.695559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545725+0000","last_change":"2024-04-26T12:30:20.524900+0000","last_active":"2024-04-26T12:30:49.545725+0000","last_peered":"2024-04-26T12:30:49.545725+0000","last_clean":"2024-04-26T12:30:49.545725+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:30:49.545725+0000","last_undegraded":"2024-04-26T12:30:49.545725+0000","last_fullsized":"2024-04-26T12:30:49.545725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:29.025840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463384+0000","last_change":"2024-04-26T12:30:12.502223+0000","last_active":"2024-04-26T12:33:21.463384+0000","last_peered":"2024-04-26T12:33:21.463384+0000","last_clean":"2024-04-26T12:33:21.463384+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:21.463384+0000","last_undegraded":"2024-04-26T12:33:21.463384+0000","last_fullsized":"2024-04-26T12:33:21.463384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:06.713634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542218+0000","last_change":"2024-04-26T12:30:10.513562+0000","last_active":"2024-04-26T12:30:49.542218+0000","last_peered":"2024-04-26T12:30:49.542218+0000","last_clean":"2024-04-26T12:30:49.542218+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:30:49.542218+0000","last_undegraded":"2024-04-26T12:30:49.542218+0000","last_fullsized":"2024-04-26T12:30:49.542218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:55.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542323+0000","last_change":"2024-04-26T12:30:14.490374+0000","last_active":"2024-04-26T12:30:49.542323+0000","last_peered":"2024-04-26T12:30:49.542323+0000","last_clean":"2024-04-26T12:30:49.542323+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:30:49.542323+0000","last_undegraded":"2024-04-26T12:30:49.542323+0000","last_fullsized":"2024-04-26T12:30:49.542323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:12.379331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.368648+0000","last_change":"2024-04-26T12:30:16.511513+0000","last_active":"2024-04-26T12:32:19.368648+0000","last_peered":"2024-04-26T12:32:19.368648+0000","last_clean":"2024-04-26T12:32:19.368648+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:32:19.368648+0000","last_undegraded":"2024-04-26T12:32:19.368648+0000","last_fullsized":"2024-04-26T12:32:19.368648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:54.574588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542848+0000","last_change":"2024-04-26T12:30:18.515934+0000","last_active":"2024-04-26T12:30:49.542848+0000","last_peered":"2024-04-26T12:30:49.542848+0000","last_clean":"2024-04-26T12:30:49.542848+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:30:49.542848+0000","last_undegraded":"2024-04-26T12:30:49.542848+0000","last_fullsized":"2024-04-26T12:30:49.542848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:25.200262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.185099+0000","last_change":"2024-04-26T12:30:12.490077+0000","last_active":"2024-04-26T12:30:55.185099+0000","last_peered":"2024-04-26T12:30:55.185099+0000","last_clean":"2024-04-26T12:30:55.185099+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:30:55.185099+0000","last_undegraded":"2024-04-26T12:30:55.185099+0000","last_fullsized":"2024-04-26T12:30:55.185099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:11.470054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542763+0000","last_change":"2024-04-26T12:30:10.523507+0000","last_active":"2024-04-26T12:30:49.542763+0000","last_peered":"2024-04-26T12:30:49.542763+0000","last_clean":"2024-04-26T12:30:49.542763+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:30:49.542763+0000","last_undegraded":"2024-04-26T12:30:49.542763+0000","last_fullsized":"2024-04-26T12:30:49.542763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:43.079489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696240+0000","last_change":"2024-04-26T12:30:14.487589+0000","last_active":"2024-04-26T12:30:49.696240+0000","last_peered":"2024-04-26T12:30:49.696240+0000","last_clean":"2024-04-26T12:30:49.696240+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:30:49.696240+0000","last_undegraded":"2024-04-26T12:30:49.696240+0000","last_fullsized":"2024-04-26T12:30:49.696240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:18.599868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.388968+0000","last_change":"2024-04-26T12:30:16.510514+0000","last_active":"2024-04-26T12:32:19.388968+0000","last_peered":"2024-04-26T12:32:19.388968+0000","last_clean":"2024-04-26T12:32:19.388968+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:32:19.388968+0000","last_undegraded":"2024-04-26T12:32:19.388968+0000","last_fullsized":"2024-04-26T12:32:19.388968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:58.939474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543187+0000","last_change":"2024-04-26T12:30:18.517450+0000","last_active":"2024-04-26T12:30:49.543187+0000","last_peered":"2024-04-26T12:30:49.543187+0000","last_clean":"2024-04-26T12:30:49.543187+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:30:49.543187+0000","last_undegraded":"2024-04-26T12:30:49.543187+0000","last_fullsized":"2024-04-26T12:30:49.543187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:21.795370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.814710+0000","last_change":"2024-04-26T12:30:20.523862+0000","last_active":"2024-04-26T12:32:20.814710+0000","last_peered":"2024-04-26T12:32:20.814710+0000","last_clean":"2024-04-26T12:32:20.814710+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:32:20.814710+0000","last_undegraded":"2024-04-26T12:32:20.814710+0000","last_fullsized":"2024-04-26T12:32:20.814710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:24.979123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.470742+0000","last_change":"2024-04-26T12:30:12.496190+0000","last_active":"2024-04-26T12:30:54.470742+0000","last_peered":"2024-04-26T12:30:54.470742+0000","last_clean":"2024-04-26T12:30:54.470742+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:30:54.470742+0000","last_undegraded":"2024-04-26T12:30:54.470742+0000","last_fullsized":"2024-04-26T12:30:54.470742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:40.668373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.455964+0000","last_change":"2024-04-26T12:30:10.495713+0000","last_active":"2024-04-26T12:33:21.455964+0000","last_peered":"2024-04-26T12:33:21.455964+0000","last_clean":"2024-04-26T12:33:21.455964+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:33:21.455964+0000","last_undegraded":"2024-04-26T12:33:21.455964+0000","last_fullsized":"2024-04-26T12:33:21.455964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:07.560296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548625+0000","last_change":"2024-04-26T12:30:14.491780+0000","last_active":"2024-04-26T12:30:49.548625+0000","last_peered":"2024-04-26T12:30:49.548625+0000","last_clean":"2024-04-26T12:30:49.548625+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:30:49.548625+0000","last_undegraded":"2024-04-26T12:30:49.548625+0000","last_fullsized":"2024-04-26T12:30:49.548625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.307690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'40","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.141057+0000","last_change":"2024-04-26T12:30:16.514001+0000","last_active":"2024-04-26T12:33:28.141057+0000","last_peered":"2024-04-26T12:33:28.141057+0000","last_clean":"2024-04-26T12:33:28.141057+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:33:28.141057+0000","last_undegraded":"2024-04-26T12:33:28.141057+0000","last_fullsized":"2024-04-26T12:33:28.141057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:45.982767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546565+0000","last_change":"2024-04-26T12:30:18.528125+0000","last_active":"2024-04-26T12:30:49.546565+0000","last_peered":"2024-04-26T12:30:49.546565+0000","last_clean":"2024-04-26T12:30:49.546565+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:30:49.546565+0000","last_undegraded":"2024-04-26T12:30:49.546565+0000","last_fullsized":"2024-04-26T12:30:49.546565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:27.914789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.542587+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:30:49.542587+0000","last_peered":"2024-04-26T12:30:49.542587+0000","last_clean":"2024-04-26T12:30:49.542587+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:30:49.542587+0000","last_undegraded":"2024-04-26T12:30:49.542587+0000","last_fullsized":"2024-04-26T12:30:49.542587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:46.834895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246915+0000","last_change":"2024-04-26T12:30:12.501410+0000","last_active":"2024-04-26T12:33:21.246915+0000","last_peered":"2024-04-26T12:33:21.246915+0000","last_clean":"2024-04-26T12:33:21.246915+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:21.246915+0000","last_undegraded":"2024-04-26T12:33:21.246915+0000","last_fullsized":"2024-04-26T12:33:21.246915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:12.616162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540042+0000","last_change":"2024-04-26T12:30:10.511419+0000","last_active":"2024-04-26T12:30:49.540042+0000","last_peered":"2024-04-26T12:30:49.540042+0000","last_clean":"2024-04-26T12:30:49.540042+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:30:49.540042+0000","last_undegraded":"2024-04-26T12:30:49.540042+0000","last_fullsized":"2024-04-26T12:30:49.540042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:10.067840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545955+0000","last_change":"2024-04-26T12:30:14.492168+0000","last_active":"2024-04-26T12:30:49.545955+0000","last_peered":"2024-04-26T12:30:49.545955+0000","last_clean":"2024-04-26T12:30:49.545955+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:30:49.545955+0000","last_undegraded":"2024-04-26T12:30:49.545955+0000","last_fullsized":"2024-04-26T12:30:49.545955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:24.135193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.386930+0000","last_change":"2024-04-26T12:30:16.515815+0000","last_active":"2024-04-26T12:32:19.386930+0000","last_peered":"2024-04-26T12:32:19.386930+0000","last_clean":"2024-04-26T12:32:19.386930+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:32:19.386930+0000","last_undegraded":"2024-04-26T12:32:19.386930+0000","last_fullsized":"2024-04-26T12:32:19.386930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:21.684193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695869+0000","last_change":"2024-04-26T12:30:18.517414+0000","last_active":"2024-04-26T12:30:49.695869+0000","last_peered":"2024-04-26T12:30:49.695869+0000","last_clean":"2024-04-26T12:30:49.695869+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:30:49.695869+0000","last_undegraded":"2024-04-26T12:30:49.695869+0000","last_fullsized":"2024-04-26T12:30:49.695869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:01.210587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.872383+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:20.872383+0000","last_peered":"2024-04-26T12:32:20.872383+0000","last_clean":"2024-04-26T12:32:20.872383+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:20.872383+0000","last_undegraded":"2024-04-26T12:32:20.872383+0000","last_fullsized":"2024-04-26T12:32:20.872383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:23.694604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184192+0000","last_change":"2024-04-26T12:30:12.491493+0000","last_active":"2024-04-26T12:30:55.184192+0000","last_peered":"2024-04-26T12:30:55.184192+0000","last_clean":"2024-04-26T12:30:55.184192+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:30:55.184192+0000","last_undegraded":"2024-04-26T12:30:55.184192+0000","last_fullsized":"2024-04-26T12:30:55.184192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:31.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.962314+0000","last_change":"2024-04-26T12:30:10.521621+0000","last_active":"2024-04-26T12:31:36.962314+0000","last_peered":"2024-04-26T12:31:36.962314+0000","last_clean":"2024-04-26T12:31:36.962314+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:31:36.962314+0000","last_undegraded":"2024-04-26T12:31:36.962314+0000","last_fullsized":"2024-04-26T12:31:36.962314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:00.153870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.552309+0000","last_change":"2024-04-26T12:30:49.551612+0000","last_active":"2024-04-26T12:30:49.552309+0000","last_peered":"2024-04-26T12:30:49.552309+0000","last_clean":"2024-04-26T12:30:49.552309+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:30:49.552309+0000","last_undegraded":"2024-04-26T12:30:49.552309+0000","last_fullsized":"2024-04-26T12:30:49.552309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:14.294829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548162+0000","last_change":"2024-04-26T12:30:16.518414+0000","last_active":"2024-04-26T12:30:49.548162+0000","last_peered":"2024-04-26T12:30:49.548162+0000","last_clean":"2024-04-26T12:30:49.548162+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:30:49.548162+0000","last_undegraded":"2024-04-26T12:30:49.548162+0000","last_fullsized":"2024-04-26T12:30:49.548162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:21.610161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":366,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.574526+0000","last_change":"2024-04-26T12:30:18.528239+0000","last_active":"2024-04-26T12:33:19.574526+0000","last_peered":"2024-04-26T12:33:19.574526+0000","last_clean":"2024-04-26T12:33:19.574526+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:19.574526+0000","last_undegraded":"2024-04-26T12:33:19.574526+0000","last_fullsized":"2024-04-26T12:33:19.574526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:47.632613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541970+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:30:49.541970+0000","last_peered":"2024-04-26T12:30:49.541970+0000","last_clean":"2024-04-26T12:30:49.541970+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:30:49.541970+0000","last_undegraded":"2024-04-26T12:30:49.541970+0000","last_fullsized":"2024-04-26T12:30:49.541970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:10.582606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532264+0000","last_change":"2024-04-26T12:30:12.489089+0000","last_active":"2024-04-26T12:33:21.532264+0000","last_peered":"2024-04-26T12:33:21.532264+0000","last_clean":"2024-04-26T12:33:21.532264+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:33:21.532264+0000","last_undegraded":"2024-04-26T12:33:21.532264+0000","last_fullsized":"2024-04-26T12:33:21.532264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:27.764119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540869+0000","last_change":"2024-04-26T12:30:10.510186+0000","last_active":"2024-04-26T12:30:49.540869+0000","last_peered":"2024-04-26T12:30:49.540869+0000","last_clean":"2024-04-26T12:30:49.540869+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:30:49.540869+0000","last_undegraded":"2024-04-26T12:30:49.540869+0000","last_fullsized":"2024-04-26T12:30:49.540869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:42.962774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539905+0000","last_change":"2024-04-26T12:30:14.494783+0000","last_active":"2024-04-26T12:30:49.539905+0000","last_peered":"2024-04-26T12:30:49.539905+0000","last_clean":"2024-04-26T12:30:49.539905+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:30:49.539905+0000","last_undegraded":"2024-04-26T12:30:49.539905+0000","last_fullsized":"2024-04-26T12:30:49.539905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:08.720169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'40","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.209290+0000","last_change":"2024-04-26T12:30:16.512429+0000","last_active":"2024-04-26T12:33:28.209290+0000","last_peered":"2024-04-26T12:33:28.209290+0000","last_clean":"2024-04-26T12:33:28.209290+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:33:28.209290+0000","last_undegraded":"2024-04-26T12:33:28.209290+0000","last_fullsized":"2024-04-26T12:33:28.209290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:08.544396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694012+0000","last_change":"2024-04-26T12:30:18.523480+0000","last_active":"2024-04-26T12:30:49.694012+0000","last_peered":"2024-04-26T12:30:49.694012+0000","last_clean":"2024-04-26T12:30:49.694012+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:30:49.694012+0000","last_undegraded":"2024-04-26T12:30:49.694012+0000","last_fullsized":"2024-04-26T12:30:49.694012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.217886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.584682+0000","last_change":"2024-04-26T12:30:20.530957+0000","last_active":"2024-04-26T12:33:21.584682+0000","last_peered":"2024-04-26T12:33:21.584682+0000","last_clean":"2024-04-26T12:33:21.584682+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:21.584682+0000","last_undegraded":"2024-04-26T12:33:21.584682+0000","last_fullsized":"2024-04-26T12:33:21.584682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:59.026673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.532275+0000","last_change":"2024-04-26T12:30:12.489703+0000","last_active":"2024-04-26T12:33:21.532275+0000","last_peered":"2024-04-26T12:33:21.532275+0000","last_clean":"2024-04-26T12:33:21.532275+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:33:21.532275+0000","last_undegraded":"2024-04-26T12:33:21.532275+0000","last_fullsized":"2024-04-26T12:33:21.532275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:22.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.458788+0000","last_change":"2024-04-26T12:30:10.524731+0000","last_active":"2024-04-26T12:33:21.458788+0000","last_peered":"2024-04-26T12:33:21.458788+0000","last_clean":"2024-04-26T12:33:21.458788+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:33:21.458788+0000","last_undegraded":"2024-04-26T12:33:21.458788+0000","last_fullsized":"2024-04-26T12:33:21.458788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:06.694451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547176+0000","last_change":"2024-04-26T12:30:14.488779+0000","last_active":"2024-04-26T12:30:49.547176+0000","last_peered":"2024-04-26T12:30:49.547176+0000","last_clean":"2024-04-26T12:30:49.547176+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:30:49.547176+0000","last_undegraded":"2024-04-26T12:30:49.547176+0000","last_fullsized":"2024-04-26T12:30:49.547176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:34.470851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.361600+0000","last_change":"2024-04-26T12:30:16.518549+0000","last_active":"2024-04-26T12:32:19.361600+0000","last_peered":"2024-04-26T12:32:19.361600+0000","last_clean":"2024-04-26T12:32:19.361600+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:32:19.361600+0000","last_undegraded":"2024-04-26T12:32:19.361600+0000","last_fullsized":"2024-04-26T12:32:19.361600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:28.849038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.541960+0000","last_change":"2024-04-26T12:30:18.524599+0000","last_active":"2024-04-26T12:30:49.541960+0000","last_peered":"2024-04-26T12:30:49.541960+0000","last_clean":"2024-04-26T12:30:49.541960+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:30:49.541960+0000","last_undegraded":"2024-04-26T12:30:49.541960+0000","last_fullsized":"2024-04-26T12:30:49.541960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:26.643236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.548824+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:30:49.548824+0000","last_peered":"2024-04-26T12:30:49.548824+0000","last_clean":"2024-04-26T12:30:49.548824+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:30:49.548824+0000","last_undegraded":"2024-04-26T12:30:49.548824+0000","last_fullsized":"2024-04-26T12:30:49.548824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:11.794456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503846+0000","last_change":"2024-04-26T12:30:12.489639+0000","last_active":"2024-04-26T12:33:21.503846+0000","last_peered":"2024-04-26T12:33:21.503846+0000","last_clean":"2024-04-26T12:33:21.503846+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:33:21.503846+0000","last_undegraded":"2024-04-26T12:33:21.503846+0000","last_fullsized":"2024-04-26T12:33:21.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:16.575048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.181506+0000","last_change":"2024-04-26T12:30:10.499110+0000","last_active":"2024-04-26T12:31:37.181506+0000","last_peered":"2024-04-26T12:31:37.181506+0000","last_clean":"2024-04-26T12:31:37.181506+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:31:37.181506+0000","last_undegraded":"2024-04-26T12:31:37.181506+0000","last_fullsized":"2024-04-26T12:31:37.181506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.539490+0000","last_change":"2024-04-26T12:30:14.488627+0000","last_active":"2024-04-26T12:30:49.539490+0000","last_peered":"2024-04-26T12:30:49.539490+0000","last_clean":"2024-04-26T12:30:49.539490+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:30:49.539490+0000","last_undegraded":"2024-04-26T12:30:49.539490+0000","last_fullsized":"2024-04-26T12:30:49.539490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:28.640096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.185518+0000","last_change":"2024-04-26T12:30:16.515666+0000","last_active":"2024-04-26T12:33:28.185518+0000","last_peered":"2024-04-26T12:33:28.185518+0000","last_clean":"2024-04-26T12:33:28.185518+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:33:28.185518+0000","last_undegraded":"2024-04-26T12:33:28.185518+0000","last_fullsized":"2024-04-26T12:33:28.185518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:54.930500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543436+0000","last_change":"2024-04-26T12:30:18.524792+0000","last_active":"2024-04-26T12:30:49.543436+0000","last_peered":"2024-04-26T12:30:49.543436+0000","last_clean":"2024-04-26T12:30:49.543436+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:30:49.543436+0000","last_undegraded":"2024-04-26T12:30:49.543436+0000","last_fullsized":"2024-04-26T12:30:49.543436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:45.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.394040+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:19.394040+0000","last_peered":"2024-04-26T12:32:19.394040+0000","last_clean":"2024-04-26T12:32:19.394040+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:19.394040+0000","last_undegraded":"2024-04-26T12:32:19.394040+0000","last_fullsized":"2024-04-26T12:32:19.394040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:13.513806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.971456+0000","last_change":"2024-04-26T12:30:12.482428+0000","last_active":"2024-04-26T12:31:36.971456+0000","last_peered":"2024-04-26T12:31:36.971456+0000","last_clean":"2024-04-26T12:31:36.971456+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:31:36.971456+0000","last_undegraded":"2024-04-26T12:31:36.971456+0000","last_fullsized":"2024-04-26T12:31:36.971456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.258549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.544532+0000","last_change":"2024-04-26T12:30:10.515261+0000","last_active":"2024-04-26T12:30:49.544532+0000","last_peered":"2024-04-26T12:30:49.544532+0000","last_clean":"2024-04-26T12:30:49.544532+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:30:49.544532+0000","last_undegraded":"2024-04-26T12:30:49.544532+0000","last_fullsized":"2024-04-26T12:30:49.544532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:36.842504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.069122+0000","last_change":"2024-04-26T12:30:14.488530+0000","last_active":"2024-04-26T12:32:18.069122+0000","last_peered":"2024-04-26T12:32:18.069122+0000","last_clean":"2024-04-26T12:32:18.069122+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:32:18.069122+0000","last_undegraded":"2024-04-26T12:32:18.069122+0000","last_fullsized":"2024-04-26T12:32:18.069122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:22.546676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.194076+0000","last_change":"2024-04-26T12:30:16.516514+0000","last_active":"2024-04-26T12:33:28.194076+0000","last_peered":"2024-04-26T12:33:28.194076+0000","last_clean":"2024-04-26T12:33:28.194076+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:28.194076+0000","last_undegraded":"2024-04-26T12:33:28.194076+0000","last_fullsized":"2024-04-26T12:33:28.194076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:03.784951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.695165+0000","last_change":"2024-04-26T12:30:18.526314+0000","last_active":"2024-04-26T12:30:49.695165+0000","last_peered":"2024-04-26T12:30:49.695165+0000","last_clean":"2024-04-26T12:30:49.695165+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:30:49.695165+0000","last_undegraded":"2024-04-26T12:30:49.695165+0000","last_fullsized":"2024-04-26T12:30:49.695165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:18.995256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.873981+0000","last_change":"2024-04-26T12:30:20.523635+0000","last_active":"2024-04-26T12:32:20.873981+0000","last_peered":"2024-04-26T12:32:20.873981+0000","last_clean":"2024-04-26T12:32:20.873981+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:32:20.873981+0000","last_undegraded":"2024-04-26T12:32:20.873981+0000","last_fullsized":"2024-04-26T12:32:20.873981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.904423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.463404+0000","last_change":"2024-04-26T12:30:12.499038+0000","last_active":"2024-04-26T12:33:21.463404+0000","last_peered":"2024-04-26T12:33:21.463404+0000","last_clean":"2024-04-26T12:33:21.463404+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:21.463404+0000","last_undegraded":"2024-04-26T12:33:21.463404+0000","last_fullsized":"2024-04-26T12:33:21.463404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:46.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543304+0000","last_change":"2024-04-26T12:30:10.508462+0000","last_active":"2024-04-26T12:30:49.543304+0000","last_peered":"2024-04-26T12:30:49.543304+0000","last_clean":"2024-04-26T12:30:49.543304+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:30:49.543304+0000","last_undegraded":"2024-04-26T12:30:49.543304+0000","last_fullsized":"2024-04-26T12:30:49.543304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:53.462271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503030+0000","last_change":"2024-04-26T12:30:12.488793+0000","last_active":"2024-04-26T12:33:21.503030+0000","last_peered":"2024-04-26T12:33:21.503030+0000","last_clean":"2024-04-26T12:33:21.503030+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:33:21.503030+0000","last_undegraded":"2024-04-26T12:33:21.503030+0000","last_fullsized":"2024-04-26T12:33:21.503030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:00.093922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497835+0000","last_change":"2024-04-26T12:30:10.488944+0000","last_active":"2024-04-26T12:32:17.497835+0000","last_peered":"2024-04-26T12:32:17.497835+0000","last_clean":"2024-04-26T12:32:17.497835+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:32:17.497835+0000","last_undegraded":"2024-04-26T12:32:17.497835+0000","last_fullsized":"2024-04-26T12:32:17.497835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:46.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503142+0000","last_change":"2024-04-26T12:30:12.491523+0000","last_active":"2024-04-26T12:33:21.503142+0000","last_peered":"2024-04-26T12:33:21.503142+0000","last_clean":"2024-04-26T12:33:21.503142+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:33:21.503142+0000","last_undegraded":"2024-04-26T12:33:21.503142+0000","last_fullsized":"2024-04-26T12:33:21.503142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:24:49.059427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.784734+0000","last_change":"2024-04-26T12:30:10.515892+0000","last_active":"2024-04-26T12:32:20.784734+0000","last_peered":"2024-04-26T12:32:20.784734+0000","last_clean":"2024-04-26T12:32:20.784734+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:32:20.784734+0000","last_undegraded":"2024-04-26T12:32:20.784734+0000","last_fullsized":"2024-04-26T12:32:20.784734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:32.895105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531862+0000","last_change":"2024-04-26T12:30:12.491568+0000","last_active":"2024-04-26T12:33:21.531862+0000","last_peered":"2024-04-26T12:33:21.531862+0000","last_clean":"2024-04-26T12:33:21.531862+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:33:21.531862+0000","last_undegraded":"2024-04-26T12:33:21.531862+0000","last_fullsized":"2024-04-26T12:33:21.531862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:00.794743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696298+0000","last_change":"2024-04-26T12:30:10.498184+0000","last_active":"2024-04-26T12:30:49.696298+0000","last_peered":"2024-04-26T12:30:49.696298+0000","last_clean":"2024-04-26T12:30:49.696298+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:30:49.696298+0000","last_undegraded":"2024-04-26T12:30:49.696298+0000","last_fullsized":"2024-04-26T12:30:49.696298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:44.476636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335403+0000","last_change":"2024-04-26T12:30:12.477969+0000","last_active":"2024-04-26T12:33:21.335403+0000","last_peered":"2024-04-26T12:33:21.335403+0000","last_clean":"2024-04-26T12:33:21.335403+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:33:21.335403+0000","last_undegraded":"2024-04-26T12:33:21.335403+0000","last_fullsized":"2024-04-26T12:33:21.335403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:52.041655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.696689+0000","last_change":"2024-04-26T12:30:10.505910+0000","last_active":"2024-04-26T12:30:49.696689+0000","last_peered":"2024-04-26T12:30:49.696689+0000","last_clean":"2024-04-26T12:30:49.696689+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:30:49.696689+0000","last_undegraded":"2024-04-26T12:30:49.696689+0000","last_fullsized":"2024-04-26T12:30:49.696689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:41.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.245421+0000","last_change":"2024-04-26T12:30:12.497999+0000","last_active":"2024-04-26T12:33:21.245421+0000","last_peered":"2024-04-26T12:33:21.245421+0000","last_clean":"2024-04-26T12:33:21.245421+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:21.245421+0000","last_undegraded":"2024-04-26T12:33:21.245421+0000","last_fullsized":"2024-04-26T12:33:21.245421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:08.184825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.545212+0000","last_change":"2024-04-26T12:30:10.507425+0000","last_active":"2024-04-26T12:30:49.545212+0000","last_peered":"2024-04-26T12:30:49.545212+0000","last_clean":"2024-04-26T12:30:49.545212+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:30:49.545212+0000","last_undegraded":"2024-04-26T12:30:49.545212+0000","last_fullsized":"2024-04-26T12:30:49.545212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:04.930580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.184617+0000","last_change":"2024-04-26T12:30:12.496187+0000","last_active":"2024-04-26T12:30:55.184617+0000","last_peered":"2024-04-26T12:30:55.184617+0000","last_clean":"2024-04-26T12:30:55.184617+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:30:55.184617+0000","last_undegraded":"2024-04-26T12:30:55.184617+0000","last_fullsized":"2024-04-26T12:30:55.184617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.521166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.546373+0000","last_change":"2024-04-26T12:30:10.504572+0000","last_active":"2024-04-26T12:30:49.546373+0000","last_peered":"2024-04-26T12:30:49.546373+0000","last_clean":"2024-04-26T12:30:49.546373+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:30:49.546373+0000","last_undegraded":"2024-04-26T12:30:49.546373+0000","last_fullsized":"2024-04-26T12:30:49.546373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:41.256044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.335198+0000","last_change":"2024-04-26T12:30:12.495561+0000","last_active":"2024-04-26T12:33:21.335198+0000","last_peered":"2024-04-26T12:33:21.335198+0000","last_clean":"2024-04-26T12:33:21.335198+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:33:21.335198+0000","last_undegraded":"2024-04-26T12:33:21.335198+0000","last_fullsized":"2024-04-26T12:33:21.335198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:31.568494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498730+0000","last_change":"2024-04-26T12:30:10.498578+0000","last_active":"2024-04-26T12:32:22.498730+0000","last_peered":"2024-04-26T12:32:22.498730+0000","last_clean":"2024-04-26T12:32:22.498730+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:32:22.498730+0000","last_undegraded":"2024-04-26T12:32:22.498730+0000","last_fullsized":"2024-04-26T12:32:22.498730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:34.399017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.503186+0000","last_change":"2024-04-26T12:30:12.496215+0000","last_active":"2024-04-26T12:33:21.503186+0000","last_peered":"2024-04-26T12:33:21.503186+0000","last_clean":"2024-04-26T12:33:21.503186+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:33:21.503186+0000","last_undegraded":"2024-04-26T12:33:21.503186+0000","last_fullsized":"2024-04-26T12:33:21.503186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:43.456916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543053+0000","last_change":"2024-04-26T12:30:10.521412+0000","last_active":"2024-04-26T12:30:49.543053+0000","last_peered":"2024-04-26T12:30:49.543053+0000","last_clean":"2024-04-26T12:30:49.543053+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:30:49.543053+0000","last_undegraded":"2024-04-26T12:30:49.543053+0000","last_fullsized":"2024-04-26T12:30:49.543053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:08.525460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538192+0000","last_change":"2024-04-26T12:30:12.493682+0000","last_active":"2024-04-26T12:33:21.538192+0000","last_peered":"2024-04-26T12:33:21.538192+0000","last_clean":"2024-04-26T12:33:21.538192+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:33:21.538192+0000","last_undegraded":"2024-04-26T12:33:21.538192+0000","last_fullsized":"2024-04-26T12:33:21.538192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:52.073143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599042+0000","last_change":"2024-04-26T12:30:10.498422+0000","last_active":"2024-04-26T12:30:53.599042+0000","last_peered":"2024-04-26T12:30:53.599042+0000","last_clean":"2024-04-26T12:30:53.599042+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:30:53.599042+0000","last_undegraded":"2024-04-26T12:30:53.599042+0000","last_fullsized":"2024-04-26T12:30:53.599042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:18.949912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.502775+0000","last_change":"2024-04-26T12:30:12.484594+0000","last_active":"2024-04-26T12:33:21.502775+0000","last_peered":"2024-04-26T12:33:21.502775+0000","last_clean":"2024-04-26T12:33:21.502775+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:33:21.502775+0000","last_undegraded":"2024-04-26T12:33:21.502775+0000","last_fullsized":"2024-04-26T12:33:21.502775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:38.153666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.540357+0000","last_change":"2024-04-26T12:30:10.514358+0000","last_active":"2024-04-26T12:30:49.540357+0000","last_peered":"2024-04-26T12:30:49.540357+0000","last_clean":"2024-04-26T12:30:49.540357+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:30:49.540357+0000","last_undegraded":"2024-04-26T12:30:49.540357+0000","last_fullsized":"2024-04-26T12:30:49.540357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:45.443501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531987+0000","last_change":"2024-04-26T12:30:12.496055+0000","last_active":"2024-04-26T12:33:21.531987+0000","last_peered":"2024-04-26T12:33:21.531987+0000","last_clean":"2024-04-26T12:33:21.531987+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:33:21.531987+0000","last_undegraded":"2024-04-26T12:33:21.531987+0000","last_fullsized":"2024-04-26T12:33:21.531987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:19.142312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:53.599086+0000","last_change":"2024-04-26T12:30:10.507296+0000","last_active":"2024-04-26T12:30:53.599086+0000","last_peered":"2024-04-26T12:30:53.599086+0000","last_clean":"2024-04-26T12:30:53.599086+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:30:53.599086+0000","last_undegraded":"2024-04-26T12:30:53.599086+0000","last_fullsized":"2024-04-26T12:30:53.599086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:46.489435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.246626+0000","last_change":"2024-04-26T12:30:12.494305+0000","last_active":"2024-04-26T12:33:21.246626+0000","last_peered":"2024-04-26T12:33:21.246626+0000","last_clean":"2024-04-26T12:33:21.246626+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:33:21.246626+0000","last_undegraded":"2024-04-26T12:33:21.246626+0000","last_fullsized":"2024-04-26T12:33:21.246626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:08.704032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.547543+0000","last_change":"2024-04-26T12:30:10.523912+0000","last_active":"2024-04-26T12:30:49.547543+0000","last_peered":"2024-04-26T12:30:49.547543+0000","last_clean":"2024-04-26T12:30:49.547543+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:30:49.547543+0000","last_undegraded":"2024-04-26T12:30:49.547543+0000","last_fullsized":"2024-04-26T12:30:49.547543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:29.542497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510934+0000","last_change":"2024-04-26T12:30:12.497891+0000","last_active":"2024-04-26T12:32:28.510934+0000","last_peered":"2024-04-26T12:32:28.510934+0000","last_clean":"2024-04-26T12:32:28.510934+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:32:28.510934+0000","last_undegraded":"2024-04-26T12:32:28.510934+0000","last_fullsized":"2024-04-26T12:32:28.510934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:40.010108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.830958+0000","last_change":"2024-04-26T12:30:10.523924+0000","last_active":"2024-04-26T12:32:20.830958+0000","last_peered":"2024-04-26T12:32:20.830958+0000","last_clean":"2024-04-26T12:32:20.830958+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:32:20.830958+0000","last_undegraded":"2024-04-26T12:32:20.830958+0000","last_fullsized":"2024-04-26T12:32:20.830958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:59.395818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.543474+0000","last_change":"2024-04-26T12:30:12.498180+0000","last_active":"2024-04-26T12:30:49.543474+0000","last_peered":"2024-04-26T12:30:49.543474+0000","last_clean":"2024-04-26T12:30:49.543474+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:30:49.543474+0000","last_undegraded":"2024-04-26T12:30:49.543474+0000","last_fullsized":"2024-04-26T12:30:49.543474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.633561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549751+0000","last_change":"2024-04-26T12:30:10.501961+0000","last_active":"2024-04-26T12:30:49.549751+0000","last_peered":"2024-04-26T12:30:49.549751+0000","last_clean":"2024-04-26T12:30:49.549751+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:30:49.549751+0000","last_undegraded":"2024-04-26T12:30:49.549751+0000","last_fullsized":"2024-04-26T12:30:49.549751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:00.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.244728+0000","last_change":"2024-04-26T12:30:12.493588+0000","last_active":"2024-04-26T12:33:21.244728+0000","last_peered":"2024-04-26T12:33:21.244728+0000","last_clean":"2024-04-26T12:33:21.244728+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:33:21.244728+0000","last_undegraded":"2024-04-26T12:33:21.244728+0000","last_fullsized":"2024-04-26T12:33:21.244728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:20.498299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.549200+0000","last_change":"2024-04-26T12:30:10.513455+0000","last_active":"2024-04-26T12:30:49.549200+0000","last_peered":"2024-04-26T12:30:49.549200+0000","last_clean":"2024-04-26T12:30:49.549200+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:30:49.549200+0000","last_undegraded":"2024-04-26T12:30:49.549200+0000","last_fullsized":"2024-04-26T12:30:49.549200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:32.904261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.450276+0000","last_change":"2024-04-26T12:30:10.520879+0000","last_active":"2024-04-26T12:33:21.450276+0000","last_peered":"2024-04-26T12:33:21.450276+0000","last_clean":"2024-04-26T12:33:21.450276+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:33:21.450276+0000","last_undegraded":"2024-04-26T12:33:21.450276+0000","last_fullsized":"2024-04-26T12:33:21.450276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:22.136008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.531885+0000","last_change":"2024-04-26T12:30:12.500495+0000","last_active":"2024-04-26T12:33:21.531885+0000","last_peered":"2024-04-26T12:33:21.531885+0000","last_clean":"2024-04-26T12:33:21.531885+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:21.531885+0000","last_undegraded":"2024-04-26T12:33:21.531885+0000","last_fullsized":"2024-04-26T12:33:21.531885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:41.554347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:30:49.694784+0000","last_change":"2024-04-26T12:30:10.505951+0000","last_active":"2024-04-26T12:30:49.694784+0000","last_peered":"2024-04-26T12:30:49.694784+0000","last_clean":"2024-04-26T12:30:49.694784+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:30:49.694784+0000","last_undegraded":"2024-04-26T12:30:49.694784+0000","last_fullsized":"2024-04-26T12:30:49.694784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:12.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341621+0000","last_change":"2024-04-26T12:30:12.498902+0000","last_active":"2024-04-26T12:33:21.341621+0000","last_peered":"2024-04-26T12:33:21.341621+0000","last_clean":"2024-04-26T12:33:21.341621+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:21.341621+0000","last_undegraded":"2024-04-26T12:33:21.341621+0000","last_fullsized":"2024-04-26T12:33:21.341621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:34.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1516,"num_read_kb":1310,"num_write":569,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1332,"ondisk_log_size":1332,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":12570624,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":87,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17211392,"data_stored":17211392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673007,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35872,"kb_used_data":8856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335968,"statfs":{"total":96636764160,"available":96600031232,"internally_reserved":0,"allocated":9068544,"data_stored":8752596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673007,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":735472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48320,"kb_used_data":8824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323520,"statfs":{"total":96636764160,"available":96587284480,"internally_reserved":0,"allocated":9035776,"data_stored":8750874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:33:32.604 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.605 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.606 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.607 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.608 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.609 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.610 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.611 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.612 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.613 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.614 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.615 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:29:53.417591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.616 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.617 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.618 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.619 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.620 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.621 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.622 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.623 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.624 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.625 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.626 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.627 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.628 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.629 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.630 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.631 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.632 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.633 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.633 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.633 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.633 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.633 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.633 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:32.633 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:33:32.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-26T12:33:52.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:33:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.741+0000 7fbcabf6e640 1 Processor -- start 2024-04-26T12:33:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.741+0000 7fbcabf6e640 1 -- start start 2024-04-26T12:33:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbcabf6e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbca408e300 0x7fbca412fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:52.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbcabf6e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca406d7a0 con 0x7fbca408d810 2024-04-26T12:33:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbcabf6e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbca40730d0 con 0x7fbca408e300 2024-04-26T12:33:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbca9509640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbca408e300 0x7fbca412fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbca9d0a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbca408d810 0x7fbca408dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52848/0 (socket says 172.21.15.132:52848) 2024-04-26T12:33:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbca9d0a640 1 -- 172.21.15.132:0/89571663 learned_addr learned my addr 172.21.15.132:0/89571663 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:33:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbca9509640 1 -- 172.21.15.132:0/89571663 >> v1:172.21.15.132:6789/0 conn(0x7fbca408d810 legacy=0x7fbca408dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbca9509640 1 -- 172.21.15.132:0/89571663 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca406e620 con 0x7fbca408e300 2024-04-26T12:33:52.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.742+0000 7fbca8d08640 1 -- 172.21.15.132:0/89571663 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248080374 0 0) 0x7fbca406d7a0 con 0x7fbca408d810 2024-04-26T12:33:52.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.743+0000 7fbca9509640 1 --2- 172.21.15.132:0/89571663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408e300 0x7fbca412fd00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400a8c0 tx=0x7fbc9402cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b2c05060183162 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:52.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.743+0000 7fbca8d08640 1 -- 172.21.15.132:0/89571663 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc9403a070 con 0x7fbca408e300 2024-04-26T12:33:52.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.743+0000 7fbca8d08640 1 -- 172.21.15.132:0/89571663 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9402da00 con 0x7fbca408e300 2024-04-26T12:33:52.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.743+0000 7fbca8d08640 1 -- 172.21.15.132:0/89571663 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc9400b040 con 0x7fbca408e300 2024-04-26T12:33:52.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.743+0000 7fbcabf6e640 1 -- 172.21.15.132:0/89571663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408e300 msgr2=0x7fbca412fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:52.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.743+0000 7fbcabf6e640 1 --2- 172.21.15.132:0/89571663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408e300 0x7fbca412fd00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400a8c0 tx=0x7fbc9402cd20 comp rx=0 tx=0).stop 2024-04-26T12:33:52.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.744+0000 7fbcabf6e640 1 -- 172.21.15.132:0/89571663 shutdown_connections 2024-04-26T12:33:52.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.744+0000 7fbcabf6e640 1 --2- 172.21.15.132:0/89571663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408e300 0x7fbca412fd00 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:52.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.744+0000 7fbcabf6e640 1 -- 172.21.15.132:0/89571663 >> 172.21.15.132:0/89571663 conn(0x7fbca409b7b0 msgr2=0x7fbca409bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:52.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.744+0000 7fbcabf6e640 1 -- 172.21.15.132:0/89571663 shutdown_connections 2024-04-26T12:33:52.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.744+0000 7fbcabf6e640 1 -- 172.21.15.132:0/89571663 wait complete. 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.744+0000 7fbcabf6e640 1 Processor -- start 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.744+0000 7fbcabf6e640 1 -- start start 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbcabf6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408d810 0x7fbca4128a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbcabf6e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbca408d100 con 0x7fbca408d810 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbca9d0a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408d810 0x7fbca4128a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbca9d0a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408d810 0x7fbca4128a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53904/0 (socket says 172.21.15.132:53904) 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbca9d0a640 1 -- 172.21.15.132:0/3703564732 learned_addr learned my addr 172.21.15.132:0/3703564732 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbca9d0a640 1 -- 172.21.15.132:0/3703564732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca412af40 con 0x7fbca408d810 2024-04-26T12:33:52.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbca9d0a640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408d810 0x7fbca4128a10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c370 tx=0x7fbca000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbc9a7fc640 1 -- 172.21.15.132:0/3703564732 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca0007410 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbc9a7fc640 1 -- 172.21.15.132:0/3703564732 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca00075d0 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbc9a7fc640 1 -- 172.21.15.132:0/3703564732 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca0004950 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.745+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca40902a0 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.746+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca412b5e0 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.746+0000 7fbc9a7fc640 1 -- 172.21.15.132:0/3703564732 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbca0011070 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.746+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca4062ed0 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.747+0000 7fbc9a7fc640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc88038060 0x7fbc8803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.747+0000 7fbc9a7fc640 1 -- 172.21.15.132:0/3703564732 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fbca004b6c0 con 0x7fbca408d810 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.747+0000 7fbca9509640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc88038060 0x7fbc8803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.748+0000 7fbca9509640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc88038060 0x7fbc8803a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbc94037000 tx=0x7fbc94031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:33:52.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.751+0000 7fbc9a7fc640 1 -- 172.21.15.132:0/3703564732 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbca001cbd0 con 0x7fbca408d810 2024-04-26T12:33:52.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.921+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbca4090640 con 0x7fbc88038060 2024-04-26T12:33:52.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.937+0000 7fbc9a7fc640 1 -- 172.21.15.132:0/3703564732 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658594 (secure 0 0 0) 0x7fbca4090640 con 0x7fbc88038060 2024-04-26T12:33:52.946 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:33:52.952 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:33:52.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc88038060 msgr2=0x7fbc8803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:52.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc88038060 0x7fbc8803a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbc94037000 tx=0x7fbc94031000 comp rx=0 tx=0).stop 2024-04-26T12:33:52.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408d810 msgr2=0x7fbca4128a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:33:52.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408d810 0x7fbca4128a10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c370 tx=0x7fbca000c830 comp rx=0 tx=0).stop 2024-04-26T12:33:52.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 shutdown_connections 2024-04-26T12:33:52.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbc88038060 0x7fbc8803a520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:52.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 --2- 172.21.15.132:0/3703564732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbca408d810 0x7fbca4128a10 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:33:52.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 >> 172.21.15.132:0/3703564732 conn(0x7fbca409b7b0 msgr2=0x7fbca41217e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:33:52.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 shutdown_connections 2024-04-26T12:33:52.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:33:52.942+0000 7fbcabf6e640 1 -- 172.21.15.132:0/3703564732 wait complete. 2024-04-26T12:33:52.955 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-04-26T12:33:52.495087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5095,"num_read_kb":4676,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4729,"ondisk_log_size":4729,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123384,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377363976,"statfs":{"total":386547056640,"available":386420711424,"internally_reserved":0,"allocated":2908160,"data_stored":1759974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004243"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501930+0000","last_change":"2024-04-26T12:30:10.508974+0000","last_active":"2024-04-26T12:32:17.501930+0000","last_peered":"2024-04-26T12:32:17.501930+0000","last_clean":"2024-04-26T12:32:17.501930+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:32:17.501930+0000","last_undegraded":"2024-04-26T12:32:17.501930+0000","last_fullsized":"2024-04-26T12:32:17.501930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513496+0000","last_change":"2024-04-26T12:30:12.499017+0000","last_active":"2024-04-26T12:32:43.513496+0000","last_peered":"2024-04-26T12:32:43.513496+0000","last_clean":"2024-04-26T12:32:43.513496+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:32:43.513496+0000","last_undegraded":"2024-04-26T12:32:43.513496+0000","last_fullsized":"2024-04-26T12:32:43.513496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497970+0000","last_change":"2024-04-26T12:30:10.489909+0000","last_active":"2024-04-26T12:32:17.497970+0000","last_peered":"2024-04-26T12:32:17.497970+0000","last_clean":"2024-04-26T12:32:17.497970+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:32:17.497970+0000","last_undegraded":"2024-04-26T12:32:17.497970+0000","last_fullsized":"2024-04-26T12:32:17.497970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'17","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583013+0000","last_change":"2024-04-26T12:30:12.484427+0000","last_active":"2024-04-26T12:33:21.583013+0000","last_peered":"2024-04-26T12:33:21.583013+0000","last_clean":"2024-04-26T12:33:21.583013+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:33:21.583013+0000","last_undegraded":"2024-04-26T12:33:21.583013+0000","last_fullsized":"2024-04-26T12:33:21.583013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.449872+0000","last_change":"2024-04-26T12:30:10.524821+0000","last_active":"2024-04-26T12:33:21.449872+0000","last_peered":"2024-04-26T12:33:21.449872+0000","last_clean":"2024-04-26T12:33:21.449872+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:33:21.449872+0000","last_undegraded":"2024-04-26T12:33:21.449872+0000","last_fullsized":"2024-04-26T12:33:21.449872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.254455+0000","last_change":"2024-04-26T12:30:12.493540+0000","last_active":"2024-04-26T12:33:21.254455+0000","last_peered":"2024-04-26T12:33:21.254455+0000","last_clean":"2024-04-26T12:33:21.254455+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:33:21.254455+0000","last_undegraded":"2024-04-26T12:33:21.254455+0000","last_fullsized":"2024-04-26T12:33:21.254455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.501186+0000","last_change":"2024-04-26T12:30:10.501461+0000","last_active":"2024-04-26T12:32:12.501186+0000","last_peered":"2024-04-26T12:32:12.501186+0000","last_clean":"2024-04-26T12:32:12.501186+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:32:12.501186+0000","last_undegraded":"2024-04-26T12:32:12.501186+0000","last_fullsized":"2024-04-26T12:32:12.501186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514076+0000","last_change":"2024-04-26T12:30:12.489894+0000","last_active":"2024-04-26T12:32:43.514076+0000","last_peered":"2024-04-26T12:32:43.514076+0000","last_clean":"2024-04-26T12:32:43.514076+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:32:43.514076+0000","last_undegraded":"2024-04-26T12:32:43.514076+0000","last_fullsized":"2024-04-26T12:32:43.514076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514057+0000","last_change":"2024-04-26T12:30:10.521268+0000","last_active":"2024-04-26T12:32:43.514057+0000","last_peered":"2024-04-26T12:32:43.514057+0000","last_clean":"2024-04-26T12:32:43.514057+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:32:43.514057+0000","last_undegraded":"2024-04-26T12:32:43.514057+0000","last_fullsized":"2024-04-26T12:32:43.514057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538239+0000","last_change":"2024-04-26T12:30:12.497804+0000","last_active":"2024-04-26T12:33:21.538239+0000","last_peered":"2024-04-26T12:33:21.538239+0000","last_clean":"2024-04-26T12:33:21.538239+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:33:21.538239+0000","last_undegraded":"2024-04-26T12:33:21.538239+0000","last_fullsized":"2024-04-26T12:33:21.538239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.505746+0000","last_change":"2024-04-26T12:30:10.505875+0000","last_active":"2024-04-26T12:32:42.505746+0000","last_peered":"2024-04-26T12:32:42.505746+0000","last_clean":"2024-04-26T12:32:42.505746+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:32:42.505746+0000","last_undegraded":"2024-04-26T12:32:42.505746+0000","last_fullsized":"2024-04-26T12:32:42.505746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538669+0000","last_change":"2024-04-26T12:30:49.554267+0000","last_active":"2024-04-26T12:33:21.538669+0000","last_peered":"2024-04-26T12:33:21.538669+0000","last_clean":"2024-04-26T12:33:21.538669+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:33:21.538669+0000","last_undegraded":"2024-04-26T12:33:21.538669+0000","last_fullsized":"2024-04-26T12:33:21.538669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115857+0000","last_change":"2024-04-26T12:30:10.519048+0000","last_active":"2024-04-26T12:33:28.115857+0000","last_peered":"2024-04-26T12:33:28.115857+0000","last_clean":"2024-04-26T12:33:28.115857+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:33:28.115857+0000","last_undegraded":"2024-04-26T12:33:28.115857+0000","last_fullsized":"2024-04-26T12:33:28.115857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583272+0000","last_change":"2024-04-26T12:30:12.491137+0000","last_active":"2024-04-26T12:33:21.583272+0000","last_peered":"2024-04-26T12:33:21.583272+0000","last_clean":"2024-04-26T12:33:21.583272+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:33:21.583272+0000","last_undegraded":"2024-04-26T12:33:21.583272+0000","last_fullsized":"2024-04-26T12:33:21.583272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.501858+0000","last_change":"2024-04-26T12:30:10.505714+0000","last_active":"2024-04-26T12:32:42.501858+0000","last_peered":"2024-04-26T12:32:42.501858+0000","last_clean":"2024-04-26T12:32:42.501858+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:32:42.501858+0000","last_undegraded":"2024-04-26T12:32:42.501858+0000","last_fullsized":"2024-04-26T12:32:42.501858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470508+0000","last_change":"2024-04-26T12:30:12.483230+0000","last_active":"2024-04-26T12:33:21.470508+0000","last_peered":"2024-04-26T12:33:21.470508+0000","last_clean":"2024-04-26T12:33:21.470508+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:21.470508+0000","last_undegraded":"2024-04-26T12:33:21.470508+0000","last_fullsized":"2024-04-26T12:33:21.470508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470456+0000","last_change":"2024-04-26T12:30:12.480460+0000","last_active":"2024-04-26T12:33:21.470456+0000","last_peered":"2024-04-26T12:33:21.470456+0000","last_clean":"2024-04-26T12:33:21.470456+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:33:21.470456+0000","last_undegraded":"2024-04-26T12:33:21.470456+0000","last_fullsized":"2024-04-26T12:33:21.470456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512921+0000","last_change":"2024-04-26T12:30:10.514263+0000","last_active":"2024-04-26T12:32:38.512921+0000","last_peered":"2024-04-26T12:32:38.512921+0000","last_clean":"2024-04-26T12:32:38.512921+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:32:38.512921+0000","last_undegraded":"2024-04-26T12:32:38.512921+0000","last_fullsized":"2024-04-26T12:32:38.512921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583005+0000","last_change":"2024-04-26T12:30:12.498685+0000","last_active":"2024-04-26T12:33:21.583005+0000","last_peered":"2024-04-26T12:33:21.583005+0000","last_clean":"2024-04-26T12:33:21.583005+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:21.583005+0000","last_undegraded":"2024-04-26T12:33:21.583005+0000","last_fullsized":"2024-04-26T12:33:21.583005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505253+0000","last_change":"2024-04-26T12:30:10.503403+0000","last_active":"2024-04-26T12:32:37.505253+0000","last_peered":"2024-04-26T12:32:37.505253+0000","last_clean":"2024-04-26T12:32:37.505253+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:32:37.505253+0000","last_undegraded":"2024-04-26T12:32:37.505253+0000","last_fullsized":"2024-04-26T12:32:37.505253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538674+0000","last_change":"2024-04-26T12:30:12.497749+0000","last_active":"2024-04-26T12:33:21.538674+0000","last_peered":"2024-04-26T12:33:21.538674+0000","last_clean":"2024-04-26T12:33:21.538674+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:33:21.538674+0000","last_undegraded":"2024-04-26T12:33:21.538674+0000","last_fullsized":"2024-04-26T12:33:21.538674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512833+0000","last_change":"2024-04-26T12:30:10.514510+0000","last_active":"2024-04-26T12:32:38.512833+0000","last_peered":"2024-04-26T12:32:38.512833+0000","last_clean":"2024-04-26T12:32:38.512833+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:32:38.512833+0000","last_undegraded":"2024-04-26T12:32:38.512833+0000","last_fullsized":"2024-04-26T12:32:38.512833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470662+0000","last_change":"2024-04-26T12:30:12.482516+0000","last_active":"2024-04-26T12:33:21.470662+0000","last_peered":"2024-04-26T12:33:21.470662+0000","last_clean":"2024-04-26T12:33:21.470662+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:33:21.470662+0000","last_undegraded":"2024-04-26T12:33:21.470662+0000","last_fullsized":"2024-04-26T12:33:21.470662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.212009+0000","last_change":"2024-04-26T12:30:10.513694+0000","last_active":"2024-04-26T12:33:21.212009+0000","last_peered":"2024-04-26T12:33:21.212009+0000","last_clean":"2024-04-26T12:33:21.212009+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:33:21.212009+0000","last_undegraded":"2024-04-26T12:33:21.212009+0000","last_fullsized":"2024-04-26T12:33:21.212009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'9","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583381+0000","last_change":"2024-04-26T12:30:12.484509+0000","last_active":"2024-04-26T12:33:21.583381+0000","last_peered":"2024-04-26T12:33:21.583381+0000","last_clean":"2024-04-26T12:33:21.583381+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:33:21.583381+0000","last_undegraded":"2024-04-26T12:33:21.583381+0000","last_fullsized":"2024-04-26T12:33:21.583381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.455478+0000","last_change":"2024-04-26T12:30:10.499600+0000","last_active":"2024-04-26T12:33:21.455478+0000","last_peered":"2024-04-26T12:33:21.455478+0000","last_clean":"2024-04-26T12:33:21.455478+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:33:21.455478+0000","last_undegraded":"2024-04-26T12:33:21.455478+0000","last_fullsized":"2024-04-26T12:33:21.455478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512857+0000","last_change":"2024-04-26T12:30:12.496161+0000","last_active":"2024-04-26T12:32:38.512857+0000","last_peered":"2024-04-26T12:32:38.512857+0000","last_clean":"2024-04-26T12:32:38.512857+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:32:38.512857+0000","last_undegraded":"2024-04-26T12:32:38.512857+0000","last_fullsized":"2024-04-26T12:32:38.512857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115742+0000","last_change":"2024-04-26T12:30:10.516884+0000","last_active":"2024-04-26T12:33:28.115742+0000","last_peered":"2024-04-26T12:33:28.115742+0000","last_clean":"2024-04-26T12:33:28.115742+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:33:28.115742+0000","last_undegraded":"2024-04-26T12:33:28.115742+0000","last_fullsized":"2024-04-26T12:33:28.115742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.546057+0000","last_change":"2024-04-26T12:30:20.535283+0000","last_active":"2024-04-26T12:33:21.546057+0000","last_peered":"2024-04-26T12:33:21.546057+0000","last_clean":"2024-04-26T12:33:21.546057+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:33:21.546057+0000","last_undegraded":"2024-04-26T12:33:21.546057+0000","last_fullsized":"2024-04-26T12:33:21.546057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512418+0000","last_change":"2024-04-26T12:30:12.490640+0000","last_active":"2024-04-26T12:32:33.512418+0000","last_peered":"2024-04-26T12:32:33.512418+0000","last_clean":"2024-04-26T12:32:33.512418+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:32:33.512418+0000","last_undegraded":"2024-04-26T12:32:33.512418+0000","last_fullsized":"2024-04-26T12:32:33.512418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512382+0000","last_change":"2024-04-26T12:30:10.524372+0000","last_active":"2024-04-26T12:32:33.512382+0000","last_peered":"2024-04-26T12:32:33.512382+0000","last_clean":"2024-04-26T12:32:33.512382+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:32:33.512382+0000","last_undegraded":"2024-04-26T12:32:33.512382+0000","last_fullsized":"2024-04-26T12:32:33.512382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.036531+0000","last_change":"2024-04-26T12:33:39.036552+0000","last_active":"2024-04-26T12:33:39.036531+0000","last_peered":"2024-04-26T12:33:39.036531+0000","last_clean":"2024-04-26T12:33:39.036531+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:33:39.036531+0000","last_undegraded":"2024-04-26T12:33:39.036531+0000","last_fullsized":"2024-04-26T12:33:39.036531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.036437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:05.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'34","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.166170+0000","last_change":"2024-04-26T12:30:16.517097+0000","last_active":"2024-04-26T12:33:28.166170+0000","last_peered":"2024-04-26T12:33:28.166170+0000","last_clean":"2024-04-26T12:33:28.166170+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:33:28.166170+0000","last_undegraded":"2024-04-26T12:33:28.166170+0000","last_fullsized":"2024-04-26T12:33:28.166170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.860386+0000","last_change":"2024-04-26T12:33:47.860428+0000","last_active":"2024-04-26T12:33:47.860386+0000","last_peered":"2024-04-26T12:33:47.860386+0000","last_clean":"2024-04-26T12:33:47.860386+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:33:47.860386+0000","last_undegraded":"2024-04-26T12:33:47.860386+0000","last_fullsized":"2024-04-26T12:33:47.860386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.860284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:42.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514372+0000","last_change":"2024-04-26T12:30:20.530528+0000","last_active":"2024-04-26T12:32:48.514372+0000","last_peered":"2024-04-26T12:32:48.514372+0000","last_clean":"2024-04-26T12:32:48.514372+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:32:48.514372+0000","last_undegraded":"2024-04-26T12:32:48.514372+0000","last_fullsized":"2024-04-26T12:32:48.514372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538199+0000","last_change":"2024-04-26T12:30:12.491732+0000","last_active":"2024-04-26T12:33:21.538199+0000","last_peered":"2024-04-26T12:33:21.538199+0000","last_clean":"2024-04-26T12:33:21.538199+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:33:21.538199+0000","last_undegraded":"2024-04-26T12:33:21.538199+0000","last_fullsized":"2024-04-26T12:33:21.538199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.504253+0000","last_change":"2024-04-26T12:30:10.507052+0000","last_active":"2024-04-26T12:32:32.504253+0000","last_peered":"2024-04-26T12:32:32.504253+0000","last_clean":"2024-04-26T12:32:32.504253+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:32:32.504253+0000","last_undegraded":"2024-04-26T12:32:32.504253+0000","last_fullsized":"2024-04-26T12:32:32.504253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.501103+0000","last_change":"2024-04-26T12:30:14.490693+0000","last_active":"2024-04-26T12:32:37.501103+0000","last_peered":"2024-04-26T12:32:37.501103+0000","last_clean":"2024-04-26T12:32:37.501103+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:32:37.501103+0000","last_undegraded":"2024-04-26T12:32:37.501103+0000","last_fullsized":"2024-04-26T12:32:37.501103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.884196+0000","last_change":"2024-04-26T12:33:37.884246+0000","last_active":"2024-04-26T12:33:37.884196+0000","last_peered":"2024-04-26T12:33:37.884196+0000","last_clean":"2024-04-26T12:33:37.884196+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:33:37.884196+0000","last_undegraded":"2024-04-26T12:33:37.884196+0000","last_fullsized":"2024-04-26T12:33:37.884196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.884093+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:49.682928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.859025+0000","last_change":"2024-04-26T12:33:39.859050+0000","last_active":"2024-04-26T12:33:39.859025+0000","last_peered":"2024-04-26T12:33:39.859025+0000","last_clean":"2024-04-26T12:33:39.859025+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:33:39.859025+0000","last_undegraded":"2024-04-26T12:33:39.859025+0000","last_fullsized":"2024-04-26T12:33:39.859025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.858931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:37.129358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.503278+0000","last_change":"2024-04-26T12:30:20.523683+0000","last_active":"2024-04-26T12:32:52.503278+0000","last_peered":"2024-04-26T12:32:52.503278+0000","last_clean":"2024-04-26T12:32:52.503278+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:32:52.503278+0000","last_undegraded":"2024-04-26T12:32:52.503278+0000","last_fullsized":"2024-04-26T12:32:52.503278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.253867+0000","last_change":"2024-04-26T12:30:49.694875+0000","last_active":"2024-04-26T12:33:21.253867+0000","last_peered":"2024-04-26T12:33:21.253867+0000","last_clean":"2024-04-26T12:33:21.253867+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:33:21.253867+0000","last_undegraded":"2024-04-26T12:33:21.253867+0000","last_fullsized":"2024-04-26T12:33:21.253867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512308+0000","last_change":"2024-04-26T12:30:10.523616+0000","last_active":"2024-04-26T12:32:33.512308+0000","last_peered":"2024-04-26T12:32:33.512308+0000","last_clean":"2024-04-26T12:32:33.512308+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:32:33.512308+0000","last_undegraded":"2024-04-26T12:32:33.512308+0000","last_fullsized":"2024-04-26T12:32:33.512308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.457300+0000","last_change":"2024-04-26T12:33:46.457327+0000","last_active":"2024-04-26T12:33:46.457300+0000","last_peered":"2024-04-26T12:33:46.457300+0000","last_clean":"2024-04-26T12:33:46.457300+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:33:46.457300+0000","last_undegraded":"2024-04-26T12:33:46.457300+0000","last_fullsized":"2024-04-26T12:33:46.457300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.457219+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:47.671663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.342694+0000","last_change":"2024-04-26T12:33:38.342730+0000","last_active":"2024-04-26T12:33:38.342694+0000","last_peered":"2024-04-26T12:33:38.342694+0000","last_clean":"2024-04-26T12:33:38.342694+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:33:38.342694+0000","last_undegraded":"2024-04-26T12:33:38.342694+0000","last_fullsized":"2024-04-26T12:33:38.342694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.342608+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:02.654541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":385,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.215072+0000","last_change":"2024-04-26T12:30:18.530920+0000","last_active":"2024-04-26T12:33:28.215072+0000","last_peered":"2024-04-26T12:33:28.215072+0000","last_clean":"2024-04-26T12:33:28.215072+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:33:28.215072+0000","last_undegraded":"2024-04-26T12:33:28.215072+0000","last_fullsized":"2024-04-26T12:33:28.215072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.506986+0000","last_change":"2024-04-26T12:30:20.528257+0000","last_active":"2024-04-26T12:32:52.506986+0000","last_peered":"2024-04-26T12:32:52.506986+0000","last_clean":"2024-04-26T12:32:52.506986+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:32:52.506986+0000","last_undegraded":"2024-04-26T12:32:52.506986+0000","last_fullsized":"2024-04-26T12:32:52.506986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.501164+0000","last_change":"2024-04-26T12:30:12.500154+0000","last_active":"2024-04-26T12:32:37.501164+0000","last_peered":"2024-04-26T12:32:37.501164+0000","last_clean":"2024-04-26T12:32:37.501164+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:32:37.501164+0000","last_undegraded":"2024-04-26T12:32:37.501164+0000","last_fullsized":"2024-04-26T12:32:37.501164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511878+0000","last_change":"2024-04-26T12:30:10.512902+0000","last_active":"2024-04-26T12:32:33.511878+0000","last_peered":"2024-04-26T12:32:33.511878+0000","last_clean":"2024-04-26T12:32:33.511878+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:32:33.511878+0000","last_undegraded":"2024-04-26T12:32:33.511878+0000","last_fullsized":"2024-04-26T12:32:33.511878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.942879+0000","last_change":"2024-04-26T12:33:33.942913+0000","last_active":"2024-04-26T12:33:33.942879+0000","last_peered":"2024-04-26T12:33:33.942879+0000","last_clean":"2024-04-26T12:33:33.942879+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:33:33.942879+0000","last_undegraded":"2024-04-26T12:33:33.942879+0000","last_fullsized":"2024-04-26T12:33:33.942879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.942777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:36.777412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.337516+0000","last_change":"2024-04-26T12:33:39.337566+0000","last_active":"2024-04-26T12:33:39.337516+0000","last_peered":"2024-04-26T12:33:39.337516+0000","last_clean":"2024-04-26T12:33:39.337516+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:33:39.337516+0000","last_undegraded":"2024-04-26T12:33:39.337516+0000","last_fullsized":"2024-04-26T12:33:39.337516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.337430+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:45.269245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.466047+0000","last_change":"2024-04-26T12:33:37.466107+0000","last_active":"2024-04-26T12:33:37.466047+0000","last_peered":"2024-04-26T12:33:37.466047+0000","last_clean":"2024-04-26T12:33:37.466047+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:37.466047+0000","last_undegraded":"2024-04-26T12:33:37.466047+0000","last_fullsized":"2024-04-26T12:33:37.466047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.465931+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510716+0000","last_change":"2024-04-26T12:30:12.493252+0000","last_active":"2024-04-26T12:32:23.510716+0000","last_peered":"2024-04-26T12:32:23.510716+0000","last_clean":"2024-04-26T12:32:23.510716+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:32:23.510716+0000","last_undegraded":"2024-04-26T12:32:23.510716+0000","last_fullsized":"2024-04-26T12:32:23.510716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503628+0000","last_change":"2024-04-26T12:30:10.508473+0000","last_active":"2024-04-26T12:32:27.503628+0000","last_peered":"2024-04-26T12:32:27.503628+0000","last_clean":"2024-04-26T12:32:27.503628+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:32:27.503628+0000","last_undegraded":"2024-04-26T12:32:27.503628+0000","last_fullsized":"2024-04-26T12:32:27.503628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.872556+0000","last_change":"2024-04-26T12:33:46.872579+0000","last_active":"2024-04-26T12:33:46.872556+0000","last_peered":"2024-04-26T12:33:46.872556+0000","last_clean":"2024-04-26T12:33:46.872556+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:33:46.872556+0000","last_undegraded":"2024-04-26T12:33:46.872556+0000","last_fullsized":"2024-04-26T12:33:46.872556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.872459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:20.085162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'54","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.341024+0000","last_change":"2024-04-26T12:33:40.341067+0000","last_active":"2024-04-26T12:33:40.341024+0000","last_peered":"2024-04-26T12:33:40.341024+0000","last_clean":"2024-04-26T12:33:40.341024+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:33:40.341024+0000","last_undegraded":"2024-04-26T12:33:40.341024+0000","last_fullsized":"2024-04-26T12:33:40.341024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.340927+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:00.228500+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.457485+0000","last_change":"2024-04-26T12:33:34.457526+0000","last_active":"2024-04-26T12:33:34.457485+0000","last_peered":"2024-04-26T12:33:34.457485+0000","last_clean":"2024-04-26T12:33:34.457485+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:33:34.457485+0000","last_undegraded":"2024-04-26T12:33:34.457485+0000","last_fullsized":"2024-04-26T12:33:34.457485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.457383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:18.910969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503541+0000","last_change":"2024-04-26T12:30:20.529100+0000","last_active":"2024-04-26T12:32:27.503541+0000","last_peered":"2024-04-26T12:32:27.503541+0000","last_clean":"2024-04-26T12:32:27.503541+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:32:27.503541+0000","last_undegraded":"2024-04-26T12:32:27.503541+0000","last_fullsized":"2024-04-26T12:32:27.503541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.254660+0000","last_change":"2024-04-26T12:30:12.496041+0000","last_active":"2024-04-26T12:33:21.254660+0000","last_peered":"2024-04-26T12:33:21.254660+0000","last_clean":"2024-04-26T12:33:21.254660+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:33:21.254660+0000","last_undegraded":"2024-04-26T12:33:21.254660+0000","last_fullsized":"2024-04-26T12:33:21.254660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503590+0000","last_change":"2024-04-26T12:30:10.501359+0000","last_active":"2024-04-26T12:32:27.503590+0000","last_peered":"2024-04-26T12:32:27.503590+0000","last_clean":"2024-04-26T12:32:27.503590+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:32:27.503590+0000","last_undegraded":"2024-04-26T12:32:27.503590+0000","last_fullsized":"2024-04-26T12:32:27.503590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499355+0000","last_change":"2024-04-26T12:30:14.491272+0000","last_active":"2024-04-26T12:32:27.499355+0000","last_peered":"2024-04-26T12:32:27.499355+0000","last_clean":"2024-04-26T12:32:27.499355+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:32:27.499355+0000","last_undegraded":"2024-04-26T12:32:27.499355+0000","last_fullsized":"2024-04-26T12:32:27.499355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'36","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.120683+0000","last_change":"2024-04-26T12:30:16.517757+0000","last_active":"2024-04-26T12:33:28.120683+0000","last_peered":"2024-04-26T12:33:28.120683+0000","last_clean":"2024-04-26T12:33:28.120683+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:33:28.120683+0000","last_undegraded":"2024-04-26T12:33:28.120683+0000","last_fullsized":"2024-04-26T12:33:28.120683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.451858+0000","last_change":"2024-04-26T12:33:36.451884+0000","last_active":"2024-04-26T12:33:36.451858+0000","last_peered":"2024-04-26T12:33:36.451858+0000","last_clean":"2024-04-26T12:33:36.451858+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:33:36.451858+0000","last_undegraded":"2024-04-26T12:33:36.451858+0000","last_fullsized":"2024-04-26T12:33:36.451858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.451767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:45.412706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511057+0000","last_change":"2024-04-26T12:30:20.531982+0000","last_active":"2024-04-26T12:32:28.511057+0000","last_peered":"2024-04-26T12:32:28.511057+0000","last_clean":"2024-04-26T12:32:28.511057+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:32:28.511057+0000","last_undegraded":"2024-04-26T12:32:28.511057+0000","last_fullsized":"2024-04-26T12:32:28.511057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583339+0000","last_change":"2024-04-26T12:30:12.483941+0000","last_active":"2024-04-26T12:33:21.583339+0000","last_peered":"2024-04-26T12:33:21.583339+0000","last_clean":"2024-04-26T12:33:21.583339+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:33:21.583339+0000","last_undegraded":"2024-04-26T12:33:21.583339+0000","last_fullsized":"2024-04-26T12:33:21.583339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115731+0000","last_change":"2024-04-26T12:30:10.524374+0000","last_active":"2024-04-26T12:33:28.115731+0000","last_peered":"2024-04-26T12:33:28.115731+0000","last_clean":"2024-04-26T12:33:28.115731+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:33:28.115731+0000","last_undegraded":"2024-04-26T12:33:28.115731+0000","last_fullsized":"2024-04-26T12:33:28.115731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.471002+0000","last_change":"2024-04-26T12:33:47.471028+0000","last_active":"2024-04-26T12:33:47.471002+0000","last_peered":"2024-04-26T12:33:47.471002+0000","last_clean":"2024-04-26T12:33:47.471002+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:33:47.471002+0000","last_undegraded":"2024-04-26T12:33:47.471002+0000","last_fullsized":"2024-04-26T12:33:47.471002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.470897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:56.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'39","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.183666+0000","last_change":"2024-04-26T12:30:16.517072+0000","last_active":"2024-04-26T12:33:28.183666+0000","last_peered":"2024-04-26T12:33:28.183666+0000","last_clean":"2024-04-26T12:33:28.183666+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:33:28.183666+0000","last_undegraded":"2024-04-26T12:33:28.183666+0000","last_fullsized":"2024-04-26T12:33:28.183666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.220381+0000","last_change":"2024-04-26T12:30:18.526287+0000","last_active":"2024-04-26T12:33:28.220381+0000","last_peered":"2024-04-26T12:33:28.220381+0000","last_clean":"2024-04-26T12:33:28.220381+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:28.220381+0000","last_undegraded":"2024-04-26T12:33:28.220381+0000","last_fullsized":"2024-04-26T12:33:28.220381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.500397+0000","last_change":"2024-04-26T12:30:20.531457+0000","last_active":"2024-04-26T12:32:32.500397+0000","last_peered":"2024-04-26T12:32:32.500397+0000","last_clean":"2024-04-26T12:32:32.500397+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:32:32.500397+0000","last_undegraded":"2024-04-26T12:32:32.500397+0000","last_fullsized":"2024-04-26T12:32:32.500397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503529+0000","last_change":"2024-04-26T12:30:12.490458+0000","last_active":"2024-04-26T12:32:27.503529+0000","last_peered":"2024-04-26T12:32:27.503529+0000","last_clean":"2024-04-26T12:32:27.503529+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:32:27.503529+0000","last_undegraded":"2024-04-26T12:32:27.503529+0000","last_fullsized":"2024-04-26T12:32:27.503529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511585+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:32:28.511585+0000","last_peered":"2024-04-26T12:32:28.511585+0000","last_clean":"2024-04-26T12:32:28.511585+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:32:28.511585+0000","last_undegraded":"2024-04-26T12:32:28.511585+0000","last_fullsized":"2024-04-26T12:32:28.511585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:02.508325+0000","last_change":"2024-04-26T12:30:49.553037+0000","last_active":"2024-04-26T12:33:02.508325+0000","last_peered":"2024-04-26T12:33:02.508325+0000","last_clean":"2024-04-26T12:33:02.508325+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:33:02.508325+0000","last_undegraded":"2024-04-26T12:33:02.508325+0000","last_fullsized":"2024-04-26T12:33:02.508325+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.025608+0000","last_change":"2024-04-26T12:33:46.025645+0000","last_active":"2024-04-26T12:33:46.025608+0000","last_peered":"2024-04-26T12:33:46.025608+0000","last_clean":"2024-04-26T12:33:46.025608+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:33:46.025608+0000","last_undegraded":"2024-04-26T12:33:46.025608+0000","last_fullsized":"2024-04-26T12:33:46.025608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.025519+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:28.207080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.486173+0000","last_change":"2024-04-26T12:33:32.486192+0000","last_active":"2024-04-26T12:33:32.486173+0000","last_peered":"2024-04-26T12:33:32.486173+0000","last_clean":"2024-04-26T12:33:32.486173+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:33:32.486173+0000","last_undegraded":"2024-04-26T12:33:32.486173+0000","last_fullsized":"2024-04-26T12:33:32.486173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.486110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:19.318546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.628889+0000","last_change":"2024-04-26T12:30:20.522951+0000","last_active":"2024-04-26T12:33:21.628889+0000","last_peered":"2024-04-26T12:33:21.628889+0000","last_clean":"2024-04-26T12:33:21.628889+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:33:21.628889+0000","last_undegraded":"2024-04-26T12:33:21.628889+0000","last_fullsized":"2024-04-26T12:33:21.628889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583389+0000","last_change":"2024-04-26T12:30:12.498504+0000","last_active":"2024-04-26T12:33:21.583389+0000","last_peered":"2024-04-26T12:33:21.583389+0000","last_clean":"2024-04-26T12:33:21.583389+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:33:21.583389+0000","last_undegraded":"2024-04-26T12:33:21.583389+0000","last_fullsized":"2024-04-26T12:33:21.583389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499489+0000","last_change":"2024-04-26T12:30:10.499408+0000","last_active":"2024-04-26T12:32:27.499489+0000","last_peered":"2024-04-26T12:32:27.499489+0000","last_clean":"2024-04-26T12:32:27.499489+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:32:27.499489+0000","last_undegraded":"2024-04-26T12:32:27.499489+0000","last_fullsized":"2024-04-26T12:32:27.499489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.504316+0000","last_change":"2024-04-26T12:30:14.488769+0000","last_active":"2024-04-26T12:32:32.504316+0000","last_peered":"2024-04-26T12:32:32.504316+0000","last_clean":"2024-04-26T12:32:32.504316+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:32:32.504316+0000","last_undegraded":"2024-04-26T12:32:32.504316+0000","last_fullsized":"2024-04-26T12:32:32.504316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.870529+0000","last_change":"2024-04-26T12:33:40.870573+0000","last_active":"2024-04-26T12:33:40.870529+0000","last_peered":"2024-04-26T12:33:40.870529+0000","last_clean":"2024-04-26T12:33:40.870529+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:33:40.870529+0000","last_undegraded":"2024-04-26T12:33:40.870529+0000","last_fullsized":"2024-04-26T12:33:40.870529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.870443+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:06.471328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512483+0000","last_change":"2024-04-26T12:30:18.528738+0000","last_active":"2024-04-26T12:32:33.512483+0000","last_peered":"2024-04-26T12:32:33.512483+0000","last_clean":"2024-04-26T12:32:33.512483+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:32:33.512483+0000","last_undegraded":"2024-04-26T12:32:33.512483+0000","last_fullsized":"2024-04-26T12:32:33.512483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.586800+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:33:21.586800+0000","last_peered":"2024-04-26T12:33:21.586800+0000","last_clean":"2024-04-26T12:33:21.586800+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:33:21.586800+0000","last_undegraded":"2024-04-26T12:33:21.586800+0000","last_fullsized":"2024-04-26T12:33:21.586800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511649+0000","last_change":"2024-04-26T12:30:12.501179+0000","last_active":"2024-04-26T12:32:28.511649+0000","last_peered":"2024-04-26T12:32:28.511649+0000","last_clean":"2024-04-26T12:32:28.511649+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:32:28.511649+0000","last_undegraded":"2024-04-26T12:32:28.511649+0000","last_fullsized":"2024-04-26T12:32:28.511649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.529454+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:21.529454+0000","last_peered":"2024-04-26T12:33:21.529454+0000","last_clean":"2024-04-26T12:33:21.529454+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:21.529454+0000","last_undegraded":"2024-04-26T12:33:21.529454+0000","last_fullsized":"2024-04-26T12:33:21.529454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.500367+0000","last_change":"2024-04-26T12:30:14.491390+0000","last_active":"2024-04-26T12:32:32.500367+0000","last_peered":"2024-04-26T12:32:32.500367+0000","last_clean":"2024-04-26T12:32:32.500367+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:32:32.500367+0000","last_undegraded":"2024-04-26T12:32:32.500367+0000","last_fullsized":"2024-04-26T12:32:32.500367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.335357+0000","last_change":"2024-04-26T12:33:43.335394+0000","last_active":"2024-04-26T12:33:43.335357+0000","last_peered":"2024-04-26T12:33:43.335357+0000","last_clean":"2024-04-26T12:33:43.335357+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:33:43.335357+0000","last_undegraded":"2024-04-26T12:33:43.335357+0000","last_fullsized":"2024-04-26T12:33:43.335357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.335257+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:44.822905+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":421,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.325088+0000","last_change":"2024-04-26T12:33:41.325114+0000","last_active":"2024-04-26T12:33:41.325088+0000","last_peered":"2024-04-26T12:33:41.325088+0000","last_clean":"2024-04-26T12:33:41.325088+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:41.325088+0000","last_undegraded":"2024-04-26T12:33:41.325088+0000","last_fullsized":"2024-04-26T12:33:41.325088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.325000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:42.600411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.588369+0000","last_change":"2024-04-26T12:30:20.523809+0000","last_active":"2024-04-26T12:33:21.588369+0000","last_peered":"2024-04-26T12:33:21.588369+0000","last_clean":"2024-04-26T12:33:21.588369+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:33:21.588369+0000","last_undegraded":"2024-04-26T12:33:21.588369+0000","last_fullsized":"2024-04-26T12:33:21.588369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.509239+0000","last_change":"2024-04-26T12:30:12.484589+0000","last_active":"2024-04-26T12:33:21.509239+0000","last_peered":"2024-04-26T12:33:21.509239+0000","last_clean":"2024-04-26T12:33:21.509239+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:33:21.509239+0000","last_undegraded":"2024-04-26T12:33:21.509239+0000","last_fullsized":"2024-04-26T12:33:21.509239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510760+0000","last_change":"2024-04-26T12:30:10.524444+0000","last_active":"2024-04-26T12:32:23.510760+0000","last_peered":"2024-04-26T12:32:23.510760+0000","last_clean":"2024-04-26T12:32:23.510760+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:32:23.510760+0000","last_undegraded":"2024-04-26T12:32:23.510760+0000","last_fullsized":"2024-04-26T12:32:23.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.919470+0000","last_change":"2024-04-26T12:33:41.919526+0000","last_active":"2024-04-26T12:33:41.919470+0000","last_peered":"2024-04-26T12:33:41.919470+0000","last_clean":"2024-04-26T12:33:41.919470+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:33:41.919470+0000","last_undegraded":"2024-04-26T12:33:41.919470+0000","last_fullsized":"2024-04-26T12:33:41.919470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.919360+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:08.145030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.033598+0000","last_change":"2024-04-26T12:33:38.033639+0000","last_active":"2024-04-26T12:33:38.033598+0000","last_peered":"2024-04-26T12:33:38.033598+0000","last_clean":"2024-04-26T12:33:38.033598+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:33:38.033598+0000","last_undegraded":"2024-04-26T12:33:38.033598+0000","last_fullsized":"2024-04-26T12:33:38.033598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.033508+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:09.947838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":511,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.012770+0000","last_change":"2024-04-26T12:33:33.012799+0000","last_active":"2024-04-26T12:33:33.012770+0000","last_peered":"2024-04-26T12:33:33.012770+0000","last_clean":"2024-04-26T12:33:33.012770+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:33.012770+0000","last_undegraded":"2024-04-26T12:33:33.012770+0000","last_fullsized":"2024-04-26T12:33:33.012770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.012673+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.693315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.511515+0000","last_change":"2024-04-26T12:30:20.527644+0000","last_active":"2024-04-26T12:33:21.511515+0000","last_peered":"2024-04-26T12:33:21.511515+0000","last_clean":"2024-04-26T12:33:21.511515+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:21.511515+0000","last_undegraded":"2024-04-26T12:33:21.511515+0000","last_fullsized":"2024-04-26T12:33:21.511515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'16","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583567+0000","last_change":"2024-04-26T12:30:12.498024+0000","last_active":"2024-04-26T12:33:21.583567+0000","last_peered":"2024-04-26T12:33:21.583567+0000","last_clean":"2024-04-26T12:33:21.583567+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:21.583567+0000","last_undegraded":"2024-04-26T12:33:21.583567+0000","last_fullsized":"2024-04-26T12:33:21.583567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510696+0000","last_change":"2024-04-26T12:30:10.521698+0000","last_active":"2024-04-26T12:32:23.510696+0000","last_peered":"2024-04-26T12:32:23.510696+0000","last_clean":"2024-04-26T12:32:23.510696+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:32:23.510696+0000","last_undegraded":"2024-04-26T12:32:23.510696+0000","last_fullsized":"2024-04-26T12:32:23.510696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.972942+0000","last_change":"2024-04-26T12:33:32.972968+0000","last_active":"2024-04-26T12:33:32.972942+0000","last_peered":"2024-04-26T12:33:32.972942+0000","last_clean":"2024-04-26T12:33:32.972942+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:33:32.972942+0000","last_undegraded":"2024-04-26T12:33:32.972942+0000","last_fullsized":"2024-04-26T12:33:32.972942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.972836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:10.206586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.924883+0000","last_change":"2024-04-26T12:33:36.924967+0000","last_active":"2024-04-26T12:33:36.924883+0000","last_peered":"2024-04-26T12:33:36.924883+0000","last_clean":"2024-04-26T12:33:36.924883+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:33:36.924883+0000","last_undegraded":"2024-04-26T12:33:36.924883+0000","last_fullsized":"2024-04-26T12:33:36.924883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.924772+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:29.763584+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.358794+0000","last_change":"2024-04-26T12:33:37.358839+0000","last_active":"2024-04-26T12:33:37.358794+0000","last_peered":"2024-04-26T12:33:37.358794+0000","last_clean":"2024-04-26T12:33:37.358794+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:33:37.358794+0000","last_undegraded":"2024-04-26T12:33:37.358794+0000","last_fullsized":"2024-04-26T12:33:37.358794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.358703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:07.891090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'6","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.627154+0000","last_change":"2024-04-26T12:30:20.527103+0000","last_active":"2024-04-26T12:33:21.627154+0000","last_peered":"2024-04-26T12:33:21.627154+0000","last_clean":"2024-04-26T12:33:21.627154+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:21.627154+0000","last_undegraded":"2024-04-26T12:33:21.627154+0000","last_fullsized":"2024-04-26T12:33:21.627154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538560+0000","last_change":"2024-04-26T12:30:12.500664+0000","last_active":"2024-04-26T12:33:21.538560+0000","last_peered":"2024-04-26T12:33:21.538560+0000","last_clean":"2024-04-26T12:33:21.538560+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:21.538560+0000","last_undegraded":"2024-04-26T12:33:21.538560+0000","last_fullsized":"2024-04-26T12:33:21.538560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:53.505890+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:31:53.505890+0000","last_peered":"2024-04-26T12:31:53.505890+0000","last_clean":"2024-04-26T12:31:53.505890+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:31:53.505890+0000","last_undegraded":"2024-04-26T12:31:53.505890+0000","last_fullsized":"2024-04-26T12:31:53.505890+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:08.508582+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:32:08.508582+0000","last_peered":"2024-04-26T12:32:08.508582+0000","last_clean":"2024-04-26T12:32:08.508582+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:32:08.508582+0000","last_undegraded":"2024-04-26T12:32:08.508582+0000","last_fullsized":"2024-04-26T12:32:08.508582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.510019+0000","last_change":"2024-04-26T12:30:10.518603+0000","last_active":"2024-04-26T12:32:18.510019+0000","last_peered":"2024-04-26T12:32:18.510019+0000","last_clean":"2024-04-26T12:32:18.510019+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:32:18.510019+0000","last_undegraded":"2024-04-26T12:32:18.510019+0000","last_fullsized":"2024-04-26T12:32:18.510019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.891556+0000","last_change":"2024-04-26T12:33:45.891610+0000","last_active":"2024-04-26T12:33:45.891556+0000","last_peered":"2024-04-26T12:33:45.891556+0000","last_clean":"2024-04-26T12:33:45.891556+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:33:45.891556+0000","last_undegraded":"2024-04-26T12:33:45.891556+0000","last_fullsized":"2024-04-26T12:33:45.891556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.891453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:38.825131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'85","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.201345+0000","last_change":"2024-04-26T12:30:16.517527+0000","last_active":"2024-04-26T12:33:28.201345+0000","last_peered":"2024-04-26T12:33:28.201345+0000","last_clean":"2024-04-26T12:33:28.201345+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:33:28.201345+0000","last_undegraded":"2024-04-26T12:33:28.201345+0000","last_fullsized":"2024-04-26T12:33:28.201345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.459707+0000","last_change":"2024-04-26T12:33:44.459732+0000","last_active":"2024-04-26T12:33:44.459707+0000","last_peered":"2024-04-26T12:33:44.459707+0000","last_clean":"2024-04-26T12:33:44.459707+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:33:44.459707+0000","last_undegraded":"2024-04-26T12:33:44.459707+0000","last_fullsized":"2024-04-26T12:33:44.459707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.459618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:37.847661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.544578+0000","last_change":"2024-04-26T12:30:20.526296+0000","last_active":"2024-04-26T12:33:21.544578+0000","last_peered":"2024-04-26T12:33:21.544578+0000","last_clean":"2024-04-26T12:33:21.544578+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:21.544578+0000","last_undegraded":"2024-04-26T12:33:21.544578+0000","last_fullsized":"2024-04-26T12:33:21.544578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510933+0000","last_change":"2024-04-26T12:30:12.488875+0000","last_active":"2024-04-26T12:32:23.510933+0000","last_peered":"2024-04-26T12:32:23.510933+0000","last_clean":"2024-04-26T12:32:23.510933+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:32:23.510933+0000","last_undegraded":"2024-04-26T12:32:23.510933+0000","last_fullsized":"2024-04-26T12:32:23.510933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:03.507693+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:32:03.507693+0000","last_peered":"2024-04-26T12:32:03.507693+0000","last_clean":"2024-04-26T12:32:03.507693+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:32:03.507693+0000","last_undegraded":"2024-04-26T12:32:03.507693+0000","last_fullsized":"2024-04-26T12:32:03.507693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497845+0000","last_change":"2024-04-26T12:30:10.488700+0000","last_active":"2024-04-26T12:32:17.497845+0000","last_peered":"2024-04-26T12:32:17.497845+0000","last_clean":"2024-04-26T12:32:17.497845+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:32:17.497845+0000","last_undegraded":"2024-04-26T12:32:17.497845+0000","last_fullsized":"2024-04-26T12:32:17.497845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.990319+0000","last_change":"2024-04-26T12:33:34.990341+0000","last_active":"2024-04-26T12:33:34.990319+0000","last_peered":"2024-04-26T12:33:34.990319+0000","last_clean":"2024-04-26T12:33:34.990319+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:33:34.990319+0000","last_undegraded":"2024-04-26T12:33:34.990319+0000","last_fullsized":"2024-04-26T12:33:34.990319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.990216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:51.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":515,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.968229+0000","last_change":"2024-04-26T12:33:34.968276+0000","last_active":"2024-04-26T12:33:34.968229+0000","last_peered":"2024-04-26T12:33:34.968229+0000","last_clean":"2024-04-26T12:33:34.968229+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:34.968229+0000","last_undegraded":"2024-04-26T12:33:34.968229+0000","last_fullsized":"2024-04-26T12:33:34.968229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.968125+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:55.925235+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510869+0000","last_change":"2024-04-26T12:30:18.530303+0000","last_active":"2024-04-26T12:32:23.510869+0000","last_peered":"2024-04-26T12:32:23.510869+0000","last_clean":"2024-04-26T12:32:23.510869+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:32:23.510869+0000","last_undegraded":"2024-04-26T12:32:23.510869+0000","last_fullsized":"2024-04-26T12:32:23.510869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511929+0000","last_change":"2024-04-26T12:30:20.532161+0000","last_active":"2024-04-26T12:32:33.511929+0000","last_peered":"2024-04-26T12:32:33.511929+0000","last_clean":"2024-04-26T12:32:33.511929+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:32:33.511929+0000","last_undegraded":"2024-04-26T12:32:33.511929+0000","last_fullsized":"2024-04-26T12:32:33.511929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'31","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583522+0000","last_change":"2024-04-26T12:30:12.500451+0000","last_active":"2024-04-26T12:33:21.583522+0000","last_peered":"2024-04-26T12:33:21.583522+0000","last_clean":"2024-04-26T12:33:21.583522+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:33:21.583522+0000","last_undegraded":"2024-04-26T12:33:21.583522+0000","last_fullsized":"2024-04-26T12:33:21.583522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:07.500599+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:32:07.500599+0000","last_peered":"2024-04-26T12:32:07.500599+0000","last_clean":"2024-04-26T12:32:07.500599+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:32:07.500599+0000","last_undegraded":"2024-04-26T12:32:07.500599+0000","last_fullsized":"2024-04-26T12:32:07.500599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.497015+0000","last_change":"2024-04-26T12:30:10.489913+0000","last_active":"2024-04-26T12:32:12.497015+0000","last_peered":"2024-04-26T12:32:12.497015+0000","last_clean":"2024-04-26T12:32:12.497015+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:32:12.497015+0000","last_undegraded":"2024-04-26T12:32:12.497015+0000","last_fullsized":"2024-04-26T12:32:12.497015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.355115+0000","last_change":"2024-04-26T12:33:47.355150+0000","last_active":"2024-04-26T12:33:47.355115+0000","last_peered":"2024-04-26T12:33:47.355115+0000","last_clean":"2024-04-26T12:33:47.355115+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:33:47.355115+0000","last_undegraded":"2024-04-26T12:33:47.355115+0000","last_fullsized":"2024-04-26T12:33:47.355115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.355025+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:37.323218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.293748+0000","last_change":"2024-04-26T12:33:44.293799+0000","last_active":"2024-04-26T12:33:44.293748+0000","last_peered":"2024-04-26T12:33:44.293748+0000","last_clean":"2024-04-26T12:33:44.293748+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:44.293748+0000","last_undegraded":"2024-04-26T12:33:44.293748+0000","last_fullsized":"2024-04-26T12:33:44.293748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.293656+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:52.328074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499525+0000","last_change":"2024-04-26T12:30:18.526395+0000","last_active":"2024-04-26T12:32:27.499525+0000","last_peered":"2024-04-26T12:32:27.499525+0000","last_clean":"2024-04-26T12:32:27.499525+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:32:27.499525+0000","last_undegraded":"2024-04-26T12:32:27.499525+0000","last_fullsized":"2024-04-26T12:32:27.499525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.513148+0000","last_change":"2024-04-26T12:30:20.531432+0000","last_active":"2024-04-26T12:32:38.513148+0000","last_peered":"2024-04-26T12:32:38.513148+0000","last_clean":"2024-04-26T12:32:38.513148+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:32:38.513148+0000","last_undegraded":"2024-04-26T12:32:38.513148+0000","last_fullsized":"2024-04-26T12:32:38.513148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497937+0000","last_change":"2024-04-26T12:30:12.489234+0000","last_active":"2024-04-26T12:32:17.497937+0000","last_peered":"2024-04-26T12:32:17.497937+0000","last_clean":"2024-04-26T12:32:17.497937+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:32:17.497937+0000","last_undegraded":"2024-04-26T12:32:17.497937+0000","last_fullsized":"2024-04-26T12:32:17.497937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:08.508533+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:32:08.508533+0000","last_peered":"2024-04-26T12:32:08.508533+0000","last_clean":"2024-04-26T12:32:08.508533+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:32:08.508533+0000","last_undegraded":"2024-04-26T12:32:08.508533+0000","last_fullsized":"2024-04-26T12:32:08.508533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.117425+0000","last_change":"2024-04-26T12:30:10.500548+0000","last_active":"2024-04-26T12:33:28.117425+0000","last_peered":"2024-04-26T12:33:28.117425+0000","last_clean":"2024-04-26T12:33:28.117425+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:33:28.117425+0000","last_undegraded":"2024-04-26T12:33:28.117425+0000","last_fullsized":"2024-04-26T12:33:28.117425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498631+0000","last_change":"2024-04-26T12:30:14.487929+0000","last_active":"2024-04-26T12:32:22.498631+0000","last_peered":"2024-04-26T12:32:22.498631+0000","last_clean":"2024-04-26T12:32:22.498631+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:32:22.498631+0000","last_undegraded":"2024-04-26T12:32:22.498631+0000","last_fullsized":"2024-04-26T12:32:22.498631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.999843+0000","last_change":"2024-04-26T12:33:47.999880+0000","last_active":"2024-04-26T12:33:47.999843+0000","last_peered":"2024-04-26T12:33:47.999843+0000","last_clean":"2024-04-26T12:33:47.999843+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:47.999843+0000","last_undegraded":"2024-04-26T12:33:47.999843+0000","last_fullsized":"2024-04-26T12:33:47.999843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.999755+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:40.140297+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511694+0000","last_change":"2024-04-26T12:30:18.529014+0000","last_active":"2024-04-26T12:32:28.511694+0000","last_peered":"2024-04-26T12:32:28.511694+0000","last_clean":"2024-04-26T12:32:28.511694+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:32:28.511694+0000","last_undegraded":"2024-04-26T12:32:28.511694+0000","last_fullsized":"2024-04-26T12:32:28.511694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511815+0000","last_change":"2024-04-26T12:30:20.535350+0000","last_active":"2024-04-26T12:32:33.511815+0000","last_peered":"2024-04-26T12:32:33.511815+0000","last_clean":"2024-04-26T12:32:33.511815+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:32:33.511815+0000","last_undegraded":"2024-04-26T12:32:33.511815+0000","last_fullsized":"2024-04-26T12:32:33.511815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.509296+0000","last_change":"2024-04-26T12:30:12.494538+0000","last_active":"2024-04-26T12:32:18.509296+0000","last_peered":"2024-04-26T12:32:18.509296+0000","last_clean":"2024-04-26T12:32:18.509296+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:32:18.509296+0000","last_undegraded":"2024-04-26T12:32:18.509296+0000","last_fullsized":"2024-04-26T12:32:18.509296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501889+0000","last_change":"2024-04-26T12:30:10.502077+0000","last_active":"2024-04-26T12:32:17.501889+0000","last_peered":"2024-04-26T12:32:17.501889+0000","last_clean":"2024-04-26T12:32:17.501889+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:32:17.501889+0000","last_undegraded":"2024-04-26T12:32:17.501889+0000","last_fullsized":"2024-04-26T12:32:17.501889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:07.496449+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:32:07.496449+0000","last_peered":"2024-04-26T12:32:07.496449+0000","last_clean":"2024-04-26T12:32:07.496449+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:32:07.496449+0000","last_undegraded":"2024-04-26T12:32:07.496449+0000","last_fullsized":"2024-04-26T12:32:07.496449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.057715+0000","last_change":"2024-04-26T12:30:14.490527+0000","last_active":"2024-04-26T12:33:28.057715+0000","last_peered":"2024-04-26T12:33:28.057715+0000","last_clean":"2024-04-26T12:33:28.057715+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:33:28.057715+0000","last_undegraded":"2024-04-26T12:33:28.057715+0000","last_fullsized":"2024-04-26T12:33:28.057715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.434146+0000","last_change":"2024-04-26T12:33:39.434204+0000","last_active":"2024-04-26T12:33:39.434146+0000","last_peered":"2024-04-26T12:33:39.434146+0000","last_clean":"2024-04-26T12:33:39.434146+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:33:39.434146+0000","last_undegraded":"2024-04-26T12:33:39.434146+0000","last_fullsized":"2024-04-26T12:33:39.434146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.434024+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:15.521556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.280568+0000","last_change":"2024-04-26T12:33:32.280612+0000","last_active":"2024-04-26T12:33:32.280568+0000","last_peered":"2024-04-26T12:33:32.280568+0000","last_clean":"2024-04-26T12:33:32.280568+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:33:32.280568+0000","last_undegraded":"2024-04-26T12:33:32.280568+0000","last_fullsized":"2024-04-26T12:33:32.280568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.280461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:13.869333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.501146+0000","last_change":"2024-04-26T12:30:20.527189+0000","last_active":"2024-04-26T12:32:37.501146+0000","last_peered":"2024-04-26T12:32:37.501146+0000","last_clean":"2024-04-26T12:32:37.501146+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:32:37.501146+0000","last_undegraded":"2024-04-26T12:32:37.501146+0000","last_fullsized":"2024-04-26T12:32:37.501146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.254833+0000","last_change":"2024-04-26T12:30:12.493953+0000","last_active":"2024-04-26T12:33:21.254833+0000","last_peered":"2024-04-26T12:33:21.254833+0000","last_clean":"2024-04-26T12:33:21.254833+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:33:21.254833+0000","last_undegraded":"2024-04-26T12:33:21.254833+0000","last_fullsized":"2024-04-26T12:33:21.254833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497924+0000","last_change":"2024-04-26T12:30:10.499533+0000","last_active":"2024-04-26T12:32:17.497924+0000","last_peered":"2024-04-26T12:32:17.497924+0000","last_clean":"2024-04-26T12:32:17.497924+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:32:17.497924+0000","last_undegraded":"2024-04-26T12:32:17.497924+0000","last_fullsized":"2024-04-26T12:32:17.497924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:08.508615+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:32:08.508615+0000","last_peered":"2024-04-26T12:32:08.508615+0000","last_clean":"2024-04-26T12:32:08.508615+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:32:08.508615+0000","last_undegraded":"2024-04-26T12:32:08.508615+0000","last_fullsized":"2024-04-26T12:32:08.508615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.509985+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:32:18.509985+0000","last_peered":"2024-04-26T12:32:18.509985+0000","last_clean":"2024-04-26T12:32:18.509985+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:32:18.509985+0000","last_undegraded":"2024-04-26T12:32:18.509985+0000","last_fullsized":"2024-04-26T12:32:18.509985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.971644+0000","last_change":"2024-04-26T12:33:33.971703+0000","last_active":"2024-04-26T12:33:33.971644+0000","last_peered":"2024-04-26T12:33:33.971644+0000","last_clean":"2024-04-26T12:33:33.971644+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:33:33.971644+0000","last_undegraded":"2024-04-26T12:33:33.971644+0000","last_fullsized":"2024-04-26T12:33:33.971644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.971556+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:47.263739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":358,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.935834+0000","last_change":"2024-04-26T12:33:35.935865+0000","last_active":"2024-04-26T12:33:35.935834+0000","last_peered":"2024-04-26T12:33:35.935834+0000","last_clean":"2024-04-26T12:33:35.935834+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:35.935834+0000","last_undegraded":"2024-04-26T12:33:35.935834+0000","last_fullsized":"2024-04-26T12:33:35.935834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.935727+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.443130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.513251+0000","last_change":"2024-04-26T12:30:20.530218+0000","last_active":"2024-04-26T12:32:38.513251+0000","last_peered":"2024-04-26T12:32:38.513251+0000","last_clean":"2024-04-26T12:32:38.513251+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:32:38.513251+0000","last_undegraded":"2024-04-26T12:32:38.513251+0000","last_fullsized":"2024-04-26T12:32:38.513251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508500+0000","last_change":"2024-04-26T12:30:12.496796+0000","last_active":"2024-04-26T12:33:21.508500+0000","last_peered":"2024-04-26T12:33:21.508500+0000","last_clean":"2024-04-26T12:33:21.508500+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:21.508500+0000","last_undegraded":"2024-04-26T12:33:21.508500+0000","last_fullsized":"2024-04-26T12:33:21.508500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510976+0000","last_change":"2024-04-26T12:30:10.516983+0000","last_active":"2024-04-26T12:32:23.510976+0000","last_peered":"2024-04-26T12:32:23.510976+0000","last_clean":"2024-04-26T12:32:23.510976+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:32:23.510976+0000","last_undegraded":"2024-04-26T12:32:23.510976+0000","last_fullsized":"2024-04-26T12:32:23.510976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.497123+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:32:12.497123+0000","last_peered":"2024-04-26T12:32:12.497123+0000","last_clean":"2024-04-26T12:32:12.497123+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:32:12.497123+0000","last_undegraded":"2024-04-26T12:32:12.497123+0000","last_fullsized":"2024-04-26T12:32:12.497123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.984606+0000","last_change":"2024-04-26T12:33:36.984631+0000","last_active":"2024-04-26T12:33:36.984606+0000","last_peered":"2024-04-26T12:33:36.984606+0000","last_clean":"2024-04-26T12:33:36.984606+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:33:36.984606+0000","last_undegraded":"2024-04-26T12:33:36.984606+0000","last_fullsized":"2024-04-26T12:33:36.984606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.984515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.255998+0000","last_change":"2024-04-26T12:30:16.517776+0000","last_active":"2024-04-26T12:33:21.255998+0000","last_peered":"2024-04-26T12:33:21.255998+0000","last_clean":"2024-04-26T12:33:21.255998+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:33:21.255998+0000","last_undegraded":"2024-04-26T12:33:21.255998+0000","last_fullsized":"2024-04-26T12:33:21.255998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.416634+0000","last_change":"2024-04-26T12:33:35.416673+0000","last_active":"2024-04-26T12:33:35.416634+0000","last_peered":"2024-04-26T12:33:35.416634+0000","last_clean":"2024-04-26T12:33:35.416634+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:35.416634+0000","last_undegraded":"2024-04-26T12:33:35.416634+0000","last_fullsized":"2024-04-26T12:33:35.416634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.416545+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.560676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512764+0000","last_change":"2024-04-26T12:30:20.532905+0000","last_active":"2024-04-26T12:32:38.512764+0000","last_peered":"2024-04-26T12:32:38.512764+0000","last_clean":"2024-04-26T12:32:38.512764+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:32:38.512764+0000","last_undegraded":"2024-04-26T12:32:38.512764+0000","last_fullsized":"2024-04-26T12:32:38.512764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470167+0000","last_change":"2024-04-26T12:30:12.481683+0000","last_active":"2024-04-26T12:33:21.470167+0000","last_peered":"2024-04-26T12:33:21.470167+0000","last_clean":"2024-04-26T12:33:21.470167+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:21.470167+0000","last_undegraded":"2024-04-26T12:33:21.470167+0000","last_fullsized":"2024-04-26T12:33:21.470167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.116123+0000","last_change":"2024-04-26T12:30:10.507125+0000","last_active":"2024-04-26T12:33:28.116123+0000","last_peered":"2024-04-26T12:33:28.116123+0000","last_clean":"2024-04-26T12:33:28.116123+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:33:28.116123+0000","last_undegraded":"2024-04-26T12:33:28.116123+0000","last_fullsized":"2024-04-26T12:33:28.116123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.509332+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:32:13.509332+0000","last_peered":"2024-04-26T12:32:13.509332+0000","last_clean":"2024-04-26T12:32:13.509332+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:32:13.509332+0000","last_undegraded":"2024-04-26T12:32:13.509332+0000","last_fullsized":"2024-04-26T12:32:13.509332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.054377+0000","last_change":"2024-04-26T12:33:42.054401+0000","last_active":"2024-04-26T12:33:42.054377+0000","last_peered":"2024-04-26T12:33:42.054377+0000","last_clean":"2024-04-26T12:33:42.054377+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:33:42.054377+0000","last_undegraded":"2024-04-26T12:33:42.054377+0000","last_fullsized":"2024-04-26T12:33:42.054377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.054238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:08.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'98","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.374582+0000","last_change":"2024-04-26T12:33:36.374652+0000","last_active":"2024-04-26T12:33:36.374582+0000","last_peered":"2024-04-26T12:33:36.374582+0000","last_clean":"2024-04-26T12:33:36.374582+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:33:36.374582+0000","last_undegraded":"2024-04-26T12:33:36.374582+0000","last_fullsized":"2024-04-26T12:33:36.374582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'98","last_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_deep_scrub":"32'98","last_deep_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.374477+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:44.404332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:31.509100+0000","last_change":"2024-04-26T12:33:31.509119+0000","last_active":"2024-04-26T12:33:31.509100+0000","last_peered":"2024-04-26T12:33:31.509100+0000","last_clean":"2024-04-26T12:33:31.509100+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:33:31.509100+0000","last_undegraded":"2024-04-26T12:33:31.509100+0000","last_fullsized":"2024-04-26T12:33:31.509100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_clean_scrub_stamp":"2024-04-26T12:33:31.509011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:04.640988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.535798+0000","last_change":"2024-04-26T12:30:20.530332+0000","last_active":"2024-04-26T12:33:21.535798+0000","last_peered":"2024-04-26T12:33:21.535798+0000","last_clean":"2024-04-26T12:33:21.535798+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:33:21.535798+0000","last_undegraded":"2024-04-26T12:33:21.535798+0000","last_fullsized":"2024-04-26T12:33:21.535798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503618+0000","last_change":"2024-04-26T12:30:20.528129+0000","last_active":"2024-04-26T12:32:27.503618+0000","last_peered":"2024-04-26T12:32:27.503618+0000","last_clean":"2024-04-26T12:32:27.503618+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:32:27.503618+0000","last_undegraded":"2024-04-26T12:32:27.503618+0000","last_fullsized":"2024-04-26T12:32:27.503618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.504280+0000","last_change":"2024-04-26T12:30:12.480553+0000","last_active":"2024-04-26T12:32:32.504280+0000","last_peered":"2024-04-26T12:32:32.504280+0000","last_clean":"2024-04-26T12:32:32.504280+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:32:32.504280+0000","last_undegraded":"2024-04-26T12:32:32.504280+0000","last_fullsized":"2024-04-26T12:32:32.504280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.229966+0000","last_change":"2024-04-26T12:30:10.523769+0000","last_active":"2024-04-26T12:33:21.229966+0000","last_peered":"2024-04-26T12:33:21.229966+0000","last_clean":"2024-04-26T12:33:21.229966+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:33:21.229966+0000","last_undegraded":"2024-04-26T12:33:21.229966+0000","last_fullsized":"2024-04-26T12:33:21.229966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.934150+0000","last_change":"2024-04-26T12:33:44.934202+0000","last_active":"2024-04-26T12:33:44.934150+0000","last_peered":"2024-04-26T12:33:44.934150+0000","last_clean":"2024-04-26T12:33:44.934150+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:33:44.934150+0000","last_undegraded":"2024-04-26T12:33:44.934150+0000","last_fullsized":"2024-04-26T12:33:44.934150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.934050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:59.400029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.180953+0000","last_change":"2024-04-26T12:30:16.518746+0000","last_active":"2024-04-26T12:33:28.180953+0000","last_peered":"2024-04-26T12:33:28.180953+0000","last_clean":"2024-04-26T12:33:28.180953+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:33:28.180953+0000","last_undegraded":"2024-04-26T12:33:28.180953+0000","last_fullsized":"2024-04-26T12:33:28.180953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.513054+0000","last_change":"2024-04-26T12:30:18.529377+0000","last_active":"2024-04-26T12:32:38.513054+0000","last_peered":"2024-04-26T12:32:38.513054+0000","last_clean":"2024-04-26T12:32:38.513054+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:32:38.513054+0000","last_undegraded":"2024-04-26T12:32:38.513054+0000","last_fullsized":"2024-04-26T12:32:38.513054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498650+0000","last_change":"2024-04-26T12:30:20.528724+0000","last_active":"2024-04-26T12:32:22.498650+0000","last_peered":"2024-04-26T12:32:22.498650+0000","last_clean":"2024-04-26T12:32:22.498650+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:32:22.498650+0000","last_undegraded":"2024-04-26T12:32:22.498650+0000","last_fullsized":"2024-04-26T12:32:22.498650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511965+0000","last_change":"2024-04-26T12:30:49.555701+0000","last_active":"2024-04-26T12:32:33.511965+0000","last_peered":"2024-04-26T12:32:33.511965+0000","last_clean":"2024-04-26T12:32:33.511965+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:32:33.511965+0000","last_undegraded":"2024-04-26T12:32:33.511965+0000","last_fullsized":"2024-04-26T12:32:33.511965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505197+0000","last_change":"2024-04-26T12:30:10.502612+0000","last_active":"2024-04-26T12:32:37.505197+0000","last_peered":"2024-04-26T12:32:37.505197+0000","last_clean":"2024-04-26T12:32:37.505197+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:32:37.505197+0000","last_undegraded":"2024-04-26T12:32:37.505197+0000","last_fullsized":"2024-04-26T12:32:37.505197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.035342+0000","last_change":"2024-04-26T12:33:41.035367+0000","last_active":"2024-04-26T12:33:41.035342+0000","last_peered":"2024-04-26T12:33:41.035342+0000","last_clean":"2024-04-26T12:33:41.035342+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:33:41.035342+0000","last_undegraded":"2024-04-26T12:33:41.035342+0000","last_fullsized":"2024-04-26T12:33:41.035342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:28.509101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.437752+0000","last_change":"2024-04-26T12:33:45.437804+0000","last_active":"2024-04-26T12:33:45.437752+0000","last_peered":"2024-04-26T12:33:45.437752+0000","last_clean":"2024-04-26T12:33:45.437752+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:45.437752+0000","last_undegraded":"2024-04-26T12:33:45.437752+0000","last_fullsized":"2024-04-26T12:33:45.437752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.437634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:24.012972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.322288+0000","last_change":"2024-04-26T12:33:33.322319+0000","last_active":"2024-04-26T12:33:33.322288+0000","last_peered":"2024-04-26T12:33:33.322288+0000","last_clean":"2024-04-26T12:33:33.322288+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:33:33.322288+0000","last_undegraded":"2024-04-26T12:33:33.322288+0000","last_fullsized":"2024-04-26T12:33:33.322288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.322193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:33.954765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.467476+0000","last_change":"2024-04-26T12:30:20.531528+0000","last_active":"2024-04-26T12:33:21.467476+0000","last_peered":"2024-04-26T12:33:21.467476+0000","last_clean":"2024-04-26T12:33:21.467476+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:33:21.467476+0000","last_undegraded":"2024-04-26T12:33:21.467476+0000","last_fullsized":"2024-04-26T12:33:21.467476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.500309+0000","last_change":"2024-04-26T12:30:12.482043+0000","last_active":"2024-04-26T12:32:32.500309+0000","last_peered":"2024-04-26T12:32:32.500309+0000","last_clean":"2024-04-26T12:32:32.500309+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:32:32.500309+0000","last_undegraded":"2024-04-26T12:32:32.500309+0000","last_fullsized":"2024-04-26T12:32:32.500309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505238+0000","last_change":"2024-04-26T12:30:10.493462+0000","last_active":"2024-04-26T12:32:37.505238+0000","last_peered":"2024-04-26T12:32:37.505238+0000","last_clean":"2024-04-26T12:32:37.505238+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:32:37.505238+0000","last_undegraded":"2024-04-26T12:32:37.505238+0000","last_fullsized":"2024-04-26T12:32:37.505238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"23'1","reported_seq":221,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.057151+0000","last_change":"2024-04-26T12:30:14.489635+0000","last_active":"2024-04-26T12:33:28.057151+0000","last_peered":"2024-04-26T12:33:28.057151+0000","last_clean":"2024-04-26T12:33:28.057151+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:33:28.057151+0000","last_undegraded":"2024-04-26T12:33:28.057151+0000","last_fullsized":"2024-04-26T12:33:28.057151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.463439+0000","last_change":"2024-04-26T12:33:43.463495+0000","last_active":"2024-04-26T12:33:43.463439+0000","last_peered":"2024-04-26T12:33:43.463439+0000","last_clean":"2024-04-26T12:33:43.463439+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:43.463439+0000","last_undegraded":"2024-04-26T12:33:43.463439+0000","last_fullsized":"2024-04-26T12:33:43.463439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.463348+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:24.510661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.045474+0000","last_change":"2024-04-26T12:33:32.045522+0000","last_active":"2024-04-26T12:33:32.045474+0000","last_peered":"2024-04-26T12:33:32.045474+0000","last_clean":"2024-04-26T12:33:32.045474+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:33:32.045474+0000","last_undegraded":"2024-04-26T12:33:32.045474+0000","last_fullsized":"2024-04-26T12:33:32.045474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.045363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:44.273391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:53.515719+0000","last_change":"2024-04-26T12:30:20.524900+0000","last_active":"2024-04-26T12:32:53.515719+0000","last_peered":"2024-04-26T12:32:53.515719+0000","last_clean":"2024-04-26T12:32:53.515719+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:32:53.515719+0000","last_undegraded":"2024-04-26T12:32:53.515719+0000","last_fullsized":"2024-04-26T12:32:53.515719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.070835+0000","last_change":"2024-04-26T12:33:45.070862+0000","last_active":"2024-04-26T12:33:45.070835+0000","last_peered":"2024-04-26T12:33:45.070835+0000","last_clean":"2024-04-26T12:33:45.070835+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:45.070835+0000","last_undegraded":"2024-04-26T12:33:45.070835+0000","last_fullsized":"2024-04-26T12:33:45.070835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.070739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:40.944238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512901+0000","last_change":"2024-04-26T12:30:10.513562+0000","last_active":"2024-04-26T12:32:38.512901+0000","last_peered":"2024-04-26T12:32:38.512901+0000","last_clean":"2024-04-26T12:32:38.512901+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:32:38.512901+0000","last_undegraded":"2024-04-26T12:32:38.512901+0000","last_fullsized":"2024-04-26T12:32:38.512901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.064258+0000","last_change":"2024-04-26T12:33:43.064299+0000","last_active":"2024-04-26T12:33:43.064258+0000","last_peered":"2024-04-26T12:33:43.064258+0000","last_clean":"2024-04-26T12:33:43.064258+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:33:43.064258+0000","last_undegraded":"2024-04-26T12:33:43.064258+0000","last_fullsized":"2024-04-26T12:33:43.064258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.064153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:56.367388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.353452+0000","last_change":"2024-04-26T12:33:42.353487+0000","last_active":"2024-04-26T12:33:42.353452+0000","last_peered":"2024-04-26T12:33:42.353452+0000","last_clean":"2024-04-26T12:33:42.353452+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:33:42.353452+0000","last_undegraded":"2024-04-26T12:33:42.353452+0000","last_fullsized":"2024-04-26T12:33:42.353452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.353371+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:27.302471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.359118+0000","last_change":"2024-04-26T12:33:35.359140+0000","last_active":"2024-04-26T12:33:35.359118+0000","last_peered":"2024-04-26T12:33:35.359118+0000","last_clean":"2024-04-26T12:33:35.359118+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:33:35.359118+0000","last_undegraded":"2024-04-26T12:33:35.359118+0000","last_fullsized":"2024-04-26T12:33:35.359118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.359023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:00.812046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.510204+0000","last_change":"2024-04-26T12:30:12.490077+0000","last_active":"2024-04-26T12:32:18.510204+0000","last_peered":"2024-04-26T12:32:18.510204+0000","last_clean":"2024-04-26T12:32:18.510204+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:32:18.510204+0000","last_undegraded":"2024-04-26T12:32:18.510204+0000","last_fullsized":"2024-04-26T12:32:18.510204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.513019+0000","last_change":"2024-04-26T12:30:10.523507+0000","last_active":"2024-04-26T12:32:38.513019+0000","last_peered":"2024-04-26T12:32:38.513019+0000","last_clean":"2024-04-26T12:32:38.513019+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:32:38.513019+0000","last_undegraded":"2024-04-26T12:32:38.513019+0000","last_fullsized":"2024-04-26T12:32:38.513019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497958+0000","last_change":"2024-04-26T12:30:14.487589+0000","last_active":"2024-04-26T12:32:17.497958+0000","last_peered":"2024-04-26T12:32:17.497958+0000","last_clean":"2024-04-26T12:32:17.497958+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:32:17.497958+0000","last_undegraded":"2024-04-26T12:32:17.497958+0000","last_fullsized":"2024-04-26T12:32:17.497958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.501845+0000","last_change":"2024-04-26T12:33:42.501879+0000","last_active":"2024-04-26T12:33:42.501845+0000","last_peered":"2024-04-26T12:33:42.501845+0000","last_clean":"2024-04-26T12:33:42.501845+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:33:42.501845+0000","last_undegraded":"2024-04-26T12:33:42.501845+0000","last_fullsized":"2024-04-26T12:33:42.501845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.501766+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:10.173839+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.366864+0000","last_change":"2024-04-26T12:33:34.366886+0000","last_active":"2024-04-26T12:33:34.366864+0000","last_peered":"2024-04-26T12:33:34.366864+0000","last_clean":"2024-04-26T12:33:34.366864+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:33:34.366864+0000","last_undegraded":"2024-04-26T12:33:34.366864+0000","last_fullsized":"2024-04-26T12:33:34.366864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.366757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:47.058265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.501892+0000","last_change":"2024-04-26T12:30:20.523862+0000","last_active":"2024-04-26T12:32:42.501892+0000","last_peered":"2024-04-26T12:32:42.501892+0000","last_clean":"2024-04-26T12:32:42.501892+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:32:42.501892+0000","last_undegraded":"2024-04-26T12:32:42.501892+0000","last_fullsized":"2024-04-26T12:32:42.501892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.497153+0000","last_change":"2024-04-26T12:30:12.496190+0000","last_active":"2024-04-26T12:32:12.497153+0000","last_peered":"2024-04-26T12:32:12.497153+0000","last_clean":"2024-04-26T12:32:12.497153+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:32:12.497153+0000","last_undegraded":"2024-04-26T12:32:12.497153+0000","last_fullsized":"2024-04-26T12:32:12.497153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.458396+0000","last_change":"2024-04-26T12:30:10.495713+0000","last_active":"2024-04-26T12:33:21.458396+0000","last_peered":"2024-04-26T12:33:21.458396+0000","last_clean":"2024-04-26T12:33:21.458396+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:33:21.458396+0000","last_undegraded":"2024-04-26T12:33:21.458396+0000","last_fullsized":"2024-04-26T12:33:21.458396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.502763+0000","last_change":"2024-04-26T12:30:14.491780+0000","last_active":"2024-04-26T12:32:22.502763+0000","last_peered":"2024-04-26T12:32:22.502763+0000","last_clean":"2024-04-26T12:32:22.502763+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:32:22.502763+0000","last_undegraded":"2024-04-26T12:32:22.502763+0000","last_fullsized":"2024-04-26T12:32:22.502763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.993283+0000","last_change":"2024-04-26T12:33:35.993331+0000","last_active":"2024-04-26T12:33:35.993283+0000","last_peered":"2024-04-26T12:33:35.993283+0000","last_clean":"2024-04-26T12:33:35.993283+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:33:35.993283+0000","last_undegraded":"2024-04-26T12:33:35.993283+0000","last_fullsized":"2024-04-26T12:33:35.993283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.993196+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.267797+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.950944+0000","last_change":"2024-04-26T12:33:43.950965+0000","last_active":"2024-04-26T12:33:43.950944+0000","last_peered":"2024-04-26T12:33:43.950944+0000","last_clean":"2024-04-26T12:33:43.950944+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:33:43.950944+0000","last_undegraded":"2024-04-26T12:33:43.950944+0000","last_fullsized":"2024-04-26T12:33:43.950944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.950850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.030430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513984+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:32:43.513984+0000","last_peered":"2024-04-26T12:32:43.513984+0000","last_clean":"2024-04-26T12:32:43.513984+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:32:43.513984+0000","last_undegraded":"2024-04-26T12:32:43.513984+0000","last_fullsized":"2024-04-26T12:32:43.513984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.015731+0000","last_change":"2024-04-26T12:33:47.015756+0000","last_active":"2024-04-26T12:33:47.015731+0000","last_peered":"2024-04-26T12:33:47.015731+0000","last_clean":"2024-04-26T12:33:47.015731+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:47.015731+0000","last_undegraded":"2024-04-26T12:33:47.015731+0000","last_fullsized":"2024-04-26T12:33:47.015731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.015630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:22.957533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513563+0000","last_change":"2024-04-26T12:30:10.511419+0000","last_active":"2024-04-26T12:32:43.513563+0000","last_peered":"2024-04-26T12:32:43.513563+0000","last_clean":"2024-04-26T12:32:43.513563+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:32:43.513563+0000","last_undegraded":"2024-04-26T12:32:43.513563+0000","last_fullsized":"2024-04-26T12:32:43.513563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.310817+0000","last_change":"2024-04-26T12:33:46.310845+0000","last_active":"2024-04-26T12:33:46.310817+0000","last_peered":"2024-04-26T12:33:46.310817+0000","last_clean":"2024-04-26T12:33:46.310817+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:33:46.310817+0000","last_undegraded":"2024-04-26T12:33:46.310817+0000","last_fullsized":"2024-04-26T12:33:46.310817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.310718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:07.825719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.467854+0000","last_change":"2024-04-26T12:33:41.467898+0000","last_active":"2024-04-26T12:33:41.467854+0000","last_peered":"2024-04-26T12:33:41.467854+0000","last_clean":"2024-04-26T12:33:41.467854+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:33:41.467854+0000","last_undegraded":"2024-04-26T12:33:41.467854+0000","last_fullsized":"2024-04-26T12:33:41.467854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.467768+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:07.391342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.445371+0000","last_change":"2024-04-26T12:33:33.445395+0000","last_active":"2024-04-26T12:33:33.445371+0000","last_peered":"2024-04-26T12:33:33.445371+0000","last_clean":"2024-04-26T12:33:33.445371+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:33:33.445371+0000","last_undegraded":"2024-04-26T12:33:33.445371+0000","last_fullsized":"2024-04-26T12:33:33.445371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.445277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.337016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513948+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:43.513948+0000","last_peered":"2024-04-26T12:32:43.513948+0000","last_clean":"2024-04-26T12:32:43.513948+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:43.513948+0000","last_undegraded":"2024-04-26T12:32:43.513948+0000","last_fullsized":"2024-04-26T12:32:43.513948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.501945+0000","last_change":"2024-04-26T12:30:12.491493+0000","last_active":"2024-04-26T12:32:42.501945+0000","last_peered":"2024-04-26T12:32:42.501945+0000","last_clean":"2024-04-26T12:32:42.501945+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:32:42.501945+0000","last_undegraded":"2024-04-26T12:32:42.501945+0000","last_fullsized":"2024-04-26T12:32:42.501945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514043+0000","last_change":"2024-04-26T12:30:10.521621+0000","last_active":"2024-04-26T12:32:43.514043+0000","last_peered":"2024-04-26T12:32:43.514043+0000","last_clean":"2024-04-26T12:32:43.514043+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:32:43.514043+0000","last_undegraded":"2024-04-26T12:32:43.514043+0000","last_fullsized":"2024-04-26T12:32:43.514043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513616+0000","last_change":"2024-04-26T12:30:49.551612+0000","last_active":"2024-04-26T12:32:43.513616+0000","last_peered":"2024-04-26T12:32:43.513616+0000","last_clean":"2024-04-26T12:32:43.513616+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:32:43.513616+0000","last_undegraded":"2024-04-26T12:32:43.513616+0000","last_fullsized":"2024-04-26T12:32:43.513616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.510166+0000","last_change":"2024-04-26T12:30:16.518414+0000","last_active":"2024-04-26T12:32:18.510166+0000","last_peered":"2024-04-26T12:32:18.510166+0000","last_clean":"2024-04-26T12:32:18.510166+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:32:18.510166+0000","last_undegraded":"2024-04-26T12:32:18.510166+0000","last_fullsized":"2024-04-26T12:32:18.510166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:15.487499+0000","last_clean_scrub_stamp":"2024-04-26T12:30:15.487499+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":378,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.307434+0000","last_change":"2024-04-26T12:33:45.307469+0000","last_active":"2024-04-26T12:33:45.307434+0000","last_peered":"2024-04-26T12:33:45.307434+0000","last_clean":"2024-04-26T12:33:45.307434+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:45.307434+0000","last_undegraded":"2024-04-26T12:33:45.307434+0000","last_fullsized":"2024-04-26T12:33:45.307434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.307342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:13.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513827+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:32:43.513827+0000","last_peered":"2024-04-26T12:32:43.513827+0000","last_clean":"2024-04-26T12:32:43.513827+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:32:43.513827+0000","last_undegraded":"2024-04-26T12:32:43.513827+0000","last_fullsized":"2024-04-26T12:32:43.513827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.537992+0000","last_change":"2024-04-26T12:30:12.489089+0000","last_active":"2024-04-26T12:33:21.537992+0000","last_peered":"2024-04-26T12:33:21.537992+0000","last_clean":"2024-04-26T12:33:21.537992+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:33:21.537992+0000","last_undegraded":"2024-04-26T12:33:21.537992+0000","last_fullsized":"2024-04-26T12:33:21.537992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513595+0000","last_change":"2024-04-26T12:30:10.510186+0000","last_active":"2024-04-26T12:32:43.513595+0000","last_peered":"2024-04-26T12:32:43.513595+0000","last_clean":"2024-04-26T12:32:43.513595+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:32:43.513595+0000","last_undegraded":"2024-04-26T12:32:43.513595+0000","last_fullsized":"2024-04-26T12:32:43.513595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.949107+0000","last_change":"2024-04-26T12:33:42.949152+0000","last_active":"2024-04-26T12:33:42.949107+0000","last_peered":"2024-04-26T12:33:42.949107+0000","last_clean":"2024-04-26T12:33:42.949107+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:33:42.949107+0000","last_undegraded":"2024-04-26T12:33:42.949107+0000","last_fullsized":"2024-04-26T12:33:42.949107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.948988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:32.255979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.890106+0000","last_change":"2024-04-26T12:33:38.890152+0000","last_active":"2024-04-26T12:33:38.890106+0000","last_peered":"2024-04-26T12:33:38.890106+0000","last_clean":"2024-04-26T12:33:38.890106+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:33:38.890106+0000","last_undegraded":"2024-04-26T12:33:38.890106+0000","last_fullsized":"2024-04-26T12:33:38.890106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.890013+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:04.019389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.461617+0000","last_change":"2024-04-26T12:33:40.461661+0000","last_active":"2024-04-26T12:33:40.461617+0000","last_peered":"2024-04-26T12:33:40.461617+0000","last_clean":"2024-04-26T12:33:40.461617+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:33:40.461617+0000","last_undegraded":"2024-04-26T12:33:40.461617+0000","last_fullsized":"2024-04-26T12:33:40.461617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.461502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:09.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.638839+0000","last_change":"2024-04-26T12:30:20.530957+0000","last_active":"2024-04-26T12:33:21.638839+0000","last_peered":"2024-04-26T12:33:21.638839+0000","last_clean":"2024-04-26T12:33:21.638839+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:21.638839+0000","last_undegraded":"2024-04-26T12:33:21.638839+0000","last_fullsized":"2024-04-26T12:33:21.638839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538397+0000","last_change":"2024-04-26T12:30:12.489703+0000","last_active":"2024-04-26T12:33:21.538397+0000","last_peered":"2024-04-26T12:33:21.538397+0000","last_clean":"2024-04-26T12:33:21.538397+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:33:21.538397+0000","last_undegraded":"2024-04-26T12:33:21.538397+0000","last_fullsized":"2024-04-26T12:33:21.538397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.461255+0000","last_change":"2024-04-26T12:30:10.524731+0000","last_active":"2024-04-26T12:33:21.461255+0000","last_peered":"2024-04-26T12:33:21.461255+0000","last_clean":"2024-04-26T12:33:21.461255+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:33:21.461255+0000","last_undegraded":"2024-04-26T12:33:21.461255+0000","last_fullsized":"2024-04-26T12:33:21.461255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:47.506411+0000","last_change":"2024-04-26T12:30:14.488779+0000","last_active":"2024-04-26T12:32:47.506411+0000","last_peered":"2024-04-26T12:32:47.506411+0000","last_clean":"2024-04-26T12:32:47.506411+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:32:47.506411+0000","last_undegraded":"2024-04-26T12:32:47.506411+0000","last_fullsized":"2024-04-26T12:32:47.506411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.453148+0000","last_change":"2024-04-26T12:33:38.453185+0000","last_active":"2024-04-26T12:33:38.453148+0000","last_peered":"2024-04-26T12:33:38.453148+0000","last_clean":"2024-04-26T12:33:38.453148+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:33:38.453148+0000","last_undegraded":"2024-04-26T12:33:38.453148+0000","last_fullsized":"2024-04-26T12:33:38.453148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.453065+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:29.052361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513892+0000","last_change":"2024-04-26T12:30:18.524599+0000","last_active":"2024-04-26T12:32:43.513892+0000","last_peered":"2024-04-26T12:32:43.513892+0000","last_clean":"2024-04-26T12:32:43.513892+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:32:43.513892+0000","last_undegraded":"2024-04-26T12:32:43.513892+0000","last_fullsized":"2024-04-26T12:32:43.513892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.515022+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:32:48.515022+0000","last_peered":"2024-04-26T12:32:48.515022+0000","last_clean":"2024-04-26T12:32:48.515022+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:32:48.515022+0000","last_undegraded":"2024-04-26T12:32:48.515022+0000","last_fullsized":"2024-04-26T12:32:48.515022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508967+0000","last_change":"2024-04-26T12:30:12.489639+0000","last_active":"2024-04-26T12:33:21.508967+0000","last_peered":"2024-04-26T12:33:21.508967+0000","last_clean":"2024-04-26T12:33:21.508967+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:33:21.508967+0000","last_undegraded":"2024-04-26T12:33:21.508967+0000","last_fullsized":"2024-04-26T12:33:21.508967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.497136+0000","last_change":"2024-04-26T12:30:10.499110+0000","last_active":"2024-04-26T12:32:12.497136+0000","last_peered":"2024-04-26T12:32:12.497136+0000","last_clean":"2024-04-26T12:32:12.497136+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:32:12.497136+0000","last_undegraded":"2024-04-26T12:32:12.497136+0000","last_fullsized":"2024-04-26T12:32:12.497136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512660+0000","last_change":"2024-04-26T12:30:14.488627+0000","last_active":"2024-04-26T12:32:38.512660+0000","last_peered":"2024-04-26T12:32:38.512660+0000","last_clean":"2024-04-26T12:32:38.512660+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:32:38.512660+0000","last_undegraded":"2024-04-26T12:32:38.512660+0000","last_fullsized":"2024-04-26T12:32:38.512660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.031288+0000","last_change":"2024-04-26T12:33:40.031319+0000","last_active":"2024-04-26T12:33:40.031288+0000","last_peered":"2024-04-26T12:33:40.031288+0000","last_clean":"2024-04-26T12:33:40.031288+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:33:40.031288+0000","last_undegraded":"2024-04-26T12:33:40.031288+0000","last_fullsized":"2024-04-26T12:33:40.031288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.031195+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:09.032628+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514824+0000","last_change":"2024-04-26T12:30:18.524792+0000","last_active":"2024-04-26T12:32:48.514824+0000","last_peered":"2024-04-26T12:32:48.514824+0000","last_clean":"2024-04-26T12:32:48.514824+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:32:48.514824+0000","last_undegraded":"2024-04-26T12:32:48.514824+0000","last_fullsized":"2024-04-26T12:32:48.514824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514960+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:48.514960+0000","last_peered":"2024-04-26T12:32:48.514960+0000","last_clean":"2024-04-26T12:32:48.514960+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:48.514960+0000","last_undegraded":"2024-04-26T12:32:48.514960+0000","last_fullsized":"2024-04-26T12:32:48.514960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505061+0000","last_change":"2024-04-26T12:30:12.482428+0000","last_active":"2024-04-26T12:32:37.505061+0000","last_peered":"2024-04-26T12:32:37.505061+0000","last_clean":"2024-04-26T12:32:37.505061+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:32:37.505061+0000","last_undegraded":"2024-04-26T12:32:37.505061+0000","last_fullsized":"2024-04-26T12:32:37.505061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.509415+0000","last_change":"2024-04-26T12:30:10.515261+0000","last_active":"2024-04-26T12:32:18.509415+0000","last_peered":"2024-04-26T12:32:18.509415+0000","last_clean":"2024-04-26T12:32:18.509415+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:32:18.509415+0000","last_undegraded":"2024-04-26T12:32:18.509415+0000","last_fullsized":"2024-04-26T12:32:18.509415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512715+0000","last_change":"2024-04-26T12:30:14.488530+0000","last_active":"2024-04-26T12:32:38.512715+0000","last_peered":"2024-04-26T12:32:38.512715+0000","last_clean":"2024-04-26T12:32:38.512715+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:32:38.512715+0000","last_undegraded":"2024-04-26T12:32:38.512715+0000","last_fullsized":"2024-04-26T12:32:38.512715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.110111+0000","last_change":"2024-04-26T12:33:44.110183+0000","last_active":"2024-04-26T12:33:44.110111+0000","last_peered":"2024-04-26T12:33:44.110111+0000","last_clean":"2024-04-26T12:33:44.110111+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:44.110111+0000","last_undegraded":"2024-04-26T12:33:44.110111+0000","last_fullsized":"2024-04-26T12:33:44.110111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.110007+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:08.558930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.503306+0000","last_change":"2024-04-26T12:30:18.526314+0000","last_active":"2024-04-26T12:32:52.503306+0000","last_peered":"2024-04-26T12:32:52.503306+0000","last_clean":"2024-04-26T12:32:52.503306+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:32:52.503306+0000","last_undegraded":"2024-04-26T12:32:52.503306+0000","last_fullsized":"2024-04-26T12:32:52.503306+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:17.496639+0000","last_clean_scrub_stamp":"2024-04-26T12:30:17.496639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514093+0000","last_change":"2024-04-26T12:30:20.523635+0000","last_active":"2024-04-26T12:32:43.514093+0000","last_peered":"2024-04-26T12:32:43.514093+0000","last_clean":"2024-04-26T12:32:43.514093+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:32:43.514093+0000","last_undegraded":"2024-04-26T12:32:43.514093+0000","last_fullsized":"2024-04-26T12:32:43.514093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470096+0000","last_change":"2024-04-26T12:30:12.499038+0000","last_active":"2024-04-26T12:33:21.470096+0000","last_peered":"2024-04-26T12:33:21.470096+0000","last_clean":"2024-04-26T12:33:21.470096+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:21.470096+0000","last_undegraded":"2024-04-26T12:33:21.470096+0000","last_fullsized":"2024-04-26T12:33:21.470096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501790+0000","last_change":"2024-04-26T12:30:10.508462+0000","last_active":"2024-04-26T12:32:17.501790+0000","last_peered":"2024-04-26T12:32:17.501790+0000","last_clean":"2024-04-26T12:32:17.501790+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:32:17.501790+0000","last_undegraded":"2024-04-26T12:32:17.501790+0000","last_fullsized":"2024-04-26T12:32:17.501790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508662+0000","last_change":"2024-04-26T12:30:12.488793+0000","last_active":"2024-04-26T12:33:21.508662+0000","last_peered":"2024-04-26T12:33:21.508662+0000","last_clean":"2024-04-26T12:33:21.508662+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:33:21.508662+0000","last_undegraded":"2024-04-26T12:33:21.508662+0000","last_fullsized":"2024-04-26T12:33:21.508662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.117053+0000","last_change":"2024-04-26T12:30:10.488944+0000","last_active":"2024-04-26T12:33:28.117053+0000","last_peered":"2024-04-26T12:33:28.117053+0000","last_clean":"2024-04-26T12:33:28.117053+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:33:28.117053+0000","last_undegraded":"2024-04-26T12:33:28.117053+0000","last_fullsized":"2024-04-26T12:33:28.117053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508794+0000","last_change":"2024-04-26T12:30:12.491523+0000","last_active":"2024-04-26T12:33:21.508794+0000","last_peered":"2024-04-26T12:33:21.508794+0000","last_clean":"2024-04-26T12:33:21.508794+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:33:21.508794+0000","last_undegraded":"2024-04-26T12:33:21.508794+0000","last_fullsized":"2024-04-26T12:33:21.508794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.787426+0000","last_change":"2024-04-26T12:30:10.515892+0000","last_active":"2024-04-26T12:32:20.787426+0000","last_peered":"2024-04-26T12:32:20.787426+0000","last_clean":"2024-04-26T12:32:20.787426+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:32:20.787426+0000","last_undegraded":"2024-04-26T12:32:20.787426+0000","last_fullsized":"2024-04-26T12:32:20.787426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538175+0000","last_change":"2024-04-26T12:30:12.491568+0000","last_active":"2024-04-26T12:33:21.538175+0000","last_peered":"2024-04-26T12:33:21.538175+0000","last_clean":"2024-04-26T12:33:21.538175+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:33:21.538175+0000","last_undegraded":"2024-04-26T12:33:21.538175+0000","last_fullsized":"2024-04-26T12:33:21.538175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497900+0000","last_change":"2024-04-26T12:30:10.498184+0000","last_active":"2024-04-26T12:32:17.497900+0000","last_peered":"2024-04-26T12:32:17.497900+0000","last_clean":"2024-04-26T12:32:17.497900+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:32:17.497900+0000","last_undegraded":"2024-04-26T12:32:17.497900+0000","last_fullsized":"2024-04-26T12:32:17.497900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341089+0000","last_change":"2024-04-26T12:30:12.477969+0000","last_active":"2024-04-26T12:33:21.341089+0000","last_peered":"2024-04-26T12:33:21.341089+0000","last_clean":"2024-04-26T12:33:21.341089+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:33:21.341089+0000","last_undegraded":"2024-04-26T12:33:21.341089+0000","last_fullsized":"2024-04-26T12:33:21.341089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498611+0000","last_change":"2024-04-26T12:30:10.505910+0000","last_active":"2024-04-26T12:32:22.498611+0000","last_peered":"2024-04-26T12:32:22.498611+0000","last_clean":"2024-04-26T12:32:22.498611+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:32:22.498611+0000","last_undegraded":"2024-04-26T12:32:22.498611+0000","last_fullsized":"2024-04-26T12:32:22.498611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.254607+0000","last_change":"2024-04-26T12:30:12.497999+0000","last_active":"2024-04-26T12:33:21.254607+0000","last_peered":"2024-04-26T12:33:21.254607+0000","last_clean":"2024-04-26T12:33:21.254607+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:21.254607+0000","last_undegraded":"2024-04-26T12:33:21.254607+0000","last_fullsized":"2024-04-26T12:33:21.254607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510243+0000","last_change":"2024-04-26T12:30:10.507425+0000","last_active":"2024-04-26T12:32:23.510243+0000","last_peered":"2024-04-26T12:32:23.510243+0000","last_clean":"2024-04-26T12:32:23.510243+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:32:23.510243+0000","last_undegraded":"2024-04-26T12:32:23.510243+0000","last_fullsized":"2024-04-26T12:32:23.510243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497859+0000","last_change":"2024-04-26T12:30:12.496187+0000","last_active":"2024-04-26T12:32:17.497859+0000","last_peered":"2024-04-26T12:32:17.497859+0000","last_clean":"2024-04-26T12:32:17.497859+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:32:17.497859+0000","last_undegraded":"2024-04-26T12:32:17.497859+0000","last_fullsized":"2024-04-26T12:32:17.497859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.502739+0000","last_change":"2024-04-26T12:30:10.504572+0000","last_active":"2024-04-26T12:32:22.502739+0000","last_peered":"2024-04-26T12:32:22.502739+0000","last_clean":"2024-04-26T12:32:22.502739+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:32:22.502739+0000","last_undegraded":"2024-04-26T12:32:22.502739+0000","last_fullsized":"2024-04-26T12:32:22.502739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341245+0000","last_change":"2024-04-26T12:30:12.495561+0000","last_active":"2024-04-26T12:33:21.341245+0000","last_peered":"2024-04-26T12:33:21.341245+0000","last_clean":"2024-04-26T12:33:21.341245+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:33:21.341245+0000","last_undegraded":"2024-04-26T12:33:21.341245+0000","last_fullsized":"2024-04-26T12:33:21.341245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.116079+0000","last_change":"2024-04-26T12:30:10.498578+0000","last_active":"2024-04-26T12:33:28.116079+0000","last_peered":"2024-04-26T12:33:28.116079+0000","last_clean":"2024-04-26T12:33:28.116079+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:33:28.116079+0000","last_undegraded":"2024-04-26T12:33:28.116079+0000","last_fullsized":"2024-04-26T12:33:28.116079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.509293+0000","last_change":"2024-04-26T12:30:12.496215+0000","last_active":"2024-04-26T12:33:21.509293+0000","last_peered":"2024-04-26T12:33:21.509293+0000","last_clean":"2024-04-26T12:33:21.509293+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:33:21.509293+0000","last_undegraded":"2024-04-26T12:33:21.509293+0000","last_fullsized":"2024-04-26T12:33:21.509293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510681+0000","last_change":"2024-04-26T12:30:10.521412+0000","last_active":"2024-04-26T12:32:23.510681+0000","last_peered":"2024-04-26T12:32:23.510681+0000","last_clean":"2024-04-26T12:32:23.510681+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:32:23.510681+0000","last_undegraded":"2024-04-26T12:32:23.510681+0000","last_fullsized":"2024-04-26T12:32:23.510681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.582873+0000","last_change":"2024-04-26T12:30:12.493682+0000","last_active":"2024-04-26T12:33:21.582873+0000","last_peered":"2024-04-26T12:33:21.582873+0000","last_clean":"2024-04-26T12:33:21.582873+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:33:21.582873+0000","last_undegraded":"2024-04-26T12:33:21.582873+0000","last_fullsized":"2024-04-26T12:33:21.582873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499420+0000","last_change":"2024-04-26T12:30:10.498422+0000","last_active":"2024-04-26T12:32:27.499420+0000","last_peered":"2024-04-26T12:32:27.499420+0000","last_clean":"2024-04-26T12:32:27.499420+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:32:27.499420+0000","last_undegraded":"2024-04-26T12:32:27.499420+0000","last_fullsized":"2024-04-26T12:32:27.499420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508520+0000","last_change":"2024-04-26T12:30:12.484594+0000","last_active":"2024-04-26T12:33:21.508520+0000","last_peered":"2024-04-26T12:33:21.508520+0000","last_clean":"2024-04-26T12:33:21.508520+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:33:21.508520+0000","last_undegraded":"2024-04-26T12:33:21.508520+0000","last_fullsized":"2024-04-26T12:33:21.508520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510909+0000","last_change":"2024-04-26T12:30:10.514358+0000","last_active":"2024-04-26T12:32:28.510909+0000","last_peered":"2024-04-26T12:32:28.510909+0000","last_clean":"2024-04-26T12:32:28.510909+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:32:28.510909+0000","last_undegraded":"2024-04-26T12:32:28.510909+0000","last_fullsized":"2024-04-26T12:32:28.510909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538183+0000","last_change":"2024-04-26T12:30:12.496055+0000","last_active":"2024-04-26T12:33:21.538183+0000","last_peered":"2024-04-26T12:33:21.538183+0000","last_clean":"2024-04-26T12:33:21.538183+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:33:21.538183+0000","last_undegraded":"2024-04-26T12:33:21.538183+0000","last_fullsized":"2024-04-26T12:33:21.538183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510961+0000","last_change":"2024-04-26T12:30:10.507296+0000","last_active":"2024-04-26T12:32:28.510961+0000","last_peered":"2024-04-26T12:32:28.510961+0000","last_clean":"2024-04-26T12:32:28.510961+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:32:28.510961+0000","last_undegraded":"2024-04-26T12:32:28.510961+0000","last_fullsized":"2024-04-26T12:32:28.510961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.254826+0000","last_change":"2024-04-26T12:30:12.494305+0000","last_active":"2024-04-26T12:33:21.254826+0000","last_peered":"2024-04-26T12:33:21.254826+0000","last_clean":"2024-04-26T12:33:21.254826+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:33:21.254826+0000","last_undegraded":"2024-04-26T12:33:21.254826+0000","last_fullsized":"2024-04-26T12:33:21.254826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511600+0000","last_change":"2024-04-26T12:30:10.523912+0000","last_active":"2024-04-26T12:32:28.511600+0000","last_peered":"2024-04-26T12:32:28.511600+0000","last_clean":"2024-04-26T12:32:28.511600+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:32:28.511600+0000","last_undegraded":"2024-04-26T12:32:28.511600+0000","last_fullsized":"2024-04-26T12:32:28.511600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.582979+0000","last_change":"2024-04-26T12:30:12.497891+0000","last_active":"2024-04-26T12:33:21.582979+0000","last_peered":"2024-04-26T12:33:21.582979+0000","last_clean":"2024-04-26T12:33:21.582979+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:33:21.582979+0000","last_undegraded":"2024-04-26T12:33:21.582979+0000","last_fullsized":"2024-04-26T12:33:21.582979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511624+0000","last_change":"2024-04-26T12:30:10.523924+0000","last_active":"2024-04-26T12:32:28.511624+0000","last_peered":"2024-04-26T12:32:28.511624+0000","last_clean":"2024-04-26T12:32:28.511624+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:32:28.511624+0000","last_undegraded":"2024-04-26T12:32:28.511624+0000","last_fullsized":"2024-04-26T12:32:28.511624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511532+0000","last_change":"2024-04-26T12:30:12.498180+0000","last_active":"2024-04-26T12:32:28.511532+0000","last_peered":"2024-04-26T12:32:28.511532+0000","last_clean":"2024-04-26T12:32:28.511532+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:32:28.511532+0000","last_undegraded":"2024-04-26T12:32:28.511532+0000","last_fullsized":"2024-04-26T12:32:28.511532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.504344+0000","last_change":"2024-04-26T12:30:10.501961+0000","last_active":"2024-04-26T12:32:32.504344+0000","last_peered":"2024-04-26T12:32:32.504344+0000","last_clean":"2024-04-26T12:32:32.504344+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:32:32.504344+0000","last_undegraded":"2024-04-26T12:32:32.504344+0000","last_fullsized":"2024-04-26T12:32:32.504344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.253832+0000","last_change":"2024-04-26T12:30:12.493588+0000","last_active":"2024-04-26T12:33:21.253832+0000","last_peered":"2024-04-26T12:33:21.253832+0000","last_clean":"2024-04-26T12:33:21.253832+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:33:21.253832+0000","last_undegraded":"2024-04-26T12:33:21.253832+0000","last_fullsized":"2024-04-26T12:33:21.253832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512496+0000","last_change":"2024-04-26T12:30:10.513455+0000","last_active":"2024-04-26T12:32:33.512496+0000","last_peered":"2024-04-26T12:32:33.512496+0000","last_clean":"2024-04-26T12:32:33.512496+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:32:33.512496+0000","last_undegraded":"2024-04-26T12:32:33.512496+0000","last_fullsized":"2024-04-26T12:32:33.512496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.452707+0000","last_change":"2024-04-26T12:30:10.520879+0000","last_active":"2024-04-26T12:33:21.452707+0000","last_peered":"2024-04-26T12:33:21.452707+0000","last_clean":"2024-04-26T12:33:21.452707+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:33:21.452707+0000","last_undegraded":"2024-04-26T12:33:21.452707+0000","last_fullsized":"2024-04-26T12:33:21.452707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538186+0000","last_change":"2024-04-26T12:30:12.500495+0000","last_active":"2024-04-26T12:33:21.538186+0000","last_peered":"2024-04-26T12:33:21.538186+0000","last_clean":"2024-04-26T12:33:21.538186+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:21.538186+0000","last_undegraded":"2024-04-26T12:33:21.538186+0000","last_fullsized":"2024-04-26T12:33:21.538186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.500285+0000","last_change":"2024-04-26T12:30:10.505951+0000","last_active":"2024-04-26T12:32:32.500285+0000","last_peered":"2024-04-26T12:32:32.500285+0000","last_clean":"2024-04-26T12:32:32.500285+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:32:32.500285+0000","last_undegraded":"2024-04-26T12:32:32.500285+0000","last_fullsized":"2024-04-26T12:32:32.500285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341712+0000","last_change":"2024-04-26T12:30:12.498902+0000","last_active":"2024-04-26T12:33:21.341712+0000","last_peered":"2024-04-26T12:33:21.341712+0000","last_clean":"2024-04-26T12:33:21.341712+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:21.341712+0000","last_undegraded":"2024-04-26T12:33:21.341712+0000","last_fullsized":"2024-04-26T12:33:21.341712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1493,"ondisk_log_size":1493,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":145189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":735472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705714,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":734135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":430080,"data_stored":145178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:33:53.020 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.020 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.020 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.020 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.020 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.020 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.020 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.021 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.022 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.023 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.024 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.025 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.026 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.027 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.028 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.028 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.028 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.028 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.028 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.028 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.028 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:29:53.417591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.029 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.030 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.031 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.032 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.033 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.034 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.035 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.036 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T12:30:15.487499+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.037 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.038 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-26T12:30:17.496639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.039 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.040 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.041 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.042 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.043 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:53.043 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:34:13.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:34:13.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.151+0000 7fe5dceba640 1 Processor -- start 2024-04-26T12:34:13.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.151+0000 7fe5dceba640 1 -- start start 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5dceba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5d8091b50 0x7fe5d8091f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5dceba640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d80928f0 con 0x7fe5d8092470 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5dceba640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d8092d40 con 0x7fe5d8091b50 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5d659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5d8091b50 0x7fe5d8091f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5d5d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe5d8092470 0x7fe5d812e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47500/0 (socket says 172.21.15.132:47500) 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5d5d9b640 1 -- 172.21.15.132:0/963742527 learned_addr learned my addr 172.21.15.132:0/963742527 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5d659c640 1 -- 172.21.15.132:0/963742527 >> v1:172.21.15.132:6789/0 conn(0x7fe5d8092470 legacy=0x7fe5d812e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5d559a640 1 -- 172.21.15.132:0/963742527 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884808330 0 0) 0x7fe5d80928f0 con 0x7fe5d8092470 2024-04-26T12:34:13.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.152+0000 7fe5d659c640 1 -- 172.21.15.132:0/963742527 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d806e120 con 0x7fe5d8091b50 2024-04-26T12:34:13.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.153+0000 7fe5d659c640 1 --2- 172.21.15.132:0/963742527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8091f30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009d90 tx=0x7fe5d002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f9164ea66d549a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.153+0000 7fe5d559a640 1 -- 172.21.15.132:0/963742527 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5d0039070 con 0x7fe5d8091b50 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.153+0000 7fe5d559a640 1 -- 172.21.15.132:0/963742527 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d002cbb0 con 0x7fe5d8091b50 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.153+0000 7fe5d559a640 1 -- 172.21.15.132:0/963742527 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5d0034440 con 0x7fe5d8091b50 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.154+0000 7fe5dceba640 1 -- 172.21.15.132:0/963742527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 msgr2=0x7fe5d8091f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.154+0000 7fe5dceba640 1 --2- 172.21.15.132:0/963742527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8091f30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009d90 tx=0x7fe5d002bf50 comp rx=0 tx=0).stop 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.154+0000 7fe5dceba640 1 -- 172.21.15.132:0/963742527 shutdown_connections 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.154+0000 7fe5dceba640 1 --2- 172.21.15.132:0/963742527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8091f30 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.154+0000 7fe5dceba640 1 -- 172.21.15.132:0/963742527 >> 172.21.15.132:0/963742527 conn(0x7fe5d809fdd0 msgr2=0x7fe5d80a01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.154+0000 7fe5dceba640 1 -- 172.21.15.132:0/963742527 shutdown_connections 2024-04-26T12:34:13.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.154+0000 7fe5dceba640 1 -- 172.21.15.132:0/963742527 wait complete. 2024-04-26T12:34:13.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.155+0000 7fe5dceba640 1 Processor -- start 2024-04-26T12:34:13.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.155+0000 7fe5dceba640 1 -- start start 2024-04-26T12:34:13.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.155+0000 7fe5dceba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:13.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.155+0000 7fe5dceba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d812ed10 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.155+0000 7fe5d659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.155+0000 7fe5d659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37390/0 (socket says 172.21.15.132:37390) 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.155+0000 7fe5d659c640 1 -- 172.21.15.132:0/248420619 learned_addr learned my addr 172.21.15.132:0/248420619 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.156+0000 7fe5d659c640 1 -- 172.21.15.132:0/248420619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d8095780 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.156+0000 7fe5d659c640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8071680 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0037040 tx=0x7fe5d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.156+0000 7fe5c6ffd640 1 -- 172.21.15.132:0/248420619 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5d0044030 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.156+0000 7fe5c6ffd640 1 -- 172.21.15.132:0/248420619 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d003f470 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.156+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d8072f40 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.156+0000 7fe5c6ffd640 1 -- 172.21.15.132:0/248420619 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5d0039040 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.156+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d8095ab0 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.157+0000 7fe5c6ffd640 1 -- 172.21.15.132:0/248420619 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe5d0047070 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.157+0000 7fe5c6ffd640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5b8038060 0x7fe5b803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.157+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d806c890 con 0x7fe5d8091b50 2024-04-26T12:34:13.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.157+0000 7fe5c6ffd640 1 -- 172.21.15.132:0/248420619 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fe5d0045070 con 0x7fe5d8091b50 2024-04-26T12:34:13.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.158+0000 7fe5d5d9b640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5b8038060 0x7fe5b803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:13.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.158+0000 7fe5d5d9b640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5b8038060 0x7fe5b803a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000c00 tx=0x7fe5cc007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:13.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.162+0000 7fe5c6ffd640 1 -- 172.21.15.132:0/248420619 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe5d806c890 con 0x7fe5d8091b50 2024-04-26T12:34:13.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.333+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5d8072800 con 0x7fe5b8038060 2024-04-26T12:34:13.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.348+0000 7fe5c6ffd640 1 -- 172.21.15.132:0/248420619 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661686 (secure 0 0 0) 0x7fe5d8072800 con 0x7fe5b8038060 2024-04-26T12:34:13.356 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:34:13.361 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.352+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5b8038060 msgr2=0x7fe5b803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.352+0000 7fe5dceba640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5b8038060 0x7fe5b803a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000c00 tx=0x7fe5cc007970 comp rx=0 tx=0).stop 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.352+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 msgr2=0x7fe5d8071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.352+0000 7fe5dceba640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8071680 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0037040 tx=0x7fe5d0004a40 comp rx=0 tx=0).stop 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.353+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 shutdown_connections 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.353+0000 7fe5dceba640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fe5b8038060 0x7fe5b803a520 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.353+0000 7fe5dceba640 1 --2- 172.21.15.132:0/248420619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5d8091b50 0x7fe5d8071680 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:13.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.353+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 >> 172.21.15.132:0/248420619 conn(0x7fe5d809fdd0 msgr2=0x7fe5d8127e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:34:13.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.353+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 shutdown_connections 2024-04-26T12:34:13.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:13.353+0000 7fe5dceba640 1 -- 172.21.15.132:0/248420619 wait complete. 2024-04-26T12:34:13.366 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-04-26T12:34:12.501419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5095,"num_read_kb":4676,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4781,"ondisk_log_size":4781,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123384,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377363976,"statfs":{"total":386547056640,"available":386420711424,"internally_reserved":0,"allocated":2908160,"data_stored":1759974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003873"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.288414+0000","last_change":"2024-04-26T12:33:58.288439+0000","last_active":"2024-04-26T12:33:58.288414+0000","last_peered":"2024-04-26T12:33:58.288414+0000","last_clean":"2024-04-26T12:33:58.288414+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:33:58.288414+0000","last_undegraded":"2024-04-26T12:33:58.288414+0000","last_fullsized":"2024-04-26T12:33:58.288414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.288321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:54.223162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.854100+0000","last_change":"2024-04-26T12:33:52.854126+0000","last_active":"2024-04-26T12:33:52.854100+0000","last_peered":"2024-04-26T12:33:52.854100+0000","last_clean":"2024-04-26T12:33:52.854100+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:33:52.854100+0000","last_undegraded":"2024-04-26T12:33:52.854100+0000","last_fullsized":"2024-04-26T12:33:52.854100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.854008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:48.175623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497970+0000","last_change":"2024-04-26T12:30:10.489909+0000","last_active":"2024-04-26T12:32:17.497970+0000","last_peered":"2024-04-26T12:32:17.497970+0000","last_clean":"2024-04-26T12:32:17.497970+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:32:17.497970+0000","last_undegraded":"2024-04-26T12:32:17.497970+0000","last_fullsized":"2024-04-26T12:32:17.497970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'17","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.583013+0000","last_change":"2024-04-26T12:30:12.484427+0000","last_active":"2024-04-26T12:33:21.583013+0000","last_peered":"2024-04-26T12:33:21.583013+0000","last_clean":"2024-04-26T12:33:21.583013+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:33:21.583013+0000","last_undegraded":"2024-04-26T12:33:21.583013+0000","last_fullsized":"2024-04-26T12:33:21.583013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.449872+0000","last_change":"2024-04-26T12:30:10.524821+0000","last_active":"2024-04-26T12:33:21.449872+0000","last_peered":"2024-04-26T12:33:21.449872+0000","last_clean":"2024-04-26T12:33:21.449872+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:33:21.449872+0000","last_undegraded":"2024-04-26T12:33:21.449872+0000","last_fullsized":"2024-04-26T12:33:21.449872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.669824+0000","last_change":"2024-04-26T12:34:06.669871+0000","last_active":"2024-04-26T12:34:06.669824+0000","last_peered":"2024-04-26T12:34:06.669824+0000","last_clean":"2024-04-26T12:34:06.669824+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:34:06.669824+0000","last_undegraded":"2024-04-26T12:34:06.669824+0000","last_fullsized":"2024-04-26T12:34:06.669824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.669725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:33.570963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.501186+0000","last_change":"2024-04-26T12:30:10.501461+0000","last_active":"2024-04-26T12:32:12.501186+0000","last_peered":"2024-04-26T12:32:12.501186+0000","last_clean":"2024-04-26T12:32:12.501186+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:32:12.501186+0000","last_undegraded":"2024-04-26T12:32:12.501186+0000","last_fullsized":"2024-04-26T12:32:12.501186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514076+0000","last_change":"2024-04-26T12:30:12.489894+0000","last_active":"2024-04-26T12:32:43.514076+0000","last_peered":"2024-04-26T12:32:43.514076+0000","last_clean":"2024-04-26T12:32:43.514076+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:32:43.514076+0000","last_undegraded":"2024-04-26T12:32:43.514076+0000","last_fullsized":"2024-04-26T12:32:43.514076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514057+0000","last_change":"2024-04-26T12:30:10.521268+0000","last_active":"2024-04-26T12:32:43.514057+0000","last_peered":"2024-04-26T12:32:43.514057+0000","last_clean":"2024-04-26T12:32:43.514057+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:32:43.514057+0000","last_undegraded":"2024-04-26T12:32:43.514057+0000","last_fullsized":"2024-04-26T12:32:43.514057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538239+0000","last_change":"2024-04-26T12:30:12.497804+0000","last_active":"2024-04-26T12:33:21.538239+0000","last_peered":"2024-04-26T12:33:21.538239+0000","last_clean":"2024-04-26T12:33:21.538239+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:33:21.538239+0000","last_undegraded":"2024-04-26T12:33:21.538239+0000","last_fullsized":"2024-04-26T12:33:21.538239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.230538+0000","last_change":"2024-04-26T12:34:06.230563+0000","last_active":"2024-04-26T12:34:06.230538+0000","last_peered":"2024-04-26T12:34:06.230538+0000","last_clean":"2024-04-26T12:34:06.230538+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:34:06.230538+0000","last_undegraded":"2024-04-26T12:34:06.230538+0000","last_fullsized":"2024-04-26T12:34:06.230538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.230442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:31.999710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538669+0000","last_change":"2024-04-26T12:30:49.554267+0000","last_active":"2024-04-26T12:33:21.538669+0000","last_peered":"2024-04-26T12:33:21.538669+0000","last_clean":"2024-04-26T12:33:21.538669+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:33:21.538669+0000","last_undegraded":"2024-04-26T12:33:21.538669+0000","last_fullsized":"2024-04-26T12:33:21.538669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115857+0000","last_change":"2024-04-26T12:30:10.519048+0000","last_active":"2024-04-26T12:33:28.115857+0000","last_peered":"2024-04-26T12:33:28.115857+0000","last_clean":"2024-04-26T12:33:28.115857+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:33:28.115857+0000","last_undegraded":"2024-04-26T12:33:28.115857+0000","last_fullsized":"2024-04-26T12:33:28.115857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.332571+0000","last_change":"2024-04-26T12:33:54.332600+0000","last_active":"2024-04-26T12:33:54.332571+0000","last_peered":"2024-04-26T12:33:54.332571+0000","last_clean":"2024-04-26T12:33:54.332571+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:33:54.332571+0000","last_undegraded":"2024-04-26T12:33:54.332571+0000","last_fullsized":"2024-04-26T12:33:54.332571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.332483+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:46.075405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.501858+0000","last_change":"2024-04-26T12:30:10.505714+0000","last_active":"2024-04-26T12:32:42.501858+0000","last_peered":"2024-04-26T12:32:42.501858+0000","last_clean":"2024-04-26T12:32:42.501858+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:32:42.501858+0000","last_undegraded":"2024-04-26T12:32:42.501858+0000","last_fullsized":"2024-04-26T12:32:42.501858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.336392+0000","last_change":"2024-04-26T12:33:59.336420+0000","last_active":"2024-04-26T12:33:59.336392+0000","last_peered":"2024-04-26T12:33:59.336392+0000","last_clean":"2024-04-26T12:33:59.336392+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:59.336392+0000","last_undegraded":"2024-04-26T12:33:59.336392+0000","last_fullsized":"2024-04-26T12:33:59.336392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.336298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:16.786139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.470456+0000","last_change":"2024-04-26T12:30:12.480460+0000","last_active":"2024-04-26T12:33:21.470456+0000","last_peered":"2024-04-26T12:33:21.470456+0000","last_clean":"2024-04-26T12:33:21.470456+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:33:21.470456+0000","last_undegraded":"2024-04-26T12:33:21.470456+0000","last_fullsized":"2024-04-26T12:33:21.470456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512921+0000","last_change":"2024-04-26T12:30:10.514263+0000","last_active":"2024-04-26T12:32:38.512921+0000","last_peered":"2024-04-26T12:32:38.512921+0000","last_clean":"2024-04-26T12:32:38.512921+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:32:38.512921+0000","last_undegraded":"2024-04-26T12:32:38.512921+0000","last_fullsized":"2024-04-26T12:32:38.512921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.778945+0000","last_change":"2024-04-26T12:33:54.778997+0000","last_active":"2024-04-26T12:33:54.778945+0000","last_peered":"2024-04-26T12:33:54.778945+0000","last_clean":"2024-04-26T12:33:54.778945+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:54.778945+0000","last_undegraded":"2024-04-26T12:33:54.778945+0000","last_fullsized":"2024-04-26T12:33:54.778945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.778831+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:42.906362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505253+0000","last_change":"2024-04-26T12:30:10.503403+0000","last_active":"2024-04-26T12:32:37.505253+0000","last_peered":"2024-04-26T12:32:37.505253+0000","last_clean":"2024-04-26T12:32:37.505253+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:32:37.505253+0000","last_undegraded":"2024-04-26T12:32:37.505253+0000","last_fullsized":"2024-04-26T12:32:37.505253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538674+0000","last_change":"2024-04-26T12:30:12.497749+0000","last_active":"2024-04-26T12:33:21.538674+0000","last_peered":"2024-04-26T12:33:21.538674+0000","last_clean":"2024-04-26T12:33:21.538674+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:33:21.538674+0000","last_undegraded":"2024-04-26T12:33:21.538674+0000","last_fullsized":"2024-04-26T12:33:21.538674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512833+0000","last_change":"2024-04-26T12:30:10.514510+0000","last_active":"2024-04-26T12:32:38.512833+0000","last_peered":"2024-04-26T12:32:38.512833+0000","last_clean":"2024-04-26T12:32:38.512833+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:32:38.512833+0000","last_undegraded":"2024-04-26T12:32:38.512833+0000","last_fullsized":"2024-04-26T12:32:38.512833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.536881+0000","last_change":"2024-04-26T12:34:06.536925+0000","last_active":"2024-04-26T12:34:06.536881+0000","last_peered":"2024-04-26T12:34:06.536881+0000","last_clean":"2024-04-26T12:34:06.536881+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:34:06.536881+0000","last_undegraded":"2024-04-26T12:34:06.536881+0000","last_fullsized":"2024-04-26T12:34:06.536881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.536779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:33.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.212009+0000","last_change":"2024-04-26T12:30:10.513694+0000","last_active":"2024-04-26T12:33:21.212009+0000","last_peered":"2024-04-26T12:33:21.212009+0000","last_clean":"2024-04-26T12:33:21.212009+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:33:21.212009+0000","last_undegraded":"2024-04-26T12:33:21.212009+0000","last_fullsized":"2024-04-26T12:33:21.212009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.360082+0000","last_change":"2024-04-26T12:34:03.360141+0000","last_active":"2024-04-26T12:34:03.360082+0000","last_peered":"2024-04-26T12:34:03.360082+0000","last_clean":"2024-04-26T12:34:03.360082+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:34:03.360082+0000","last_undegraded":"2024-04-26T12:34:03.360082+0000","last_fullsized":"2024-04-26T12:34:03.360082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.359974+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:04.442738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.455478+0000","last_change":"2024-04-26T12:30:10.499600+0000","last_active":"2024-04-26T12:33:21.455478+0000","last_peered":"2024-04-26T12:33:21.455478+0000","last_clean":"2024-04-26T12:33:21.455478+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:33:21.455478+0000","last_undegraded":"2024-04-26T12:33:21.455478+0000","last_fullsized":"2024-04-26T12:33:21.455478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512857+0000","last_change":"2024-04-26T12:30:12.496161+0000","last_active":"2024-04-26T12:32:38.512857+0000","last_peered":"2024-04-26T12:32:38.512857+0000","last_clean":"2024-04-26T12:32:38.512857+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:32:38.512857+0000","last_undegraded":"2024-04-26T12:32:38.512857+0000","last_fullsized":"2024-04-26T12:32:38.512857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115742+0000","last_change":"2024-04-26T12:30:10.516884+0000","last_active":"2024-04-26T12:33:28.115742+0000","last_peered":"2024-04-26T12:33:28.115742+0000","last_clean":"2024-04-26T12:33:28.115742+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:33:28.115742+0000","last_undegraded":"2024-04-26T12:33:28.115742+0000","last_fullsized":"2024-04-26T12:33:28.115742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.546057+0000","last_change":"2024-04-26T12:30:20.535283+0000","last_active":"2024-04-26T12:33:21.546057+0000","last_peered":"2024-04-26T12:33:21.546057+0000","last_clean":"2024-04-26T12:33:21.546057+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:33:21.546057+0000","last_undegraded":"2024-04-26T12:33:21.546057+0000","last_fullsized":"2024-04-26T12:33:21.546057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512418+0000","last_change":"2024-04-26T12:30:12.490640+0000","last_active":"2024-04-26T12:32:33.512418+0000","last_peered":"2024-04-26T12:32:33.512418+0000","last_clean":"2024-04-26T12:32:33.512418+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:32:33.512418+0000","last_undegraded":"2024-04-26T12:32:33.512418+0000","last_fullsized":"2024-04-26T12:32:33.512418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512382+0000","last_change":"2024-04-26T12:30:10.524372+0000","last_active":"2024-04-26T12:32:33.512382+0000","last_peered":"2024-04-26T12:32:33.512382+0000","last_clean":"2024-04-26T12:32:33.512382+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:32:33.512382+0000","last_undegraded":"2024-04-26T12:32:33.512382+0000","last_fullsized":"2024-04-26T12:32:33.512382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.036531+0000","last_change":"2024-04-26T12:33:39.036552+0000","last_active":"2024-04-26T12:33:39.036531+0000","last_peered":"2024-04-26T12:33:39.036531+0000","last_clean":"2024-04-26T12:33:39.036531+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:33:39.036531+0000","last_undegraded":"2024-04-26T12:33:39.036531+0000","last_fullsized":"2024-04-26T12:33:39.036531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.036437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:05.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.757268+0000","last_change":"2024-04-26T12:34:00.757313+0000","last_active":"2024-04-26T12:34:00.757268+0000","last_peered":"2024-04-26T12:34:00.757268+0000","last_clean":"2024-04-26T12:34:00.757268+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:34:00.757268+0000","last_undegraded":"2024-04-26T12:34:00.757268+0000","last_fullsized":"2024-04-26T12:34:00.757268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.757183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:25.221766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.860386+0000","last_change":"2024-04-26T12:33:47.860428+0000","last_active":"2024-04-26T12:33:47.860386+0000","last_peered":"2024-04-26T12:33:47.860386+0000","last_clean":"2024-04-26T12:33:47.860386+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:33:47.860386+0000","last_undegraded":"2024-04-26T12:33:47.860386+0000","last_fullsized":"2024-04-26T12:33:47.860386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.860284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:42.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.819119+0000","last_change":"2024-04-26T12:33:55.819147+0000","last_active":"2024-04-26T12:33:55.819119+0000","last_peered":"2024-04-26T12:33:55.819119+0000","last_clean":"2024-04-26T12:33:55.819119+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:33:55.819119+0000","last_undegraded":"2024-04-26T12:33:55.819119+0000","last_fullsized":"2024-04-26T12:33:55.819119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.819023+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:12.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538199+0000","last_change":"2024-04-26T12:30:12.491732+0000","last_active":"2024-04-26T12:33:21.538199+0000","last_peered":"2024-04-26T12:33:21.538199+0000","last_clean":"2024-04-26T12:33:21.538199+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:33:21.538199+0000","last_undegraded":"2024-04-26T12:33:21.538199+0000","last_fullsized":"2024-04-26T12:33:21.538199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.313982+0000","last_change":"2024-04-26T12:34:04.314012+0000","last_active":"2024-04-26T12:34:04.313982+0000","last_peered":"2024-04-26T12:34:04.313982+0000","last_clean":"2024-04-26T12:34:04.313982+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:34:04.313982+0000","last_undegraded":"2024-04-26T12:34:04.313982+0000","last_fullsized":"2024-04-26T12:34:04.313982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.313892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:49.817325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.582666+0000","last_change":"2024-04-26T12:33:51.582709+0000","last_active":"2024-04-26T12:33:51.582666+0000","last_peered":"2024-04-26T12:33:51.582666+0000","last_clean":"2024-04-26T12:33:51.582666+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:33:51.582666+0000","last_undegraded":"2024-04-26T12:33:51.582666+0000","last_fullsized":"2024-04-26T12:33:51.582666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.582551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:26.718562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.884196+0000","last_change":"2024-04-26T12:33:37.884246+0000","last_active":"2024-04-26T12:33:37.884196+0000","last_peered":"2024-04-26T12:33:37.884196+0000","last_clean":"2024-04-26T12:33:37.884196+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:33:37.884196+0000","last_undegraded":"2024-04-26T12:33:37.884196+0000","last_fullsized":"2024-04-26T12:33:37.884196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.884093+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:49.682928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.859025+0000","last_change":"2024-04-26T12:33:39.859050+0000","last_active":"2024-04-26T12:33:39.859025+0000","last_peered":"2024-04-26T12:33:39.859025+0000","last_clean":"2024-04-26T12:33:39.859025+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:33:39.859025+0000","last_undegraded":"2024-04-26T12:33:39.859025+0000","last_fullsized":"2024-04-26T12:33:39.859025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.858931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:37.129358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.503278+0000","last_change":"2024-04-26T12:30:20.523683+0000","last_active":"2024-04-26T12:32:52.503278+0000","last_peered":"2024-04-26T12:32:52.503278+0000","last_clean":"2024-04-26T12:32:52.503278+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:32:52.503278+0000","last_undegraded":"2024-04-26T12:32:52.503278+0000","last_fullsized":"2024-04-26T12:32:52.503278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.253867+0000","last_change":"2024-04-26T12:30:49.694875+0000","last_active":"2024-04-26T12:33:21.253867+0000","last_peered":"2024-04-26T12:33:21.253867+0000","last_clean":"2024-04-26T12:33:21.253867+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:33:21.253867+0000","last_undegraded":"2024-04-26T12:33:21.253867+0000","last_fullsized":"2024-04-26T12:33:21.253867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512308+0000","last_change":"2024-04-26T12:30:10.523616+0000","last_active":"2024-04-26T12:32:33.512308+0000","last_peered":"2024-04-26T12:32:33.512308+0000","last_clean":"2024-04-26T12:32:33.512308+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:32:33.512308+0000","last_undegraded":"2024-04-26T12:32:33.512308+0000","last_fullsized":"2024-04-26T12:32:33.512308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.457300+0000","last_change":"2024-04-26T12:33:46.457327+0000","last_active":"2024-04-26T12:33:46.457300+0000","last_peered":"2024-04-26T12:33:46.457300+0000","last_clean":"2024-04-26T12:33:46.457300+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:33:46.457300+0000","last_undegraded":"2024-04-26T12:33:46.457300+0000","last_fullsized":"2024-04-26T12:33:46.457300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.457219+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:47.671663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.342694+0000","last_change":"2024-04-26T12:33:38.342730+0000","last_active":"2024-04-26T12:33:38.342694+0000","last_peered":"2024-04-26T12:33:38.342694+0000","last_clean":"2024-04-26T12:33:38.342694+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:33:38.342694+0000","last_undegraded":"2024-04-26T12:33:38.342694+0000","last_fullsized":"2024-04-26T12:33:38.342694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.342608+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:02.654541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":394,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.668123+0000","last_change":"2024-04-26T12:34:07.668165+0000","last_active":"2024-04-26T12:34:07.668123+0000","last_peered":"2024-04-26T12:34:07.668123+0000","last_clean":"2024-04-26T12:34:07.668123+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:34:07.668123+0000","last_undegraded":"2024-04-26T12:34:07.668123+0000","last_fullsized":"2024-04-26T12:34:07.668123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.667991+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:57.252635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.506986+0000","last_change":"2024-04-26T12:30:20.528257+0000","last_active":"2024-04-26T12:32:52.506986+0000","last_peered":"2024-04-26T12:32:52.506986+0000","last_clean":"2024-04-26T12:32:52.506986+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:32:52.506986+0000","last_undegraded":"2024-04-26T12:32:52.506986+0000","last_fullsized":"2024-04-26T12:32:52.506986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.639814+0000","last_change":"2024-04-26T12:33:59.639842+0000","last_active":"2024-04-26T12:33:59.639814+0000","last_peered":"2024-04-26T12:33:59.639814+0000","last_clean":"2024-04-26T12:33:59.639814+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:33:59.639814+0000","last_undegraded":"2024-04-26T12:33:59.639814+0000","last_fullsized":"2024-04-26T12:33:59.639814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.639717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:28.819645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511878+0000","last_change":"2024-04-26T12:30:10.512902+0000","last_active":"2024-04-26T12:32:33.511878+0000","last_peered":"2024-04-26T12:32:33.511878+0000","last_clean":"2024-04-26T12:32:33.511878+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:32:33.511878+0000","last_undegraded":"2024-04-26T12:32:33.511878+0000","last_fullsized":"2024-04-26T12:32:33.511878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.942879+0000","last_change":"2024-04-26T12:33:33.942913+0000","last_active":"2024-04-26T12:33:33.942879+0000","last_peered":"2024-04-26T12:33:33.942879+0000","last_clean":"2024-04-26T12:33:33.942879+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:33:33.942879+0000","last_undegraded":"2024-04-26T12:33:33.942879+0000","last_fullsized":"2024-04-26T12:33:33.942879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.942777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:36.777412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.337516+0000","last_change":"2024-04-26T12:33:39.337566+0000","last_active":"2024-04-26T12:33:39.337516+0000","last_peered":"2024-04-26T12:33:39.337516+0000","last_clean":"2024-04-26T12:33:39.337516+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:33:39.337516+0000","last_undegraded":"2024-04-26T12:33:39.337516+0000","last_fullsized":"2024-04-26T12:33:39.337516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.337430+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:45.269245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.466047+0000","last_change":"2024-04-26T12:33:37.466107+0000","last_active":"2024-04-26T12:33:37.466047+0000","last_peered":"2024-04-26T12:33:37.466047+0000","last_clean":"2024-04-26T12:33:37.466047+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:37.466047+0000","last_undegraded":"2024-04-26T12:33:37.466047+0000","last_fullsized":"2024-04-26T12:33:37.466047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.465931+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510716+0000","last_change":"2024-04-26T12:30:12.493252+0000","last_active":"2024-04-26T12:32:23.510716+0000","last_peered":"2024-04-26T12:32:23.510716+0000","last_clean":"2024-04-26T12:32:23.510716+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:32:23.510716+0000","last_undegraded":"2024-04-26T12:32:23.510716+0000","last_fullsized":"2024-04-26T12:32:23.510716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.373042+0000","last_change":"2024-04-26T12:34:00.373086+0000","last_active":"2024-04-26T12:34:00.373042+0000","last_peered":"2024-04-26T12:34:00.373042+0000","last_clean":"2024-04-26T12:34:00.373042+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:34:00.373042+0000","last_undegraded":"2024-04-26T12:34:00.373042+0000","last_fullsized":"2024-04-26T12:34:00.373042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.372929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:27.486437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.872556+0000","last_change":"2024-04-26T12:33:46.872579+0000","last_active":"2024-04-26T12:33:46.872556+0000","last_peered":"2024-04-26T12:33:46.872556+0000","last_clean":"2024-04-26T12:33:46.872556+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:33:46.872556+0000","last_undegraded":"2024-04-26T12:33:46.872556+0000","last_fullsized":"2024-04-26T12:33:46.872556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.872459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:20.085162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'54","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.341024+0000","last_change":"2024-04-26T12:33:40.341067+0000","last_active":"2024-04-26T12:33:40.341024+0000","last_peered":"2024-04-26T12:33:40.341024+0000","last_clean":"2024-04-26T12:33:40.341024+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:33:40.341024+0000","last_undegraded":"2024-04-26T12:33:40.341024+0000","last_fullsized":"2024-04-26T12:33:40.341024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.340927+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:00.228500+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.457485+0000","last_change":"2024-04-26T12:33:34.457526+0000","last_active":"2024-04-26T12:33:34.457485+0000","last_peered":"2024-04-26T12:33:34.457485+0000","last_clean":"2024-04-26T12:33:34.457485+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:33:34.457485+0000","last_undegraded":"2024-04-26T12:33:34.457485+0000","last_fullsized":"2024-04-26T12:33:34.457485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.457383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:18.910969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503541+0000","last_change":"2024-04-26T12:30:20.529100+0000","last_active":"2024-04-26T12:32:27.503541+0000","last_peered":"2024-04-26T12:32:27.503541+0000","last_clean":"2024-04-26T12:32:27.503541+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:32:27.503541+0000","last_undegraded":"2024-04-26T12:32:27.503541+0000","last_fullsized":"2024-04-26T12:32:27.503541+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.791124+0000","last_change":"2024-04-26T12:34:05.791149+0000","last_active":"2024-04-26T12:34:05.791124+0000","last_peered":"2024-04-26T12:34:05.791124+0000","last_clean":"2024-04-26T12:34:05.791124+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:34:05.791124+0000","last_undegraded":"2024-04-26T12:34:05.791124+0000","last_fullsized":"2024-04-26T12:34:05.791124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.791018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:41.156216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503590+0000","last_change":"2024-04-26T12:30:10.501359+0000","last_active":"2024-04-26T12:32:27.503590+0000","last_peered":"2024-04-26T12:32:27.503590+0000","last_clean":"2024-04-26T12:32:27.503590+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:32:27.503590+0000","last_undegraded":"2024-04-26T12:32:27.503590+0000","last_fullsized":"2024-04-26T12:32:27.503590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.534447+0000","last_change":"2024-04-26T12:33:50.534500+0000","last_active":"2024-04-26T12:33:50.534447+0000","last_peered":"2024-04-26T12:33:50.534447+0000","last_clean":"2024-04-26T12:33:50.534447+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:33:50.534447+0000","last_undegraded":"2024-04-26T12:33:50.534447+0000","last_fullsized":"2024-04-26T12:33:50.534447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.534336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:36.444391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'40","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.724217+0000","last_change":"2024-04-26T12:34:02.724251+0000","last_active":"2024-04-26T12:34:02.724217+0000","last_peered":"2024-04-26T12:34:02.724217+0000","last_clean":"2024-04-26T12:34:02.724217+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:34:02.724217+0000","last_undegraded":"2024-04-26T12:34:02.724217+0000","last_fullsized":"2024-04-26T12:34:02.724217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.724129+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.917634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.451858+0000","last_change":"2024-04-26T12:33:36.451884+0000","last_active":"2024-04-26T12:33:36.451858+0000","last_peered":"2024-04-26T12:33:36.451858+0000","last_clean":"2024-04-26T12:33:36.451858+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:33:36.451858+0000","last_undegraded":"2024-04-26T12:33:36.451858+0000","last_fullsized":"2024-04-26T12:33:36.451858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.451767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:45.412706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'5","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511057+0000","last_change":"2024-04-26T12:30:20.531982+0000","last_active":"2024-04-26T12:32:28.511057+0000","last_peered":"2024-04-26T12:32:28.511057+0000","last_clean":"2024-04-26T12:32:28.511057+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:32:28.511057+0000","last_undegraded":"2024-04-26T12:32:28.511057+0000","last_fullsized":"2024-04-26T12:32:28.511057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.334417+0000","last_change":"2024-04-26T12:34:01.334451+0000","last_active":"2024-04-26T12:34:01.334417+0000","last_peered":"2024-04-26T12:34:01.334417+0000","last_clean":"2024-04-26T12:34:01.334417+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:34:01.334417+0000","last_undegraded":"2024-04-26T12:34:01.334417+0000","last_fullsized":"2024-04-26T12:34:01.334417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.334329+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:19.047133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115731+0000","last_change":"2024-04-26T12:30:10.524374+0000","last_active":"2024-04-26T12:33:28.115731+0000","last_peered":"2024-04-26T12:33:28.115731+0000","last_clean":"2024-04-26T12:33:28.115731+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:33:28.115731+0000","last_undegraded":"2024-04-26T12:33:28.115731+0000","last_fullsized":"2024-04-26T12:33:28.115731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.471002+0000","last_change":"2024-04-26T12:33:47.471028+0000","last_active":"2024-04-26T12:33:47.471002+0000","last_peered":"2024-04-26T12:33:47.471002+0000","last_clean":"2024-04-26T12:33:47.471002+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:33:47.471002+0000","last_undegraded":"2024-04-26T12:33:47.471002+0000","last_fullsized":"2024-04-26T12:33:47.471002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.470897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:56.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.902395+0000","last_change":"2024-04-26T12:33:51.902471+0000","last_active":"2024-04-26T12:33:51.902395+0000","last_peered":"2024-04-26T12:33:51.902395+0000","last_clean":"2024-04-26T12:33:51.902395+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:33:51.902395+0000","last_undegraded":"2024-04-26T12:33:51.902395+0000","last_fullsized":"2024-04-26T12:33:51.902395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.902291+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:22.459245+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.490354+0000","last_change":"2024-04-26T12:33:48.490381+0000","last_active":"2024-04-26T12:33:48.490354+0000","last_peered":"2024-04-26T12:33:48.490354+0000","last_clean":"2024-04-26T12:33:48.490354+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:48.490354+0000","last_undegraded":"2024-04-26T12:33:48.490354+0000","last_fullsized":"2024-04-26T12:33:48.490354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.490266+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:44.425107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.500397+0000","last_change":"2024-04-26T12:30:20.531457+0000","last_active":"2024-04-26T12:32:32.500397+0000","last_peered":"2024-04-26T12:32:32.500397+0000","last_clean":"2024-04-26T12:32:32.500397+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:32:32.500397+0000","last_undegraded":"2024-04-26T12:32:32.500397+0000","last_fullsized":"2024-04-26T12:32:32.500397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503529+0000","last_change":"2024-04-26T12:30:12.490458+0000","last_active":"2024-04-26T12:32:27.503529+0000","last_peered":"2024-04-26T12:32:27.503529+0000","last_clean":"2024-04-26T12:32:27.503529+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:32:27.503529+0000","last_undegraded":"2024-04-26T12:32:27.503529+0000","last_fullsized":"2024-04-26T12:32:27.503529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511585+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:32:28.511585+0000","last_peered":"2024-04-26T12:32:28.511585+0000","last_clean":"2024-04-26T12:32:28.511585+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:32:28.511585+0000","last_undegraded":"2024-04-26T12:32:28.511585+0000","last_fullsized":"2024-04-26T12:32:28.511585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:02.508325+0000","last_change":"2024-04-26T12:30:49.553037+0000","last_active":"2024-04-26T12:33:02.508325+0000","last_peered":"2024-04-26T12:33:02.508325+0000","last_clean":"2024-04-26T12:33:02.508325+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:33:02.508325+0000","last_undegraded":"2024-04-26T12:33:02.508325+0000","last_fullsized":"2024-04-26T12:33:02.508325+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.025608+0000","last_change":"2024-04-26T12:33:46.025645+0000","last_active":"2024-04-26T12:33:46.025608+0000","last_peered":"2024-04-26T12:33:46.025608+0000","last_clean":"2024-04-26T12:33:46.025608+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:33:46.025608+0000","last_undegraded":"2024-04-26T12:33:46.025608+0000","last_fullsized":"2024-04-26T12:33:46.025608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.025519+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:28.207080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.486173+0000","last_change":"2024-04-26T12:33:32.486192+0000","last_active":"2024-04-26T12:33:32.486173+0000","last_peered":"2024-04-26T12:33:32.486173+0000","last_clean":"2024-04-26T12:33:32.486173+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:33:32.486173+0000","last_undegraded":"2024-04-26T12:33:32.486173+0000","last_fullsized":"2024-04-26T12:33:32.486173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.486110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:19.318546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.625115+0000","last_change":"2024-04-26T12:34:00.625149+0000","last_active":"2024-04-26T12:34:00.625115+0000","last_peered":"2024-04-26T12:34:00.625115+0000","last_clean":"2024-04-26T12:34:00.625115+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:34:00.625115+0000","last_undegraded":"2024-04-26T12:34:00.625115+0000","last_fullsized":"2024-04-26T12:34:00.625115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.625009+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.384957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.852380+0000","last_change":"2024-04-26T12:33:56.852418+0000","last_active":"2024-04-26T12:33:56.852380+0000","last_peered":"2024-04-26T12:33:56.852380+0000","last_clean":"2024-04-26T12:33:56.852380+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:33:56.852380+0000","last_undegraded":"2024-04-26T12:33:56.852380+0000","last_fullsized":"2024-04-26T12:33:56.852380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.852284+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.300655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499489+0000","last_change":"2024-04-26T12:30:10.499408+0000","last_active":"2024-04-26T12:32:27.499489+0000","last_peered":"2024-04-26T12:32:27.499489+0000","last_clean":"2024-04-26T12:32:27.499489+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:32:27.499489+0000","last_undegraded":"2024-04-26T12:32:27.499489+0000","last_fullsized":"2024-04-26T12:32:27.499489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.377168+0000","last_change":"2024-04-26T12:33:52.377200+0000","last_active":"2024-04-26T12:33:52.377168+0000","last_peered":"2024-04-26T12:33:52.377168+0000","last_clean":"2024-04-26T12:33:52.377168+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:33:52.377168+0000","last_undegraded":"2024-04-26T12:33:52.377168+0000","last_fullsized":"2024-04-26T12:33:52.377168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.377072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:20.049145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.870529+0000","last_change":"2024-04-26T12:33:40.870573+0000","last_active":"2024-04-26T12:33:40.870529+0000","last_peered":"2024-04-26T12:33:40.870529+0000","last_clean":"2024-04-26T12:33:40.870529+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:33:40.870529+0000","last_undegraded":"2024-04-26T12:33:40.870529+0000","last_fullsized":"2024-04-26T12:33:40.870529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.870443+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:06.471328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.854614+0000","last_change":"2024-04-26T12:33:53.854635+0000","last_active":"2024-04-26T12:33:53.854614+0000","last_peered":"2024-04-26T12:33:53.854614+0000","last_clean":"2024-04-26T12:33:53.854614+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:33:53.854614+0000","last_undegraded":"2024-04-26T12:33:53.854614+0000","last_fullsized":"2024-04-26T12:33:53.854614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.854523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:51.983807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.586800+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:33:21.586800+0000","last_peered":"2024-04-26T12:33:21.586800+0000","last_clean":"2024-04-26T12:33:21.586800+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:33:21.586800+0000","last_undegraded":"2024-04-26T12:33:21.586800+0000","last_fullsized":"2024-04-26T12:33:21.586800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.957299+0000","last_change":"2024-04-26T12:33:48.957328+0000","last_active":"2024-04-26T12:33:48.957299+0000","last_peered":"2024-04-26T12:33:48.957299+0000","last_clean":"2024-04-26T12:33:48.957299+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:33:48.957299+0000","last_undegraded":"2024-04-26T12:33:48.957299+0000","last_fullsized":"2024-04-26T12:33:48.957299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.957209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:19.960752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.529454+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:21.529454+0000","last_peered":"2024-04-26T12:33:21.529454+0000","last_clean":"2024-04-26T12:33:21.529454+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:21.529454+0000","last_undegraded":"2024-04-26T12:33:21.529454+0000","last_fullsized":"2024-04-26T12:33:21.529454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.485557+0000","last_change":"2024-04-26T12:33:49.485594+0000","last_active":"2024-04-26T12:33:49.485557+0000","last_peered":"2024-04-26T12:33:49.485557+0000","last_clean":"2024-04-26T12:33:49.485557+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:33:49.485557+0000","last_undegraded":"2024-04-26T12:33:49.485557+0000","last_fullsized":"2024-04-26T12:33:49.485557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.485434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.630769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.335357+0000","last_change":"2024-04-26T12:33:43.335394+0000","last_active":"2024-04-26T12:33:43.335357+0000","last_peered":"2024-04-26T12:33:43.335357+0000","last_clean":"2024-04-26T12:33:43.335357+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:33:43.335357+0000","last_undegraded":"2024-04-26T12:33:43.335357+0000","last_fullsized":"2024-04-26T12:33:43.335357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.335257+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:44.822905+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":421,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.325088+0000","last_change":"2024-04-26T12:33:41.325114+0000","last_active":"2024-04-26T12:33:41.325088+0000","last_peered":"2024-04-26T12:33:41.325088+0000","last_clean":"2024-04-26T12:33:41.325088+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:41.325088+0000","last_undegraded":"2024-04-26T12:33:41.325088+0000","last_fullsized":"2024-04-26T12:33:41.325088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.325000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:42.600411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.588369+0000","last_change":"2024-04-26T12:30:20.523809+0000","last_active":"2024-04-26T12:33:21.588369+0000","last_peered":"2024-04-26T12:33:21.588369+0000","last_clean":"2024-04-26T12:33:21.588369+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:33:21.588369+0000","last_undegraded":"2024-04-26T12:33:21.588369+0000","last_fullsized":"2024-04-26T12:33:21.588369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.271796+0000","last_change":"2024-04-26T12:34:05.271830+0000","last_active":"2024-04-26T12:34:05.271796+0000","last_peered":"2024-04-26T12:34:05.271796+0000","last_clean":"2024-04-26T12:34:05.271796+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:34:05.271796+0000","last_undegraded":"2024-04-26T12:34:05.271796+0000","last_fullsized":"2024-04-26T12:34:05.271796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.271706+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:10.784909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510760+0000","last_change":"2024-04-26T12:30:10.524444+0000","last_active":"2024-04-26T12:32:23.510760+0000","last_peered":"2024-04-26T12:32:23.510760+0000","last_clean":"2024-04-26T12:32:23.510760+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:32:23.510760+0000","last_undegraded":"2024-04-26T12:32:23.510760+0000","last_fullsized":"2024-04-26T12:32:23.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.919470+0000","last_change":"2024-04-26T12:33:41.919526+0000","last_active":"2024-04-26T12:33:41.919470+0000","last_peered":"2024-04-26T12:33:41.919470+0000","last_clean":"2024-04-26T12:33:41.919470+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:33:41.919470+0000","last_undegraded":"2024-04-26T12:33:41.919470+0000","last_fullsized":"2024-04-26T12:33:41.919470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.919360+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:08.145030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.033598+0000","last_change":"2024-04-26T12:33:38.033639+0000","last_active":"2024-04-26T12:33:38.033598+0000","last_peered":"2024-04-26T12:33:38.033598+0000","last_clean":"2024-04-26T12:33:38.033598+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:33:38.033598+0000","last_undegraded":"2024-04-26T12:33:38.033598+0000","last_fullsized":"2024-04-26T12:33:38.033598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.033508+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:09.947838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":511,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.012770+0000","last_change":"2024-04-26T12:33:33.012799+0000","last_active":"2024-04-26T12:33:33.012770+0000","last_peered":"2024-04-26T12:33:33.012770+0000","last_clean":"2024-04-26T12:33:33.012770+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:33.012770+0000","last_undegraded":"2024-04-26T12:33:33.012770+0000","last_fullsized":"2024-04-26T12:33:33.012770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.012673+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.693315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.329838+0000","last_change":"2024-04-26T12:33:53.329889+0000","last_active":"2024-04-26T12:33:53.329838+0000","last_peered":"2024-04-26T12:33:53.329838+0000","last_clean":"2024-04-26T12:33:53.329838+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:53.329838+0000","last_undegraded":"2024-04-26T12:33:53.329838+0000","last_fullsized":"2024-04-26T12:33:53.329838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.329710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:13.585776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'18","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.835018+0000","last_change":"2024-04-26T12:33:57.835053+0000","last_active":"2024-04-26T12:33:57.835018+0000","last_peered":"2024-04-26T12:33:57.835018+0000","last_clean":"2024-04-26T12:33:57.835018+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:57.835018+0000","last_undegraded":"2024-04-26T12:33:57.835018+0000","last_fullsized":"2024-04-26T12:33:57.835018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.834902+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:31.144768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510696+0000","last_change":"2024-04-26T12:30:10.521698+0000","last_active":"2024-04-26T12:32:23.510696+0000","last_peered":"2024-04-26T12:32:23.510696+0000","last_clean":"2024-04-26T12:32:23.510696+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:32:23.510696+0000","last_undegraded":"2024-04-26T12:32:23.510696+0000","last_fullsized":"2024-04-26T12:32:23.510696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.972942+0000","last_change":"2024-04-26T12:33:32.972968+0000","last_active":"2024-04-26T12:33:32.972942+0000","last_peered":"2024-04-26T12:33:32.972942+0000","last_clean":"2024-04-26T12:33:32.972942+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:33:32.972942+0000","last_undegraded":"2024-04-26T12:33:32.972942+0000","last_fullsized":"2024-04-26T12:33:32.972942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.972836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:10.206586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.924883+0000","last_change":"2024-04-26T12:33:36.924967+0000","last_active":"2024-04-26T12:33:36.924883+0000","last_peered":"2024-04-26T12:33:36.924883+0000","last_clean":"2024-04-26T12:33:36.924883+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:33:36.924883+0000","last_undegraded":"2024-04-26T12:33:36.924883+0000","last_fullsized":"2024-04-26T12:33:36.924883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.924772+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:29.763584+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.358794+0000","last_change":"2024-04-26T12:33:37.358839+0000","last_active":"2024-04-26T12:33:37.358794+0000","last_peered":"2024-04-26T12:33:37.358794+0000","last_clean":"2024-04-26T12:33:37.358794+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:33:37.358794+0000","last_undegraded":"2024-04-26T12:33:37.358794+0000","last_fullsized":"2024-04-26T12:33:37.358794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.358703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:07.891090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.830420+0000","last_change":"2024-04-26T12:33:51.830448+0000","last_active":"2024-04-26T12:33:51.830420+0000","last_peered":"2024-04-26T12:33:51.830420+0000","last_clean":"2024-04-26T12:33:51.830420+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:51.830420+0000","last_undegraded":"2024-04-26T12:33:51.830420+0000","last_fullsized":"2024-04-26T12:33:51.830420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.830335+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:23.254930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.916284+0000","last_change":"2024-04-26T12:33:49.916310+0000","last_active":"2024-04-26T12:33:49.916284+0000","last_peered":"2024-04-26T12:33:49.916284+0000","last_clean":"2024-04-26T12:33:49.916284+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:49.916284+0000","last_undegraded":"2024-04-26T12:33:49.916284+0000","last_fullsized":"2024-04-26T12:33:49.916284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.916195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:02.556981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:31.417719+0000","last_change":"2024-04-26T12:29:54.462135+0000","last_active":"2024-04-26T12:33:31.417719+0000","last_peered":"2024-04-26T12:33:31.417719+0000","last_clean":"2024-04-26T12:33:31.417719+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:33:31.417719+0000","last_undegraded":"2024-04-26T12:33:31.417719+0000","last_fullsized":"2024-04-26T12:33:31.417719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:29:53.417591+0000","last_clean_scrub_stamp":"2024-04-26T12:29:53.417591+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:08.508582+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:32:08.508582+0000","last_peered":"2024-04-26T12:32:08.508582+0000","last_clean":"2024-04-26T12:32:08.508582+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:32:08.508582+0000","last_undegraded":"2024-04-26T12:32:08.508582+0000","last_fullsized":"2024-04-26T12:32:08.508582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.510019+0000","last_change":"2024-04-26T12:30:10.518603+0000","last_active":"2024-04-26T12:32:18.510019+0000","last_peered":"2024-04-26T12:32:18.510019+0000","last_clean":"2024-04-26T12:32:18.510019+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:32:18.510019+0000","last_undegraded":"2024-04-26T12:32:18.510019+0000","last_fullsized":"2024-04-26T12:32:18.510019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.891556+0000","last_change":"2024-04-26T12:33:45.891610+0000","last_active":"2024-04-26T12:33:45.891556+0000","last_peered":"2024-04-26T12:33:45.891556+0000","last_clean":"2024-04-26T12:33:45.891556+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:33:45.891556+0000","last_undegraded":"2024-04-26T12:33:45.891556+0000","last_fullsized":"2024-04-26T12:33:45.891556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.891453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:38.825131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.748539+0000","last_change":"2024-04-26T12:34:04.748578+0000","last_active":"2024-04-26T12:34:04.748539+0000","last_peered":"2024-04-26T12:34:04.748539+0000","last_clean":"2024-04-26T12:34:04.748539+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:34:04.748539+0000","last_undegraded":"2024-04-26T12:34:04.748539+0000","last_fullsized":"2024-04-26T12:34:04.748539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.748449+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:37.997307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.459707+0000","last_change":"2024-04-26T12:33:44.459732+0000","last_active":"2024-04-26T12:33:44.459707+0000","last_peered":"2024-04-26T12:33:44.459707+0000","last_clean":"2024-04-26T12:33:44.459707+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:33:44.459707+0000","last_undegraded":"2024-04-26T12:33:44.459707+0000","last_fullsized":"2024-04-26T12:33:44.459707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.459618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:37.847661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.385577+0000","last_change":"2024-04-26T12:33:49.385606+0000","last_active":"2024-04-26T12:33:49.385577+0000","last_peered":"2024-04-26T12:33:49.385577+0000","last_clean":"2024-04-26T12:33:49.385577+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:49.385577+0000","last_undegraded":"2024-04-26T12:33:49.385577+0000","last_fullsized":"2024-04-26T12:33:49.385577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.385474+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:25.473005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510933+0000","last_change":"2024-04-26T12:30:12.488875+0000","last_active":"2024-04-26T12:32:23.510933+0000","last_peered":"2024-04-26T12:32:23.510933+0000","last_clean":"2024-04-26T12:32:23.510933+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:32:23.510933+0000","last_undegraded":"2024-04-26T12:32:23.510933+0000","last_fullsized":"2024-04-26T12:32:23.510933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269409+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:33:32.269409+0000","last_peered":"2024-04-26T12:33:32.269409+0000","last_clean":"2024-04-26T12:33:32.269409+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:33:32.269409+0000","last_undegraded":"2024-04-26T12:33:32.269409+0000","last_fullsized":"2024-04-26T12:33:32.269409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497845+0000","last_change":"2024-04-26T12:30:10.488700+0000","last_active":"2024-04-26T12:32:17.497845+0000","last_peered":"2024-04-26T12:32:17.497845+0000","last_clean":"2024-04-26T12:32:17.497845+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:32:17.497845+0000","last_undegraded":"2024-04-26T12:32:17.497845+0000","last_fullsized":"2024-04-26T12:32:17.497845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.990319+0000","last_change":"2024-04-26T12:33:34.990341+0000","last_active":"2024-04-26T12:33:34.990319+0000","last_peered":"2024-04-26T12:33:34.990319+0000","last_clean":"2024-04-26T12:33:34.990319+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:33:34.990319+0000","last_undegraded":"2024-04-26T12:33:34.990319+0000","last_fullsized":"2024-04-26T12:33:34.990319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.990216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:51.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":515,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.968229+0000","last_change":"2024-04-26T12:33:34.968276+0000","last_active":"2024-04-26T12:33:34.968229+0000","last_peered":"2024-04-26T12:33:34.968229+0000","last_clean":"2024-04-26T12:33:34.968229+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:34.968229+0000","last_undegraded":"2024-04-26T12:33:34.968229+0000","last_fullsized":"2024-04-26T12:33:34.968229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.968125+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:55.925235+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.757721+0000","last_change":"2024-04-26T12:34:03.757744+0000","last_active":"2024-04-26T12:34:03.757721+0000","last_peered":"2024-04-26T12:34:03.757721+0000","last_clean":"2024-04-26T12:34:03.757721+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:34:03.757721+0000","last_undegraded":"2024-04-26T12:34:03.757721+0000","last_fullsized":"2024-04-26T12:34:03.757721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.757597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:19.314316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511929+0000","last_change":"2024-04-26T12:30:20.532161+0000","last_active":"2024-04-26T12:32:33.511929+0000","last_peered":"2024-04-26T12:32:33.511929+0000","last_clean":"2024-04-26T12:32:33.511929+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:32:33.511929+0000","last_undegraded":"2024-04-26T12:32:33.511929+0000","last_fullsized":"2024-04-26T12:32:33.511929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'32","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.678106+0000","last_change":"2024-04-26T12:33:58.678134+0000","last_active":"2024-04-26T12:33:58.678106+0000","last_peered":"2024-04-26T12:33:58.678106+0000","last_clean":"2024-04-26T12:33:58.678106+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:33:58.678106+0000","last_undegraded":"2024-04-26T12:33:58.678106+0000","last_fullsized":"2024-04-26T12:33:58.678106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.678019+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:17.835330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:07.500599+0000","last_change":"2024-04-26T12:30:01.441281+0000","last_active":"2024-04-26T12:32:07.500599+0000","last_peered":"2024-04-26T12:32:07.500599+0000","last_clean":"2024-04-26T12:32:07.500599+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:32:07.500599+0000","last_undegraded":"2024-04-26T12:32:07.500599+0000","last_fullsized":"2024-04-26T12:32:07.500599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.497015+0000","last_change":"2024-04-26T12:30:10.489913+0000","last_active":"2024-04-26T12:32:12.497015+0000","last_peered":"2024-04-26T12:32:12.497015+0000","last_clean":"2024-04-26T12:32:12.497015+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:32:12.497015+0000","last_undegraded":"2024-04-26T12:32:12.497015+0000","last_fullsized":"2024-04-26T12:32:12.497015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.355115+0000","last_change":"2024-04-26T12:33:47.355150+0000","last_active":"2024-04-26T12:33:47.355115+0000","last_peered":"2024-04-26T12:33:47.355115+0000","last_clean":"2024-04-26T12:33:47.355115+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:33:47.355115+0000","last_undegraded":"2024-04-26T12:33:47.355115+0000","last_fullsized":"2024-04-26T12:33:47.355115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.355025+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:37.323218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.293748+0000","last_change":"2024-04-26T12:33:44.293799+0000","last_active":"2024-04-26T12:33:44.293748+0000","last_peered":"2024-04-26T12:33:44.293748+0000","last_clean":"2024-04-26T12:33:44.293748+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:44.293748+0000","last_undegraded":"2024-04-26T12:33:44.293748+0000","last_fullsized":"2024-04-26T12:33:44.293748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.293656+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:52.328074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.614593+0000","last_change":"2024-04-26T12:33:56.614615+0000","last_active":"2024-04-26T12:33:56.614593+0000","last_peered":"2024-04-26T12:33:56.614593+0000","last_clean":"2024-04-26T12:33:56.614593+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:33:56.614593+0000","last_undegraded":"2024-04-26T12:33:56.614593+0000","last_fullsized":"2024-04-26T12:33:56.614593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.614468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:09.789955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.513148+0000","last_change":"2024-04-26T12:30:20.531432+0000","last_active":"2024-04-26T12:32:38.513148+0000","last_peered":"2024-04-26T12:32:38.513148+0000","last_clean":"2024-04-26T12:32:38.513148+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:32:38.513148+0000","last_undegraded":"2024-04-26T12:32:38.513148+0000","last_fullsized":"2024-04-26T12:32:38.513148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497937+0000","last_change":"2024-04-26T12:30:12.489234+0000","last_active":"2024-04-26T12:32:17.497937+0000","last_peered":"2024-04-26T12:32:17.497937+0000","last_clean":"2024-04-26T12:32:17.497937+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:32:17.497937+0000","last_undegraded":"2024-04-26T12:32:17.497937+0000","last_fullsized":"2024-04-26T12:32:17.497937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:08.508533+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:32:08.508533+0000","last_peered":"2024-04-26T12:32:08.508533+0000","last_clean":"2024-04-26T12:32:08.508533+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:32:08.508533+0000","last_undegraded":"2024-04-26T12:32:08.508533+0000","last_fullsized":"2024-04-26T12:32:08.508533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.117425+0000","last_change":"2024-04-26T12:30:10.500548+0000","last_active":"2024-04-26T12:33:28.117425+0000","last_peered":"2024-04-26T12:33:28.117425+0000","last_clean":"2024-04-26T12:33:28.117425+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:33:28.117425+0000","last_undegraded":"2024-04-26T12:33:28.117425+0000","last_fullsized":"2024-04-26T12:33:28.117425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.628349+0000","last_change":"2024-04-26T12:33:54.628392+0000","last_active":"2024-04-26T12:33:54.628349+0000","last_peered":"2024-04-26T12:33:54.628349+0000","last_clean":"2024-04-26T12:33:54.628349+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:33:54.628349+0000","last_undegraded":"2024-04-26T12:33:54.628349+0000","last_fullsized":"2024-04-26T12:33:54.628349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.628252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:07.053904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.999843+0000","last_change":"2024-04-26T12:33:47.999880+0000","last_active":"2024-04-26T12:33:47.999843+0000","last_peered":"2024-04-26T12:33:47.999843+0000","last_clean":"2024-04-26T12:33:47.999843+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:47.999843+0000","last_undegraded":"2024-04-26T12:33:47.999843+0000","last_fullsized":"2024-04-26T12:33:47.999843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.999755+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:40.140297+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.813198+0000","last_change":"2024-04-26T12:33:55.813237+0000","last_active":"2024-04-26T12:33:55.813198+0000","last_peered":"2024-04-26T12:33:55.813198+0000","last_clean":"2024-04-26T12:33:55.813198+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:33:55.813198+0000","last_undegraded":"2024-04-26T12:33:55.813198+0000","last_fullsized":"2024-04-26T12:33:55.813198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.813058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:32.755533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511815+0000","last_change":"2024-04-26T12:30:20.535350+0000","last_active":"2024-04-26T12:32:33.511815+0000","last_peered":"2024-04-26T12:32:33.511815+0000","last_clean":"2024-04-26T12:32:33.511815+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:32:33.511815+0000","last_undegraded":"2024-04-26T12:32:33.511815+0000","last_fullsized":"2024-04-26T12:32:33.511815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.819507+0000","last_change":"2024-04-26T12:34:03.819534+0000","last_active":"2024-04-26T12:34:03.819507+0000","last_peered":"2024-04-26T12:34:03.819507+0000","last_clean":"2024-04-26T12:34:03.819507+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:34:03.819507+0000","last_undegraded":"2024-04-26T12:34:03.819507+0000","last_fullsized":"2024-04-26T12:34:03.819507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.819412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:28.268336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.501889+0000","last_change":"2024-04-26T12:30:10.502077+0000","last_active":"2024-04-26T12:32:17.501889+0000","last_peered":"2024-04-26T12:32:17.501889+0000","last_clean":"2024-04-26T12:32:17.501889+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:32:17.501889+0000","last_undegraded":"2024-04-26T12:32:17.501889+0000","last_fullsized":"2024-04-26T12:32:17.501889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:07.496449+0000","last_change":"2024-04-26T12:30:01.440031+0000","last_active":"2024-04-26T12:32:07.496449+0000","last_peered":"2024-04-26T12:32:07.496449+0000","last_clean":"2024-04-26T12:32:07.496449+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:32:07.496449+0000","last_undegraded":"2024-04-26T12:32:07.496449+0000","last_fullsized":"2024-04-26T12:32:07.496449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.586787+0000","last_change":"2024-04-26T12:33:53.586839+0000","last_active":"2024-04-26T12:33:53.586787+0000","last_peered":"2024-04-26T12:33:53.586787+0000","last_clean":"2024-04-26T12:33:53.586787+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:33:53.586787+0000","last_undegraded":"2024-04-26T12:33:53.586787+0000","last_fullsized":"2024-04-26T12:33:53.586787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.586700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:09.928615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.434146+0000","last_change":"2024-04-26T12:33:39.434204+0000","last_active":"2024-04-26T12:33:39.434146+0000","last_peered":"2024-04-26T12:33:39.434146+0000","last_clean":"2024-04-26T12:33:39.434146+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:33:39.434146+0000","last_undegraded":"2024-04-26T12:33:39.434146+0000","last_fullsized":"2024-04-26T12:33:39.434146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.434024+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:15.521556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.280568+0000","last_change":"2024-04-26T12:33:32.280612+0000","last_active":"2024-04-26T12:33:32.280568+0000","last_peered":"2024-04-26T12:33:32.280568+0000","last_clean":"2024-04-26T12:33:32.280568+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:33:32.280568+0000","last_undegraded":"2024-04-26T12:33:32.280568+0000","last_fullsized":"2024-04-26T12:33:32.280568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.280461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:13.869333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.501146+0000","last_change":"2024-04-26T12:30:20.527189+0000","last_active":"2024-04-26T12:32:37.501146+0000","last_peered":"2024-04-26T12:32:37.501146+0000","last_clean":"2024-04-26T12:32:37.501146+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:32:37.501146+0000","last_undegraded":"2024-04-26T12:32:37.501146+0000","last_fullsized":"2024-04-26T12:32:37.501146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.773213+0000","last_change":"2024-04-26T12:34:02.773240+0000","last_active":"2024-04-26T12:34:02.773213+0000","last_peered":"2024-04-26T12:34:02.773213+0000","last_clean":"2024-04-26T12:34:02.773213+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:34:02.773213+0000","last_undegraded":"2024-04-26T12:34:02.773213+0000","last_fullsized":"2024-04-26T12:34:02.773213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.773121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:07.596283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497924+0000","last_change":"2024-04-26T12:30:10.499533+0000","last_active":"2024-04-26T12:32:17.497924+0000","last_peered":"2024-04-26T12:32:17.497924+0000","last_clean":"2024-04-26T12:32:17.497924+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:32:17.497924+0000","last_undegraded":"2024-04-26T12:32:17.497924+0000","last_fullsized":"2024-04-26T12:32:17.497924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:08.508615+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:32:08.508615+0000","last_peered":"2024-04-26T12:32:08.508615+0000","last_clean":"2024-04-26T12:32:08.508615+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:32:08.508615+0000","last_undegraded":"2024-04-26T12:32:08.508615+0000","last_fullsized":"2024-04-26T12:32:08.508615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.509985+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:32:18.509985+0000","last_peered":"2024-04-26T12:32:18.509985+0000","last_clean":"2024-04-26T12:32:18.509985+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:32:18.509985+0000","last_undegraded":"2024-04-26T12:32:18.509985+0000","last_fullsized":"2024-04-26T12:32:18.509985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.971644+0000","last_change":"2024-04-26T12:33:33.971703+0000","last_active":"2024-04-26T12:33:33.971644+0000","last_peered":"2024-04-26T12:33:33.971644+0000","last_clean":"2024-04-26T12:33:33.971644+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:33:33.971644+0000","last_undegraded":"2024-04-26T12:33:33.971644+0000","last_fullsized":"2024-04-26T12:33:33.971644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.971556+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:47.263739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":358,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.935834+0000","last_change":"2024-04-26T12:33:35.935865+0000","last_active":"2024-04-26T12:33:35.935834+0000","last_peered":"2024-04-26T12:33:35.935834+0000","last_clean":"2024-04-26T12:33:35.935834+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:35.935834+0000","last_undegraded":"2024-04-26T12:33:35.935834+0000","last_fullsized":"2024-04-26T12:33:35.935834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.935727+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.443130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.513251+0000","last_change":"2024-04-26T12:30:20.530218+0000","last_active":"2024-04-26T12:32:38.513251+0000","last_peered":"2024-04-26T12:32:38.513251+0000","last_clean":"2024-04-26T12:32:38.513251+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:32:38.513251+0000","last_undegraded":"2024-04-26T12:32:38.513251+0000","last_fullsized":"2024-04-26T12:32:38.513251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.853041+0000","last_change":"2024-04-26T12:33:52.853067+0000","last_active":"2024-04-26T12:33:52.853041+0000","last_peered":"2024-04-26T12:33:52.853041+0000","last_clean":"2024-04-26T12:33:52.853041+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:52.853041+0000","last_undegraded":"2024-04-26T12:33:52.853041+0000","last_fullsized":"2024-04-26T12:33:52.853041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.852918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:03.508340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510976+0000","last_change":"2024-04-26T12:30:10.516983+0000","last_active":"2024-04-26T12:32:23.510976+0000","last_peered":"2024-04-26T12:32:23.510976+0000","last_clean":"2024-04-26T12:32:23.510976+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:32:23.510976+0000","last_undegraded":"2024-04-26T12:32:23.510976+0000","last_fullsized":"2024-04-26T12:32:23.510976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.497123+0000","last_change":"2024-04-26T12:30:01.440024+0000","last_active":"2024-04-26T12:32:12.497123+0000","last_peered":"2024-04-26T12:32:12.497123+0000","last_clean":"2024-04-26T12:32:12.497123+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:32:12.497123+0000","last_undegraded":"2024-04-26T12:32:12.497123+0000","last_fullsized":"2024-04-26T12:32:12.497123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.984606+0000","last_change":"2024-04-26T12:33:36.984631+0000","last_active":"2024-04-26T12:33:36.984606+0000","last_peered":"2024-04-26T12:33:36.984606+0000","last_clean":"2024-04-26T12:33:36.984606+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:33:36.984606+0000","last_undegraded":"2024-04-26T12:33:36.984606+0000","last_fullsized":"2024-04-26T12:33:36.984606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.984515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'17","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.768898+0000","last_change":"2024-04-26T12:34:01.768960+0000","last_active":"2024-04-26T12:34:01.768898+0000","last_peered":"2024-04-26T12:34:01.768898+0000","last_clean":"2024-04-26T12:34:01.768898+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:34:01.768898+0000","last_undegraded":"2024-04-26T12:34:01.768898+0000","last_fullsized":"2024-04-26T12:34:01.768898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.768788+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:00.147323+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.416634+0000","last_change":"2024-04-26T12:33:35.416673+0000","last_active":"2024-04-26T12:33:35.416634+0000","last_peered":"2024-04-26T12:33:35.416634+0000","last_clean":"2024-04-26T12:33:35.416634+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:35.416634+0000","last_undegraded":"2024-04-26T12:33:35.416634+0000","last_fullsized":"2024-04-26T12:33:35.416634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.416545+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.560676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512764+0000","last_change":"2024-04-26T12:30:20.532905+0000","last_active":"2024-04-26T12:32:38.512764+0000","last_peered":"2024-04-26T12:32:38.512764+0000","last_clean":"2024-04-26T12:32:38.512764+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:32:38.512764+0000","last_undegraded":"2024-04-26T12:32:38.512764+0000","last_fullsized":"2024-04-26T12:32:38.512764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.357461+0000","last_change":"2024-04-26T12:33:55.357489+0000","last_active":"2024-04-26T12:33:55.357461+0000","last_peered":"2024-04-26T12:33:55.357461+0000","last_clean":"2024-04-26T12:33:55.357461+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:55.357461+0000","last_undegraded":"2024-04-26T12:33:55.357461+0000","last_fullsized":"2024-04-26T12:33:55.357461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.357374+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:33.932712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.116123+0000","last_change":"2024-04-26T12:30:10.507125+0000","last_active":"2024-04-26T12:33:28.116123+0000","last_peered":"2024-04-26T12:33:28.116123+0000","last_clean":"2024-04-26T12:33:28.116123+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:33:28.116123+0000","last_undegraded":"2024-04-26T12:33:28.116123+0000","last_fullsized":"2024-04-26T12:33:28.116123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.509332+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:32:13.509332+0000","last_peered":"2024-04-26T12:32:13.509332+0000","last_clean":"2024-04-26T12:32:13.509332+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:32:13.509332+0000","last_undegraded":"2024-04-26T12:32:13.509332+0000","last_fullsized":"2024-04-26T12:32:13.509332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.054377+0000","last_change":"2024-04-26T12:33:42.054401+0000","last_active":"2024-04-26T12:33:42.054377+0000","last_peered":"2024-04-26T12:33:42.054377+0000","last_clean":"2024-04-26T12:33:42.054377+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:33:42.054377+0000","last_undegraded":"2024-04-26T12:33:42.054377+0000","last_fullsized":"2024-04-26T12:33:42.054377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.054238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:08.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'98","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.374582+0000","last_change":"2024-04-26T12:33:36.374652+0000","last_active":"2024-04-26T12:33:36.374582+0000","last_peered":"2024-04-26T12:33:36.374582+0000","last_clean":"2024-04-26T12:33:36.374582+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:33:36.374582+0000","last_undegraded":"2024-04-26T12:33:36.374582+0000","last_fullsized":"2024-04-26T12:33:36.374582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'98","last_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_deep_scrub":"32'98","last_deep_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.374477+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:44.404332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:31.509100+0000","last_change":"2024-04-26T12:33:31.509119+0000","last_active":"2024-04-26T12:33:31.509100+0000","last_peered":"2024-04-26T12:33:31.509100+0000","last_clean":"2024-04-26T12:33:31.509100+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:33:31.509100+0000","last_undegraded":"2024-04-26T12:33:31.509100+0000","last_fullsized":"2024-04-26T12:33:31.509100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_clean_scrub_stamp":"2024-04-26T12:33:31.509011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:04.640988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.535798+0000","last_change":"2024-04-26T12:30:20.530332+0000","last_active":"2024-04-26T12:33:21.535798+0000","last_peered":"2024-04-26T12:33:21.535798+0000","last_clean":"2024-04-26T12:33:21.535798+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:33:21.535798+0000","last_undegraded":"2024-04-26T12:33:21.535798+0000","last_fullsized":"2024-04-26T12:33:21.535798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.503618+0000","last_change":"2024-04-26T12:30:20.528129+0000","last_active":"2024-04-26T12:32:27.503618+0000","last_peered":"2024-04-26T12:32:27.503618+0000","last_clean":"2024-04-26T12:32:27.503618+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:32:27.503618+0000","last_undegraded":"2024-04-26T12:32:27.503618+0000","last_fullsized":"2024-04-26T12:32:27.503618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.308525+0000","last_change":"2024-04-26T12:33:56.308548+0000","last_active":"2024-04-26T12:33:56.308525+0000","last_peered":"2024-04-26T12:33:56.308525+0000","last_clean":"2024-04-26T12:33:56.308525+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:33:56.308525+0000","last_undegraded":"2024-04-26T12:33:56.308525+0000","last_fullsized":"2024-04-26T12:33:56.308525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.308437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:57.522881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.229966+0000","last_change":"2024-04-26T12:30:10.523769+0000","last_active":"2024-04-26T12:33:21.229966+0000","last_peered":"2024-04-26T12:33:21.229966+0000","last_clean":"2024-04-26T12:33:21.229966+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:33:21.229966+0000","last_undegraded":"2024-04-26T12:33:21.229966+0000","last_fullsized":"2024-04-26T12:33:21.229966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.934150+0000","last_change":"2024-04-26T12:33:44.934202+0000","last_active":"2024-04-26T12:33:44.934150+0000","last_peered":"2024-04-26T12:33:44.934150+0000","last_clean":"2024-04-26T12:33:44.934150+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:33:44.934150+0000","last_undegraded":"2024-04-26T12:33:44.934150+0000","last_fullsized":"2024-04-26T12:33:44.934150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.934050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:59.400029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.816928+0000","last_change":"2024-04-26T12:33:57.816962+0000","last_active":"2024-04-26T12:33:57.816928+0000","last_peered":"2024-04-26T12:33:57.816928+0000","last_clean":"2024-04-26T12:33:57.816928+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:33:57.816928+0000","last_undegraded":"2024-04-26T12:33:57.816928+0000","last_fullsized":"2024-04-26T12:33:57.816928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.816840+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:35.943755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.746321+0000","last_change":"2024-04-26T12:33:59.746343+0000","last_active":"2024-04-26T12:33:59.746321+0000","last_peered":"2024-04-26T12:33:59.746321+0000","last_clean":"2024-04-26T12:33:59.746321+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:33:59.746321+0000","last_undegraded":"2024-04-26T12:33:59.746321+0000","last_fullsized":"2024-04-26T12:33:59.746321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.746239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:32.070259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.498650+0000","last_change":"2024-04-26T12:30:20.528724+0000","last_active":"2024-04-26T12:32:22.498650+0000","last_peered":"2024-04-26T12:32:22.498650+0000","last_clean":"2024-04-26T12:32:22.498650+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:32:22.498650+0000","last_undegraded":"2024-04-26T12:32:22.498650+0000","last_fullsized":"2024-04-26T12:32:22.498650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511965+0000","last_change":"2024-04-26T12:30:49.555701+0000","last_active":"2024-04-26T12:32:33.511965+0000","last_peered":"2024-04-26T12:32:33.511965+0000","last_clean":"2024-04-26T12:32:33.511965+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:32:33.511965+0000","last_undegraded":"2024-04-26T12:32:33.511965+0000","last_fullsized":"2024-04-26T12:32:33.511965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505197+0000","last_change":"2024-04-26T12:30:10.502612+0000","last_active":"2024-04-26T12:32:37.505197+0000","last_peered":"2024-04-26T12:32:37.505197+0000","last_clean":"2024-04-26T12:32:37.505197+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:32:37.505197+0000","last_undegraded":"2024-04-26T12:32:37.505197+0000","last_fullsized":"2024-04-26T12:32:37.505197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.035342+0000","last_change":"2024-04-26T12:33:41.035367+0000","last_active":"2024-04-26T12:33:41.035342+0000","last_peered":"2024-04-26T12:33:41.035342+0000","last_clean":"2024-04-26T12:33:41.035342+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:33:41.035342+0000","last_undegraded":"2024-04-26T12:33:41.035342+0000","last_fullsized":"2024-04-26T12:33:41.035342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:28.509101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.437752+0000","last_change":"2024-04-26T12:33:45.437804+0000","last_active":"2024-04-26T12:33:45.437752+0000","last_peered":"2024-04-26T12:33:45.437752+0000","last_clean":"2024-04-26T12:33:45.437752+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:45.437752+0000","last_undegraded":"2024-04-26T12:33:45.437752+0000","last_fullsized":"2024-04-26T12:33:45.437752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.437634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:24.012972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.322288+0000","last_change":"2024-04-26T12:33:33.322319+0000","last_active":"2024-04-26T12:33:33.322288+0000","last_peered":"2024-04-26T12:33:33.322288+0000","last_clean":"2024-04-26T12:33:33.322288+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:33:33.322288+0000","last_undegraded":"2024-04-26T12:33:33.322288+0000","last_fullsized":"2024-04-26T12:33:33.322288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.322193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:33.954765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.467476+0000","last_change":"2024-04-26T12:30:20.531528+0000","last_active":"2024-04-26T12:33:21.467476+0000","last_peered":"2024-04-26T12:33:21.467476+0000","last_clean":"2024-04-26T12:33:21.467476+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:33:21.467476+0000","last_undegraded":"2024-04-26T12:33:21.467476+0000","last_fullsized":"2024-04-26T12:33:21.467476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.600351+0000","last_change":"2024-04-26T12:34:04.600423+0000","last_active":"2024-04-26T12:34:04.600351+0000","last_peered":"2024-04-26T12:34:04.600351+0000","last_clean":"2024-04-26T12:34:04.600351+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:34:04.600351+0000","last_undegraded":"2024-04-26T12:34:04.600351+0000","last_fullsized":"2024-04-26T12:34:04.600351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.600237+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:05.911708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.505238+0000","last_change":"2024-04-26T12:30:10.493462+0000","last_active":"2024-04-26T12:32:37.505238+0000","last_peered":"2024-04-26T12:32:37.505238+0000","last_clean":"2024-04-26T12:32:37.505238+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:32:37.505238+0000","last_undegraded":"2024-04-26T12:32:37.505238+0000","last_fullsized":"2024-04-26T12:32:37.505238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.384229+0000","last_change":"2024-04-26T12:33:50.384269+0000","last_active":"2024-04-26T12:33:50.384229+0000","last_peered":"2024-04-26T12:33:50.384229+0000","last_clean":"2024-04-26T12:33:50.384229+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:33:50.384229+0000","last_undegraded":"2024-04-26T12:33:50.384229+0000","last_fullsized":"2024-04-26T12:33:50.384229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.384133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:33.191713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.463439+0000","last_change":"2024-04-26T12:33:43.463495+0000","last_active":"2024-04-26T12:33:43.463439+0000","last_peered":"2024-04-26T12:33:43.463439+0000","last_clean":"2024-04-26T12:33:43.463439+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:43.463439+0000","last_undegraded":"2024-04-26T12:33:43.463439+0000","last_fullsized":"2024-04-26T12:33:43.463439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.463348+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:24.510661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.045474+0000","last_change":"2024-04-26T12:33:32.045522+0000","last_active":"2024-04-26T12:33:32.045474+0000","last_peered":"2024-04-26T12:33:32.045474+0000","last_clean":"2024-04-26T12:33:32.045474+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:33:32.045474+0000","last_undegraded":"2024-04-26T12:33:32.045474+0000","last_fullsized":"2024-04-26T12:33:32.045474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.045363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:44.273391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:53.515719+0000","last_change":"2024-04-26T12:30:20.524900+0000","last_active":"2024-04-26T12:32:53.515719+0000","last_peered":"2024-04-26T12:32:53.515719+0000","last_clean":"2024-04-26T12:32:53.515719+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:32:53.515719+0000","last_undegraded":"2024-04-26T12:32:53.515719+0000","last_fullsized":"2024-04-26T12:32:53.515719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.070835+0000","last_change":"2024-04-26T12:33:45.070862+0000","last_active":"2024-04-26T12:33:45.070835+0000","last_peered":"2024-04-26T12:33:45.070835+0000","last_clean":"2024-04-26T12:33:45.070835+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:45.070835+0000","last_undegraded":"2024-04-26T12:33:45.070835+0000","last_fullsized":"2024-04-26T12:33:45.070835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.070739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:40.944238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512901+0000","last_change":"2024-04-26T12:30:10.513562+0000","last_active":"2024-04-26T12:32:38.512901+0000","last_peered":"2024-04-26T12:32:38.512901+0000","last_clean":"2024-04-26T12:32:38.512901+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:32:38.512901+0000","last_undegraded":"2024-04-26T12:32:38.512901+0000","last_fullsized":"2024-04-26T12:32:38.512901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.064258+0000","last_change":"2024-04-26T12:33:43.064299+0000","last_active":"2024-04-26T12:33:43.064258+0000","last_peered":"2024-04-26T12:33:43.064258+0000","last_clean":"2024-04-26T12:33:43.064258+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:33:43.064258+0000","last_undegraded":"2024-04-26T12:33:43.064258+0000","last_fullsized":"2024-04-26T12:33:43.064258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.064153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:56.367388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.353452+0000","last_change":"2024-04-26T12:33:42.353487+0000","last_active":"2024-04-26T12:33:42.353452+0000","last_peered":"2024-04-26T12:33:42.353452+0000","last_clean":"2024-04-26T12:33:42.353452+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:33:42.353452+0000","last_undegraded":"2024-04-26T12:33:42.353452+0000","last_fullsized":"2024-04-26T12:33:42.353452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.353371+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:27.302471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.359118+0000","last_change":"2024-04-26T12:33:35.359140+0000","last_active":"2024-04-26T12:33:35.359118+0000","last_peered":"2024-04-26T12:33:35.359118+0000","last_clean":"2024-04-26T12:33:35.359118+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:33:35.359118+0000","last_undegraded":"2024-04-26T12:33:35.359118+0000","last_fullsized":"2024-04-26T12:33:35.359118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.359023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:00.812046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.510204+0000","last_change":"2024-04-26T12:30:12.490077+0000","last_active":"2024-04-26T12:32:18.510204+0000","last_peered":"2024-04-26T12:32:18.510204+0000","last_clean":"2024-04-26T12:32:18.510204+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:32:18.510204+0000","last_undegraded":"2024-04-26T12:32:18.510204+0000","last_fullsized":"2024-04-26T12:32:18.510204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.513019+0000","last_change":"2024-04-26T12:30:10.523507+0000","last_active":"2024-04-26T12:32:38.513019+0000","last_peered":"2024-04-26T12:32:38.513019+0000","last_clean":"2024-04-26T12:32:38.513019+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:32:38.513019+0000","last_undegraded":"2024-04-26T12:32:38.513019+0000","last_fullsized":"2024-04-26T12:32:38.513019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.643250+0000","last_change":"2024-04-26T12:33:55.643280+0000","last_active":"2024-04-26T12:33:55.643250+0000","last_peered":"2024-04-26T12:33:55.643250+0000","last_clean":"2024-04-26T12:33:55.643250+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:33:55.643250+0000","last_undegraded":"2024-04-26T12:33:55.643250+0000","last_fullsized":"2024-04-26T12:33:55.643250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.643144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.649463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.501845+0000","last_change":"2024-04-26T12:33:42.501879+0000","last_active":"2024-04-26T12:33:42.501845+0000","last_peered":"2024-04-26T12:33:42.501845+0000","last_clean":"2024-04-26T12:33:42.501845+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:33:42.501845+0000","last_undegraded":"2024-04-26T12:33:42.501845+0000","last_fullsized":"2024-04-26T12:33:42.501845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.501766+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:10.173839+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.366864+0000","last_change":"2024-04-26T12:33:34.366886+0000","last_active":"2024-04-26T12:33:34.366864+0000","last_peered":"2024-04-26T12:33:34.366864+0000","last_clean":"2024-04-26T12:33:34.366864+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:33:34.366864+0000","last_undegraded":"2024-04-26T12:33:34.366864+0000","last_fullsized":"2024-04-26T12:33:34.366864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.366757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:47.058265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.501892+0000","last_change":"2024-04-26T12:30:20.523862+0000","last_active":"2024-04-26T12:32:42.501892+0000","last_peered":"2024-04-26T12:32:42.501892+0000","last_clean":"2024-04-26T12:32:42.501892+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:32:42.501892+0000","last_undegraded":"2024-04-26T12:32:42.501892+0000","last_fullsized":"2024-04-26T12:32:42.501892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.626734+0000","last_change":"2024-04-26T12:34:01.626796+0000","last_active":"2024-04-26T12:34:01.626734+0000","last_peered":"2024-04-26T12:34:01.626734+0000","last_clean":"2024-04-26T12:34:01.626734+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:34:01.626734+0000","last_undegraded":"2024-04-26T12:34:01.626734+0000","last_fullsized":"2024-04-26T12:34:01.626734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.626634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:21.911777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.458396+0000","last_change":"2024-04-26T12:30:10.495713+0000","last_active":"2024-04-26T12:33:21.458396+0000","last_peered":"2024-04-26T12:33:21.458396+0000","last_clean":"2024-04-26T12:33:21.458396+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:33:21.458396+0000","last_undegraded":"2024-04-26T12:33:21.458396+0000","last_fullsized":"2024-04-26T12:33:21.458396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.385532+0000","last_change":"2024-04-26T12:33:48.385555+0000","last_active":"2024-04-26T12:33:48.385532+0000","last_peered":"2024-04-26T12:33:48.385532+0000","last_clean":"2024-04-26T12:33:48.385532+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:33:48.385532+0000","last_undegraded":"2024-04-26T12:33:48.385532+0000","last_fullsized":"2024-04-26T12:33:48.385532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.385445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:38.984742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.993283+0000","last_change":"2024-04-26T12:33:35.993331+0000","last_active":"2024-04-26T12:33:35.993283+0000","last_peered":"2024-04-26T12:33:35.993283+0000","last_clean":"2024-04-26T12:33:35.993283+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:33:35.993283+0000","last_undegraded":"2024-04-26T12:33:35.993283+0000","last_fullsized":"2024-04-26T12:33:35.993283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.993196+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.267797+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.950944+0000","last_change":"2024-04-26T12:33:43.950965+0000","last_active":"2024-04-26T12:33:43.950944+0000","last_peered":"2024-04-26T12:33:43.950944+0000","last_clean":"2024-04-26T12:33:43.950944+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:33:43.950944+0000","last_undegraded":"2024-04-26T12:33:43.950944+0000","last_fullsized":"2024-04-26T12:33:43.950944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.950850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.030430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513984+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:32:43.513984+0000","last_peered":"2024-04-26T12:32:43.513984+0000","last_clean":"2024-04-26T12:32:43.513984+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:32:43.513984+0000","last_undegraded":"2024-04-26T12:32:43.513984+0000","last_fullsized":"2024-04-26T12:32:43.513984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.015731+0000","last_change":"2024-04-26T12:33:47.015756+0000","last_active":"2024-04-26T12:33:47.015731+0000","last_peered":"2024-04-26T12:33:47.015731+0000","last_clean":"2024-04-26T12:33:47.015731+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:47.015731+0000","last_undegraded":"2024-04-26T12:33:47.015731+0000","last_fullsized":"2024-04-26T12:33:47.015731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.015630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:22.957533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513563+0000","last_change":"2024-04-26T12:30:10.511419+0000","last_active":"2024-04-26T12:32:43.513563+0000","last_peered":"2024-04-26T12:32:43.513563+0000","last_clean":"2024-04-26T12:32:43.513563+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:32:43.513563+0000","last_undegraded":"2024-04-26T12:32:43.513563+0000","last_fullsized":"2024-04-26T12:32:43.513563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.310817+0000","last_change":"2024-04-26T12:33:46.310845+0000","last_active":"2024-04-26T12:33:46.310817+0000","last_peered":"2024-04-26T12:33:46.310817+0000","last_clean":"2024-04-26T12:33:46.310817+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:33:46.310817+0000","last_undegraded":"2024-04-26T12:33:46.310817+0000","last_fullsized":"2024-04-26T12:33:46.310817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.310718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:07.825719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.467854+0000","last_change":"2024-04-26T12:33:41.467898+0000","last_active":"2024-04-26T12:33:41.467854+0000","last_peered":"2024-04-26T12:33:41.467854+0000","last_clean":"2024-04-26T12:33:41.467854+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:33:41.467854+0000","last_undegraded":"2024-04-26T12:33:41.467854+0000","last_fullsized":"2024-04-26T12:33:41.467854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.467768+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:07.391342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.445371+0000","last_change":"2024-04-26T12:33:33.445395+0000","last_active":"2024-04-26T12:33:33.445371+0000","last_peered":"2024-04-26T12:33:33.445371+0000","last_clean":"2024-04-26T12:33:33.445371+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:33:33.445371+0000","last_undegraded":"2024-04-26T12:33:33.445371+0000","last_fullsized":"2024-04-26T12:33:33.445371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.445277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.337016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513948+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:43.513948+0000","last_peered":"2024-04-26T12:32:43.513948+0000","last_clean":"2024-04-26T12:32:43.513948+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:43.513948+0000","last_undegraded":"2024-04-26T12:32:43.513948+0000","last_fullsized":"2024-04-26T12:32:43.513948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.501945+0000","last_change":"2024-04-26T12:30:12.491493+0000","last_active":"2024-04-26T12:32:42.501945+0000","last_peered":"2024-04-26T12:32:42.501945+0000","last_clean":"2024-04-26T12:32:42.501945+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:32:42.501945+0000","last_undegraded":"2024-04-26T12:32:42.501945+0000","last_fullsized":"2024-04-26T12:32:42.501945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514043+0000","last_change":"2024-04-26T12:30:10.521621+0000","last_active":"2024-04-26T12:32:43.514043+0000","last_peered":"2024-04-26T12:32:43.514043+0000","last_clean":"2024-04-26T12:32:43.514043+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:32:43.514043+0000","last_undegraded":"2024-04-26T12:32:43.514043+0000","last_fullsized":"2024-04-26T12:32:43.514043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513616+0000","last_change":"2024-04-26T12:30:49.551612+0000","last_active":"2024-04-26T12:32:43.513616+0000","last_peered":"2024-04-26T12:32:43.513616+0000","last_clean":"2024-04-26T12:32:43.513616+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:32:43.513616+0000","last_undegraded":"2024-04-26T12:32:43.513616+0000","last_fullsized":"2024-04-26T12:32:43.513616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.780607+0000","last_change":"2024-04-26T12:33:58.780643+0000","last_active":"2024-04-26T12:33:58.780607+0000","last_peered":"2024-04-26T12:33:58.780607+0000","last_clean":"2024-04-26T12:33:58.780607+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:33:58.780607+0000","last_undegraded":"2024-04-26T12:33:58.780607+0000","last_fullsized":"2024-04-26T12:33:58.780607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.780521+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:19.088998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":378,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.307434+0000","last_change":"2024-04-26T12:33:45.307469+0000","last_active":"2024-04-26T12:33:45.307434+0000","last_peered":"2024-04-26T12:33:45.307434+0000","last_clean":"2024-04-26T12:33:45.307434+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:45.307434+0000","last_undegraded":"2024-04-26T12:33:45.307434+0000","last_fullsized":"2024-04-26T12:33:45.307434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.307342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:13.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513827+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:32:43.513827+0000","last_peered":"2024-04-26T12:32:43.513827+0000","last_clean":"2024-04-26T12:32:43.513827+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:32:43.513827+0000","last_undegraded":"2024-04-26T12:32:43.513827+0000","last_fullsized":"2024-04-26T12:32:43.513827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.244297+0000","last_change":"2024-04-26T12:34:07.244321+0000","last_active":"2024-04-26T12:34:07.244297+0000","last_peered":"2024-04-26T12:34:07.244297+0000","last_clean":"2024-04-26T12:34:07.244297+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:34:07.244297+0000","last_undegraded":"2024-04-26T12:34:07.244297+0000","last_fullsized":"2024-04-26T12:34:07.244297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.244206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:57.848776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513595+0000","last_change":"2024-04-26T12:30:10.510186+0000","last_active":"2024-04-26T12:32:43.513595+0000","last_peered":"2024-04-26T12:32:43.513595+0000","last_clean":"2024-04-26T12:32:43.513595+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:32:43.513595+0000","last_undegraded":"2024-04-26T12:32:43.513595+0000","last_fullsized":"2024-04-26T12:32:43.513595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.949107+0000","last_change":"2024-04-26T12:33:42.949152+0000","last_active":"2024-04-26T12:33:42.949107+0000","last_peered":"2024-04-26T12:33:42.949107+0000","last_clean":"2024-04-26T12:33:42.949107+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:33:42.949107+0000","last_undegraded":"2024-04-26T12:33:42.949107+0000","last_fullsized":"2024-04-26T12:33:42.949107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.948988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:32.255979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.890106+0000","last_change":"2024-04-26T12:33:38.890152+0000","last_active":"2024-04-26T12:33:38.890106+0000","last_peered":"2024-04-26T12:33:38.890106+0000","last_clean":"2024-04-26T12:33:38.890106+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:33:38.890106+0000","last_undegraded":"2024-04-26T12:33:38.890106+0000","last_fullsized":"2024-04-26T12:33:38.890106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.890013+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:04.019389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.461617+0000","last_change":"2024-04-26T12:33:40.461661+0000","last_active":"2024-04-26T12:33:40.461617+0000","last_peered":"2024-04-26T12:33:40.461617+0000","last_clean":"2024-04-26T12:33:40.461617+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:33:40.461617+0000","last_undegraded":"2024-04-26T12:33:40.461617+0000","last_fullsized":"2024-04-26T12:33:40.461617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.461502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:09.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.780785+0000","last_change":"2024-04-26T12:33:59.780852+0000","last_active":"2024-04-26T12:33:59.780785+0000","last_peered":"2024-04-26T12:33:59.780785+0000","last_clean":"2024-04-26T12:33:59.780785+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:59.780785+0000","last_undegraded":"2024-04-26T12:33:59.780785+0000","last_fullsized":"2024-04-26T12:33:59.780785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.780664+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.693729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538397+0000","last_change":"2024-04-26T12:30:12.489703+0000","last_active":"2024-04-26T12:33:21.538397+0000","last_peered":"2024-04-26T12:33:21.538397+0000","last_clean":"2024-04-26T12:33:21.538397+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:33:21.538397+0000","last_undegraded":"2024-04-26T12:33:21.538397+0000","last_fullsized":"2024-04-26T12:33:21.538397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.461255+0000","last_change":"2024-04-26T12:30:10.524731+0000","last_active":"2024-04-26T12:33:21.461255+0000","last_peered":"2024-04-26T12:33:21.461255+0000","last_clean":"2024-04-26T12:33:21.461255+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:33:21.461255+0000","last_undegraded":"2024-04-26T12:33:21.461255+0000","last_fullsized":"2024-04-26T12:33:21.461255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.346128+0000","last_change":"2024-04-26T12:33:51.346173+0000","last_active":"2024-04-26T12:33:51.346128+0000","last_peered":"2024-04-26T12:33:51.346128+0000","last_clean":"2024-04-26T12:33:51.346128+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:33:51.346128+0000","last_undegraded":"2024-04-26T12:33:51.346128+0000","last_fullsized":"2024-04-26T12:33:51.346128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.346025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:20.507543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.453148+0000","last_change":"2024-04-26T12:33:38.453185+0000","last_active":"2024-04-26T12:33:38.453148+0000","last_peered":"2024-04-26T12:33:38.453148+0000","last_clean":"2024-04-26T12:33:38.453148+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:33:38.453148+0000","last_undegraded":"2024-04-26T12:33:38.453148+0000","last_fullsized":"2024-04-26T12:33:38.453148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.453065+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:29.052361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.794633+0000","last_change":"2024-04-26T12:33:56.794664+0000","last_active":"2024-04-26T12:33:56.794633+0000","last_peered":"2024-04-26T12:33:56.794633+0000","last_clean":"2024-04-26T12:33:56.794633+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:33:56.794633+0000","last_undegraded":"2024-04-26T12:33:56.794633+0000","last_fullsized":"2024-04-26T12:33:56.794633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.794541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:59.556259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.515022+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:32:48.515022+0000","last_peered":"2024-04-26T12:32:48.515022+0000","last_clean":"2024-04-26T12:32:48.515022+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:32:48.515022+0000","last_undegraded":"2024-04-26T12:32:48.515022+0000","last_fullsized":"2024-04-26T12:32:48.515022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508967+0000","last_change":"2024-04-26T12:30:12.489639+0000","last_active":"2024-04-26T12:33:21.508967+0000","last_peered":"2024-04-26T12:33:21.508967+0000","last_clean":"2024-04-26T12:33:21.508967+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:33:21.508967+0000","last_undegraded":"2024-04-26T12:33:21.508967+0000","last_fullsized":"2024-04-26T12:33:21.508967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.497136+0000","last_change":"2024-04-26T12:30:10.499110+0000","last_active":"2024-04-26T12:32:12.497136+0000","last_peered":"2024-04-26T12:32:12.497136+0000","last_clean":"2024-04-26T12:32:12.497136+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:32:12.497136+0000","last_undegraded":"2024-04-26T12:32:12.497136+0000","last_fullsized":"2024-04-26T12:32:12.497136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.865538+0000","last_change":"2024-04-26T12:33:48.865560+0000","last_active":"2024-04-26T12:33:48.865538+0000","last_peered":"2024-04-26T12:33:48.865538+0000","last_clean":"2024-04-26T12:33:48.865538+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:33:48.865538+0000","last_undegraded":"2024-04-26T12:33:48.865538+0000","last_fullsized":"2024-04-26T12:33:48.865538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.865441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:06.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.031288+0000","last_change":"2024-04-26T12:33:40.031319+0000","last_active":"2024-04-26T12:33:40.031288+0000","last_peered":"2024-04-26T12:33:40.031288+0000","last_clean":"2024-04-26T12:33:40.031288+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:33:40.031288+0000","last_undegraded":"2024-04-26T12:33:40.031288+0000","last_fullsized":"2024-04-26T12:33:40.031288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.031195+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:09.032628+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.850966+0000","last_change":"2024-04-26T12:33:54.851018+0000","last_active":"2024-04-26T12:33:54.850966+0000","last_peered":"2024-04-26T12:33:54.850966+0000","last_clean":"2024-04-26T12:33:54.850966+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:33:54.850966+0000","last_undegraded":"2024-04-26T12:33:54.850966+0000","last_fullsized":"2024-04-26T12:33:54.850966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.850864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:43.512855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514960+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:48.514960+0000","last_peered":"2024-04-26T12:32:48.514960+0000","last_clean":"2024-04-26T12:32:48.514960+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:48.514960+0000","last_undegraded":"2024-04-26T12:32:48.514960+0000","last_fullsized":"2024-04-26T12:32:48.514960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.267026+0000","last_change":"2024-04-26T12:33:57.267051+0000","last_active":"2024-04-26T12:33:57.267026+0000","last_peered":"2024-04-26T12:33:57.267026+0000","last_clean":"2024-04-26T12:33:57.267026+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:33:57.267026+0000","last_undegraded":"2024-04-26T12:33:57.267026+0000","last_fullsized":"2024-04-26T12:33:57.267026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.266942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:20.057671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.834819+0000","last_change":"2024-04-26T12:34:06.834847+0000","last_active":"2024-04-26T12:34:06.834819+0000","last_peered":"2024-04-26T12:34:06.834819+0000","last_clean":"2024-04-26T12:34:06.834819+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:34:06.834819+0000","last_undegraded":"2024-04-26T12:34:06.834819+0000","last_fullsized":"2024-04-26T12:34:06.834819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.834717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:39.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.835414+0000","last_change":"2024-04-26T12:33:49.835479+0000","last_active":"2024-04-26T12:33:49.835414+0000","last_peered":"2024-04-26T12:33:49.835414+0000","last_clean":"2024-04-26T12:33:49.835414+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:33:49.835414+0000","last_undegraded":"2024-04-26T12:33:49.835414+0000","last_fullsized":"2024-04-26T12:33:49.835414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.835315+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.299112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.110111+0000","last_change":"2024-04-26T12:33:44.110183+0000","last_active":"2024-04-26T12:33:44.110111+0000","last_peered":"2024-04-26T12:33:44.110111+0000","last_clean":"2024-04-26T12:33:44.110111+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:44.110111+0000","last_undegraded":"2024-04-26T12:33:44.110111+0000","last_fullsized":"2024-04-26T12:33:44.110111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.110007+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:08.558930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.548918+0000","last_change":"2024-04-26T12:33:52.548980+0000","last_active":"2024-04-26T12:33:52.548918+0000","last_peered":"2024-04-26T12:33:52.548918+0000","last_clean":"2024-04-26T12:33:52.548918+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:33:52.548918+0000","last_undegraded":"2024-04-26T12:33:52.548918+0000","last_fullsized":"2024-04-26T12:33:52.548918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.548815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:10.261619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514093+0000","last_change":"2024-04-26T12:30:20.523635+0000","last_active":"2024-04-26T12:32:43.514093+0000","last_peered":"2024-04-26T12:32:43.514093+0000","last_clean":"2024-04-26T12:32:43.514093+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:32:43.514093+0000","last_undegraded":"2024-04-26T12:32:43.514093+0000","last_fullsized":"2024-04-26T12:32:43.514093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.818335+0000","last_change":"2024-04-26T12:33:50.818359+0000","last_active":"2024-04-26T12:33:50.818335+0000","last_peered":"2024-04-26T12:33:50.818335+0000","last_clean":"2024-04-26T12:33:50.818335+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:50.818335+0000","last_undegraded":"2024-04-26T12:33:50.818335+0000","last_fullsized":"2024-04-26T12:33:50.818335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.818238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:03.334266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.340588+0000","last_change":"2024-04-26T12:34:02.340615+0000","last_active":"2024-04-26T12:34:02.340588+0000","last_peered":"2024-04-26T12:34:02.340588+0000","last_clean":"2024-04-26T12:34:02.340588+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:34:02.340588+0000","last_undegraded":"2024-04-26T12:34:02.340588+0000","last_fullsized":"2024-04-26T12:34:02.340588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.340498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:45.990532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508662+0000","last_change":"2024-04-26T12:30:12.488793+0000","last_active":"2024-04-26T12:33:21.508662+0000","last_peered":"2024-04-26T12:33:21.508662+0000","last_clean":"2024-04-26T12:33:21.508662+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:33:21.508662+0000","last_undegraded":"2024-04-26T12:33:21.508662+0000","last_fullsized":"2024-04-26T12:33:21.508662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.117053+0000","last_change":"2024-04-26T12:30:10.488944+0000","last_active":"2024-04-26T12:33:28.117053+0000","last_peered":"2024-04-26T12:33:28.117053+0000","last_clean":"2024-04-26T12:33:28.117053+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:33:28.117053+0000","last_undegraded":"2024-04-26T12:33:28.117053+0000","last_fullsized":"2024-04-26T12:33:28.117053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508794+0000","last_change":"2024-04-26T12:30:12.491523+0000","last_active":"2024-04-26T12:33:21.508794+0000","last_peered":"2024-04-26T12:33:21.508794+0000","last_clean":"2024-04-26T12:33:21.508794+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:33:21.508794+0000","last_undegraded":"2024-04-26T12:33:21.508794+0000","last_fullsized":"2024-04-26T12:33:21.508794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.787426+0000","last_change":"2024-04-26T12:30:10.515892+0000","last_active":"2024-04-26T12:32:20.787426+0000","last_peered":"2024-04-26T12:32:20.787426+0000","last_clean":"2024-04-26T12:32:20.787426+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:32:20.787426+0000","last_undegraded":"2024-04-26T12:32:20.787426+0000","last_fullsized":"2024-04-26T12:32:20.787426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.538175+0000","last_change":"2024-04-26T12:30:12.491568+0000","last_active":"2024-04-26T12:33:21.538175+0000","last_peered":"2024-04-26T12:33:21.538175+0000","last_clean":"2024-04-26T12:33:21.538175+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:33:21.538175+0000","last_undegraded":"2024-04-26T12:33:21.538175+0000","last_fullsized":"2024-04-26T12:33:21.538175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497900+0000","last_change":"2024-04-26T12:30:10.498184+0000","last_active":"2024-04-26T12:32:17.497900+0000","last_peered":"2024-04-26T12:32:17.497900+0000","last_clean":"2024-04-26T12:32:17.497900+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:32:17.497900+0000","last_undegraded":"2024-04-26T12:32:17.497900+0000","last_fullsized":"2024-04-26T12:32:17.497900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.649581+0000","last_change":"2024-04-26T12:34:02.649641+0000","last_active":"2024-04-26T12:34:02.649581+0000","last_peered":"2024-04-26T12:34:02.649581+0000","last_clean":"2024-04-26T12:34:02.649581+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:34:02.649581+0000","last_undegraded":"2024-04-26T12:34:02.649581+0000","last_fullsized":"2024-04-26T12:34:02.649581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.649475+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:18.869480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.571979+0000","last_change":"2024-04-26T12:34:05.572013+0000","last_active":"2024-04-26T12:34:05.571979+0000","last_peered":"2024-04-26T12:34:05.571979+0000","last_clean":"2024-04-26T12:34:05.571979+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:34:05.571979+0000","last_undegraded":"2024-04-26T12:34:05.571979+0000","last_fullsized":"2024-04-26T12:34:05.571979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.571886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:23.002390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.802114+0000","last_change":"2024-04-26T12:33:58.802145+0000","last_active":"2024-04-26T12:33:58.802114+0000","last_peered":"2024-04-26T12:33:58.802114+0000","last_clean":"2024-04-26T12:33:58.802114+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:58.802114+0000","last_undegraded":"2024-04-26T12:33:58.802114+0000","last_fullsized":"2024-04-26T12:33:58.802114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.802005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:27.815229+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510243+0000","last_change":"2024-04-26T12:30:10.507425+0000","last_active":"2024-04-26T12:32:23.510243+0000","last_peered":"2024-04-26T12:32:23.510243+0000","last_clean":"2024-04-26T12:32:23.510243+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:32:23.510243+0000","last_undegraded":"2024-04-26T12:32:23.510243+0000","last_fullsized":"2024-04-26T12:32:23.510243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.497859+0000","last_change":"2024-04-26T12:30:12.496187+0000","last_active":"2024-04-26T12:32:17.497859+0000","last_peered":"2024-04-26T12:32:17.497859+0000","last_clean":"2024-04-26T12:32:17.497859+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:32:17.497859+0000","last_undegraded":"2024-04-26T12:32:17.497859+0000","last_fullsized":"2024-04-26T12:32:17.497859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.502739+0000","last_change":"2024-04-26T12:30:10.504572+0000","last_active":"2024-04-26T12:32:22.502739+0000","last_peered":"2024-04-26T12:32:22.502739+0000","last_clean":"2024-04-26T12:32:22.502739+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:32:22.502739+0000","last_undegraded":"2024-04-26T12:32:22.502739+0000","last_fullsized":"2024-04-26T12:32:22.502739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.341245+0000","last_change":"2024-04-26T12:30:12.495561+0000","last_active":"2024-04-26T12:33:21.341245+0000","last_peered":"2024-04-26T12:33:21.341245+0000","last_clean":"2024-04-26T12:33:21.341245+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:33:21.341245+0000","last_undegraded":"2024-04-26T12:33:21.341245+0000","last_fullsized":"2024-04-26T12:33:21.341245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.116079+0000","last_change":"2024-04-26T12:30:10.498578+0000","last_active":"2024-04-26T12:33:28.116079+0000","last_peered":"2024-04-26T12:33:28.116079+0000","last_clean":"2024-04-26T12:33:28.116079+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:33:28.116079+0000","last_undegraded":"2024-04-26T12:33:28.116079+0000","last_fullsized":"2024-04-26T12:33:28.116079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.509293+0000","last_change":"2024-04-26T12:30:12.496215+0000","last_active":"2024-04-26T12:33:21.509293+0000","last_peered":"2024-04-26T12:33:21.509293+0000","last_clean":"2024-04-26T12:33:21.509293+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:33:21.509293+0000","last_undegraded":"2024-04-26T12:33:21.509293+0000","last_fullsized":"2024-04-26T12:33:21.509293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510681+0000","last_change":"2024-04-26T12:30:10.521412+0000","last_active":"2024-04-26T12:32:23.510681+0000","last_peered":"2024-04-26T12:32:23.510681+0000","last_clean":"2024-04-26T12:32:23.510681+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:32:23.510681+0000","last_undegraded":"2024-04-26T12:32:23.510681+0000","last_fullsized":"2024-04-26T12:32:23.510681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.700100+0000","last_change":"2024-04-26T12:34:05.700148+0000","last_active":"2024-04-26T12:34:05.700100+0000","last_peered":"2024-04-26T12:34:05.700100+0000","last_clean":"2024-04-26T12:34:05.700100+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:34:05.700100+0000","last_undegraded":"2024-04-26T12:34:05.700100+0000","last_fullsized":"2024-04-26T12:34:05.700100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.700014+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:54.202928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:27.499420+0000","last_change":"2024-04-26T12:30:10.498422+0000","last_active":"2024-04-26T12:32:27.499420+0000","last_peered":"2024-04-26T12:32:27.499420+0000","last_clean":"2024-04-26T12:32:27.499420+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:32:27.499420+0000","last_undegraded":"2024-04-26T12:32:27.499420+0000","last_fullsized":"2024-04-26T12:32:27.499420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.508520+0000","last_change":"2024-04-26T12:30:12.484594+0000","last_active":"2024-04-26T12:33:21.508520+0000","last_peered":"2024-04-26T12:33:21.508520+0000","last_clean":"2024-04-26T12:33:21.508520+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:33:21.508520+0000","last_undegraded":"2024-04-26T12:33:21.508520+0000","last_fullsized":"2024-04-26T12:33:21.508520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510909+0000","last_change":"2024-04-26T12:30:10.514358+0000","last_active":"2024-04-26T12:32:28.510909+0000","last_peered":"2024-04-26T12:32:28.510909+0000","last_clean":"2024-04-26T12:32:28.510909+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:32:28.510909+0000","last_undegraded":"2024-04-26T12:32:28.510909+0000","last_fullsized":"2024-04-26T12:32:28.510909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.794029+0000","last_change":"2024-04-26T12:34:07.794058+0000","last_active":"2024-04-26T12:34:07.794029+0000","last_peered":"2024-04-26T12:34:07.794029+0000","last_clean":"2024-04-26T12:34:07.794029+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:34:07.794029+0000","last_undegraded":"2024-04-26T12:34:07.794029+0000","last_fullsized":"2024-04-26T12:34:07.794029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.793931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:31.555282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.510961+0000","last_change":"2024-04-26T12:30:10.507296+0000","last_active":"2024-04-26T12:32:28.510961+0000","last_peered":"2024-04-26T12:32:28.510961+0000","last_clean":"2024-04-26T12:32:28.510961+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:32:28.510961+0000","last_undegraded":"2024-04-26T12:32:28.510961+0000","last_fullsized":"2024-04-26T12:32:28.510961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.753441+0000","last_change":"2024-04-26T12:34:01.753500+0000","last_active":"2024-04-26T12:34:01.753441+0000","last_peered":"2024-04-26T12:34:01.753441+0000","last_clean":"2024-04-26T12:34:01.753441+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:34:01.753441+0000","last_undegraded":"2024-04-26T12:34:01.753441+0000","last_fullsized":"2024-04-26T12:34:01.753441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.753343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.379403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511600+0000","last_change":"2024-04-26T12:30:10.523912+0000","last_active":"2024-04-26T12:32:28.511600+0000","last_peered":"2024-04-26T12:32:28.511600+0000","last_clean":"2024-04-26T12:32:28.511600+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:32:28.511600+0000","last_undegraded":"2024-04-26T12:32:28.511600+0000","last_fullsized":"2024-04-26T12:32:28.511600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.784344+0000","last_change":"2024-04-26T12:34:00.784416+0000","last_active":"2024-04-26T12:34:00.784344+0000","last_peered":"2024-04-26T12:34:00.784344+0000","last_clean":"2024-04-26T12:34:00.784344+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:34:00.784344+0000","last_undegraded":"2024-04-26T12:34:00.784344+0000","last_fullsized":"2024-04-26T12:34:00.784344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.784248+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:01.988211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511624+0000","last_change":"2024-04-26T12:30:10.523924+0000","last_active":"2024-04-26T12:32:28.511624+0000","last_peered":"2024-04-26T12:32:28.511624+0000","last_clean":"2024-04-26T12:32:28.511624+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:32:28.511624+0000","last_undegraded":"2024-04-26T12:32:28.511624+0000","last_fullsized":"2024-04-26T12:32:28.511624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.944335+0000","last_change":"2024-04-26T12:33:50.944361+0000","last_active":"2024-04-26T12:33:50.944335+0000","last_peered":"2024-04-26T12:33:50.944335+0000","last_clean":"2024-04-26T12:33:50.944335+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:33:50.944335+0000","last_undegraded":"2024-04-26T12:33:50.944335+0000","last_fullsized":"2024-04-26T12:33:50.944335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.944248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:32.447511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.504344+0000","last_change":"2024-04-26T12:30:10.501961+0000","last_active":"2024-04-26T12:32:32.504344+0000","last_peered":"2024-04-26T12:32:32.504344+0000","last_clean":"2024-04-26T12:32:32.504344+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:32:32.504344+0000","last_undegraded":"2024-04-26T12:32:32.504344+0000","last_fullsized":"2024-04-26T12:32:32.504344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.787635+0000","last_change":"2024-04-26T12:34:04.787661+0000","last_active":"2024-04-26T12:34:04.787635+0000","last_peered":"2024-04-26T12:34:04.787635+0000","last_clean":"2024-04-26T12:34:04.787635+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:34:04.787635+0000","last_undegraded":"2024-04-26T12:34:04.787635+0000","last_fullsized":"2024-04-26T12:34:04.787635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.787527+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:20.485303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512496+0000","last_change":"2024-04-26T12:30:10.513455+0000","last_active":"2024-04-26T12:32:33.512496+0000","last_peered":"2024-04-26T12:32:33.512496+0000","last_clean":"2024-04-26T12:32:33.512496+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:32:33.512496+0000","last_undegraded":"2024-04-26T12:32:33.512496+0000","last_fullsized":"2024-04-26T12:32:33.512496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.452707+0000","last_change":"2024-04-26T12:30:10.520879+0000","last_active":"2024-04-26T12:33:21.452707+0000","last_peered":"2024-04-26T12:33:21.452707+0000","last_clean":"2024-04-26T12:33:21.452707+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:33:21.452707+0000","last_undegraded":"2024-04-26T12:33:21.452707+0000","last_fullsized":"2024-04-26T12:33:21.452707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.659740+0000","last_change":"2024-04-26T12:33:57.659780+0000","last_active":"2024-04-26T12:33:57.659740+0000","last_peered":"2024-04-26T12:33:57.659740+0000","last_clean":"2024-04-26T12:33:57.659740+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:57.659740+0000","last_undegraded":"2024-04-26T12:33:57.659740+0000","last_fullsized":"2024-04-26T12:33:57.659740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.659656+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:51.882456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.634694+0000","last_change":"2024-04-26T12:34:03.634721+0000","last_active":"2024-04-26T12:34:03.634694+0000","last_peered":"2024-04-26T12:34:03.634694+0000","last_clean":"2024-04-26T12:34:03.634694+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:34:03.634694+0000","last_undegraded":"2024-04-26T12:34:03.634694+0000","last_fullsized":"2024-04-26T12:34:03.634694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.634604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:37.832568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.820080+0000","last_change":"2024-04-26T12:33:53.820107+0000","last_active":"2024-04-26T12:33:53.820080+0000","last_peered":"2024-04-26T12:33:53.820080+0000","last_clean":"2024-04-26T12:33:53.820080+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:53.820080+0000","last_undegraded":"2024-04-26T12:33:53.820080+0000","last_fullsized":"2024-04-26T12:33:53.820080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.819987+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:06.561948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":145189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673015,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":735472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":734135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":430080,"data_stored":145178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:34:13.377 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.377 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.377 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.377 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.377 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.377 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.377 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.378 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.379 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.380 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.381 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.382 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.382 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.382 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.382 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.382 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:29:53.417591+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=29, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.382 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.382 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.383 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.384 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.385 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.386 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.386 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.386 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.386 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.386 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.386 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.386 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.387 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.388 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.389 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.390 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.391 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.392 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:13.392 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:34:33.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.500+0000 7f056d03f640 1 Processor -- start 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.500+0000 7f056d03f640 1 -- start start 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.500+0000 7f056d03f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f056812c1e0 0x7f056812c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.500+0000 7f056d03f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f056806b4b0 con 0x7f056812cc40 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.500+0000 7f056d03f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f0568070360 con 0x7f056812c1e0 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.501+0000 7f0566d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f056812c1e0 0x7f056812c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.501+0000 7f056659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f056812cc40 0x7f0568128c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50722/0 (socket says 172.21.15.132:50722) 2024-04-26T12:34:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.501+0000 7f056659c640 1 -- 172.21.15.132:0/1348392378 learned_addr learned my addr 172.21.15.132:0/1348392378 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:34:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.501+0000 7f0566d9d640 1 -- 172.21.15.132:0/1348392378 >> v1:172.21.15.132:6789/0 conn(0x7f056812cc40 legacy=0x7f0568128c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.501+0000 7f0566d9d640 1 -- 172.21.15.132:0/1348392378 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056808edd0 con 0x7f056812c1e0 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f0566d9d640 1 --2- 172.21.15.132:0/1348392378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f056812c700 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0558009720 tx=0x7f055802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9f38a2ec0494bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f0565d9b640 1 -- 172.21.15.132:0/1348392378 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558035020 con 0x7f056812c1e0 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f0565d9b640 1 -- 172.21.15.132:0/1348392378 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0558031760 con 0x7f056812c1e0 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f0565d9b640 1 -- 172.21.15.132:0/1348392378 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558031a60 con 0x7f056812c1e0 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f056d03f640 1 -- 172.21.15.132:0/1348392378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 msgr2=0x7f056812c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f056d03f640 1 --2- 172.21.15.132:0/1348392378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f056812c700 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0558009720 tx=0x7f055802b8d0 comp rx=0 tx=0).stop 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f056d03f640 1 -- 172.21.15.132:0/1348392378 shutdown_connections 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f056d03f640 1 --2- 172.21.15.132:0/1348392378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f056812c700 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f056d03f640 1 -- 172.21.15.132:0/1348392378 >> 172.21.15.132:0/1348392378 conn(0x7f056809b7b0 msgr2=0x7f056809bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:34:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f056d03f640 1 -- 172.21.15.132:0/1348392378 shutdown_connections 2024-04-26T12:34:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.502+0000 7f056d03f640 1 -- 172.21.15.132:0/1348392378 wait complete. 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.503+0000 7f056d03f640 1 Processor -- start 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f056d03f640 1 -- start start 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f056d03f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f05681217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f056d03f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f056806ffc0 con 0x7f056812c1e0 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f0566d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f05681217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f0566d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f05681217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55482/0 (socket says 172.21.15.132:55482) 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f0566d9d640 1 -- 172.21.15.132:0/3533775660 learned_addr learned my addr 172.21.15.132:0/3533775660 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f0566d9d640 1 -- 172.21.15.132:0/3533775660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0568072a20 con 0x7f056812c1e0 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.504+0000 7f0566d9d640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f05681217e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0558034040 tx=0x7f05580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.505+0000 7f054f7fe640 1 -- 172.21.15.132:0/3533775660 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f055803acc0 con 0x7f056812c1e0 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.505+0000 7f054f7fe640 1 -- 172.21.15.132:0/3533775660 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05580443f0 con 0x7f056812c1e0 2024-04-26T12:34:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.505+0000 7f054f7fe640 1 -- 172.21.15.132:0/3533775660 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f055803ae60 con 0x7f056812c1e0 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.505+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056808d6c0 con 0x7f056812c1e0 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.505+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0568124390 con 0x7f056812c1e0 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.505+0000 7f054f7fe640 1 -- 172.21.15.132:0/3533775660 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f055804b060 con 0x7f056812c1e0 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.506+0000 7f054f7fe640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0554038060 0x7f055403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.506+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0568062ed0 con 0x7f056812c1e0 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.506+0000 7f054f7fe640 1 -- 172.21.15.132:0/3533775660 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f055806db10 con 0x7f056812c1e0 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.506+0000 7f056659c640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0554038060 0x7f055403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.507+0000 7f056659c640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0554038060 0x7f055403a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f055c000f60 tx=0x7f055c007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.511+0000 7f054f7fe640 1 -- 172.21.15.132:0/3533775660 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0568072a20 con 0x7f056812c1e0 2024-04-26T12:34:33.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.679+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05680008d0 con 0x7f0554038060 2024-04-26T12:34:33.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.695+0000 7f054f7fe640 1 -- 172.21.15.132:0/3533775660 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664770 (secure 0 0 0) 0x7f05680008d0 con 0x7f0554038060 2024-04-26T12:34:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:34:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:34:33.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0554038060 msgr2=0x7f055403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:33.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0554038060 0x7f055403a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f055c000f60 tx=0x7f055c007a80 comp rx=0 tx=0).stop 2024-04-26T12:34:33.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 msgr2=0x7f05681217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:33.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f05681217e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0558034040 tx=0x7f05580046c0 comp rx=0 tx=0).stop 2024-04-26T12:34:33.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 shutdown_connections 2024-04-26T12:34:33.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f0554038060 0x7f055403a520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:33.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 --2- 172.21.15.132:0/3533775660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f056812c1e0 0x7f05681217e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:33.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 >> 172.21.15.132:0/3533775660 conn(0x7f056809b7b0 msgr2=0x7f05681b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:34:33.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 shutdown_connections 2024-04-26T12:34:33.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:33.699+0000 7f056d03f640 1 -- 172.21.15.132:0/3533775660 wait complete. 2024-04-26T12:34:33.715 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-04-26T12:34:32.507462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5095,"num_read_kb":4676,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4785,"ondisk_log_size":4785,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123384,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377363976,"statfs":{"total":386547056640,"available":386420711424,"internally_reserved":0,"allocated":2908160,"data_stored":1759974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003823"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.288439+0000","last_change":"2024-04-26T12:33:58.288439+0000","last_active":"2024-04-26T12:33:58.288439+0000","last_peered":"2024-04-26T12:33:58.288439+0000","last_clean":"2024-04-26T12:33:58.288439+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:33:58.288439+0000","last_undegraded":"2024-04-26T12:33:58.288439+0000","last_fullsized":"2024-04-26T12:33:58.288439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.288321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:54.223162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.854100+0000","last_change":"2024-04-26T12:33:52.854126+0000","last_active":"2024-04-26T12:33:52.854100+0000","last_peered":"2024-04-26T12:33:52.854100+0000","last_clean":"2024-04-26T12:33:52.854100+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:33:52.854100+0000","last_undegraded":"2024-04-26T12:33:52.854100+0000","last_fullsized":"2024-04-26T12:33:52.854100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.854008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:48.175623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.609564+0000","last_change":"2024-04-26T12:34:22.609592+0000","last_active":"2024-04-26T12:34:22.609564+0000","last_peered":"2024-04-26T12:34:22.609564+0000","last_clean":"2024-04-26T12:34:22.609564+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:34:22.609564+0000","last_undegraded":"2024-04-26T12:34:22.609564+0000","last_fullsized":"2024-04-26T12:34:22.609564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:22.609471+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:22.609471+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.609471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:33.445654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.666975+0000","last_change":"2024-04-26T12:34:18.667006+0000","last_active":"2024-04-26T12:34:18.666975+0000","last_peered":"2024-04-26T12:34:18.666975+0000","last_clean":"2024-04-26T12:34:18.666975+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:34:18.666975+0000","last_undegraded":"2024-04-26T12:34:18.666975+0000","last_fullsized":"2024-04-26T12:34:18.666975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:34:18.666884+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:34:18.666884+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.666884+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.442000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.685114+0000","last_change":"2024-04-26T12:34:21.685114+0000","last_active":"2024-04-26T12:34:21.685114+0000","last_peered":"2024-04-26T12:34:21.685114+0000","last_clean":"2024-04-26T12:34:21.685114+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:34:21.685114+0000","last_undegraded":"2024-04-26T12:34:21.685114+0000","last_fullsized":"2024-04-26T12:34:21.685114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:21.684952+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.684952+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.684952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:31.971000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.669824+0000","last_change":"2024-04-26T12:34:06.669871+0000","last_active":"2024-04-26T12:34:06.669824+0000","last_peered":"2024-04-26T12:34:06.669824+0000","last_clean":"2024-04-26T12:34:06.669824+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:34:06.669824+0000","last_undegraded":"2024-04-26T12:34:06.669824+0000","last_fullsized":"2024-04-26T12:34:06.669824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.669725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:33.570963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.209207+0000","last_change":"2024-04-26T12:34:15.209232+0000","last_active":"2024-04-26T12:34:15.209207+0000","last_peered":"2024-04-26T12:34:15.209207+0000","last_clean":"2024-04-26T12:34:15.209207+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:34:15.209207+0000","last_undegraded":"2024-04-26T12:34:15.209207+0000","last_fullsized":"2024-04-26T12:34:15.209207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:15.209099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:15.209099+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.209099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:34.233375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.669332+0000","last_change":"2024-04-26T12:34:14.669361+0000","last_active":"2024-04-26T12:34:14.669332+0000","last_peered":"2024-04-26T12:34:14.669332+0000","last_clean":"2024-04-26T12:34:14.669332+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:34:14.669332+0000","last_undegraded":"2024-04-26T12:34:14.669332+0000","last_fullsized":"2024-04-26T12:34:14.669332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:14.669243+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:14.669243+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.669243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:18.241558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514057+0000","last_change":"2024-04-26T12:30:10.521268+0000","last_active":"2024-04-26T12:32:43.514057+0000","last_peered":"2024-04-26T12:32:43.514057+0000","last_clean":"2024-04-26T12:32:43.514057+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:32:43.514057+0000","last_undegraded":"2024-04-26T12:32:43.514057+0000","last_fullsized":"2024-04-26T12:32:43.514057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.819186+0000","last_change":"2024-04-26T12:34:25.819213+0000","last_active":"2024-04-26T12:34:25.819186+0000","last_peered":"2024-04-26T12:34:25.819186+0000","last_clean":"2024-04-26T12:34:25.819186+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:34:25.819186+0000","last_undegraded":"2024-04-26T12:34:25.819186+0000","last_fullsized":"2024-04-26T12:34:25.819186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:34:25.819067+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:34:25.819067+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.819067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:59.067925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.230538+0000","last_change":"2024-04-26T12:34:06.230563+0000","last_active":"2024-04-26T12:34:06.230538+0000","last_peered":"2024-04-26T12:34:06.230538+0000","last_clean":"2024-04-26T12:34:06.230538+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:34:06.230538+0000","last_undegraded":"2024-04-26T12:34:06.230538+0000","last_fullsized":"2024-04-26T12:34:06.230538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.230442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:31.999710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.284784+0000","last_change":"2024-04-26T12:34:25.284821+0000","last_active":"2024-04-26T12:34:25.284784+0000","last_peered":"2024-04-26T12:34:25.284784+0000","last_clean":"2024-04-26T12:34:25.284784+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:34:25.284784+0000","last_undegraded":"2024-04-26T12:34:25.284784+0000","last_fullsized":"2024-04-26T12:34:25.284784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:25.284696+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:25.284696+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.284696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.824773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115857+0000","last_change":"2024-04-26T12:30:10.519048+0000","last_active":"2024-04-26T12:33:28.115857+0000","last_peered":"2024-04-26T12:33:28.115857+0000","last_clean":"2024-04-26T12:33:28.115857+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:33:28.115857+0000","last_undegraded":"2024-04-26T12:33:28.115857+0000","last_fullsized":"2024-04-26T12:33:28.115857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.332600+0000","last_change":"2024-04-26T12:33:54.332600+0000","last_active":"2024-04-26T12:33:54.332600+0000","last_peered":"2024-04-26T12:33:54.332600+0000","last_clean":"2024-04-26T12:33:54.332600+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:33:54.332600+0000","last_undegraded":"2024-04-26T12:33:54.332600+0000","last_fullsized":"2024-04-26T12:33:54.332600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.332483+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:46.075405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.528863+0000","last_change":"2024-04-26T12:34:07.528890+0000","last_active":"2024-04-26T12:34:07.528863+0000","last_peered":"2024-04-26T12:34:07.528863+0000","last_clean":"2024-04-26T12:34:07.528863+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:34:07.528863+0000","last_undegraded":"2024-04-26T12:34:07.528863+0000","last_fullsized":"2024-04-26T12:34:07.528863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:07.528773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:07.528773+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.528773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:35.692596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.336420+0000","last_change":"2024-04-26T12:33:59.336420+0000","last_active":"2024-04-26T12:33:59.336420+0000","last_peered":"2024-04-26T12:33:59.336420+0000","last_clean":"2024-04-26T12:33:59.336420+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:59.336420+0000","last_undegraded":"2024-04-26T12:33:59.336420+0000","last_fullsized":"2024-04-26T12:33:59.336420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.336298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:16.786139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.647501+0000","last_change":"2024-04-26T12:34:20.647529+0000","last_active":"2024-04-26T12:34:20.647501+0000","last_peered":"2024-04-26T12:34:20.647501+0000","last_clean":"2024-04-26T12:34:20.647501+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:34:20.647501+0000","last_undegraded":"2024-04-26T12:34:20.647501+0000","last_fullsized":"2024-04-26T12:34:20.647501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:20.647411+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:20.647411+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.647411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.619236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.857309+0000","last_change":"2024-04-26T12:34:14.857334+0000","last_active":"2024-04-26T12:34:14.857309+0000","last_peered":"2024-04-26T12:34:14.857309+0000","last_clean":"2024-04-26T12:34:14.857309+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:34:14.857309+0000","last_undegraded":"2024-04-26T12:34:14.857309+0000","last_fullsized":"2024-04-26T12:34:14.857309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:14.857209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:14.857209+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.857209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:12.986493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.778945+0000","last_change":"2024-04-26T12:33:54.778997+0000","last_active":"2024-04-26T12:33:54.778945+0000","last_peered":"2024-04-26T12:33:54.778945+0000","last_clean":"2024-04-26T12:33:54.778945+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:54.778945+0000","last_undegraded":"2024-04-26T12:33:54.778945+0000","last_fullsized":"2024-04-26T12:33:54.778945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.778831+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:42.906362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.213693+0000","last_change":"2024-04-26T12:34:10.213732+0000","last_active":"2024-04-26T12:34:10.213693+0000","last_peered":"2024-04-26T12:34:10.213693+0000","last_clean":"2024-04-26T12:34:10.213693+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:34:10.213693+0000","last_undegraded":"2024-04-26T12:34:10.213693+0000","last_fullsized":"2024-04-26T12:34:10.213693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:10.213568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:10.213568+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.213568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:30.498711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.871588+0000","last_change":"2024-04-26T12:34:15.871611+0000","last_active":"2024-04-26T12:34:15.871588+0000","last_peered":"2024-04-26T12:34:15.871588+0000","last_clean":"2024-04-26T12:34:15.871588+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:34:15.871588+0000","last_undegraded":"2024-04-26T12:34:15.871588+0000","last_fullsized":"2024-04-26T12:34:15.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:15.871498+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:15.871498+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.871498+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:04.533490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.812024+0000","last_change":"2024-04-26T12:34:10.812049+0000","last_active":"2024-04-26T12:34:10.812024+0000","last_peered":"2024-04-26T12:34:10.812024+0000","last_clean":"2024-04-26T12:34:10.812024+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:34:10.812024+0000","last_undegraded":"2024-04-26T12:34:10.812024+0000","last_fullsized":"2024-04-26T12:34:10.812024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:10.811929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:10.811929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.811929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:20.400842+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.536881+0000","last_change":"2024-04-26T12:34:06.536925+0000","last_active":"2024-04-26T12:34:06.536881+0000","last_peered":"2024-04-26T12:34:06.536881+0000","last_clean":"2024-04-26T12:34:06.536881+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:34:06.536881+0000","last_undegraded":"2024-04-26T12:34:06.536881+0000","last_fullsized":"2024-04-26T12:34:06.536881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.536779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:33.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.842487+0000","last_change":"2024-04-26T12:34:08.842555+0000","last_active":"2024-04-26T12:34:08.842487+0000","last_peered":"2024-04-26T12:34:08.842487+0000","last_clean":"2024-04-26T12:34:08.842487+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:34:08.842487+0000","last_undegraded":"2024-04-26T12:34:08.842487+0000","last_fullsized":"2024-04-26T12:34:08.842487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:08.842382+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:08.842382+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.842382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:39.151474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.360082+0000","last_change":"2024-04-26T12:34:03.360141+0000","last_active":"2024-04-26T12:34:03.360082+0000","last_peered":"2024-04-26T12:34:03.360082+0000","last_clean":"2024-04-26T12:34:03.360082+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:34:03.360082+0000","last_undegraded":"2024-04-26T12:34:03.360082+0000","last_fullsized":"2024-04-26T12:34:03.360082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.359974+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:04.442738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.566597+0000","last_change":"2024-04-26T12:34:09.566626+0000","last_active":"2024-04-26T12:34:09.566597+0000","last_peered":"2024-04-26T12:34:09.566597+0000","last_clean":"2024-04-26T12:34:09.566597+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:34:09.566597+0000","last_undegraded":"2024-04-26T12:34:09.566597+0000","last_fullsized":"2024-04-26T12:34:09.566597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:09.566504+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:09.566504+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.566504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:28.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.846263+0000","last_change":"2024-04-26T12:34:09.846287+0000","last_active":"2024-04-26T12:34:09.846263+0000","last_peered":"2024-04-26T12:34:09.846263+0000","last_clean":"2024-04-26T12:34:09.846263+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:34:09.846263+0000","last_undegraded":"2024-04-26T12:34:09.846263+0000","last_fullsized":"2024-04-26T12:34:09.846263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:09.846147+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:09.846147+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.846147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:02.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115742+0000","last_change":"2024-04-26T12:30:10.516884+0000","last_active":"2024-04-26T12:33:28.115742+0000","last_peered":"2024-04-26T12:33:28.115742+0000","last_clean":"2024-04-26T12:33:28.115742+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:33:28.115742+0000","last_undegraded":"2024-04-26T12:33:28.115742+0000","last_fullsized":"2024-04-26T12:33:28.115742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.546057+0000","last_change":"2024-04-26T12:30:20.535283+0000","last_active":"2024-04-26T12:33:21.546057+0000","last_peered":"2024-04-26T12:33:21.546057+0000","last_clean":"2024-04-26T12:33:21.546057+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:33:21.546057+0000","last_undegraded":"2024-04-26T12:33:21.546057+0000","last_fullsized":"2024-04-26T12:33:21.546057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.684217+0000","last_change":"2024-04-26T12:34:12.684244+0000","last_active":"2024-04-26T12:34:12.684217+0000","last_peered":"2024-04-26T12:34:12.684217+0000","last_clean":"2024-04-26T12:34:12.684217+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:34:12.684217+0000","last_undegraded":"2024-04-26T12:34:12.684217+0000","last_fullsized":"2024-04-26T12:34:12.684217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:12.684075+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:12.684075+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.684075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:21.651054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512382+0000","last_change":"2024-04-26T12:30:10.524372+0000","last_active":"2024-04-26T12:32:33.512382+0000","last_peered":"2024-04-26T12:32:33.512382+0000","last_clean":"2024-04-26T12:32:33.512382+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:32:33.512382+0000","last_undegraded":"2024-04-26T12:32:33.512382+0000","last_fullsized":"2024-04-26T12:32:33.512382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.036531+0000","last_change":"2024-04-26T12:33:39.036552+0000","last_active":"2024-04-26T12:33:39.036531+0000","last_peered":"2024-04-26T12:33:39.036531+0000","last_clean":"2024-04-26T12:33:39.036531+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:33:39.036531+0000","last_undegraded":"2024-04-26T12:33:39.036531+0000","last_fullsized":"2024-04-26T12:33:39.036531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.036437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:05.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.757268+0000","last_change":"2024-04-26T12:34:00.757313+0000","last_active":"2024-04-26T12:34:00.757268+0000","last_peered":"2024-04-26T12:34:00.757268+0000","last_clean":"2024-04-26T12:34:00.757268+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:34:00.757268+0000","last_undegraded":"2024-04-26T12:34:00.757268+0000","last_fullsized":"2024-04-26T12:34:00.757268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.757183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:25.221766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.860386+0000","last_change":"2024-04-26T12:33:47.860428+0000","last_active":"2024-04-26T12:33:47.860386+0000","last_peered":"2024-04-26T12:33:47.860386+0000","last_clean":"2024-04-26T12:33:47.860386+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:33:47.860386+0000","last_undegraded":"2024-04-26T12:33:47.860386+0000","last_fullsized":"2024-04-26T12:33:47.860386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.860284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:42.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.819119+0000","last_change":"2024-04-26T12:33:55.819147+0000","last_active":"2024-04-26T12:33:55.819119+0000","last_peered":"2024-04-26T12:33:55.819119+0000","last_clean":"2024-04-26T12:33:55.819119+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:33:55.819119+0000","last_undegraded":"2024-04-26T12:33:55.819119+0000","last_fullsized":"2024-04-26T12:33:55.819119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.819023+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:12.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.623546+0000","last_change":"2024-04-26T12:34:09.623569+0000","last_active":"2024-04-26T12:34:09.623546+0000","last_peered":"2024-04-26T12:34:09.623546+0000","last_clean":"2024-04-26T12:34:09.623546+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:34:09.623546+0000","last_undegraded":"2024-04-26T12:34:09.623546+0000","last_fullsized":"2024-04-26T12:34:09.623546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:34:09.623444+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:34:09.623444+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.623444+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:16.228875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.313982+0000","last_change":"2024-04-26T12:34:04.314012+0000","last_active":"2024-04-26T12:34:04.313982+0000","last_peered":"2024-04-26T12:34:04.313982+0000","last_clean":"2024-04-26T12:34:04.313982+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:34:04.313982+0000","last_undegraded":"2024-04-26T12:34:04.313982+0000","last_fullsized":"2024-04-26T12:34:04.313982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.313892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:49.817325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.582666+0000","last_change":"2024-04-26T12:33:51.582709+0000","last_active":"2024-04-26T12:33:51.582666+0000","last_peered":"2024-04-26T12:33:51.582666+0000","last_clean":"2024-04-26T12:33:51.582666+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:33:51.582666+0000","last_undegraded":"2024-04-26T12:33:51.582666+0000","last_fullsized":"2024-04-26T12:33:51.582666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.582551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:26.718562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.884196+0000","last_change":"2024-04-26T12:33:37.884246+0000","last_active":"2024-04-26T12:33:37.884196+0000","last_peered":"2024-04-26T12:33:37.884196+0000","last_clean":"2024-04-26T12:33:37.884196+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:33:37.884196+0000","last_undegraded":"2024-04-26T12:33:37.884196+0000","last_fullsized":"2024-04-26T12:33:37.884196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.884093+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:49.682928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.859025+0000","last_change":"2024-04-26T12:33:39.859050+0000","last_active":"2024-04-26T12:33:39.859025+0000","last_peered":"2024-04-26T12:33:39.859025+0000","last_clean":"2024-04-26T12:33:39.859025+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:33:39.859025+0000","last_undegraded":"2024-04-26T12:33:39.859025+0000","last_fullsized":"2024-04-26T12:33:39.859025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.858931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:37.129358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.450797+0000","last_change":"2024-04-26T12:34:27.450823+0000","last_active":"2024-04-26T12:34:27.450797+0000","last_peered":"2024-04-26T12:34:27.450797+0000","last_clean":"2024-04-26T12:34:27.450797+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:34:27.450797+0000","last_undegraded":"2024-04-26T12:34:27.450797+0000","last_fullsized":"2024-04-26T12:34:27.450797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:27.450670+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:27.450670+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.450670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:28.031703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.271818+0000","last_change":"2024-04-26T12:34:26.271846+0000","last_active":"2024-04-26T12:34:26.271818+0000","last_peered":"2024-04-26T12:34:26.271818+0000","last_clean":"2024-04-26T12:34:26.271818+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:34:26.271818+0000","last_undegraded":"2024-04-26T12:34:26.271818+0000","last_fullsized":"2024-04-26T12:34:26.271818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:26.271725+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:26.271725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.271725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:37.887067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.566622+0000","last_change":"2024-04-26T12:34:27.566652+0000","last_active":"2024-04-26T12:34:27.566622+0000","last_peered":"2024-04-26T12:34:27.566622+0000","last_clean":"2024-04-26T12:34:27.566622+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:34:27.566622+0000","last_undegraded":"2024-04-26T12:34:27.566622+0000","last_fullsized":"2024-04-26T12:34:27.566622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:27.566516+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:27.566516+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.566516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:12.334644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.457300+0000","last_change":"2024-04-26T12:33:46.457327+0000","last_active":"2024-04-26T12:33:46.457300+0000","last_peered":"2024-04-26T12:33:46.457300+0000","last_clean":"2024-04-26T12:33:46.457300+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:33:46.457300+0000","last_undegraded":"2024-04-26T12:33:46.457300+0000","last_fullsized":"2024-04-26T12:33:46.457300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.457219+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:47.671663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.342694+0000","last_change":"2024-04-26T12:33:38.342730+0000","last_active":"2024-04-26T12:33:38.342694+0000","last_peered":"2024-04-26T12:33:38.342694+0000","last_clean":"2024-04-26T12:33:38.342694+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:33:38.342694+0000","last_undegraded":"2024-04-26T12:33:38.342694+0000","last_fullsized":"2024-04-26T12:33:38.342694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.342608+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:02.654541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":394,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.668123+0000","last_change":"2024-04-26T12:34:07.668165+0000","last_active":"2024-04-26T12:34:07.668123+0000","last_peered":"2024-04-26T12:34:07.668123+0000","last_clean":"2024-04-26T12:34:07.668123+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:34:07.668123+0000","last_undegraded":"2024-04-26T12:34:07.668123+0000","last_fullsized":"2024-04-26T12:34:07.668123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.667991+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:57.252635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.255875+0000","last_change":"2024-04-26T12:34:21.255905+0000","last_active":"2024-04-26T12:34:21.255875+0000","last_peered":"2024-04-26T12:34:21.255875+0000","last_clean":"2024-04-26T12:34:21.255875+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:34:21.255875+0000","last_undegraded":"2024-04-26T12:34:21.255875+0000","last_fullsized":"2024-04-26T12:34:21.255875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:21.255772+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.255772+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.255772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:26.069167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.639814+0000","last_change":"2024-04-26T12:33:59.639842+0000","last_active":"2024-04-26T12:33:59.639814+0000","last_peered":"2024-04-26T12:33:59.639814+0000","last_clean":"2024-04-26T12:33:59.639814+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:33:59.639814+0000","last_undegraded":"2024-04-26T12:33:59.639814+0000","last_fullsized":"2024-04-26T12:33:59.639814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.639717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:28.819645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.834133+0000","last_change":"2024-04-26T12:34:24.834188+0000","last_active":"2024-04-26T12:34:24.834133+0000","last_peered":"2024-04-26T12:34:24.834133+0000","last_clean":"2024-04-26T12:34:24.834133+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:34:24.834133+0000","last_undegraded":"2024-04-26T12:34:24.834133+0000","last_fullsized":"2024-04-26T12:34:24.834133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.834032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.834032+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.834032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:40.390751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.942879+0000","last_change":"2024-04-26T12:33:33.942913+0000","last_active":"2024-04-26T12:33:33.942879+0000","last_peered":"2024-04-26T12:33:33.942879+0000","last_clean":"2024-04-26T12:33:33.942879+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:33:33.942879+0000","last_undegraded":"2024-04-26T12:33:33.942879+0000","last_fullsized":"2024-04-26T12:33:33.942879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.942777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:36.777412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.337516+0000","last_change":"2024-04-26T12:33:39.337566+0000","last_active":"2024-04-26T12:33:39.337516+0000","last_peered":"2024-04-26T12:33:39.337516+0000","last_clean":"2024-04-26T12:33:39.337516+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:33:39.337516+0000","last_undegraded":"2024-04-26T12:33:39.337516+0000","last_fullsized":"2024-04-26T12:33:39.337516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.337430+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:45.269245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.466047+0000","last_change":"2024-04-26T12:33:37.466107+0000","last_active":"2024-04-26T12:33:37.466047+0000","last_peered":"2024-04-26T12:33:37.466047+0000","last_clean":"2024-04-26T12:33:37.466047+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:37.466047+0000","last_undegraded":"2024-04-26T12:33:37.466047+0000","last_fullsized":"2024-04-26T12:33:37.466047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.465931+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.639099+0000","last_change":"2024-04-26T12:34:08.639127+0000","last_active":"2024-04-26T12:34:08.639099+0000","last_peered":"2024-04-26T12:34:08.639099+0000","last_clean":"2024-04-26T12:34:08.639099+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:34:08.639099+0000","last_undegraded":"2024-04-26T12:34:08.639099+0000","last_fullsized":"2024-04-26T12:34:08.639099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:08.639013+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:08.639013+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.639013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:31.061812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.373042+0000","last_change":"2024-04-26T12:34:00.373086+0000","last_active":"2024-04-26T12:34:00.373042+0000","last_peered":"2024-04-26T12:34:00.373042+0000","last_clean":"2024-04-26T12:34:00.373042+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:34:00.373042+0000","last_undegraded":"2024-04-26T12:34:00.373042+0000","last_fullsized":"2024-04-26T12:34:00.373042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.372929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:27.486437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.872556+0000","last_change":"2024-04-26T12:33:46.872579+0000","last_active":"2024-04-26T12:33:46.872556+0000","last_peered":"2024-04-26T12:33:46.872556+0000","last_clean":"2024-04-26T12:33:46.872556+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:33:46.872556+0000","last_undegraded":"2024-04-26T12:33:46.872556+0000","last_fullsized":"2024-04-26T12:33:46.872556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.872459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:20.085162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'54","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.341024+0000","last_change":"2024-04-26T12:33:40.341067+0000","last_active":"2024-04-26T12:33:40.341024+0000","last_peered":"2024-04-26T12:33:40.341024+0000","last_clean":"2024-04-26T12:33:40.341024+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:33:40.341024+0000","last_undegraded":"2024-04-26T12:33:40.341024+0000","last_fullsized":"2024-04-26T12:33:40.341024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.340927+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:00.228500+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.457485+0000","last_change":"2024-04-26T12:33:34.457526+0000","last_active":"2024-04-26T12:33:34.457485+0000","last_peered":"2024-04-26T12:33:34.457485+0000","last_clean":"2024-04-26T12:33:34.457485+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:33:34.457485+0000","last_undegraded":"2024-04-26T12:33:34.457485+0000","last_fullsized":"2024-04-26T12:33:34.457485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.457383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:18.910969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.259324+0000","last_change":"2024-04-26T12:34:22.259347+0000","last_active":"2024-04-26T12:34:22.259324+0000","last_peered":"2024-04-26T12:34:22.259324+0000","last_clean":"2024-04-26T12:34:22.259324+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:34:22.259324+0000","last_undegraded":"2024-04-26T12:34:22.259324+0000","last_fullsized":"2024-04-26T12:34:22.259324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:34:22.259235+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:34:22.259235+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.259235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:23.699604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.791124+0000","last_change":"2024-04-26T12:34:05.791149+0000","last_active":"2024-04-26T12:34:05.791124+0000","last_peered":"2024-04-26T12:34:05.791124+0000","last_clean":"2024-04-26T12:34:05.791124+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:34:05.791124+0000","last_undegraded":"2024-04-26T12:34:05.791124+0000","last_fullsized":"2024-04-26T12:34:05.791124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.791018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:41.156216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.216148+0000","last_change":"2024-04-26T12:34:14.216174+0000","last_active":"2024-04-26T12:34:14.216148+0000","last_peered":"2024-04-26T12:34:14.216148+0000","last_clean":"2024-04-26T12:34:14.216148+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:34:14.216148+0000","last_undegraded":"2024-04-26T12:34:14.216148+0000","last_fullsized":"2024-04-26T12:34:14.216148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:14.216059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:14.216059+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.216059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:23.021916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.534447+0000","last_change":"2024-04-26T12:33:50.534500+0000","last_active":"2024-04-26T12:33:50.534447+0000","last_peered":"2024-04-26T12:33:50.534447+0000","last_clean":"2024-04-26T12:33:50.534447+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:33:50.534447+0000","last_undegraded":"2024-04-26T12:33:50.534447+0000","last_fullsized":"2024-04-26T12:33:50.534447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.534336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:36.444391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'40","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.724217+0000","last_change":"2024-04-26T12:34:02.724251+0000","last_active":"2024-04-26T12:34:02.724217+0000","last_peered":"2024-04-26T12:34:02.724217+0000","last_clean":"2024-04-26T12:34:02.724217+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:34:02.724217+0000","last_undegraded":"2024-04-26T12:34:02.724217+0000","last_fullsized":"2024-04-26T12:34:02.724217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.724129+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.917634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.451858+0000","last_change":"2024-04-26T12:33:36.451884+0000","last_active":"2024-04-26T12:33:36.451858+0000","last_peered":"2024-04-26T12:33:36.451858+0000","last_clean":"2024-04-26T12:33:36.451858+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:33:36.451858+0000","last_undegraded":"2024-04-26T12:33:36.451858+0000","last_fullsized":"2024-04-26T12:33:36.451858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.451767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:45.412706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.821168+0000","last_change":"2024-04-26T12:34:26.821196+0000","last_active":"2024-04-26T12:34:26.821168+0000","last_peered":"2024-04-26T12:34:26.821168+0000","last_clean":"2024-04-26T12:34:26.821168+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:34:26.821168+0000","last_undegraded":"2024-04-26T12:34:26.821168+0000","last_fullsized":"2024-04-26T12:34:26.821168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:26.821082+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:26.821082+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.821082+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:15.323997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.334417+0000","last_change":"2024-04-26T12:34:01.334451+0000","last_active":"2024-04-26T12:34:01.334417+0000","last_peered":"2024-04-26T12:34:01.334417+0000","last_clean":"2024-04-26T12:34:01.334417+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:34:01.334417+0000","last_undegraded":"2024-04-26T12:34:01.334417+0000","last_fullsized":"2024-04-26T12:34:01.334417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.334329+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:19.047133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:28.115731+0000","last_change":"2024-04-26T12:30:10.524374+0000","last_active":"2024-04-26T12:33:28.115731+0000","last_peered":"2024-04-26T12:33:28.115731+0000","last_clean":"2024-04-26T12:33:28.115731+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:33:28.115731+0000","last_undegraded":"2024-04-26T12:33:28.115731+0000","last_fullsized":"2024-04-26T12:33:28.115731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.471002+0000","last_change":"2024-04-26T12:33:47.471028+0000","last_active":"2024-04-26T12:33:47.471002+0000","last_peered":"2024-04-26T12:33:47.471002+0000","last_clean":"2024-04-26T12:33:47.471002+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:33:47.471002+0000","last_undegraded":"2024-04-26T12:33:47.471002+0000","last_fullsized":"2024-04-26T12:33:47.471002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.470897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:56.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.902395+0000","last_change":"2024-04-26T12:33:51.902471+0000","last_active":"2024-04-26T12:33:51.902395+0000","last_peered":"2024-04-26T12:33:51.902395+0000","last_clean":"2024-04-26T12:33:51.902395+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:33:51.902395+0000","last_undegraded":"2024-04-26T12:33:51.902395+0000","last_fullsized":"2024-04-26T12:33:51.902395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.902291+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:22.459245+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.490354+0000","last_change":"2024-04-26T12:33:48.490381+0000","last_active":"2024-04-26T12:33:48.490354+0000","last_peered":"2024-04-26T12:33:48.490354+0000","last_clean":"2024-04-26T12:33:48.490354+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:48.490354+0000","last_undegraded":"2024-04-26T12:33:48.490354+0000","last_fullsized":"2024-04-26T12:33:48.490354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.490266+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:44.425107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.500397+0000","last_change":"2024-04-26T12:30:20.531457+0000","last_active":"2024-04-26T12:32:32.500397+0000","last_peered":"2024-04-26T12:32:32.500397+0000","last_clean":"2024-04-26T12:32:32.500397+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:32:32.500397+0000","last_undegraded":"2024-04-26T12:32:32.500397+0000","last_fullsized":"2024-04-26T12:32:32.500397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.255220+0000","last_change":"2024-04-26T12:34:19.255286+0000","last_active":"2024-04-26T12:34:19.255220+0000","last_peered":"2024-04-26T12:34:19.255220+0000","last_clean":"2024-04-26T12:34:19.255220+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:34:19.255220+0000","last_undegraded":"2024-04-26T12:34:19.255220+0000","last_fullsized":"2024-04-26T12:34:19.255220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:19.255094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:19.255094+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.255094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:13.286904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511585+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:32:28.511585+0000","last_peered":"2024-04-26T12:32:28.511585+0000","last_clean":"2024-04-26T12:32:28.511585+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:32:28.511585+0000","last_undegraded":"2024-04-26T12:32:28.511585+0000","last_fullsized":"2024-04-26T12:32:28.511585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.284415+0000","last_change":"2024-04-26T12:34:24.284479+0000","last_active":"2024-04-26T12:34:24.284415+0000","last_peered":"2024-04-26T12:34:24.284415+0000","last_clean":"2024-04-26T12:34:24.284415+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:34:24.284415+0000","last_undegraded":"2024-04-26T12:34:24.284415+0000","last_fullsized":"2024-04-26T12:34:24.284415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.284319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.284319+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.284319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:44.396150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.025608+0000","last_change":"2024-04-26T12:33:46.025645+0000","last_active":"2024-04-26T12:33:46.025608+0000","last_peered":"2024-04-26T12:33:46.025608+0000","last_clean":"2024-04-26T12:33:46.025608+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:33:46.025608+0000","last_undegraded":"2024-04-26T12:33:46.025608+0000","last_fullsized":"2024-04-26T12:33:46.025608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.025519+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:28.207080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.486173+0000","last_change":"2024-04-26T12:33:32.486192+0000","last_active":"2024-04-26T12:33:32.486173+0000","last_peered":"2024-04-26T12:33:32.486173+0000","last_clean":"2024-04-26T12:33:32.486173+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:33:32.486173+0000","last_undegraded":"2024-04-26T12:33:32.486173+0000","last_fullsized":"2024-04-26T12:33:32.486173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.486110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:19.318546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.625115+0000","last_change":"2024-04-26T12:34:00.625149+0000","last_active":"2024-04-26T12:34:00.625115+0000","last_peered":"2024-04-26T12:34:00.625115+0000","last_clean":"2024-04-26T12:34:00.625115+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:34:00.625115+0000","last_undegraded":"2024-04-26T12:34:00.625115+0000","last_fullsized":"2024-04-26T12:34:00.625115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.625009+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.384957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.852380+0000","last_change":"2024-04-26T12:33:56.852418+0000","last_active":"2024-04-26T12:33:56.852380+0000","last_peered":"2024-04-26T12:33:56.852380+0000","last_clean":"2024-04-26T12:33:56.852380+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:33:56.852380+0000","last_undegraded":"2024-04-26T12:33:56.852380+0000","last_fullsized":"2024-04-26T12:33:56.852380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.852284+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.300655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.537980+0000","last_change":"2024-04-26T12:34:13.538013+0000","last_active":"2024-04-26T12:34:13.537980+0000","last_peered":"2024-04-26T12:34:13.537980+0000","last_clean":"2024-04-26T12:34:13.537980+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:34:13.537980+0000","last_undegraded":"2024-04-26T12:34:13.537980+0000","last_fullsized":"2024-04-26T12:34:13.537980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:13.537899+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:13.537899+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.537899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:14.978267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.377168+0000","last_change":"2024-04-26T12:33:52.377200+0000","last_active":"2024-04-26T12:33:52.377168+0000","last_peered":"2024-04-26T12:33:52.377168+0000","last_clean":"2024-04-26T12:33:52.377168+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:33:52.377168+0000","last_undegraded":"2024-04-26T12:33:52.377168+0000","last_fullsized":"2024-04-26T12:33:52.377168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.377072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:20.049145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.870529+0000","last_change":"2024-04-26T12:33:40.870573+0000","last_active":"2024-04-26T12:33:40.870529+0000","last_peered":"2024-04-26T12:33:40.870529+0000","last_clean":"2024-04-26T12:33:40.870529+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:33:40.870529+0000","last_undegraded":"2024-04-26T12:33:40.870529+0000","last_fullsized":"2024-04-26T12:33:40.870529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.870443+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:06.471328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.854614+0000","last_change":"2024-04-26T12:33:53.854635+0000","last_active":"2024-04-26T12:33:53.854614+0000","last_peered":"2024-04-26T12:33:53.854614+0000","last_clean":"2024-04-26T12:33:53.854614+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:33:53.854614+0000","last_undegraded":"2024-04-26T12:33:53.854614+0000","last_fullsized":"2024-04-26T12:33:53.854614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.854523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:51.983807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.270874+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:33:32.270874+0000","last_peered":"2024-04-26T12:33:32.270874+0000","last_clean":"2024-04-26T12:33:32.270874+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:33:32.270874+0000","last_undegraded":"2024-04-26T12:33:32.270874+0000","last_fullsized":"2024-04-26T12:33:32.270874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.957299+0000","last_change":"2024-04-26T12:33:48.957328+0000","last_active":"2024-04-26T12:33:48.957299+0000","last_peered":"2024-04-26T12:33:48.957299+0000","last_clean":"2024-04-26T12:33:48.957299+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:33:48.957299+0000","last_undegraded":"2024-04-26T12:33:48.957299+0000","last_fullsized":"2024-04-26T12:33:48.957299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.957209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:19.960752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.529454+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:21.529454+0000","last_peered":"2024-04-26T12:33:21.529454+0000","last_clean":"2024-04-26T12:33:21.529454+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:21.529454+0000","last_undegraded":"2024-04-26T12:33:21.529454+0000","last_fullsized":"2024-04-26T12:33:21.529454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.485557+0000","last_change":"2024-04-26T12:33:49.485594+0000","last_active":"2024-04-26T12:33:49.485557+0000","last_peered":"2024-04-26T12:33:49.485557+0000","last_clean":"2024-04-26T12:33:49.485557+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:33:49.485557+0000","last_undegraded":"2024-04-26T12:33:49.485557+0000","last_fullsized":"2024-04-26T12:33:49.485557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.485434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.630769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.335357+0000","last_change":"2024-04-26T12:33:43.335394+0000","last_active":"2024-04-26T12:33:43.335357+0000","last_peered":"2024-04-26T12:33:43.335357+0000","last_clean":"2024-04-26T12:33:43.335357+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:33:43.335357+0000","last_undegraded":"2024-04-26T12:33:43.335357+0000","last_fullsized":"2024-04-26T12:33:43.335357+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.335257+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:44.822905+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":421,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.325088+0000","last_change":"2024-04-26T12:33:41.325114+0000","last_active":"2024-04-26T12:33:41.325088+0000","last_peered":"2024-04-26T12:33:41.325088+0000","last_clean":"2024-04-26T12:33:41.325088+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:41.325088+0000","last_undegraded":"2024-04-26T12:33:41.325088+0000","last_fullsized":"2024-04-26T12:33:41.325088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.325000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:42.600411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.588369+0000","last_change":"2024-04-26T12:30:20.523809+0000","last_active":"2024-04-26T12:33:21.588369+0000","last_peered":"2024-04-26T12:33:21.588369+0000","last_clean":"2024-04-26T12:33:21.588369+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:33:21.588369+0000","last_undegraded":"2024-04-26T12:33:21.588369+0000","last_fullsized":"2024-04-26T12:33:21.588369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.271796+0000","last_change":"2024-04-26T12:34:05.271830+0000","last_active":"2024-04-26T12:34:05.271796+0000","last_peered":"2024-04-26T12:34:05.271796+0000","last_clean":"2024-04-26T12:34:05.271796+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:34:05.271796+0000","last_undegraded":"2024-04-26T12:34:05.271796+0000","last_fullsized":"2024-04-26T12:34:05.271796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.271706+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:10.784909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.607740+0000","last_change":"2024-04-26T12:34:24.607765+0000","last_active":"2024-04-26T12:34:24.607740+0000","last_peered":"2024-04-26T12:34:24.607740+0000","last_clean":"2024-04-26T12:34:24.607740+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:34:24.607740+0000","last_undegraded":"2024-04-26T12:34:24.607740+0000","last_fullsized":"2024-04-26T12:34:24.607740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.607633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.607633+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.607633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:36.469232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.919470+0000","last_change":"2024-04-26T12:33:41.919526+0000","last_active":"2024-04-26T12:33:41.919470+0000","last_peered":"2024-04-26T12:33:41.919470+0000","last_clean":"2024-04-26T12:33:41.919470+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:33:41.919470+0000","last_undegraded":"2024-04-26T12:33:41.919470+0000","last_fullsized":"2024-04-26T12:33:41.919470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.919360+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:08.145030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.033598+0000","last_change":"2024-04-26T12:33:38.033639+0000","last_active":"2024-04-26T12:33:38.033598+0000","last_peered":"2024-04-26T12:33:38.033598+0000","last_clean":"2024-04-26T12:33:38.033598+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:33:38.033598+0000","last_undegraded":"2024-04-26T12:33:38.033598+0000","last_fullsized":"2024-04-26T12:33:38.033598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.033508+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:09.947838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":511,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.012770+0000","last_change":"2024-04-26T12:33:33.012799+0000","last_active":"2024-04-26T12:33:33.012770+0000","last_peered":"2024-04-26T12:33:33.012770+0000","last_clean":"2024-04-26T12:33:33.012770+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:33.012770+0000","last_undegraded":"2024-04-26T12:33:33.012770+0000","last_fullsized":"2024-04-26T12:33:33.012770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.012673+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.693315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.329838+0000","last_change":"2024-04-26T12:33:53.329889+0000","last_active":"2024-04-26T12:33:53.329838+0000","last_peered":"2024-04-26T12:33:53.329838+0000","last_clean":"2024-04-26T12:33:53.329838+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:53.329838+0000","last_undegraded":"2024-04-26T12:33:53.329838+0000","last_fullsized":"2024-04-26T12:33:53.329838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.329710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:13.585776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'18","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.835018+0000","last_change":"2024-04-26T12:33:57.835053+0000","last_active":"2024-04-26T12:33:57.835018+0000","last_peered":"2024-04-26T12:33:57.835018+0000","last_clean":"2024-04-26T12:33:57.835018+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:57.835018+0000","last_undegraded":"2024-04-26T12:33:57.835018+0000","last_fullsized":"2024-04-26T12:33:57.835018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.834902+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:31.144768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.584386+0000","last_change":"2024-04-26T12:34:26.584425+0000","last_active":"2024-04-26T12:34:26.584386+0000","last_peered":"2024-04-26T12:34:26.584386+0000","last_clean":"2024-04-26T12:34:26.584386+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:34:26.584386+0000","last_undegraded":"2024-04-26T12:34:26.584386+0000","last_fullsized":"2024-04-26T12:34:26.584386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:26.584268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:26.584268+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.584268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:32.141285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.972942+0000","last_change":"2024-04-26T12:33:32.972968+0000","last_active":"2024-04-26T12:33:32.972942+0000","last_peered":"2024-04-26T12:33:32.972942+0000","last_clean":"2024-04-26T12:33:32.972942+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:33:32.972942+0000","last_undegraded":"2024-04-26T12:33:32.972942+0000","last_fullsized":"2024-04-26T12:33:32.972942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.972836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:10.206586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.924883+0000","last_change":"2024-04-26T12:33:36.924967+0000","last_active":"2024-04-26T12:33:36.924883+0000","last_peered":"2024-04-26T12:33:36.924883+0000","last_clean":"2024-04-26T12:33:36.924883+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:33:36.924883+0000","last_undegraded":"2024-04-26T12:33:36.924883+0000","last_fullsized":"2024-04-26T12:33:36.924883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.924772+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:29.763584+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.358794+0000","last_change":"2024-04-26T12:33:37.358839+0000","last_active":"2024-04-26T12:33:37.358794+0000","last_peered":"2024-04-26T12:33:37.358794+0000","last_clean":"2024-04-26T12:33:37.358794+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:33:37.358794+0000","last_undegraded":"2024-04-26T12:33:37.358794+0000","last_fullsized":"2024-04-26T12:33:37.358794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.358703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:07.891090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.830420+0000","last_change":"2024-04-26T12:33:51.830448+0000","last_active":"2024-04-26T12:33:51.830420+0000","last_peered":"2024-04-26T12:33:51.830420+0000","last_clean":"2024-04-26T12:33:51.830420+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:51.830420+0000","last_undegraded":"2024-04-26T12:33:51.830420+0000","last_fullsized":"2024-04-26T12:33:51.830420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.830335+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:23.254930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.916310+0000","last_change":"2024-04-26T12:33:49.916310+0000","last_active":"2024-04-26T12:33:49.916310+0000","last_peered":"2024-04-26T12:33:49.916310+0000","last_clean":"2024-04-26T12:33:49.916310+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:49.916310+0000","last_undegraded":"2024-04-26T12:33:49.916310+0000","last_fullsized":"2024-04-26T12:33:49.916310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.916195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:02.556981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.900215+0000","last_change":"2024-04-26T12:34:17.900270+0000","last_active":"2024-04-26T12:34:17.900215+0000","last_peered":"2024-04-26T12:34:17.900215+0000","last_clean":"2024-04-26T12:34:17.900215+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:34:17.900215+0000","last_undegraded":"2024-04-26T12:34:17.900215+0000","last_fullsized":"2024-04-26T12:34:17.900215+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-26T12:34:17.900111+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-26T12:34:17.900111+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.900111+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.661828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269416+0000","last_change":"2024-04-26T12:30:01.439676+0000","last_active":"2024-04-26T12:33:32.269416+0000","last_peered":"2024-04-26T12:33:32.269416+0000","last_clean":"2024-04-26T12:33:32.269416+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:33:32.269416+0000","last_undegraded":"2024-04-26T12:33:32.269416+0000","last_fullsized":"2024-04-26T12:33:32.269416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269523+0000","last_change":"2024-04-26T12:30:10.518603+0000","last_active":"2024-04-26T12:33:32.269523+0000","last_peered":"2024-04-26T12:33:32.269523+0000","last_clean":"2024-04-26T12:33:32.269523+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:33:32.269523+0000","last_undegraded":"2024-04-26T12:33:32.269523+0000","last_fullsized":"2024-04-26T12:33:32.269523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.891610+0000","last_change":"2024-04-26T12:33:45.891610+0000","last_active":"2024-04-26T12:33:45.891610+0000","last_peered":"2024-04-26T12:33:45.891610+0000","last_clean":"2024-04-26T12:33:45.891610+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:33:45.891610+0000","last_undegraded":"2024-04-26T12:33:45.891610+0000","last_fullsized":"2024-04-26T12:33:45.891610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.891453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:38.825131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.748539+0000","last_change":"2024-04-26T12:34:04.748578+0000","last_active":"2024-04-26T12:34:04.748539+0000","last_peered":"2024-04-26T12:34:04.748539+0000","last_clean":"2024-04-26T12:34:04.748539+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:34:04.748539+0000","last_undegraded":"2024-04-26T12:34:04.748539+0000","last_fullsized":"2024-04-26T12:34:04.748539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.748449+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:37.997307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.459707+0000","last_change":"2024-04-26T12:33:44.459732+0000","last_active":"2024-04-26T12:33:44.459707+0000","last_peered":"2024-04-26T12:33:44.459707+0000","last_clean":"2024-04-26T12:33:44.459707+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:33:44.459707+0000","last_undegraded":"2024-04-26T12:33:44.459707+0000","last_fullsized":"2024-04-26T12:33:44.459707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.459618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:37.847661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.385577+0000","last_change":"2024-04-26T12:33:49.385606+0000","last_active":"2024-04-26T12:33:49.385577+0000","last_peered":"2024-04-26T12:33:49.385577+0000","last_clean":"2024-04-26T12:33:49.385577+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:49.385577+0000","last_undegraded":"2024-04-26T12:33:49.385577+0000","last_fullsized":"2024-04-26T12:33:49.385577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.385474+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:25.473005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.651585+0000","last_change":"2024-04-26T12:34:17.651628+0000","last_active":"2024-04-26T12:34:17.651585+0000","last_peered":"2024-04-26T12:34:17.651585+0000","last_clean":"2024-04-26T12:34:17.651585+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:34:17.651585+0000","last_undegraded":"2024-04-26T12:34:17.651585+0000","last_fullsized":"2024-04-26T12:34:17.651585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:17.651456+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:17.651456+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.651456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:57.164554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269409+0000","last_change":"2024-04-26T12:30:01.440525+0000","last_active":"2024-04-26T12:33:32.269409+0000","last_peered":"2024-04-26T12:33:32.269409+0000","last_clean":"2024-04-26T12:33:32.269409+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:33:32.269409+0000","last_undegraded":"2024-04-26T12:33:32.269409+0000","last_fullsized":"2024-04-26T12:33:32.269409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.577169+0000","last_change":"2024-04-26T12:34:20.577169+0000","last_active":"2024-04-26T12:34:20.577169+0000","last_peered":"2024-04-26T12:34:20.577169+0000","last_clean":"2024-04-26T12:34:20.577169+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:34:20.577169+0000","last_undegraded":"2024-04-26T12:34:20.577169+0000","last_fullsized":"2024-04-26T12:34:20.577169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:20.577044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:20.577044+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.577044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:08.079282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.990319+0000","last_change":"2024-04-26T12:33:34.990341+0000","last_active":"2024-04-26T12:33:34.990319+0000","last_peered":"2024-04-26T12:33:34.990319+0000","last_clean":"2024-04-26T12:33:34.990319+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:33:34.990319+0000","last_undegraded":"2024-04-26T12:33:34.990319+0000","last_fullsized":"2024-04-26T12:33:34.990319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.990216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:51.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":516,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.968276+0000","last_change":"2024-04-26T12:33:34.968276+0000","last_active":"2024-04-26T12:33:34.968276+0000","last_peered":"2024-04-26T12:33:34.968276+0000","last_clean":"2024-04-26T12:33:34.968276+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:34.968276+0000","last_undegraded":"2024-04-26T12:33:34.968276+0000","last_fullsized":"2024-04-26T12:33:34.968276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.968125+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:55.925235+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.757744+0000","last_change":"2024-04-26T12:34:03.757744+0000","last_active":"2024-04-26T12:34:03.757744+0000","last_peered":"2024-04-26T12:34:03.757744+0000","last_clean":"2024-04-26T12:34:03.757744+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:34:03.757744+0000","last_undegraded":"2024-04-26T12:34:03.757744+0000","last_fullsized":"2024-04-26T12:34:03.757744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.757597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:19.314316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.815067+0000","last_change":"2024-04-26T12:34:27.815095+0000","last_active":"2024-04-26T12:34:27.815067+0000","last_peered":"2024-04-26T12:34:27.815067+0000","last_clean":"2024-04-26T12:34:27.815067+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:34:27.815067+0000","last_undegraded":"2024-04-26T12:34:27.815067+0000","last_fullsized":"2024-04-26T12:34:27.815067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:27.814977+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:27.814977+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.814977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:54.716214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'32","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.678106+0000","last_change":"2024-04-26T12:33:58.678134+0000","last_active":"2024-04-26T12:33:58.678106+0000","last_peered":"2024-04-26T12:33:58.678106+0000","last_clean":"2024-04-26T12:33:58.678106+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:33:58.678106+0000","last_undegraded":"2024-04-26T12:33:58.678106+0000","last_fullsized":"2024-04-26T12:33:58.678106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.678019+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:17.835330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.202870+0000","last_change":"2024-04-26T12:34:11.202870+0000","last_active":"2024-04-26T12:34:11.202870+0000","last_peered":"2024-04-26T12:34:11.202870+0000","last_clean":"2024-04-26T12:34:11.202870+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:34:11.202870+0000","last_undegraded":"2024-04-26T12:34:11.202870+0000","last_fullsized":"2024-04-26T12:34:11.202870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:11.202740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:11.202740+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.202740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:08.255369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.584357+0000","last_change":"2024-04-26T12:34:23.584386+0000","last_active":"2024-04-26T12:34:23.584357+0000","last_peered":"2024-04-26T12:34:23.584357+0000","last_clean":"2024-04-26T12:34:23.584357+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:34:23.584357+0000","last_undegraded":"2024-04-26T12:34:23.584357+0000","last_fullsized":"2024-04-26T12:34:23.584357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:23.584266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:23.584266+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.584266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:08.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.355115+0000","last_change":"2024-04-26T12:33:47.355150+0000","last_active":"2024-04-26T12:33:47.355115+0000","last_peered":"2024-04-26T12:33:47.355115+0000","last_clean":"2024-04-26T12:33:47.355115+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:33:47.355115+0000","last_undegraded":"2024-04-26T12:33:47.355115+0000","last_fullsized":"2024-04-26T12:33:47.355115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.355025+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:37.323218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.293799+0000","last_change":"2024-04-26T12:33:44.293799+0000","last_active":"2024-04-26T12:33:44.293799+0000","last_peered":"2024-04-26T12:33:44.293799+0000","last_clean":"2024-04-26T12:33:44.293799+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:44.293799+0000","last_undegraded":"2024-04-26T12:33:44.293799+0000","last_fullsized":"2024-04-26T12:33:44.293799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.293656+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:52.328074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.614593+0000","last_change":"2024-04-26T12:33:56.614615+0000","last_active":"2024-04-26T12:33:56.614593+0000","last_peered":"2024-04-26T12:33:56.614593+0000","last_clean":"2024-04-26T12:33:56.614593+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:33:56.614593+0000","last_undegraded":"2024-04-26T12:33:56.614593+0000","last_fullsized":"2024-04-26T12:33:56.614593+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.614468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:09.789955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.649499+0000","last_change":"2024-04-26T12:34:23.649526+0000","last_active":"2024-04-26T12:34:23.649499+0000","last_peered":"2024-04-26T12:34:23.649499+0000","last_clean":"2024-04-26T12:34:23.649499+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:34:23.649499+0000","last_undegraded":"2024-04-26T12:34:23.649499+0000","last_fullsized":"2024-04-26T12:34:23.649499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:23.649405+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:23.649405+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.649405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:28.507228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.522505+0000","last_change":"2024-04-26T12:34:12.522505+0000","last_active":"2024-04-26T12:34:12.522505+0000","last_peered":"2024-04-26T12:34:12.522505+0000","last_clean":"2024-04-26T12:34:12.522505+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:34:12.522505+0000","last_undegraded":"2024-04-26T12:34:12.522505+0000","last_fullsized":"2024-04-26T12:34:12.522505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.522395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.522395+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.522395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:17.335789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269442+0000","last_change":"2024-04-26T12:30:01.441132+0000","last_active":"2024-04-26T12:33:32.269442+0000","last_peered":"2024-04-26T12:33:32.269442+0000","last_clean":"2024-04-26T12:33:32.269442+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:33:32.269442+0000","last_undegraded":"2024-04-26T12:33:32.269442+0000","last_fullsized":"2024-04-26T12:33:32.269442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.191902+0000","last_change":"2024-04-26T12:34:13.191902+0000","last_active":"2024-04-26T12:34:13.191902+0000","last_peered":"2024-04-26T12:34:13.191902+0000","last_clean":"2024-04-26T12:34:13.191902+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:34:13.191902+0000","last_undegraded":"2024-04-26T12:34:13.191902+0000","last_fullsized":"2024-04-26T12:34:13.191902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:13.191778+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:13.191778+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.191778+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:23.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.628392+0000","last_change":"2024-04-26T12:33:54.628392+0000","last_active":"2024-04-26T12:33:54.628392+0000","last_peered":"2024-04-26T12:33:54.628392+0000","last_clean":"2024-04-26T12:33:54.628392+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:33:54.628392+0000","last_undegraded":"2024-04-26T12:33:54.628392+0000","last_fullsized":"2024-04-26T12:33:54.628392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.628252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:07.053904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.999843+0000","last_change":"2024-04-26T12:33:47.999880+0000","last_active":"2024-04-26T12:33:47.999843+0000","last_peered":"2024-04-26T12:33:47.999843+0000","last_clean":"2024-04-26T12:33:47.999843+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:47.999843+0000","last_undegraded":"2024-04-26T12:33:47.999843+0000","last_fullsized":"2024-04-26T12:33:47.999843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.999755+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:40.140297+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.813198+0000","last_change":"2024-04-26T12:33:55.813237+0000","last_active":"2024-04-26T12:33:55.813198+0000","last_peered":"2024-04-26T12:33:55.813198+0000","last_clean":"2024-04-26T12:33:55.813198+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:33:55.813198+0000","last_undegraded":"2024-04-26T12:33:55.813198+0000","last_fullsized":"2024-04-26T12:33:55.813198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.813058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:32.755533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511815+0000","last_change":"2024-04-26T12:30:20.535350+0000","last_active":"2024-04-26T12:32:33.511815+0000","last_peered":"2024-04-26T12:32:33.511815+0000","last_clean":"2024-04-26T12:32:33.511815+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:32:33.511815+0000","last_undegraded":"2024-04-26T12:32:33.511815+0000","last_fullsized":"2024-04-26T12:32:33.511815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.819534+0000","last_change":"2024-04-26T12:34:03.819534+0000","last_active":"2024-04-26T12:34:03.819534+0000","last_peered":"2024-04-26T12:34:03.819534+0000","last_clean":"2024-04-26T12:34:03.819534+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:34:03.819534+0000","last_undegraded":"2024-04-26T12:34:03.819534+0000","last_fullsized":"2024-04-26T12:34:03.819534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.819412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:28.268336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.192622+0000","last_change":"2024-04-26T12:34:17.192622+0000","last_active":"2024-04-26T12:34:17.192622+0000","last_peered":"2024-04-26T12:34:17.192622+0000","last_clean":"2024-04-26T12:34:17.192622+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:34:17.192622+0000","last_undegraded":"2024-04-26T12:34:17.192622+0000","last_fullsized":"2024-04-26T12:34:17.192622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:17.192508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:17.192508+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.192508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.601445+0000","last_change":"2024-04-26T12:34:19.601474+0000","last_active":"2024-04-26T12:34:19.601445+0000","last_peered":"2024-04-26T12:34:19.601445+0000","last_clean":"2024-04-26T12:34:19.601445+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:34:19.601445+0000","last_undegraded":"2024-04-26T12:34:19.601445+0000","last_fullsized":"2024-04-26T12:34:19.601445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:19.601341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:19.601341+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.601341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:40.439925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.586839+0000","last_change":"2024-04-26T12:33:53.586839+0000","last_active":"2024-04-26T12:33:53.586839+0000","last_peered":"2024-04-26T12:33:53.586839+0000","last_clean":"2024-04-26T12:33:53.586839+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:33:53.586839+0000","last_undegraded":"2024-04-26T12:33:53.586839+0000","last_fullsized":"2024-04-26T12:33:53.586839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.586700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:09.928615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.434204+0000","last_change":"2024-04-26T12:33:39.434204+0000","last_active":"2024-04-26T12:33:39.434204+0000","last_peered":"2024-04-26T12:33:39.434204+0000","last_clean":"2024-04-26T12:33:39.434204+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:33:39.434204+0000","last_undegraded":"2024-04-26T12:33:39.434204+0000","last_fullsized":"2024-04-26T12:33:39.434204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.434024+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:15.521556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.280568+0000","last_change":"2024-04-26T12:33:32.280612+0000","last_active":"2024-04-26T12:33:32.280568+0000","last_peered":"2024-04-26T12:33:32.280568+0000","last_clean":"2024-04-26T12:33:32.280568+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:33:32.280568+0000","last_undegraded":"2024-04-26T12:33:32.280568+0000","last_fullsized":"2024-04-26T12:33:32.280568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.280461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:13.869333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.501146+0000","last_change":"2024-04-26T12:30:20.527189+0000","last_active":"2024-04-26T12:32:37.501146+0000","last_peered":"2024-04-26T12:32:37.501146+0000","last_clean":"2024-04-26T12:32:37.501146+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:32:37.501146+0000","last_undegraded":"2024-04-26T12:32:37.501146+0000","last_fullsized":"2024-04-26T12:32:37.501146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.773240+0000","last_change":"2024-04-26T12:34:02.773240+0000","last_active":"2024-04-26T12:34:02.773240+0000","last_peered":"2024-04-26T12:34:02.773240+0000","last_clean":"2024-04-26T12:34:02.773240+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:34:02.773240+0000","last_undegraded":"2024-04-26T12:34:02.773240+0000","last_fullsized":"2024-04-26T12:34:02.773240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.773121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:07.596283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.485557+0000","last_change":"2024-04-26T12:34:11.485557+0000","last_active":"2024-04-26T12:34:11.485557+0000","last_peered":"2024-04-26T12:34:11.485557+0000","last_clean":"2024-04-26T12:34:11.485557+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:34:11.485557+0000","last_undegraded":"2024-04-26T12:34:11.485557+0000","last_fullsized":"2024-04-26T12:34:11.485557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:11.485429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:11.485429+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.485429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:39.753319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269409+0000","last_change":"2024-04-26T12:30:01.440653+0000","last_active":"2024-04-26T12:33:32.269409+0000","last_peered":"2024-04-26T12:33:32.269409+0000","last_clean":"2024-04-26T12:33:32.269409+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:33:32.269409+0000","last_undegraded":"2024-04-26T12:33:32.269409+0000","last_fullsized":"2024-04-26T12:33:32.269409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.270349+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:33:32.270349+0000","last_peered":"2024-04-26T12:33:32.270349+0000","last_clean":"2024-04-26T12:33:32.270349+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:33:32.270349+0000","last_undegraded":"2024-04-26T12:33:32.270349+0000","last_fullsized":"2024-04-26T12:33:32.270349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.971703+0000","last_change":"2024-04-26T12:33:33.971703+0000","last_active":"2024-04-26T12:33:33.971703+0000","last_peered":"2024-04-26T12:33:33.971703+0000","last_clean":"2024-04-26T12:33:33.971703+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:33:33.971703+0000","last_undegraded":"2024-04-26T12:33:33.971703+0000","last_fullsized":"2024-04-26T12:33:33.971703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.971556+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:47.263739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.935865+0000","last_change":"2024-04-26T12:33:35.935865+0000","last_active":"2024-04-26T12:33:35.935865+0000","last_peered":"2024-04-26T12:33:35.935865+0000","last_clean":"2024-04-26T12:33:35.935865+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:35.935865+0000","last_undegraded":"2024-04-26T12:33:35.935865+0000","last_fullsized":"2024-04-26T12:33:35.935865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.935727+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.443130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.689221+0000","last_change":"2024-04-26T12:34:19.689247+0000","last_active":"2024-04-26T12:34:19.689221+0000","last_peered":"2024-04-26T12:34:19.689221+0000","last_clean":"2024-04-26T12:34:19.689221+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:34:19.689221+0000","last_undegraded":"2024-04-26T12:34:19.689221+0000","last_fullsized":"2024-04-26T12:34:19.689221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:19.689111+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:19.689111+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.689111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:08.076312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.853067+0000","last_change":"2024-04-26T12:33:52.853067+0000","last_active":"2024-04-26T12:33:52.853067+0000","last_peered":"2024-04-26T12:33:52.853067+0000","last_clean":"2024-04-26T12:33:52.853067+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:52.853067+0000","last_undegraded":"2024-04-26T12:33:52.853067+0000","last_fullsized":"2024-04-26T12:33:52.853067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.852918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:03.508340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510976+0000","last_change":"2024-04-26T12:30:10.516983+0000","last_active":"2024-04-26T12:32:23.510976+0000","last_peered":"2024-04-26T12:32:23.510976+0000","last_clean":"2024-04-26T12:32:23.510976+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:32:23.510976+0000","last_undegraded":"2024-04-26T12:32:23.510976+0000","last_fullsized":"2024-04-26T12:32:23.510976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.575719+0000","last_change":"2024-04-26T12:34:18.575719+0000","last_active":"2024-04-26T12:34:18.575719+0000","last_peered":"2024-04-26T12:34:18.575719+0000","last_clean":"2024-04-26T12:34:18.575719+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:34:18.575719+0000","last_undegraded":"2024-04-26T12:34:18.575719+0000","last_fullsized":"2024-04-26T12:34:18.575719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:18.575593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:18.575593+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.575593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:14.196858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.984631+0000","last_change":"2024-04-26T12:33:36.984631+0000","last_active":"2024-04-26T12:33:36.984631+0000","last_peered":"2024-04-26T12:33:36.984631+0000","last_clean":"2024-04-26T12:33:36.984631+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:33:36.984631+0000","last_undegraded":"2024-04-26T12:33:36.984631+0000","last_fullsized":"2024-04-26T12:33:36.984631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.984515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'17","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.768960+0000","last_change":"2024-04-26T12:34:01.768960+0000","last_active":"2024-04-26T12:34:01.768960+0000","last_peered":"2024-04-26T12:34:01.768960+0000","last_clean":"2024-04-26T12:34:01.768960+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:34:01.768960+0000","last_undegraded":"2024-04-26T12:34:01.768960+0000","last_fullsized":"2024-04-26T12:34:01.768960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.768788+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:00.147323+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.416634+0000","last_change":"2024-04-26T12:33:35.416673+0000","last_active":"2024-04-26T12:33:35.416634+0000","last_peered":"2024-04-26T12:33:35.416634+0000","last_clean":"2024-04-26T12:33:35.416634+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:35.416634+0000","last_undegraded":"2024-04-26T12:33:35.416634+0000","last_fullsized":"2024-04-26T12:33:35.416634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.416545+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.560676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:38.512764+0000","last_change":"2024-04-26T12:30:20.532905+0000","last_active":"2024-04-26T12:32:38.512764+0000","last_peered":"2024-04-26T12:32:38.512764+0000","last_clean":"2024-04-26T12:32:38.512764+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:32:38.512764+0000","last_undegraded":"2024-04-26T12:32:38.512764+0000","last_fullsized":"2024-04-26T12:32:38.512764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.357489+0000","last_change":"2024-04-26T12:33:55.357489+0000","last_active":"2024-04-26T12:33:55.357489+0000","last_peered":"2024-04-26T12:33:55.357489+0000","last_clean":"2024-04-26T12:33:55.357489+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:55.357489+0000","last_undegraded":"2024-04-26T12:33:55.357489+0000","last_fullsized":"2024-04-26T12:33:55.357489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.357374+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:33.932712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.857909+0000","last_change":"2024-04-26T12:34:19.857960+0000","last_active":"2024-04-26T12:34:19.857909+0000","last_peered":"2024-04-26T12:34:19.857909+0000","last_clean":"2024-04-26T12:34:19.857909+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:34:19.857909+0000","last_undegraded":"2024-04-26T12:34:19.857909+0000","last_fullsized":"2024-04-26T12:34:19.857909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:19.857792+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:19.857792+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.857792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:40.166269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269423+0000","last_change":"2024-04-26T12:30:01.460675+0000","last_active":"2024-04-26T12:33:32.269423+0000","last_peered":"2024-04-26T12:33:32.269423+0000","last_clean":"2024-04-26T12:33:32.269423+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:33:32.269423+0000","last_undegraded":"2024-04-26T12:33:32.269423+0000","last_fullsized":"2024-04-26T12:33:32.269423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:00.429022+0000","last_clean_scrub_stamp":"2024-04-26T12:30:00.429022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.054401+0000","last_change":"2024-04-26T12:33:42.054401+0000","last_active":"2024-04-26T12:33:42.054401+0000","last_peered":"2024-04-26T12:33:42.054401+0000","last_clean":"2024-04-26T12:33:42.054401+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:33:42.054401+0000","last_undegraded":"2024-04-26T12:33:42.054401+0000","last_fullsized":"2024-04-26T12:33:42.054401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.054238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:08.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'98","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.374652+0000","last_change":"2024-04-26T12:33:36.374652+0000","last_active":"2024-04-26T12:33:36.374652+0000","last_peered":"2024-04-26T12:33:36.374652+0000","last_clean":"2024-04-26T12:33:36.374652+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:33:36.374652+0000","last_undegraded":"2024-04-26T12:33:36.374652+0000","last_fullsized":"2024-04-26T12:33:36.374652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'98","last_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_deep_scrub":"32'98","last_deep_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.374477+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:44.404332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:31.509100+0000","last_change":"2024-04-26T12:33:31.509119+0000","last_active":"2024-04-26T12:33:31.509100+0000","last_peered":"2024-04-26T12:33:31.509100+0000","last_clean":"2024-04-26T12:33:31.509100+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:33:31.509100+0000","last_undegraded":"2024-04-26T12:33:31.509100+0000","last_fullsized":"2024-04-26T12:33:31.509100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_clean_scrub_stamp":"2024-04-26T12:33:31.509011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:04.640988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.257735+0000","last_change":"2024-04-26T12:34:23.257762+0000","last_active":"2024-04-26T12:34:23.257735+0000","last_peered":"2024-04-26T12:34:23.257735+0000","last_clean":"2024-04-26T12:34:23.257735+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:34:23.257735+0000","last_undegraded":"2024-04-26T12:34:23.257735+0000","last_fullsized":"2024-04-26T12:34:23.257735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:23.257646+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:23.257646+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.257646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:46.316848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.271506+0000","last_change":"2024-04-26T12:34:20.271530+0000","last_active":"2024-04-26T12:34:20.271506+0000","last_peered":"2024-04-26T12:34:20.271506+0000","last_clean":"2024-04-26T12:34:20.271506+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:34:20.271506+0000","last_undegraded":"2024-04-26T12:34:20.271506+0000","last_fullsized":"2024-04-26T12:34:20.271506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:20.271416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:20.271416+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.271416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:04.907796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.308525+0000","last_change":"2024-04-26T12:33:56.308548+0000","last_active":"2024-04-26T12:33:56.308525+0000","last_peered":"2024-04-26T12:33:56.308525+0000","last_clean":"2024-04-26T12:33:56.308525+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:33:56.308525+0000","last_undegraded":"2024-04-26T12:33:56.308525+0000","last_fullsized":"2024-04-26T12:33:56.308525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.308437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:57.522881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.229966+0000","last_change":"2024-04-26T12:30:10.523769+0000","last_active":"2024-04-26T12:33:21.229966+0000","last_peered":"2024-04-26T12:33:21.229966+0000","last_clean":"2024-04-26T12:33:21.229966+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:33:21.229966+0000","last_undegraded":"2024-04-26T12:33:21.229966+0000","last_fullsized":"2024-04-26T12:33:21.229966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.934150+0000","last_change":"2024-04-26T12:33:44.934202+0000","last_active":"2024-04-26T12:33:44.934150+0000","last_peered":"2024-04-26T12:33:44.934150+0000","last_clean":"2024-04-26T12:33:44.934150+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:33:44.934150+0000","last_undegraded":"2024-04-26T12:33:44.934150+0000","last_fullsized":"2024-04-26T12:33:44.934150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.934050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:59.400029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.816928+0000","last_change":"2024-04-26T12:33:57.816962+0000","last_active":"2024-04-26T12:33:57.816928+0000","last_peered":"2024-04-26T12:33:57.816928+0000","last_clean":"2024-04-26T12:33:57.816928+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:33:57.816928+0000","last_undegraded":"2024-04-26T12:33:57.816928+0000","last_fullsized":"2024-04-26T12:33:57.816928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.816840+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:35.943755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.746321+0000","last_change":"2024-04-26T12:33:59.746343+0000","last_active":"2024-04-26T12:33:59.746321+0000","last_peered":"2024-04-26T12:33:59.746321+0000","last_clean":"2024-04-26T12:33:59.746321+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:33:59.746321+0000","last_undegraded":"2024-04-26T12:33:59.746321+0000","last_fullsized":"2024-04-26T12:33:59.746321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.746239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:32.070259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:30.992312+0000","last_change":"2024-04-26T12:30:20.528724+0000","last_active":"2024-04-26T12:33:30.992312+0000","last_peered":"2024-04-26T12:33:30.992312+0000","last_clean":"2024-04-26T12:33:30.992312+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:33:30.992312+0000","last_undegraded":"2024-04-26T12:33:30.992312+0000","last_fullsized":"2024-04-26T12:33:30.992312+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.511965+0000","last_change":"2024-04-26T12:30:49.555701+0000","last_active":"2024-04-26T12:32:33.511965+0000","last_peered":"2024-04-26T12:32:33.511965+0000","last_clean":"2024-04-26T12:32:33.511965+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:32:33.511965+0000","last_undegraded":"2024-04-26T12:32:33.511965+0000","last_fullsized":"2024-04-26T12:32:33.511965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:11.463891+0000","last_clean_scrub_stamp":"2024-04-26T12:30:11.463891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.235931+0000","last_change":"2024-04-26T12:34:18.235976+0000","last_active":"2024-04-26T12:34:18.235931+0000","last_peered":"2024-04-26T12:34:18.235931+0000","last_clean":"2024-04-26T12:34:18.235931+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:34:18.235931+0000","last_undegraded":"2024-04-26T12:34:18.235931+0000","last_fullsized":"2024-04-26T12:34:18.235931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:18.235790+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:18.235790+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.235790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.405932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.035342+0000","last_change":"2024-04-26T12:33:41.035367+0000","last_active":"2024-04-26T12:33:41.035342+0000","last_peered":"2024-04-26T12:33:41.035342+0000","last_clean":"2024-04-26T12:33:41.035342+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:33:41.035342+0000","last_undegraded":"2024-04-26T12:33:41.035342+0000","last_fullsized":"2024-04-26T12:33:41.035342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:28.509101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.437752+0000","last_change":"2024-04-26T12:33:45.437804+0000","last_active":"2024-04-26T12:33:45.437752+0000","last_peered":"2024-04-26T12:33:45.437752+0000","last_clean":"2024-04-26T12:33:45.437752+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:45.437752+0000","last_undegraded":"2024-04-26T12:33:45.437752+0000","last_fullsized":"2024-04-26T12:33:45.437752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.437634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:24.012972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.322288+0000","last_change":"2024-04-26T12:33:33.322319+0000","last_active":"2024-04-26T12:33:33.322288+0000","last_peered":"2024-04-26T12:33:33.322288+0000","last_clean":"2024-04-26T12:33:33.322288+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:33:33.322288+0000","last_undegraded":"2024-04-26T12:33:33.322288+0000","last_fullsized":"2024-04-26T12:33:33.322288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.322193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:33.954765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.467476+0000","last_change":"2024-04-26T12:30:20.531528+0000","last_active":"2024-04-26T12:33:21.467476+0000","last_peered":"2024-04-26T12:33:21.467476+0000","last_clean":"2024-04-26T12:33:21.467476+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:33:21.467476+0000","last_undegraded":"2024-04-26T12:33:21.467476+0000","last_fullsized":"2024-04-26T12:33:21.467476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.600351+0000","last_change":"2024-04-26T12:34:04.600423+0000","last_active":"2024-04-26T12:34:04.600351+0000","last_peered":"2024-04-26T12:34:04.600351+0000","last_clean":"2024-04-26T12:34:04.600351+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:34:04.600351+0000","last_undegraded":"2024-04-26T12:34:04.600351+0000","last_fullsized":"2024-04-26T12:34:04.600351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.600237+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:05.911708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.200686+0000","last_change":"2024-04-26T12:34:12.200726+0000","last_active":"2024-04-26T12:34:12.200686+0000","last_peered":"2024-04-26T12:34:12.200686+0000","last_clean":"2024-04-26T12:34:12.200686+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:34:12.200686+0000","last_undegraded":"2024-04-26T12:34:12.200686+0000","last_fullsized":"2024-04-26T12:34:12.200686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.200570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.200570+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.200570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:36.158516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.384229+0000","last_change":"2024-04-26T12:33:50.384269+0000","last_active":"2024-04-26T12:33:50.384229+0000","last_peered":"2024-04-26T12:33:50.384229+0000","last_clean":"2024-04-26T12:33:50.384229+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:33:50.384229+0000","last_undegraded":"2024-04-26T12:33:50.384229+0000","last_fullsized":"2024-04-26T12:33:50.384229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.384133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:33.191713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.463439+0000","last_change":"2024-04-26T12:33:43.463495+0000","last_active":"2024-04-26T12:33:43.463439+0000","last_peered":"2024-04-26T12:33:43.463439+0000","last_clean":"2024-04-26T12:33:43.463439+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:43.463439+0000","last_undegraded":"2024-04-26T12:33:43.463439+0000","last_fullsized":"2024-04-26T12:33:43.463439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.463348+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:24.510661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.045474+0000","last_change":"2024-04-26T12:33:32.045522+0000","last_active":"2024-04-26T12:33:32.045474+0000","last_peered":"2024-04-26T12:33:32.045474+0000","last_clean":"2024-04-26T12:33:32.045474+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:33:32.045474+0000","last_undegraded":"2024-04-26T12:33:32.045474+0000","last_fullsized":"2024-04-26T12:33:32.045474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.045363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:44.273391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.633676+0000","last_change":"2024-04-26T12:34:15.633701+0000","last_active":"2024-04-26T12:34:15.633676+0000","last_peered":"2024-04-26T12:34:15.633676+0000","last_clean":"2024-04-26T12:34:15.633676+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:34:15.633676+0000","last_undegraded":"2024-04-26T12:34:15.633676+0000","last_fullsized":"2024-04-26T12:34:15.633676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:15.633579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:15.633579+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.633579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:51.038174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.070835+0000","last_change":"2024-04-26T12:33:45.070862+0000","last_active":"2024-04-26T12:33:45.070835+0000","last_peered":"2024-04-26T12:33:45.070835+0000","last_clean":"2024-04-26T12:33:45.070835+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:45.070835+0000","last_undegraded":"2024-04-26T12:33:45.070835+0000","last_fullsized":"2024-04-26T12:33:45.070835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.070739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:40.944238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.918854+0000","last_change":"2024-04-26T12:34:16.918879+0000","last_active":"2024-04-26T12:34:16.918854+0000","last_peered":"2024-04-26T12:34:16.918854+0000","last_clean":"2024-04-26T12:34:16.918854+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:34:16.918854+0000","last_undegraded":"2024-04-26T12:34:16.918854+0000","last_fullsized":"2024-04-26T12:34:16.918854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:16.918745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:16.918745+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.918745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:53.861220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.064258+0000","last_change":"2024-04-26T12:33:43.064299+0000","last_active":"2024-04-26T12:33:43.064258+0000","last_peered":"2024-04-26T12:33:43.064258+0000","last_clean":"2024-04-26T12:33:43.064258+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:33:43.064258+0000","last_undegraded":"2024-04-26T12:33:43.064258+0000","last_fullsized":"2024-04-26T12:33:43.064258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.064153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:56.367388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.353452+0000","last_change":"2024-04-26T12:33:42.353487+0000","last_active":"2024-04-26T12:33:42.353452+0000","last_peered":"2024-04-26T12:33:42.353452+0000","last_clean":"2024-04-26T12:33:42.353452+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:33:42.353452+0000","last_undegraded":"2024-04-26T12:33:42.353452+0000","last_fullsized":"2024-04-26T12:33:42.353452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.353371+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:27.302471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.359118+0000","last_change":"2024-04-26T12:33:35.359140+0000","last_active":"2024-04-26T12:33:35.359118+0000","last_peered":"2024-04-26T12:33:35.359118+0000","last_clean":"2024-04-26T12:33:35.359118+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:33:35.359118+0000","last_undegraded":"2024-04-26T12:33:35.359118+0000","last_fullsized":"2024-04-26T12:33:35.359118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.359023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:00.812046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.656432+0000","last_change":"2024-04-26T12:34:13.656432+0000","last_active":"2024-04-26T12:34:13.656432+0000","last_peered":"2024-04-26T12:34:13.656432+0000","last_clean":"2024-04-26T12:34:13.656432+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:34:13.656432+0000","last_undegraded":"2024-04-26T12:34:13.656432+0000","last_fullsized":"2024-04-26T12:34:13.656432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:13.656317+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:13.656317+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.656317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:18.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.581517+0000","last_change":"2024-04-26T12:34:25.581540+0000","last_active":"2024-04-26T12:34:25.581517+0000","last_peered":"2024-04-26T12:34:25.581517+0000","last_clean":"2024-04-26T12:34:25.581517+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:34:25.581517+0000","last_undegraded":"2024-04-26T12:34:25.581517+0000","last_fullsized":"2024-04-26T12:34:25.581517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:25.581430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:25.581430+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.581430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:39.147174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.643280+0000","last_change":"2024-04-26T12:33:55.643280+0000","last_active":"2024-04-26T12:33:55.643280+0000","last_peered":"2024-04-26T12:33:55.643280+0000","last_clean":"2024-04-26T12:33:55.643280+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:33:55.643280+0000","last_undegraded":"2024-04-26T12:33:55.643280+0000","last_fullsized":"2024-04-26T12:33:55.643280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.643144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.649463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.501845+0000","last_change":"2024-04-26T12:33:42.501879+0000","last_active":"2024-04-26T12:33:42.501845+0000","last_peered":"2024-04-26T12:33:42.501845+0000","last_clean":"2024-04-26T12:33:42.501845+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:33:42.501845+0000","last_undegraded":"2024-04-26T12:33:42.501845+0000","last_fullsized":"2024-04-26T12:33:42.501845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.501766+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:10.173839+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.366864+0000","last_change":"2024-04-26T12:33:34.366886+0000","last_active":"2024-04-26T12:33:34.366864+0000","last_peered":"2024-04-26T12:33:34.366864+0000","last_clean":"2024-04-26T12:33:34.366864+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:33:34.366864+0000","last_undegraded":"2024-04-26T12:33:34.366864+0000","last_fullsized":"2024-04-26T12:33:34.366864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.366757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:47.058265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:42.501892+0000","last_change":"2024-04-26T12:30:20.523862+0000","last_active":"2024-04-26T12:32:42.501892+0000","last_peered":"2024-04-26T12:32:42.501892+0000","last_clean":"2024-04-26T12:32:42.501892+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:32:42.501892+0000","last_undegraded":"2024-04-26T12:32:42.501892+0000","last_fullsized":"2024-04-26T12:32:42.501892+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.626796+0000","last_change":"2024-04-26T12:34:01.626796+0000","last_active":"2024-04-26T12:34:01.626796+0000","last_peered":"2024-04-26T12:34:01.626796+0000","last_clean":"2024-04-26T12:34:01.626796+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:34:01.626796+0000","last_undegraded":"2024-04-26T12:34:01.626796+0000","last_fullsized":"2024-04-26T12:34:01.626796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.626634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:21.911777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.874928+0000","last_change":"2024-04-26T12:34:18.874958+0000","last_active":"2024-04-26T12:34:18.874928+0000","last_peered":"2024-04-26T12:34:18.874928+0000","last_clean":"2024-04-26T12:34:18.874928+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:34:18.874928+0000","last_undegraded":"2024-04-26T12:34:18.874928+0000","last_fullsized":"2024-04-26T12:34:18.874928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:18.874831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:18.874831+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.874831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:57.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.385555+0000","last_change":"2024-04-26T12:33:48.385555+0000","last_active":"2024-04-26T12:33:48.385555+0000","last_peered":"2024-04-26T12:33:48.385555+0000","last_clean":"2024-04-26T12:33:48.385555+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:33:48.385555+0000","last_undegraded":"2024-04-26T12:33:48.385555+0000","last_fullsized":"2024-04-26T12:33:48.385555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.385445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:38.984742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.993283+0000","last_change":"2024-04-26T12:33:35.993331+0000","last_active":"2024-04-26T12:33:35.993283+0000","last_peered":"2024-04-26T12:33:35.993283+0000","last_clean":"2024-04-26T12:33:35.993283+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:33:35.993283+0000","last_undegraded":"2024-04-26T12:33:35.993283+0000","last_fullsized":"2024-04-26T12:33:35.993283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.993196+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.267797+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.950944+0000","last_change":"2024-04-26T12:33:43.950965+0000","last_active":"2024-04-26T12:33:43.950944+0000","last_peered":"2024-04-26T12:33:43.950944+0000","last_clean":"2024-04-26T12:33:43.950944+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:33:43.950944+0000","last_undegraded":"2024-04-26T12:33:43.950944+0000","last_fullsized":"2024-04-26T12:33:43.950944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.950850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.030430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513984+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:32:43.513984+0000","last_peered":"2024-04-26T12:32:43.513984+0000","last_clean":"2024-04-26T12:32:43.513984+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:32:43.513984+0000","last_undegraded":"2024-04-26T12:32:43.513984+0000","last_fullsized":"2024-04-26T12:32:43.513984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.015731+0000","last_change":"2024-04-26T12:33:47.015756+0000","last_active":"2024-04-26T12:33:47.015731+0000","last_peered":"2024-04-26T12:33:47.015731+0000","last_clean":"2024-04-26T12:33:47.015731+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:47.015731+0000","last_undegraded":"2024-04-26T12:33:47.015731+0000","last_fullsized":"2024-04-26T12:33:47.015731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.015630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:22.957533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.867447+0000","last_change":"2024-04-26T12:34:23.867478+0000","last_active":"2024-04-26T12:34:23.867447+0000","last_peered":"2024-04-26T12:34:23.867447+0000","last_clean":"2024-04-26T12:34:23.867447+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:34:23.867447+0000","last_undegraded":"2024-04-26T12:34:23.867447+0000","last_fullsized":"2024-04-26T12:34:23.867447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:23.867357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:23.867357+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.867357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:20.060861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.310817+0000","last_change":"2024-04-26T12:33:46.310845+0000","last_active":"2024-04-26T12:33:46.310817+0000","last_peered":"2024-04-26T12:33:46.310817+0000","last_clean":"2024-04-26T12:33:46.310817+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:33:46.310817+0000","last_undegraded":"2024-04-26T12:33:46.310817+0000","last_fullsized":"2024-04-26T12:33:46.310817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.310718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:07.825719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.467898+0000","last_change":"2024-04-26T12:33:41.467898+0000","last_active":"2024-04-26T12:33:41.467898+0000","last_peered":"2024-04-26T12:33:41.467898+0000","last_clean":"2024-04-26T12:33:41.467898+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:33:41.467898+0000","last_undegraded":"2024-04-26T12:33:41.467898+0000","last_fullsized":"2024-04-26T12:33:41.467898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.467768+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:07.391342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.445395+0000","last_change":"2024-04-26T12:33:33.445395+0000","last_active":"2024-04-26T12:33:33.445395+0000","last_peered":"2024-04-26T12:33:33.445395+0000","last_clean":"2024-04-26T12:33:33.445395+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:33:33.445395+0000","last_undegraded":"2024-04-26T12:33:33.445395+0000","last_fullsized":"2024-04-26T12:33:33.445395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.445277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.337016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513948+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:43.513948+0000","last_peered":"2024-04-26T12:32:43.513948+0000","last_clean":"2024-04-26T12:32:43.513948+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:43.513948+0000","last_undegraded":"2024-04-26T12:32:43.513948+0000","last_fullsized":"2024-04-26T12:32:43.513948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.549850+0000","last_change":"2024-04-26T12:34:14.549876+0000","last_active":"2024-04-26T12:34:14.549850+0000","last_peered":"2024-04-26T12:34:14.549850+0000","last_clean":"2024-04-26T12:34:14.549850+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:34:14.549850+0000","last_undegraded":"2024-04-26T12:34:14.549850+0000","last_fullsized":"2024-04-26T12:34:14.549850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:14.549743+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:14.549743+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.549743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:37.608945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.514043+0000","last_change":"2024-04-26T12:30:10.521621+0000","last_active":"2024-04-26T12:32:43.514043+0000","last_peered":"2024-04-26T12:32:43.514043+0000","last_clean":"2024-04-26T12:32:43.514043+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:32:43.514043+0000","last_undegraded":"2024-04-26T12:32:43.514043+0000","last_fullsized":"2024-04-26T12:32:43.514043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513616+0000","last_change":"2024-04-26T12:30:49.551612+0000","last_active":"2024-04-26T12:32:43.513616+0000","last_peered":"2024-04-26T12:32:43.513616+0000","last_clean":"2024-04-26T12:32:43.513616+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:32:43.513616+0000","last_undegraded":"2024-04-26T12:32:43.513616+0000","last_fullsized":"2024-04-26T12:32:43.513616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.780643+0000","last_change":"2024-04-26T12:33:58.780643+0000","last_active":"2024-04-26T12:33:58.780643+0000","last_peered":"2024-04-26T12:33:58.780643+0000","last_clean":"2024-04-26T12:33:58.780643+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:33:58.780643+0000","last_undegraded":"2024-04-26T12:33:58.780643+0000","last_fullsized":"2024-04-26T12:33:58.780643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.780521+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:19.088998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":378,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.307434+0000","last_change":"2024-04-26T12:33:45.307469+0000","last_active":"2024-04-26T12:33:45.307434+0000","last_peered":"2024-04-26T12:33:45.307434+0000","last_clean":"2024-04-26T12:33:45.307434+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:45.307434+0000","last_undegraded":"2024-04-26T12:33:45.307434+0000","last_fullsized":"2024-04-26T12:33:45.307434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.307342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:13.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513827+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:32:43.513827+0000","last_peered":"2024-04-26T12:32:43.513827+0000","last_clean":"2024-04-26T12:32:43.513827+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:32:43.513827+0000","last_undegraded":"2024-04-26T12:32:43.513827+0000","last_fullsized":"2024-04-26T12:32:43.513827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.244297+0000","last_change":"2024-04-26T12:34:07.244321+0000","last_active":"2024-04-26T12:34:07.244297+0000","last_peered":"2024-04-26T12:34:07.244297+0000","last_clean":"2024-04-26T12:34:07.244297+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:34:07.244297+0000","last_undegraded":"2024-04-26T12:34:07.244297+0000","last_fullsized":"2024-04-26T12:34:07.244297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.244206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:57.848776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.891153+0000","last_change":"2024-04-26T12:34:22.891177+0000","last_active":"2024-04-26T12:34:22.891153+0000","last_peered":"2024-04-26T12:34:22.891153+0000","last_clean":"2024-04-26T12:34:22.891153+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:34:22.891153+0000","last_undegraded":"2024-04-26T12:34:22.891153+0000","last_fullsized":"2024-04-26T12:34:22.891153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:22.891064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:22.891064+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.891064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:21.269599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.949107+0000","last_change":"2024-04-26T12:33:42.949152+0000","last_active":"2024-04-26T12:33:42.949107+0000","last_peered":"2024-04-26T12:33:42.949107+0000","last_clean":"2024-04-26T12:33:42.949107+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:33:42.949107+0000","last_undegraded":"2024-04-26T12:33:42.949107+0000","last_fullsized":"2024-04-26T12:33:42.949107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.948988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:32.255979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.890106+0000","last_change":"2024-04-26T12:33:38.890152+0000","last_active":"2024-04-26T12:33:38.890106+0000","last_peered":"2024-04-26T12:33:38.890106+0000","last_clean":"2024-04-26T12:33:38.890106+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:33:38.890106+0000","last_undegraded":"2024-04-26T12:33:38.890106+0000","last_fullsized":"2024-04-26T12:33:38.890106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.890013+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:04.019389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.461617+0000","last_change":"2024-04-26T12:33:40.461661+0000","last_active":"2024-04-26T12:33:40.461617+0000","last_peered":"2024-04-26T12:33:40.461617+0000","last_clean":"2024-04-26T12:33:40.461617+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:33:40.461617+0000","last_undegraded":"2024-04-26T12:33:40.461617+0000","last_fullsized":"2024-04-26T12:33:40.461617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.461502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:09.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.780785+0000","last_change":"2024-04-26T12:33:59.780852+0000","last_active":"2024-04-26T12:33:59.780785+0000","last_peered":"2024-04-26T12:33:59.780785+0000","last_clean":"2024-04-26T12:33:59.780785+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:59.780785+0000","last_undegraded":"2024-04-26T12:33:59.780785+0000","last_fullsized":"2024-04-26T12:33:59.780785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.780664+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.693729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.221052+0000","last_change":"2024-04-26T12:34:09.221090+0000","last_active":"2024-04-26T12:34:09.221052+0000","last_peered":"2024-04-26T12:34:09.221052+0000","last_clean":"2024-04-26T12:34:09.221052+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:34:09.221052+0000","last_undegraded":"2024-04-26T12:34:09.221052+0000","last_fullsized":"2024-04-26T12:34:09.221052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:09.220964+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:09.220964+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.220964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:46.980912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.696822+0000","last_change":"2024-04-26T12:34:22.696849+0000","last_active":"2024-04-26T12:34:22.696822+0000","last_peered":"2024-04-26T12:34:22.696822+0000","last_clean":"2024-04-26T12:34:22.696822+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:34:22.696822+0000","last_undegraded":"2024-04-26T12:34:22.696822+0000","last_fullsized":"2024-04-26T12:34:22.696822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:22.696725+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:22.696725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.696725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:42.822222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.346128+0000","last_change":"2024-04-26T12:33:51.346173+0000","last_active":"2024-04-26T12:33:51.346128+0000","last_peered":"2024-04-26T12:33:51.346128+0000","last_clean":"2024-04-26T12:33:51.346128+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:33:51.346128+0000","last_undegraded":"2024-04-26T12:33:51.346128+0000","last_fullsized":"2024-04-26T12:33:51.346128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.346025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:20.507543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.453148+0000","last_change":"2024-04-26T12:33:38.453185+0000","last_active":"2024-04-26T12:33:38.453148+0000","last_peered":"2024-04-26T12:33:38.453148+0000","last_clean":"2024-04-26T12:33:38.453148+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:33:38.453148+0000","last_undegraded":"2024-04-26T12:33:38.453148+0000","last_fullsized":"2024-04-26T12:33:38.453148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.453065+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:29.052361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.794633+0000","last_change":"2024-04-26T12:33:56.794664+0000","last_active":"2024-04-26T12:33:56.794633+0000","last_peered":"2024-04-26T12:33:56.794633+0000","last_clean":"2024-04-26T12:33:56.794633+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:33:56.794633+0000","last_undegraded":"2024-04-26T12:33:56.794633+0000","last_fullsized":"2024-04-26T12:33:56.794633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.794541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:59.556259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.515022+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:32:48.515022+0000","last_peered":"2024-04-26T12:32:48.515022+0000","last_clean":"2024-04-26T12:32:48.515022+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:32:48.515022+0000","last_undegraded":"2024-04-26T12:32:48.515022+0000","last_fullsized":"2024-04-26T12:32:48.515022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.647080+0000","last_change":"2024-04-26T12:34:16.647109+0000","last_active":"2024-04-26T12:34:16.647080+0000","last_peered":"2024-04-26T12:34:16.647080+0000","last_clean":"2024-04-26T12:34:16.647080+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:34:16.647080+0000","last_undegraded":"2024-04-26T12:34:16.647080+0000","last_fullsized":"2024-04-26T12:34:16.647080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:16.646984+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:16.646984+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.646984+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:39.688700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.595342+0000","last_change":"2024-04-26T12:34:15.595389+0000","last_active":"2024-04-26T12:34:15.595342+0000","last_peered":"2024-04-26T12:34:15.595342+0000","last_clean":"2024-04-26T12:34:15.595342+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:34:15.595342+0000","last_undegraded":"2024-04-26T12:34:15.595342+0000","last_fullsized":"2024-04-26T12:34:15.595342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:15.595199+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:15.595199+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.595199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:35.707029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.865538+0000","last_change":"2024-04-26T12:33:48.865560+0000","last_active":"2024-04-26T12:33:48.865538+0000","last_peered":"2024-04-26T12:33:48.865538+0000","last_clean":"2024-04-26T12:33:48.865538+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:33:48.865538+0000","last_undegraded":"2024-04-26T12:33:48.865538+0000","last_fullsized":"2024-04-26T12:33:48.865538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.865441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:06.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.031288+0000","last_change":"2024-04-26T12:33:40.031319+0000","last_active":"2024-04-26T12:33:40.031288+0000","last_peered":"2024-04-26T12:33:40.031288+0000","last_clean":"2024-04-26T12:33:40.031288+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:33:40.031288+0000","last_undegraded":"2024-04-26T12:33:40.031288+0000","last_fullsized":"2024-04-26T12:33:40.031288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.031195+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:09.032628+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.850966+0000","last_change":"2024-04-26T12:33:54.851018+0000","last_active":"2024-04-26T12:33:54.850966+0000","last_peered":"2024-04-26T12:33:54.850966+0000","last_clean":"2024-04-26T12:33:54.850966+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:33:54.850966+0000","last_undegraded":"2024-04-26T12:33:54.850966+0000","last_fullsized":"2024-04-26T12:33:54.850966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.850864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:43.512855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514960+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:48.514960+0000","last_peered":"2024-04-26T12:32:48.514960+0000","last_clean":"2024-04-26T12:32:48.514960+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:48.514960+0000","last_undegraded":"2024-04-26T12:32:48.514960+0000","last_fullsized":"2024-04-26T12:32:48.514960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.267026+0000","last_change":"2024-04-26T12:33:57.267051+0000","last_active":"2024-04-26T12:33:57.267026+0000","last_peered":"2024-04-26T12:33:57.267026+0000","last_clean":"2024-04-26T12:33:57.267026+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:33:57.267026+0000","last_undegraded":"2024-04-26T12:33:57.267026+0000","last_fullsized":"2024-04-26T12:33:57.267026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.266942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:20.057671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.834847+0000","last_change":"2024-04-26T12:34:06.834847+0000","last_active":"2024-04-26T12:34:06.834847+0000","last_peered":"2024-04-26T12:34:06.834847+0000","last_clean":"2024-04-26T12:34:06.834847+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:34:06.834847+0000","last_undegraded":"2024-04-26T12:34:06.834847+0000","last_fullsized":"2024-04-26T12:34:06.834847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.834717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:39.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.835414+0000","last_change":"2024-04-26T12:33:49.835479+0000","last_active":"2024-04-26T12:33:49.835414+0000","last_peered":"2024-04-26T12:33:49.835414+0000","last_clean":"2024-04-26T12:33:49.835414+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:33:49.835414+0000","last_undegraded":"2024-04-26T12:33:49.835414+0000","last_fullsized":"2024-04-26T12:33:49.835414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.835315+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.299112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.110111+0000","last_change":"2024-04-26T12:33:44.110183+0000","last_active":"2024-04-26T12:33:44.110111+0000","last_peered":"2024-04-26T12:33:44.110111+0000","last_clean":"2024-04-26T12:33:44.110111+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:44.110111+0000","last_undegraded":"2024-04-26T12:33:44.110111+0000","last_fullsized":"2024-04-26T12:33:44.110111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.110007+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:08.558930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.548918+0000","last_change":"2024-04-26T12:33:52.548980+0000","last_active":"2024-04-26T12:33:52.548918+0000","last_peered":"2024-04-26T12:33:52.548918+0000","last_clean":"2024-04-26T12:33:52.548918+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:33:52.548918+0000","last_undegraded":"2024-04-26T12:33:52.548918+0000","last_fullsized":"2024-04-26T12:33:52.548918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.548815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:10.261619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.649011+0000","last_change":"2024-04-26T12:34:11.649035+0000","last_active":"2024-04-26T12:34:11.649011+0000","last_peered":"2024-04-26T12:34:11.649011+0000","last_clean":"2024-04-26T12:34:11.649011+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:34:11.649011+0000","last_undegraded":"2024-04-26T12:34:11.649011+0000","last_fullsized":"2024-04-26T12:34:11.649011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:11.648922+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:11.648922+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.648922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:48.291861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.818335+0000","last_change":"2024-04-26T12:33:50.818359+0000","last_active":"2024-04-26T12:33:50.818335+0000","last_peered":"2024-04-26T12:33:50.818335+0000","last_clean":"2024-04-26T12:33:50.818335+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:50.818335+0000","last_undegraded":"2024-04-26T12:33:50.818335+0000","last_fullsized":"2024-04-26T12:33:50.818335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.818238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:03.334266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.340615+0000","last_change":"2024-04-26T12:34:02.340615+0000","last_active":"2024-04-26T12:34:02.340615+0000","last_peered":"2024-04-26T12:34:02.340615+0000","last_clean":"2024-04-26T12:34:02.340615+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:34:02.340615+0000","last_undegraded":"2024-04-26T12:34:02.340615+0000","last_fullsized":"2024-04-26T12:34:02.340615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.340498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:45.990532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.522204+0000","last_change":"2024-04-26T12:34:10.522256+0000","last_active":"2024-04-26T12:34:10.522204+0000","last_peered":"2024-04-26T12:34:10.522204+0000","last_clean":"2024-04-26T12:34:10.522204+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:34:10.522204+0000","last_undegraded":"2024-04-26T12:34:10.522204+0000","last_fullsized":"2024-04-26T12:34:10.522204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:10.522104+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:10.522104+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.522104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:04.553913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.590225+0000","last_change":"2024-04-26T12:34:21.590225+0000","last_active":"2024-04-26T12:34:21.590225+0000","last_peered":"2024-04-26T12:34:21.590225+0000","last_clean":"2024-04-26T12:34:21.590225+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:34:21.590225+0000","last_undegraded":"2024-04-26T12:34:21.590225+0000","last_fullsized":"2024-04-26T12:34:21.590225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:21.590040+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.590040+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.590040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:37.256101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.670606+0000","last_change":"2024-04-26T12:34:10.670636+0000","last_active":"2024-04-26T12:34:10.670606+0000","last_peered":"2024-04-26T12:34:10.670606+0000","last_clean":"2024-04-26T12:34:10.670606+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:34:10.670606+0000","last_undegraded":"2024-04-26T12:34:10.670606+0000","last_fullsized":"2024-04-26T12:34:10.670606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:10.670511+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:10.670511+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.670511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:55.402857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269778+0000","last_change":"2024-04-26T12:30:10.515892+0000","last_active":"2024-04-26T12:33:32.269778+0000","last_peered":"2024-04-26T12:33:32.269778+0000","last_clean":"2024-04-26T12:33:32.269778+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:33:32.269778+0000","last_undegraded":"2024-04-26T12:33:32.269778+0000","last_fullsized":"2024-04-26T12:33:32.269778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.608377+0000","last_change":"2024-04-26T12:34:16.608406+0000","last_active":"2024-04-26T12:34:16.608377+0000","last_peered":"2024-04-26T12:34:16.608377+0000","last_clean":"2024-04-26T12:34:16.608377+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:34:16.608377+0000","last_undegraded":"2024-04-26T12:34:16.608377+0000","last_fullsized":"2024-04-26T12:34:16.608377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-26T12:34:16.608288+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-26T12:34:16.608288+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.608288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:10.148366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.557250+0000","last_change":"2024-04-26T12:34:24.557284+0000","last_active":"2024-04-26T12:34:24.557250+0000","last_peered":"2024-04-26T12:34:24.557250+0000","last_clean":"2024-04-26T12:34:24.557250+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:34:24.557250+0000","last_undegraded":"2024-04-26T12:34:24.557250+0000","last_fullsized":"2024-04-26T12:34:24.557250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.557137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.557137+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.557137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:37.751454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.649641+0000","last_change":"2024-04-26T12:34:02.649641+0000","last_active":"2024-04-26T12:34:02.649641+0000","last_peered":"2024-04-26T12:34:02.649641+0000","last_clean":"2024-04-26T12:34:02.649641+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:34:02.649641+0000","last_undegraded":"2024-04-26T12:34:02.649641+0000","last_fullsized":"2024-04-26T12:34:02.649641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.649475+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:18.869480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.571979+0000","last_change":"2024-04-26T12:34:05.572013+0000","last_active":"2024-04-26T12:34:05.571979+0000","last_peered":"2024-04-26T12:34:05.571979+0000","last_clean":"2024-04-26T12:34:05.571979+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:34:05.571979+0000","last_undegraded":"2024-04-26T12:34:05.571979+0000","last_fullsized":"2024-04-26T12:34:05.571979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.571886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:23.002390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.802145+0000","last_change":"2024-04-26T12:33:58.802145+0000","last_active":"2024-04-26T12:33:58.802145+0000","last_peered":"2024-04-26T12:33:58.802145+0000","last_clean":"2024-04-26T12:33:58.802145+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:58.802145+0000","last_undegraded":"2024-04-26T12:33:58.802145+0000","last_fullsized":"2024-04-26T12:33:58.802145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.802005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:27.815229+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.843544+0000","last_change":"2024-04-26T12:34:21.843585+0000","last_active":"2024-04-26T12:34:21.843544+0000","last_peered":"2024-04-26T12:34:21.843544+0000","last_clean":"2024-04-26T12:34:21.843544+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:34:21.843544+0000","last_undegraded":"2024-04-26T12:34:21.843544+0000","last_fullsized":"2024-04-26T12:34:21.843544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:21.843455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:21.843455+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.843455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:46.308037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.494203+0000","last_change":"2024-04-26T12:34:26.494232+0000","last_active":"2024-04-26T12:34:26.494203+0000","last_peered":"2024-04-26T12:34:26.494203+0000","last_clean":"2024-04-26T12:34:26.494203+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:34:26.494203+0000","last_undegraded":"2024-04-26T12:34:26.494203+0000","last_fullsized":"2024-04-26T12:34:26.494203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:26.494114+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:26.494114+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.494114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:29.814796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.267616+0000","last_change":"2024-04-26T12:34:08.267641+0000","last_active":"2024-04-26T12:34:08.267616+0000","last_peered":"2024-04-26T12:34:08.267616+0000","last_clean":"2024-04-26T12:34:08.267616+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:34:08.267616+0000","last_undegraded":"2024-04-26T12:34:08.267616+0000","last_fullsized":"2024-04-26T12:34:08.267616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:08.267528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:08.267528+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.267528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:44.813032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.835712+0000","last_change":"2024-04-26T12:34:13.835712+0000","last_active":"2024-04-26T12:34:13.835712+0000","last_peered":"2024-04-26T12:34:13.835712+0000","last_clean":"2024-04-26T12:34:13.835712+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:34:13.835712+0000","last_undegraded":"2024-04-26T12:34:13.835712+0000","last_fullsized":"2024-04-26T12:34:13.835712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:13.835564+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:13.835564+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.835564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:43.848744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.575763+0000","last_change":"2024-04-26T12:34:17.575792+0000","last_active":"2024-04-26T12:34:17.575763+0000","last_peered":"2024-04-26T12:34:17.575763+0000","last_clean":"2024-04-26T12:34:17.575763+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:34:17.575763+0000","last_undegraded":"2024-04-26T12:34:17.575763+0000","last_fullsized":"2024-04-26T12:34:17.575763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:17.575676+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:17.575676+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.575676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:29.191018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.838246+0000","last_change":"2024-04-26T12:34:11.838275+0000","last_active":"2024-04-26T12:34:11.838246+0000","last_peered":"2024-04-26T12:34:11.838246+0000","last_clean":"2024-04-26T12:34:11.838246+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:34:11.838246+0000","last_undegraded":"2024-04-26T12:34:11.838246+0000","last_fullsized":"2024-04-26T12:34:11.838246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:34:11.838159+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:34:11.838159+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.838159+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:53.341422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.510681+0000","last_change":"2024-04-26T12:30:10.521412+0000","last_active":"2024-04-26T12:32:23.510681+0000","last_peered":"2024-04-26T12:32:23.510681+0000","last_clean":"2024-04-26T12:32:23.510681+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:32:23.510681+0000","last_undegraded":"2024-04-26T12:32:23.510681+0000","last_fullsized":"2024-04-26T12:32:23.510681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.700100+0000","last_change":"2024-04-26T12:34:05.700148+0000","last_active":"2024-04-26T12:34:05.700100+0000","last_peered":"2024-04-26T12:34:05.700100+0000","last_clean":"2024-04-26T12:34:05.700100+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:34:05.700100+0000","last_undegraded":"2024-04-26T12:34:05.700100+0000","last_fullsized":"2024-04-26T12:34:05.700100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.700014+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:54.202928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.516273+0000","last_change":"2024-04-26T12:34:25.516299+0000","last_active":"2024-04-26T12:34:25.516273+0000","last_peered":"2024-04-26T12:34:25.516273+0000","last_clean":"2024-04-26T12:34:25.516273+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:34:25.516273+0000","last_undegraded":"2024-04-26T12:34:25.516273+0000","last_fullsized":"2024-04-26T12:34:25.516273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:25.516169+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:25.516169+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.516169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:08.695312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.536612+0000","last_change":"2024-04-26T12:34:08.536643+0000","last_active":"2024-04-26T12:34:08.536612+0000","last_peered":"2024-04-26T12:34:08.536612+0000","last_clean":"2024-04-26T12:34:08.536612+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:34:08.536612+0000","last_undegraded":"2024-04-26T12:34:08.536612+0000","last_fullsized":"2024-04-26T12:34:08.536612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:08.536533+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:08.536533+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.536533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:29.406137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.872822+0000","last_change":"2024-04-26T12:34:12.872851+0000","last_active":"2024-04-26T12:34:12.872822+0000","last_peered":"2024-04-26T12:34:12.872822+0000","last_clean":"2024-04-26T12:34:12.872822+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:34:12.872822+0000","last_undegraded":"2024-04-26T12:34:12.872822+0000","last_fullsized":"2024-04-26T12:34:12.872822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.872720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.872720+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.872720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:43.429674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.794029+0000","last_change":"2024-04-26T12:34:07.794058+0000","last_active":"2024-04-26T12:34:07.794029+0000","last_peered":"2024-04-26T12:34:07.794029+0000","last_clean":"2024-04-26T12:34:07.794029+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:34:07.794029+0000","last_undegraded":"2024-04-26T12:34:07.794029+0000","last_fullsized":"2024-04-26T12:34:07.794029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.793931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:31.555282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.818440+0000","last_change":"2024-04-26T12:34:20.818485+0000","last_active":"2024-04-26T12:34:20.818440+0000","last_peered":"2024-04-26T12:34:20.818440+0000","last_clean":"2024-04-26T12:34:20.818440+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:34:20.818440+0000","last_undegraded":"2024-04-26T12:34:20.818440+0000","last_fullsized":"2024-04-26T12:34:20.818440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:20.818344+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:20.818344+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.818344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:53.142364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.753441+0000","last_change":"2024-04-26T12:34:01.753500+0000","last_active":"2024-04-26T12:34:01.753441+0000","last_peered":"2024-04-26T12:34:01.753441+0000","last_clean":"2024-04-26T12:34:01.753441+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:34:01.753441+0000","last_undegraded":"2024-04-26T12:34:01.753441+0000","last_fullsized":"2024-04-26T12:34:01.753441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.753343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.379403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511600+0000","last_change":"2024-04-26T12:30:10.523912+0000","last_active":"2024-04-26T12:32:28.511600+0000","last_peered":"2024-04-26T12:32:28.511600+0000","last_clean":"2024-04-26T12:32:28.511600+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:32:28.511600+0000","last_undegraded":"2024-04-26T12:32:28.511600+0000","last_fullsized":"2024-04-26T12:32:28.511600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.784344+0000","last_change":"2024-04-26T12:34:00.784416+0000","last_active":"2024-04-26T12:34:00.784344+0000","last_peered":"2024-04-26T12:34:00.784344+0000","last_clean":"2024-04-26T12:34:00.784344+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:34:00.784344+0000","last_undegraded":"2024-04-26T12:34:00.784344+0000","last_fullsized":"2024-04-26T12:34:00.784344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.784248+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:01.988211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:28.511624+0000","last_change":"2024-04-26T12:30:10.523924+0000","last_active":"2024-04-26T12:32:28.511624+0000","last_peered":"2024-04-26T12:32:28.511624+0000","last_clean":"2024-04-26T12:32:28.511624+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:32:28.511624+0000","last_undegraded":"2024-04-26T12:32:28.511624+0000","last_fullsized":"2024-04-26T12:32:28.511624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.944335+0000","last_change":"2024-04-26T12:33:50.944361+0000","last_active":"2024-04-26T12:33:50.944335+0000","last_peered":"2024-04-26T12:33:50.944335+0000","last_clean":"2024-04-26T12:33:50.944335+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:33:50.944335+0000","last_undegraded":"2024-04-26T12:33:50.944335+0000","last_fullsized":"2024-04-26T12:33:50.944335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.944248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:32.447511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.195032+0000","last_change":"2024-04-26T12:34:16.195084+0000","last_active":"2024-04-26T12:34:16.195032+0000","last_peered":"2024-04-26T12:34:16.195032+0000","last_clean":"2024-04-26T12:34:16.195032+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:34:16.195032+0000","last_undegraded":"2024-04-26T12:34:16.195032+0000","last_fullsized":"2024-04-26T12:34:16.195032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:16.194929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:16.194929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.194929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:17.275448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.787635+0000","last_change":"2024-04-26T12:34:04.787661+0000","last_active":"2024-04-26T12:34:04.787635+0000","last_peered":"2024-04-26T12:34:04.787635+0000","last_clean":"2024-04-26T12:34:04.787635+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:34:04.787635+0000","last_undegraded":"2024-04-26T12:34:04.787635+0000","last_fullsized":"2024-04-26T12:34:04.787635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.787527+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:20.485303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.512496+0000","last_change":"2024-04-26T12:30:10.513455+0000","last_active":"2024-04-26T12:32:33.512496+0000","last_peered":"2024-04-26T12:32:33.512496+0000","last_clean":"2024-04-26T12:32:33.512496+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:32:33.512496+0000","last_undegraded":"2024-04-26T12:32:33.512496+0000","last_fullsized":"2024-04-26T12:32:33.512496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:21.452707+0000","last_change":"2024-04-26T12:30:10.520879+0000","last_active":"2024-04-26T12:33:21.452707+0000","last_peered":"2024-04-26T12:33:21.452707+0000","last_clean":"2024-04-26T12:33:21.452707+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:33:21.452707+0000","last_undegraded":"2024-04-26T12:33:21.452707+0000","last_fullsized":"2024-04-26T12:33:21.452707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.659740+0000","last_change":"2024-04-26T12:33:57.659780+0000","last_active":"2024-04-26T12:33:57.659740+0000","last_peered":"2024-04-26T12:33:57.659740+0000","last_clean":"2024-04-26T12:33:57.659740+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:57.659740+0000","last_undegraded":"2024-04-26T12:33:57.659740+0000","last_fullsized":"2024-04-26T12:33:57.659740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.659656+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:51.882456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.634694+0000","last_change":"2024-04-26T12:34:03.634721+0000","last_active":"2024-04-26T12:34:03.634694+0000","last_peered":"2024-04-26T12:34:03.634694+0000","last_clean":"2024-04-26T12:34:03.634694+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:34:03.634694+0000","last_undegraded":"2024-04-26T12:34:03.634694+0000","last_fullsized":"2024-04-26T12:34:03.634694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.634604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:37.832568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.820080+0000","last_change":"2024-04-26T12:33:53.820107+0000","last_active":"2024-04-26T12:33:53.820080+0000","last_peered":"2024-04-26T12:33:53.820080+0000","last_clean":"2024-04-26T12:33:53.820080+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:53.820080+0000","last_undegraded":"2024-04-26T12:33:53.820080+0000","last_fullsized":"2024-04-26T12:33:53.820080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.819987+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:06.561948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":145189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673019,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":735472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705722,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":734135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":430080,"data_stored":145178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:34:33.725 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.726 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.726 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.726 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.726 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.727 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.727 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.727 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.727 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.727 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.728 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.728 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.728 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.728 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.728 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.729 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.729 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.729 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.729 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.729 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.730 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.730 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:00.429022+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.730 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.730 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.730 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:30:11.463891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.731 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.731 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.731 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.731 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.731 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.731 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.732 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.732 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.732 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.732 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.733 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.733 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.733 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.733 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.733 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:33.733 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:34:53.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.843+0000 7fda1dc4e640 1 Processor -- start 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.843+0000 7fda1dc4e640 1 -- start start 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.843+0000 7fda1dc4e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fda1812e490 0x7fda18130880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.843+0000 7fda1dc4e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1806b3f0 con 0x7fda181280d0 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.843+0000 7fda1dc4e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fda18127c80 con 0x7fda1812e490 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.844+0000 7fda16ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fda1812e490 0x7fda18130880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.844+0000 7fda177fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fda181280d0 0x7fda181284b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39300/0 (socket says 172.21.15.132:39300) 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.844+0000 7fda177fe640 1 -- 172.21.15.132:0/4282420588 learned_addr learned my addr 172.21.15.132:0/4282420588 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.844+0000 7fda16ffd640 1 -- 172.21.15.132:0/4282420588 >> v1:172.21.15.132:6789/0 conn(0x7fda181280d0 legacy=0x7fda181284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:53.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.844+0000 7fda16ffd640 1 -- 172.21.15.132:0/4282420588 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1806ef00 con 0x7fda1812e490 2024-04-26T12:34:53.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda16ffd640 1 --2- 172.21.15.132:0/4282420588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1812e490 0x7fda18130880 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009720 tx=0x7fda0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e6a2b631ee7e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:53.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda167fc640 1 -- 172.21.15.132:0/4282420588 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0c0316d0 con 0x7fda1812e490 2024-04-26T12:34:53.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda167fc640 1 -- 172.21.15.132:0/4282420588 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c037070 con 0x7fda1812e490 2024-04-26T12:34:53.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda167fc640 1 -- 172.21.15.132:0/4282420588 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda0c0319c0 con 0x7fda1812e490 2024-04-26T12:34:53.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda1dc4e640 1 -- 172.21.15.132:0/4282420588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1812e490 msgr2=0x7fda18130880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:53.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda1dc4e640 1 --2- 172.21.15.132:0/4282420588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1812e490 0x7fda18130880 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009720 tx=0x7fda0c02b840 comp rx=0 tx=0).stop 2024-04-26T12:34:53.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda1dc4e640 1 -- 172.21.15.132:0/4282420588 shutdown_connections 2024-04-26T12:34:53.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda1dc4e640 1 --2- 172.21.15.132:0/4282420588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda1812e490 0x7fda18130880 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:53.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda1dc4e640 1 -- 172.21.15.132:0/4282420588 >> 172.21.15.132:0/4282420588 conn(0x7fda1809b7b0 msgr2=0x7fda1809bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:34:53.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda1dc4e640 1 -- 172.21.15.132:0/4282420588 shutdown_connections 2024-04-26T12:34:53.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.845+0000 7fda1dc4e640 1 -- 172.21.15.132:0/4282420588 wait complete. 2024-04-26T12:34:53.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.846+0000 7fda1dc4e640 1 Processor -- start 2024-04-26T12:34:53.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.846+0000 7fda1dc4e640 1 -- start start 2024-04-26T12:34:53.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda1dc4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda181280d0 0x7fda181297c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:53.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda1dc4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fda18128bc0 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda181280d0 0x7fda181297c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda181280d0 0x7fda181297c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49112/0 (socket says 172.21.15.132:49112) 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda177fe640 1 -- 172.21.15.132:0/1795948771 learned_addr learned my addr 172.21.15.132:0/1795948771 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda177fe640 1 -- 172.21.15.132:0/1795948771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1812bd40 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda177fe640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda181280d0 0x7fda181297c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c380 tx=0x7fda0800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fd9fffff640 1 -- 172.21.15.132:0/1795948771 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda08005c10 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fd9fffff640 1 -- 172.21.15.132:0/1795948771 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda08005db0 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fd9fffff640 1 -- 172.21.15.132:0/1795948771 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda08004930 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1812c200 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.847+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda18129d00 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.848+0000 7fd9fffff640 1 -- 172.21.15.132:0/1795948771 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fda0801a020 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.849+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1812cc30 con 0x7fda181280d0 2024-04-26T12:34:53.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.849+0000 7fd9fffff640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fda04038060 0x7fda0403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:34:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.849+0000 7fd9fffff640 1 -- 172.21.15.132:0/1795948771 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fda0804b230 con 0x7fda181280d0 2024-04-26T12:34:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.849+0000 7fda16ffd640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fda04038060 0x7fda0403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:34:53.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.850+0000 7fda16ffd640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fda04038060 0x7fda0403a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fda0c036000 tx=0x7fda0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:34:53.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:53.853+0000 7fd9fffff640 1 -- 172.21.15.132:0/1795948771 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fda080127f0 con 0x7fda181280d0 2024-04-26T12:34:54.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.025+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda1808e1d0 con 0x7fda04038060 2024-04-26T12:34:54.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.041+0000 7fd9fffff640 1 -- 172.21.15.132:0/1795948771 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665959 (secure 0 0 0) 0x7fda1808e1d0 con 0x7fda04038060 2024-04-26T12:34:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:34:54.056 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:34:54.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fda04038060 msgr2=0x7fda0403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:54.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fda04038060 0x7fda0403a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fda0c036000 tx=0x7fda0c008030 comp rx=0 tx=0).stop 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda181280d0 msgr2=0x7fda181297c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda181280d0 0x7fda181297c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c380 tx=0x7fda0800c840 comp rx=0 tx=0).stop 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 shutdown_connections 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fda04038060 0x7fda0403a520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 --2- 172.21.15.132:0/1795948771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda181280d0 0x7fda181297c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.045+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 >> 172.21.15.132:0/1795948771 conn(0x7fda1809b7b0 msgr2=0x7fda180994f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.046+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 shutdown_connections 2024-04-26T12:34:54.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:34:54.046+0000 7fda1dc4e640 1 -- 172.21.15.132:0/1795948771 wait complete. 2024-04-26T12:34:54.061 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-04-26T12:34:52.514575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5095,"num_read_kb":4676,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123384,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377363976,"statfs":{"total":386547056640,"available":386420711424,"internally_reserved":0,"allocated":2908160,"data_stored":1759974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003862"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.288439+0000","last_change":"2024-04-26T12:33:58.288439+0000","last_active":"2024-04-26T12:33:58.288439+0000","last_peered":"2024-04-26T12:33:58.288439+0000","last_clean":"2024-04-26T12:33:58.288439+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:33:58.288439+0000","last_undegraded":"2024-04-26T12:33:58.288439+0000","last_fullsized":"2024-04-26T12:33:58.288439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.288321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:54.223162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.854100+0000","last_change":"2024-04-26T12:33:52.854126+0000","last_active":"2024-04-26T12:33:52.854100+0000","last_peered":"2024-04-26T12:33:52.854100+0000","last_clean":"2024-04-26T12:33:52.854100+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:33:52.854100+0000","last_undegraded":"2024-04-26T12:33:52.854100+0000","last_fullsized":"2024-04-26T12:33:52.854100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.854008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:48.175623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.609564+0000","last_change":"2024-04-26T12:34:22.609592+0000","last_active":"2024-04-26T12:34:22.609564+0000","last_peered":"2024-04-26T12:34:22.609564+0000","last_clean":"2024-04-26T12:34:22.609564+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:34:22.609564+0000","last_undegraded":"2024-04-26T12:34:22.609564+0000","last_fullsized":"2024-04-26T12:34:22.609564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:22.609471+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:22.609471+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.609471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:33.445654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.666975+0000","last_change":"2024-04-26T12:34:18.667006+0000","last_active":"2024-04-26T12:34:18.666975+0000","last_peered":"2024-04-26T12:34:18.666975+0000","last_clean":"2024-04-26T12:34:18.666975+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:34:18.666975+0000","last_undegraded":"2024-04-26T12:34:18.666975+0000","last_fullsized":"2024-04-26T12:34:18.666975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:34:18.666884+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:34:18.666884+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.666884+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.442000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.685114+0000","last_change":"2024-04-26T12:34:21.685114+0000","last_active":"2024-04-26T12:34:21.685114+0000","last_peered":"2024-04-26T12:34:21.685114+0000","last_clean":"2024-04-26T12:34:21.685114+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:34:21.685114+0000","last_undegraded":"2024-04-26T12:34:21.685114+0000","last_fullsized":"2024-04-26T12:34:21.685114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:21.684952+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.684952+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.684952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:31.971000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.669824+0000","last_change":"2024-04-26T12:34:06.669871+0000","last_active":"2024-04-26T12:34:06.669824+0000","last_peered":"2024-04-26T12:34:06.669824+0000","last_clean":"2024-04-26T12:34:06.669824+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:34:06.669824+0000","last_undegraded":"2024-04-26T12:34:06.669824+0000","last_fullsized":"2024-04-26T12:34:06.669824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.669725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:33.570963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.209207+0000","last_change":"2024-04-26T12:34:15.209232+0000","last_active":"2024-04-26T12:34:15.209207+0000","last_peered":"2024-04-26T12:34:15.209207+0000","last_clean":"2024-04-26T12:34:15.209207+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:34:15.209207+0000","last_undegraded":"2024-04-26T12:34:15.209207+0000","last_fullsized":"2024-04-26T12:34:15.209207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:15.209099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:15.209099+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.209099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:34.233375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.669332+0000","last_change":"2024-04-26T12:34:14.669361+0000","last_active":"2024-04-26T12:34:14.669332+0000","last_peered":"2024-04-26T12:34:14.669332+0000","last_clean":"2024-04-26T12:34:14.669332+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:34:14.669332+0000","last_undegraded":"2024-04-26T12:34:14.669332+0000","last_fullsized":"2024-04-26T12:34:14.669332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:14.669243+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:14.669243+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.669243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:18.241558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:30.519091+0000","last_change":"2024-04-26T12:34:30.519121+0000","last_active":"2024-04-26T12:34:30.519091+0000","last_peered":"2024-04-26T12:34:30.519091+0000","last_clean":"2024-04-26T12:34:30.519091+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:34:30.519091+0000","last_undegraded":"2024-04-26T12:34:30.519091+0000","last_fullsized":"2024-04-26T12:34:30.519091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:30.518998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:30.518998+0000","last_clean_scrub_stamp":"2024-04-26T12:34:30.518998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:03.943828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.819186+0000","last_change":"2024-04-26T12:34:25.819213+0000","last_active":"2024-04-26T12:34:25.819186+0000","last_peered":"2024-04-26T12:34:25.819186+0000","last_clean":"2024-04-26T12:34:25.819186+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:34:25.819186+0000","last_undegraded":"2024-04-26T12:34:25.819186+0000","last_fullsized":"2024-04-26T12:34:25.819186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:34:25.819067+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:34:25.819067+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.819067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:59.067925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.230538+0000","last_change":"2024-04-26T12:34:06.230563+0000","last_active":"2024-04-26T12:34:06.230538+0000","last_peered":"2024-04-26T12:34:06.230538+0000","last_clean":"2024-04-26T12:34:06.230538+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:34:06.230538+0000","last_undegraded":"2024-04-26T12:34:06.230538+0000","last_fullsized":"2024-04-26T12:34:06.230538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.230442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:31.999710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.284784+0000","last_change":"2024-04-26T12:34:25.284821+0000","last_active":"2024-04-26T12:34:25.284784+0000","last_peered":"2024-04-26T12:34:25.284784+0000","last_clean":"2024-04-26T12:34:25.284784+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:34:25.284784+0000","last_undegraded":"2024-04-26T12:34:25.284784+0000","last_fullsized":"2024-04-26T12:34:25.284784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:25.284696+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:25.284696+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.284696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.824773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:34.592452+0000","last_change":"2024-04-26T12:34:34.592487+0000","last_active":"2024-04-26T12:34:34.592452+0000","last_peered":"2024-04-26T12:34:34.592452+0000","last_clean":"2024-04-26T12:34:34.592452+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:34:34.592452+0000","last_undegraded":"2024-04-26T12:34:34.592452+0000","last_fullsized":"2024-04-26T12:34:34.592452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:34.592342+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:34.592342+0000","last_clean_scrub_stamp":"2024-04-26T12:34:34.592342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:48.673055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.332600+0000","last_change":"2024-04-26T12:33:54.332600+0000","last_active":"2024-04-26T12:33:54.332600+0000","last_peered":"2024-04-26T12:33:54.332600+0000","last_clean":"2024-04-26T12:33:54.332600+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:33:54.332600+0000","last_undegraded":"2024-04-26T12:33:54.332600+0000","last_fullsized":"2024-04-26T12:33:54.332600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.332483+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:46.075405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.528863+0000","last_change":"2024-04-26T12:34:07.528890+0000","last_active":"2024-04-26T12:34:07.528863+0000","last_peered":"2024-04-26T12:34:07.528863+0000","last_clean":"2024-04-26T12:34:07.528863+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:34:07.528863+0000","last_undegraded":"2024-04-26T12:34:07.528863+0000","last_fullsized":"2024-04-26T12:34:07.528863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:07.528773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:07.528773+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.528773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:35.692596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.336420+0000","last_change":"2024-04-26T12:33:59.336420+0000","last_active":"2024-04-26T12:33:59.336420+0000","last_peered":"2024-04-26T12:33:59.336420+0000","last_clean":"2024-04-26T12:33:59.336420+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:59.336420+0000","last_undegraded":"2024-04-26T12:33:59.336420+0000","last_fullsized":"2024-04-26T12:33:59.336420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.336298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:16.786139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.647501+0000","last_change":"2024-04-26T12:34:20.647529+0000","last_active":"2024-04-26T12:34:20.647501+0000","last_peered":"2024-04-26T12:34:20.647501+0000","last_clean":"2024-04-26T12:34:20.647501+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:34:20.647501+0000","last_undegraded":"2024-04-26T12:34:20.647501+0000","last_fullsized":"2024-04-26T12:34:20.647501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:20.647411+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:20.647411+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.647411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.619236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.857309+0000","last_change":"2024-04-26T12:34:14.857334+0000","last_active":"2024-04-26T12:34:14.857309+0000","last_peered":"2024-04-26T12:34:14.857309+0000","last_clean":"2024-04-26T12:34:14.857309+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:34:14.857309+0000","last_undegraded":"2024-04-26T12:34:14.857309+0000","last_fullsized":"2024-04-26T12:34:14.857309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:14.857209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:14.857209+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.857209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:12.986493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.778945+0000","last_change":"2024-04-26T12:33:54.778997+0000","last_active":"2024-04-26T12:33:54.778945+0000","last_peered":"2024-04-26T12:33:54.778945+0000","last_clean":"2024-04-26T12:33:54.778945+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:54.778945+0000","last_undegraded":"2024-04-26T12:33:54.778945+0000","last_fullsized":"2024-04-26T12:33:54.778945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.778831+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:42.906362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.213693+0000","last_change":"2024-04-26T12:34:10.213732+0000","last_active":"2024-04-26T12:34:10.213693+0000","last_peered":"2024-04-26T12:34:10.213693+0000","last_clean":"2024-04-26T12:34:10.213693+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:34:10.213693+0000","last_undegraded":"2024-04-26T12:34:10.213693+0000","last_fullsized":"2024-04-26T12:34:10.213693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:10.213568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:10.213568+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.213568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:30.498711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.871588+0000","last_change":"2024-04-26T12:34:15.871611+0000","last_active":"2024-04-26T12:34:15.871588+0000","last_peered":"2024-04-26T12:34:15.871588+0000","last_clean":"2024-04-26T12:34:15.871588+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:34:15.871588+0000","last_undegraded":"2024-04-26T12:34:15.871588+0000","last_fullsized":"2024-04-26T12:34:15.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:15.871498+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:15.871498+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.871498+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:04.533490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.812024+0000","last_change":"2024-04-26T12:34:10.812049+0000","last_active":"2024-04-26T12:34:10.812024+0000","last_peered":"2024-04-26T12:34:10.812024+0000","last_clean":"2024-04-26T12:34:10.812024+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:34:10.812024+0000","last_undegraded":"2024-04-26T12:34:10.812024+0000","last_fullsized":"2024-04-26T12:34:10.812024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:10.811929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:10.811929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.811929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:20.400842+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.536881+0000","last_change":"2024-04-26T12:34:06.536925+0000","last_active":"2024-04-26T12:34:06.536881+0000","last_peered":"2024-04-26T12:34:06.536881+0000","last_clean":"2024-04-26T12:34:06.536881+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:34:06.536881+0000","last_undegraded":"2024-04-26T12:34:06.536881+0000","last_fullsized":"2024-04-26T12:34:06.536881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.536779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:33.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.842487+0000","last_change":"2024-04-26T12:34:08.842555+0000","last_active":"2024-04-26T12:34:08.842487+0000","last_peered":"2024-04-26T12:34:08.842487+0000","last_clean":"2024-04-26T12:34:08.842487+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:34:08.842487+0000","last_undegraded":"2024-04-26T12:34:08.842487+0000","last_fullsized":"2024-04-26T12:34:08.842487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:08.842382+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:08.842382+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.842382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:39.151474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.360082+0000","last_change":"2024-04-26T12:34:03.360141+0000","last_active":"2024-04-26T12:34:03.360082+0000","last_peered":"2024-04-26T12:34:03.360082+0000","last_clean":"2024-04-26T12:34:03.360082+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:34:03.360082+0000","last_undegraded":"2024-04-26T12:34:03.360082+0000","last_fullsized":"2024-04-26T12:34:03.360082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.359974+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:04.442738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.566597+0000","last_change":"2024-04-26T12:34:09.566626+0000","last_active":"2024-04-26T12:34:09.566597+0000","last_peered":"2024-04-26T12:34:09.566597+0000","last_clean":"2024-04-26T12:34:09.566597+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:34:09.566597+0000","last_undegraded":"2024-04-26T12:34:09.566597+0000","last_fullsized":"2024-04-26T12:34:09.566597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:09.566504+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:09.566504+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.566504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:28.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.846263+0000","last_change":"2024-04-26T12:34:09.846287+0000","last_active":"2024-04-26T12:34:09.846263+0000","last_peered":"2024-04-26T12:34:09.846263+0000","last_clean":"2024-04-26T12:34:09.846263+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:34:09.846263+0000","last_undegraded":"2024-04-26T12:34:09.846263+0000","last_fullsized":"2024-04-26T12:34:09.846263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:09.846147+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:09.846147+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.846147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:02.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:40.681783+0000","last_change":"2024-04-26T12:34:40.681823+0000","last_active":"2024-04-26T12:34:40.681783+0000","last_peered":"2024-04-26T12:34:40.681783+0000","last_clean":"2024-04-26T12:34:40.681783+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:34:40.681783+0000","last_undegraded":"2024-04-26T12:34:40.681783+0000","last_fullsized":"2024-04-26T12:34:40.681783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:40.681684+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:40.681684+0000","last_clean_scrub_stamp":"2024-04-26T12:34:40.681684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:33.886826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:29.862045+0000","last_change":"2024-04-26T12:34:29.862075+0000","last_active":"2024-04-26T12:34:29.862045+0000","last_peered":"2024-04-26T12:34:29.862045+0000","last_clean":"2024-04-26T12:34:29.862045+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:34:29.862045+0000","last_undegraded":"2024-04-26T12:34:29.862045+0000","last_fullsized":"2024-04-26T12:34:29.862045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:34:29.861947+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:34:29.861947+0000","last_clean_scrub_stamp":"2024-04-26T12:34:29.861947+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:52.284746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.684217+0000","last_change":"2024-04-26T12:34:12.684244+0000","last_active":"2024-04-26T12:34:12.684217+0000","last_peered":"2024-04-26T12:34:12.684217+0000","last_clean":"2024-04-26T12:34:12.684217+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:34:12.684217+0000","last_undegraded":"2024-04-26T12:34:12.684217+0000","last_fullsized":"2024-04-26T12:34:12.684217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:12.684075+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:12.684075+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.684075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:21.651054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:39.653855+0000","last_change":"2024-04-26T12:34:39.653883+0000","last_active":"2024-04-26T12:34:39.653855+0000","last_peered":"2024-04-26T12:34:39.653855+0000","last_clean":"2024-04-26T12:34:39.653855+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:34:39.653855+0000","last_undegraded":"2024-04-26T12:34:39.653855+0000","last_fullsized":"2024-04-26T12:34:39.653855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:39.653753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:39.653753+0000","last_clean_scrub_stamp":"2024-04-26T12:34:39.653753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:14.099371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.036531+0000","last_change":"2024-04-26T12:33:39.036552+0000","last_active":"2024-04-26T12:33:39.036531+0000","last_peered":"2024-04-26T12:33:39.036531+0000","last_clean":"2024-04-26T12:33:39.036531+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:33:39.036531+0000","last_undegraded":"2024-04-26T12:33:39.036531+0000","last_fullsized":"2024-04-26T12:33:39.036531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.036437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:05.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.757268+0000","last_change":"2024-04-26T12:34:00.757313+0000","last_active":"2024-04-26T12:34:00.757268+0000","last_peered":"2024-04-26T12:34:00.757268+0000","last_clean":"2024-04-26T12:34:00.757268+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:34:00.757268+0000","last_undegraded":"2024-04-26T12:34:00.757268+0000","last_fullsized":"2024-04-26T12:34:00.757268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.757183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:25.221766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.860386+0000","last_change":"2024-04-26T12:33:47.860428+0000","last_active":"2024-04-26T12:33:47.860386+0000","last_peered":"2024-04-26T12:33:47.860386+0000","last_clean":"2024-04-26T12:33:47.860386+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:33:47.860386+0000","last_undegraded":"2024-04-26T12:33:47.860386+0000","last_fullsized":"2024-04-26T12:33:47.860386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.860284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:42.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.819119+0000","last_change":"2024-04-26T12:33:55.819147+0000","last_active":"2024-04-26T12:33:55.819119+0000","last_peered":"2024-04-26T12:33:55.819119+0000","last_clean":"2024-04-26T12:33:55.819119+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:33:55.819119+0000","last_undegraded":"2024-04-26T12:33:55.819119+0000","last_fullsized":"2024-04-26T12:33:55.819119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.819023+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:12.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.623546+0000","last_change":"2024-04-26T12:34:09.623569+0000","last_active":"2024-04-26T12:34:09.623546+0000","last_peered":"2024-04-26T12:34:09.623546+0000","last_clean":"2024-04-26T12:34:09.623546+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:34:09.623546+0000","last_undegraded":"2024-04-26T12:34:09.623546+0000","last_fullsized":"2024-04-26T12:34:09.623546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:34:09.623444+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:34:09.623444+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.623444+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:16.228875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.313982+0000","last_change":"2024-04-26T12:34:04.314012+0000","last_active":"2024-04-26T12:34:04.313982+0000","last_peered":"2024-04-26T12:34:04.313982+0000","last_clean":"2024-04-26T12:34:04.313982+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:34:04.313982+0000","last_undegraded":"2024-04-26T12:34:04.313982+0000","last_fullsized":"2024-04-26T12:34:04.313982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.313892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:49.817325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.582666+0000","last_change":"2024-04-26T12:33:51.582709+0000","last_active":"2024-04-26T12:33:51.582666+0000","last_peered":"2024-04-26T12:33:51.582666+0000","last_clean":"2024-04-26T12:33:51.582666+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:33:51.582666+0000","last_undegraded":"2024-04-26T12:33:51.582666+0000","last_fullsized":"2024-04-26T12:33:51.582666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.582551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:26.718562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.884196+0000","last_change":"2024-04-26T12:33:37.884246+0000","last_active":"2024-04-26T12:33:37.884196+0000","last_peered":"2024-04-26T12:33:37.884196+0000","last_clean":"2024-04-26T12:33:37.884196+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:33:37.884196+0000","last_undegraded":"2024-04-26T12:33:37.884196+0000","last_fullsized":"2024-04-26T12:33:37.884196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.884093+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:49.682928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.859025+0000","last_change":"2024-04-26T12:33:39.859050+0000","last_active":"2024-04-26T12:33:39.859025+0000","last_peered":"2024-04-26T12:33:39.859025+0000","last_clean":"2024-04-26T12:33:39.859025+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:33:39.859025+0000","last_undegraded":"2024-04-26T12:33:39.859025+0000","last_fullsized":"2024-04-26T12:33:39.859025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.858931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:37.129358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.450797+0000","last_change":"2024-04-26T12:34:27.450823+0000","last_active":"2024-04-26T12:34:27.450797+0000","last_peered":"2024-04-26T12:34:27.450797+0000","last_clean":"2024-04-26T12:34:27.450797+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:34:27.450797+0000","last_undegraded":"2024-04-26T12:34:27.450797+0000","last_fullsized":"2024-04-26T12:34:27.450797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:27.450670+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:27.450670+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.450670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:28.031703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.271818+0000","last_change":"2024-04-26T12:34:26.271846+0000","last_active":"2024-04-26T12:34:26.271818+0000","last_peered":"2024-04-26T12:34:26.271818+0000","last_clean":"2024-04-26T12:34:26.271818+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:34:26.271818+0000","last_undegraded":"2024-04-26T12:34:26.271818+0000","last_fullsized":"2024-04-26T12:34:26.271818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:26.271725+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:26.271725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.271725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:37.887067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.566622+0000","last_change":"2024-04-26T12:34:27.566652+0000","last_active":"2024-04-26T12:34:27.566622+0000","last_peered":"2024-04-26T12:34:27.566622+0000","last_clean":"2024-04-26T12:34:27.566622+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:34:27.566622+0000","last_undegraded":"2024-04-26T12:34:27.566622+0000","last_fullsized":"2024-04-26T12:34:27.566622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:27.566516+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:27.566516+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.566516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:12.334644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.457300+0000","last_change":"2024-04-26T12:33:46.457327+0000","last_active":"2024-04-26T12:33:46.457300+0000","last_peered":"2024-04-26T12:33:46.457300+0000","last_clean":"2024-04-26T12:33:46.457300+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:33:46.457300+0000","last_undegraded":"2024-04-26T12:33:46.457300+0000","last_fullsized":"2024-04-26T12:33:46.457300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.457219+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:47.671663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.342694+0000","last_change":"2024-04-26T12:33:38.342730+0000","last_active":"2024-04-26T12:33:38.342694+0000","last_peered":"2024-04-26T12:33:38.342694+0000","last_clean":"2024-04-26T12:33:38.342694+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:33:38.342694+0000","last_undegraded":"2024-04-26T12:33:38.342694+0000","last_fullsized":"2024-04-26T12:33:38.342694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.342608+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:02.654541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":394,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.668123+0000","last_change":"2024-04-26T12:34:07.668165+0000","last_active":"2024-04-26T12:34:07.668123+0000","last_peered":"2024-04-26T12:34:07.668123+0000","last_clean":"2024-04-26T12:34:07.668123+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:34:07.668123+0000","last_undegraded":"2024-04-26T12:34:07.668123+0000","last_fullsized":"2024-04-26T12:34:07.668123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.667991+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:57.252635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.255875+0000","last_change":"2024-04-26T12:34:21.255905+0000","last_active":"2024-04-26T12:34:21.255875+0000","last_peered":"2024-04-26T12:34:21.255875+0000","last_clean":"2024-04-26T12:34:21.255875+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:34:21.255875+0000","last_undegraded":"2024-04-26T12:34:21.255875+0000","last_fullsized":"2024-04-26T12:34:21.255875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:21.255772+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.255772+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.255772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:26.069167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.639814+0000","last_change":"2024-04-26T12:33:59.639842+0000","last_active":"2024-04-26T12:33:59.639814+0000","last_peered":"2024-04-26T12:33:59.639814+0000","last_clean":"2024-04-26T12:33:59.639814+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:33:59.639814+0000","last_undegraded":"2024-04-26T12:33:59.639814+0000","last_fullsized":"2024-04-26T12:33:59.639814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.639717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:28.819645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.834133+0000","last_change":"2024-04-26T12:34:24.834188+0000","last_active":"2024-04-26T12:34:24.834133+0000","last_peered":"2024-04-26T12:34:24.834133+0000","last_clean":"2024-04-26T12:34:24.834133+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:34:24.834133+0000","last_undegraded":"2024-04-26T12:34:24.834133+0000","last_fullsized":"2024-04-26T12:34:24.834133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.834032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.834032+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.834032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:40.390751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.942879+0000","last_change":"2024-04-26T12:33:33.942913+0000","last_active":"2024-04-26T12:33:33.942879+0000","last_peered":"2024-04-26T12:33:33.942879+0000","last_clean":"2024-04-26T12:33:33.942879+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:33:33.942879+0000","last_undegraded":"2024-04-26T12:33:33.942879+0000","last_fullsized":"2024-04-26T12:33:33.942879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.942777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:36.777412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.337516+0000","last_change":"2024-04-26T12:33:39.337566+0000","last_active":"2024-04-26T12:33:39.337516+0000","last_peered":"2024-04-26T12:33:39.337516+0000","last_clean":"2024-04-26T12:33:39.337516+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:33:39.337516+0000","last_undegraded":"2024-04-26T12:33:39.337516+0000","last_fullsized":"2024-04-26T12:33:39.337516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.337430+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:45.269245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.466047+0000","last_change":"2024-04-26T12:33:37.466107+0000","last_active":"2024-04-26T12:33:37.466047+0000","last_peered":"2024-04-26T12:33:37.466047+0000","last_clean":"2024-04-26T12:33:37.466047+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:37.466047+0000","last_undegraded":"2024-04-26T12:33:37.466047+0000","last_fullsized":"2024-04-26T12:33:37.466047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.465931+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.639127+0000","last_change":"2024-04-26T12:34:08.639127+0000","last_active":"2024-04-26T12:34:08.639127+0000","last_peered":"2024-04-26T12:34:08.639127+0000","last_clean":"2024-04-26T12:34:08.639127+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:34:08.639127+0000","last_undegraded":"2024-04-26T12:34:08.639127+0000","last_fullsized":"2024-04-26T12:34:08.639127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:08.639013+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:08.639013+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.639013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:31.061812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.373086+0000","last_change":"2024-04-26T12:34:00.373086+0000","last_active":"2024-04-26T12:34:00.373086+0000","last_peered":"2024-04-26T12:34:00.373086+0000","last_clean":"2024-04-26T12:34:00.373086+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:34:00.373086+0000","last_undegraded":"2024-04-26T12:34:00.373086+0000","last_fullsized":"2024-04-26T12:34:00.373086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.372929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:27.486437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.872579+0000","last_change":"2024-04-26T12:33:46.872579+0000","last_active":"2024-04-26T12:33:46.872579+0000","last_peered":"2024-04-26T12:33:46.872579+0000","last_clean":"2024-04-26T12:33:46.872579+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:33:46.872579+0000","last_undegraded":"2024-04-26T12:33:46.872579+0000","last_fullsized":"2024-04-26T12:33:46.872579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.872459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:20.085162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'54","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.341067+0000","last_change":"2024-04-26T12:33:40.341067+0000","last_active":"2024-04-26T12:33:40.341067+0000","last_peered":"2024-04-26T12:33:40.341067+0000","last_clean":"2024-04-26T12:33:40.341067+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:33:40.341067+0000","last_undegraded":"2024-04-26T12:33:40.341067+0000","last_fullsized":"2024-04-26T12:33:40.341067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.340927+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:00.228500+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.457485+0000","last_change":"2024-04-26T12:33:34.457526+0000","last_active":"2024-04-26T12:33:34.457485+0000","last_peered":"2024-04-26T12:33:34.457485+0000","last_clean":"2024-04-26T12:33:34.457485+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:33:34.457485+0000","last_undegraded":"2024-04-26T12:33:34.457485+0000","last_fullsized":"2024-04-26T12:33:34.457485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.457383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:18.910969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.259347+0000","last_change":"2024-04-26T12:34:22.259347+0000","last_active":"2024-04-26T12:34:22.259347+0000","last_peered":"2024-04-26T12:34:22.259347+0000","last_clean":"2024-04-26T12:34:22.259347+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:34:22.259347+0000","last_undegraded":"2024-04-26T12:34:22.259347+0000","last_fullsized":"2024-04-26T12:34:22.259347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:34:22.259235+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:34:22.259235+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.259235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:23.699604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.791149+0000","last_change":"2024-04-26T12:34:05.791149+0000","last_active":"2024-04-26T12:34:05.791149+0000","last_peered":"2024-04-26T12:34:05.791149+0000","last_clean":"2024-04-26T12:34:05.791149+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:34:05.791149+0000","last_undegraded":"2024-04-26T12:34:05.791149+0000","last_fullsized":"2024-04-26T12:34:05.791149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.791018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:41.156216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.216174+0000","last_change":"2024-04-26T12:34:14.216174+0000","last_active":"2024-04-26T12:34:14.216174+0000","last_peered":"2024-04-26T12:34:14.216174+0000","last_clean":"2024-04-26T12:34:14.216174+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:34:14.216174+0000","last_undegraded":"2024-04-26T12:34:14.216174+0000","last_fullsized":"2024-04-26T12:34:14.216174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:14.216059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:14.216059+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.216059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:23.021916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.534500+0000","last_change":"2024-04-26T12:33:50.534500+0000","last_active":"2024-04-26T12:33:50.534500+0000","last_peered":"2024-04-26T12:33:50.534500+0000","last_clean":"2024-04-26T12:33:50.534500+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:33:50.534500+0000","last_undegraded":"2024-04-26T12:33:50.534500+0000","last_fullsized":"2024-04-26T12:33:50.534500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.534336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:36.444391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.724251+0000","last_change":"2024-04-26T12:34:02.724251+0000","last_active":"2024-04-26T12:34:02.724251+0000","last_peered":"2024-04-26T12:34:02.724251+0000","last_clean":"2024-04-26T12:34:02.724251+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:34:02.724251+0000","last_undegraded":"2024-04-26T12:34:02.724251+0000","last_fullsized":"2024-04-26T12:34:02.724251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.724129+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.917634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.451884+0000","last_change":"2024-04-26T12:33:36.451884+0000","last_active":"2024-04-26T12:33:36.451884+0000","last_peered":"2024-04-26T12:33:36.451884+0000","last_clean":"2024-04-26T12:33:36.451884+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:33:36.451884+0000","last_undegraded":"2024-04-26T12:33:36.451884+0000","last_fullsized":"2024-04-26T12:33:36.451884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.451767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:45.412706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.821196+0000","last_change":"2024-04-26T12:34:26.821196+0000","last_active":"2024-04-26T12:34:26.821196+0000","last_peered":"2024-04-26T12:34:26.821196+0000","last_clean":"2024-04-26T12:34:26.821196+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:34:26.821196+0000","last_undegraded":"2024-04-26T12:34:26.821196+0000","last_fullsized":"2024-04-26T12:34:26.821196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:26.821082+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:26.821082+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.821082+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:15.323997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.334451+0000","last_change":"2024-04-26T12:34:01.334451+0000","last_active":"2024-04-26T12:34:01.334451+0000","last_peered":"2024-04-26T12:34:01.334451+0000","last_clean":"2024-04-26T12:34:01.334451+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:34:01.334451+0000","last_undegraded":"2024-04-26T12:34:01.334451+0000","last_fullsized":"2024-04-26T12:34:01.334451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.334329+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:19.047133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:37.573038+0000","last_change":"2024-04-26T12:34:37.573038+0000","last_active":"2024-04-26T12:34:37.573038+0000","last_peered":"2024-04-26T12:34:37.573038+0000","last_clean":"2024-04-26T12:34:37.573038+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:34:37.573038+0000","last_undegraded":"2024-04-26T12:34:37.573038+0000","last_fullsized":"2024-04-26T12:34:37.573038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:37.572885+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:37.572885+0000","last_clean_scrub_stamp":"2024-04-26T12:34:37.572885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:16.636879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.471028+0000","last_change":"2024-04-26T12:33:47.471028+0000","last_active":"2024-04-26T12:33:47.471028+0000","last_peered":"2024-04-26T12:33:47.471028+0000","last_clean":"2024-04-26T12:33:47.471028+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:33:47.471028+0000","last_undegraded":"2024-04-26T12:33:47.471028+0000","last_fullsized":"2024-04-26T12:33:47.471028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.470897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:56.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.902471+0000","last_change":"2024-04-26T12:33:51.902471+0000","last_active":"2024-04-26T12:33:51.902471+0000","last_peered":"2024-04-26T12:33:51.902471+0000","last_clean":"2024-04-26T12:33:51.902471+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:33:51.902471+0000","last_undegraded":"2024-04-26T12:33:51.902471+0000","last_fullsized":"2024-04-26T12:33:51.902471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.902291+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:22.459245+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.490381+0000","last_change":"2024-04-26T12:33:48.490381+0000","last_active":"2024-04-26T12:33:48.490381+0000","last_peered":"2024-04-26T12:33:48.490381+0000","last_clean":"2024-04-26T12:33:48.490381+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:48.490381+0000","last_undegraded":"2024-04-26T12:33:48.490381+0000","last_fullsized":"2024-04-26T12:33:48.490381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.490266+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:44.425107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:32.429275+0000","last_change":"2024-04-26T12:34:32.429275+0000","last_active":"2024-04-26T12:34:32.429275+0000","last_peered":"2024-04-26T12:34:32.429275+0000","last_clean":"2024-04-26T12:34:32.429275+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:34:32.429275+0000","last_undegraded":"2024-04-26T12:34:32.429275+0000","last_fullsized":"2024-04-26T12:34:32.429275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:32.429145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:32.429145+0000","last_clean_scrub_stamp":"2024-04-26T12:34:32.429145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:23.497400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.255286+0000","last_change":"2024-04-26T12:34:19.255286+0000","last_active":"2024-04-26T12:34:19.255286+0000","last_peered":"2024-04-26T12:34:19.255286+0000","last_clean":"2024-04-26T12:34:19.255286+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:34:19.255286+0000","last_undegraded":"2024-04-26T12:34:19.255286+0000","last_fullsized":"2024-04-26T12:34:19.255286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:19.255094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:19.255094+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.255094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:13.286904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269579+0000","last_change":"2024-04-26T12:30:10.524281+0000","last_active":"2024-04-26T12:33:32.269579+0000","last_peered":"2024-04-26T12:33:32.269579+0000","last_clean":"2024-04-26T12:33:32.269579+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:33:32.269579+0000","last_undegraded":"2024-04-26T12:33:32.269579+0000","last_fullsized":"2024-04-26T12:33:32.269579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.284415+0000","last_change":"2024-04-26T12:34:24.284479+0000","last_active":"2024-04-26T12:34:24.284415+0000","last_peered":"2024-04-26T12:34:24.284415+0000","last_clean":"2024-04-26T12:34:24.284415+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:34:24.284415+0000","last_undegraded":"2024-04-26T12:34:24.284415+0000","last_fullsized":"2024-04-26T12:34:24.284415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.284319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.284319+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.284319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:44.396150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'63","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.025645+0000","last_change":"2024-04-26T12:33:46.025645+0000","last_active":"2024-04-26T12:33:46.025645+0000","last_peered":"2024-04-26T12:33:46.025645+0000","last_clean":"2024-04-26T12:33:46.025645+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:33:46.025645+0000","last_undegraded":"2024-04-26T12:33:46.025645+0000","last_fullsized":"2024-04-26T12:33:46.025645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.025519+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:28.207080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.486192+0000","last_change":"2024-04-26T12:33:32.486192+0000","last_active":"2024-04-26T12:33:32.486192+0000","last_peered":"2024-04-26T12:33:32.486192+0000","last_clean":"2024-04-26T12:33:32.486192+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:33:32.486192+0000","last_undegraded":"2024-04-26T12:33:32.486192+0000","last_fullsized":"2024-04-26T12:33:32.486192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.486110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:19.318546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.625149+0000","last_change":"2024-04-26T12:34:00.625149+0000","last_active":"2024-04-26T12:34:00.625149+0000","last_peered":"2024-04-26T12:34:00.625149+0000","last_clean":"2024-04-26T12:34:00.625149+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:34:00.625149+0000","last_undegraded":"2024-04-26T12:34:00.625149+0000","last_fullsized":"2024-04-26T12:34:00.625149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.625009+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.384957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.852418+0000","last_change":"2024-04-26T12:33:56.852418+0000","last_active":"2024-04-26T12:33:56.852418+0000","last_peered":"2024-04-26T12:33:56.852418+0000","last_clean":"2024-04-26T12:33:56.852418+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:33:56.852418+0000","last_undegraded":"2024-04-26T12:33:56.852418+0000","last_fullsized":"2024-04-26T12:33:56.852418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.852284+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.300655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.538013+0000","last_change":"2024-04-26T12:34:13.538013+0000","last_active":"2024-04-26T12:34:13.538013+0000","last_peered":"2024-04-26T12:34:13.538013+0000","last_clean":"2024-04-26T12:34:13.538013+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:34:13.538013+0000","last_undegraded":"2024-04-26T12:34:13.538013+0000","last_fullsized":"2024-04-26T12:34:13.538013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:13.537899+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:13.537899+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.537899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:14.978267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.377200+0000","last_change":"2024-04-26T12:33:52.377200+0000","last_active":"2024-04-26T12:33:52.377200+0000","last_peered":"2024-04-26T12:33:52.377200+0000","last_clean":"2024-04-26T12:33:52.377200+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:33:52.377200+0000","last_undegraded":"2024-04-26T12:33:52.377200+0000","last_fullsized":"2024-04-26T12:33:52.377200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.377072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:20.049145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.870573+0000","last_change":"2024-04-26T12:33:40.870573+0000","last_active":"2024-04-26T12:33:40.870573+0000","last_peered":"2024-04-26T12:33:40.870573+0000","last_clean":"2024-04-26T12:33:40.870573+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:33:40.870573+0000","last_undegraded":"2024-04-26T12:33:40.870573+0000","last_fullsized":"2024-04-26T12:33:40.870573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.870443+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:06.471328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.854635+0000","last_change":"2024-04-26T12:33:53.854635+0000","last_active":"2024-04-26T12:33:53.854635+0000","last_peered":"2024-04-26T12:33:53.854635+0000","last_clean":"2024-04-26T12:33:53.854635+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:33:53.854635+0000","last_undegraded":"2024-04-26T12:33:53.854635+0000","last_fullsized":"2024-04-26T12:33:53.854635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.854523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:51.983807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'7","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.270874+0000","last_change":"2024-04-26T12:30:20.532649+0000","last_active":"2024-04-26T12:33:32.270874+0000","last_peered":"2024-04-26T12:33:32.270874+0000","last_clean":"2024-04-26T12:33:32.270874+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:33:32.270874+0000","last_undegraded":"2024-04-26T12:33:32.270874+0000","last_fullsized":"2024-04-26T12:33:32.270874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.957328+0000","last_change":"2024-04-26T12:33:48.957328+0000","last_active":"2024-04-26T12:33:48.957328+0000","last_peered":"2024-04-26T12:33:48.957328+0000","last_clean":"2024-04-26T12:33:48.957328+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:33:48.957328+0000","last_undegraded":"2024-04-26T12:33:48.957328+0000","last_fullsized":"2024-04-26T12:33:48.957328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.957209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:19.960752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.269539+0000","last_change":"2024-04-26T12:30:10.516364+0000","last_active":"2024-04-26T12:33:32.269539+0000","last_peered":"2024-04-26T12:33:32.269539+0000","last_clean":"2024-04-26T12:33:32.269539+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:33:32.269539+0000","last_undegraded":"2024-04-26T12:33:32.269539+0000","last_fullsized":"2024-04-26T12:33:32.269539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:09.454310+0000","last_clean_scrub_stamp":"2024-04-26T12:30:09.454310+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.485594+0000","last_change":"2024-04-26T12:33:49.485594+0000","last_active":"2024-04-26T12:33:49.485594+0000","last_peered":"2024-04-26T12:33:49.485594+0000","last_clean":"2024-04-26T12:33:49.485594+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:33:49.485594+0000","last_undegraded":"2024-04-26T12:33:49.485594+0000","last_fullsized":"2024-04-26T12:33:49.485594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.485434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.630769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.335394+0000","last_change":"2024-04-26T12:33:43.335394+0000","last_active":"2024-04-26T12:33:43.335394+0000","last_peered":"2024-04-26T12:33:43.335394+0000","last_clean":"2024-04-26T12:33:43.335394+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:33:43.335394+0000","last_undegraded":"2024-04-26T12:33:43.335394+0000","last_fullsized":"2024-04-26T12:33:43.335394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.335257+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:44.822905+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":421,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.325088+0000","last_change":"2024-04-26T12:33:41.325114+0000","last_active":"2024-04-26T12:33:41.325088+0000","last_peered":"2024-04-26T12:33:41.325088+0000","last_clean":"2024-04-26T12:33:41.325088+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:41.325088+0000","last_undegraded":"2024-04-26T12:33:41.325088+0000","last_fullsized":"2024-04-26T12:33:41.325088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.325000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:42.600411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:28.495981+0000","last_change":"2024-04-26T12:34:28.495981+0000","last_active":"2024-04-26T12:34:28.495981+0000","last_peered":"2024-04-26T12:34:28.495981+0000","last_clean":"2024-04-26T12:34:28.495981+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:34:28.495981+0000","last_undegraded":"2024-04-26T12:34:28.495981+0000","last_fullsized":"2024-04-26T12:34:28.495981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:34:28.495862+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:34:28.495862+0000","last_clean_scrub_stamp":"2024-04-26T12:34:28.495862+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:58.659027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.271830+0000","last_change":"2024-04-26T12:34:05.271830+0000","last_active":"2024-04-26T12:34:05.271830+0000","last_peered":"2024-04-26T12:34:05.271830+0000","last_clean":"2024-04-26T12:34:05.271830+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:34:05.271830+0000","last_undegraded":"2024-04-26T12:34:05.271830+0000","last_fullsized":"2024-04-26T12:34:05.271830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.271706+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:10.784909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.607765+0000","last_change":"2024-04-26T12:34:24.607765+0000","last_active":"2024-04-26T12:34:24.607765+0000","last_peered":"2024-04-26T12:34:24.607765+0000","last_clean":"2024-04-26T12:34:24.607765+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:34:24.607765+0000","last_undegraded":"2024-04-26T12:34:24.607765+0000","last_fullsized":"2024-04-26T12:34:24.607765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.607633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.607633+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.607633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:36.469232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.919526+0000","last_change":"2024-04-26T12:33:41.919526+0000","last_active":"2024-04-26T12:33:41.919526+0000","last_peered":"2024-04-26T12:33:41.919526+0000","last_clean":"2024-04-26T12:33:41.919526+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:33:41.919526+0000","last_undegraded":"2024-04-26T12:33:41.919526+0000","last_fullsized":"2024-04-26T12:33:41.919526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.919360+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:08.145030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.033639+0000","last_change":"2024-04-26T12:33:38.033639+0000","last_active":"2024-04-26T12:33:38.033639+0000","last_peered":"2024-04-26T12:33:38.033639+0000","last_clean":"2024-04-26T12:33:38.033639+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:33:38.033639+0000","last_undegraded":"2024-04-26T12:33:38.033639+0000","last_fullsized":"2024-04-26T12:33:38.033639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.033508+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:09.947838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":512,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.012799+0000","last_change":"2024-04-26T12:33:33.012799+0000","last_active":"2024-04-26T12:33:33.012799+0000","last_peered":"2024-04-26T12:33:33.012799+0000","last_clean":"2024-04-26T12:33:33.012799+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:33.012799+0000","last_undegraded":"2024-04-26T12:33:33.012799+0000","last_fullsized":"2024-04-26T12:33:33.012799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.012673+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.693315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.329889+0000","last_change":"2024-04-26T12:33:53.329889+0000","last_active":"2024-04-26T12:33:53.329889+0000","last_peered":"2024-04-26T12:33:53.329889+0000","last_clean":"2024-04-26T12:33:53.329889+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:53.329889+0000","last_undegraded":"2024-04-26T12:33:53.329889+0000","last_fullsized":"2024-04-26T12:33:53.329889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.329710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:13.585776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'18","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.835053+0000","last_change":"2024-04-26T12:33:57.835053+0000","last_active":"2024-04-26T12:33:57.835053+0000","last_peered":"2024-04-26T12:33:57.835053+0000","last_clean":"2024-04-26T12:33:57.835053+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:57.835053+0000","last_undegraded":"2024-04-26T12:33:57.835053+0000","last_fullsized":"2024-04-26T12:33:57.835053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.834902+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:31.144768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.584425+0000","last_change":"2024-04-26T12:34:26.584425+0000","last_active":"2024-04-26T12:34:26.584425+0000","last_peered":"2024-04-26T12:34:26.584425+0000","last_clean":"2024-04-26T12:34:26.584425+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:34:26.584425+0000","last_undegraded":"2024-04-26T12:34:26.584425+0000","last_fullsized":"2024-04-26T12:34:26.584425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:26.584268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:26.584268+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.584268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:32.141285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.972968+0000","last_change":"2024-04-26T12:33:32.972968+0000","last_active":"2024-04-26T12:33:32.972968+0000","last_peered":"2024-04-26T12:33:32.972968+0000","last_clean":"2024-04-26T12:33:32.972968+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:33:32.972968+0000","last_undegraded":"2024-04-26T12:33:32.972968+0000","last_fullsized":"2024-04-26T12:33:32.972968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.972836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:10.206586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.924967+0000","last_change":"2024-04-26T12:33:36.924967+0000","last_active":"2024-04-26T12:33:36.924967+0000","last_peered":"2024-04-26T12:33:36.924967+0000","last_clean":"2024-04-26T12:33:36.924967+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:33:36.924967+0000","last_undegraded":"2024-04-26T12:33:36.924967+0000","last_fullsized":"2024-04-26T12:33:36.924967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.924772+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:29.763584+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.358794+0000","last_change":"2024-04-26T12:33:37.358839+0000","last_active":"2024-04-26T12:33:37.358794+0000","last_peered":"2024-04-26T12:33:37.358794+0000","last_clean":"2024-04-26T12:33:37.358794+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:33:37.358794+0000","last_undegraded":"2024-04-26T12:33:37.358794+0000","last_fullsized":"2024-04-26T12:33:37.358794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.358703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:07.891090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.830448+0000","last_change":"2024-04-26T12:33:51.830448+0000","last_active":"2024-04-26T12:33:51.830448+0000","last_peered":"2024-04-26T12:33:51.830448+0000","last_clean":"2024-04-26T12:33:51.830448+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:51.830448+0000","last_undegraded":"2024-04-26T12:33:51.830448+0000","last_fullsized":"2024-04-26T12:33:51.830448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.830335+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:23.254930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.916310+0000","last_change":"2024-04-26T12:33:49.916310+0000","last_active":"2024-04-26T12:33:49.916310+0000","last_peered":"2024-04-26T12:33:49.916310+0000","last_clean":"2024-04-26T12:33:49.916310+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:49.916310+0000","last_undegraded":"2024-04-26T12:33:49.916310+0000","last_fullsized":"2024-04-26T12:33:49.916310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.916195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:02.556981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.900215+0000","last_change":"2024-04-26T12:34:17.900270+0000","last_active":"2024-04-26T12:34:17.900215+0000","last_peered":"2024-04-26T12:34:17.900215+0000","last_clean":"2024-04-26T12:34:17.900215+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:34:17.900215+0000","last_undegraded":"2024-04-26T12:34:17.900215+0000","last_fullsized":"2024-04-26T12:34:17.900215+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-26T12:34:17.900111+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-26T12:34:17.900111+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.900111+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.661828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:41.676511+0000","last_change":"2024-04-26T12:34:41.676544+0000","last_active":"2024-04-26T12:34:41.676511+0000","last_peered":"2024-04-26T12:34:41.676511+0000","last_clean":"2024-04-26T12:34:41.676511+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:34:41.676511+0000","last_undegraded":"2024-04-26T12:34:41.676511+0000","last_fullsized":"2024-04-26T12:34:41.676511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:41.676422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:41.676422+0000","last_clean_scrub_stamp":"2024-04-26T12:34:41.676422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:20.964187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:36.577535+0000","last_change":"2024-04-26T12:34:36.577576+0000","last_active":"2024-04-26T12:34:36.577535+0000","last_peered":"2024-04-26T12:34:36.577535+0000","last_clean":"2024-04-26T12:34:36.577535+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:34:36.577535+0000","last_undegraded":"2024-04-26T12:34:36.577535+0000","last_fullsized":"2024-04-26T12:34:36.577535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:36.577412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:36.577412+0000","last_clean_scrub_stamp":"2024-04-26T12:34:36.577412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:21.710353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.891610+0000","last_change":"2024-04-26T12:33:45.891610+0000","last_active":"2024-04-26T12:33:45.891610+0000","last_peered":"2024-04-26T12:33:45.891610+0000","last_clean":"2024-04-26T12:33:45.891610+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:33:45.891610+0000","last_undegraded":"2024-04-26T12:33:45.891610+0000","last_fullsized":"2024-04-26T12:33:45.891610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.891453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:38.825131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.748578+0000","last_change":"2024-04-26T12:34:04.748578+0000","last_active":"2024-04-26T12:34:04.748578+0000","last_peered":"2024-04-26T12:34:04.748578+0000","last_clean":"2024-04-26T12:34:04.748578+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:34:04.748578+0000","last_undegraded":"2024-04-26T12:34:04.748578+0000","last_fullsized":"2024-04-26T12:34:04.748578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.748449+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:37.997307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.459732+0000","last_change":"2024-04-26T12:33:44.459732+0000","last_active":"2024-04-26T12:33:44.459732+0000","last_peered":"2024-04-26T12:33:44.459732+0000","last_clean":"2024-04-26T12:33:44.459732+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:33:44.459732+0000","last_undegraded":"2024-04-26T12:33:44.459732+0000","last_fullsized":"2024-04-26T12:33:44.459732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.459618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:37.847661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.385606+0000","last_change":"2024-04-26T12:33:49.385606+0000","last_active":"2024-04-26T12:33:49.385606+0000","last_peered":"2024-04-26T12:33:49.385606+0000","last_clean":"2024-04-26T12:33:49.385606+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:49.385606+0000","last_undegraded":"2024-04-26T12:33:49.385606+0000","last_fullsized":"2024-04-26T12:33:49.385606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.385474+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:25.473005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.651628+0000","last_change":"2024-04-26T12:34:17.651628+0000","last_active":"2024-04-26T12:34:17.651628+0000","last_peered":"2024-04-26T12:34:17.651628+0000","last_clean":"2024-04-26T12:34:17.651628+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:34:17.651628+0000","last_undegraded":"2024-04-26T12:34:17.651628+0000","last_fullsized":"2024-04-26T12:34:17.651628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:17.651456+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:17.651456+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.651456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:57.164554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:42.639503+0000","last_change":"2024-04-26T12:34:42.639532+0000","last_active":"2024-04-26T12:34:42.639503+0000","last_peered":"2024-04-26T12:34:42.639503+0000","last_clean":"2024-04-26T12:34:42.639503+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:34:42.639503+0000","last_undegraded":"2024-04-26T12:34:42.639503+0000","last_fullsized":"2024-04-26T12:34:42.639503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:42.639395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:42.639395+0000","last_clean_scrub_stamp":"2024-04-26T12:34:42.639395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:43.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.577169+0000","last_change":"2024-04-26T12:34:20.577169+0000","last_active":"2024-04-26T12:34:20.577169+0000","last_peered":"2024-04-26T12:34:20.577169+0000","last_clean":"2024-04-26T12:34:20.577169+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:34:20.577169+0000","last_undegraded":"2024-04-26T12:34:20.577169+0000","last_fullsized":"2024-04-26T12:34:20.577169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:20.577044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:20.577044+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.577044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:08.079282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.990341+0000","last_change":"2024-04-26T12:33:34.990341+0000","last_active":"2024-04-26T12:33:34.990341+0000","last_peered":"2024-04-26T12:33:34.990341+0000","last_clean":"2024-04-26T12:33:34.990341+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:33:34.990341+0000","last_undegraded":"2024-04-26T12:33:34.990341+0000","last_fullsized":"2024-04-26T12:33:34.990341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.990216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:51.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":516,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.968276+0000","last_change":"2024-04-26T12:33:34.968276+0000","last_active":"2024-04-26T12:33:34.968276+0000","last_peered":"2024-04-26T12:33:34.968276+0000","last_clean":"2024-04-26T12:33:34.968276+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:34.968276+0000","last_undegraded":"2024-04-26T12:33:34.968276+0000","last_fullsized":"2024-04-26T12:33:34.968276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.968125+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:55.925235+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.757744+0000","last_change":"2024-04-26T12:34:03.757744+0000","last_active":"2024-04-26T12:34:03.757744+0000","last_peered":"2024-04-26T12:34:03.757744+0000","last_clean":"2024-04-26T12:34:03.757744+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:34:03.757744+0000","last_undegraded":"2024-04-26T12:34:03.757744+0000","last_fullsized":"2024-04-26T12:34:03.757744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.757597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:19.314316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.815095+0000","last_change":"2024-04-26T12:34:27.815095+0000","last_active":"2024-04-26T12:34:27.815095+0000","last_peered":"2024-04-26T12:34:27.815095+0000","last_clean":"2024-04-26T12:34:27.815095+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:34:27.815095+0000","last_undegraded":"2024-04-26T12:34:27.815095+0000","last_fullsized":"2024-04-26T12:34:27.815095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:27.814977+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:27.814977+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.814977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:54.716214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'32","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.678134+0000","last_change":"2024-04-26T12:33:58.678134+0000","last_active":"2024-04-26T12:33:58.678134+0000","last_peered":"2024-04-26T12:33:58.678134+0000","last_clean":"2024-04-26T12:33:58.678134+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:33:58.678134+0000","last_undegraded":"2024-04-26T12:33:58.678134+0000","last_fullsized":"2024-04-26T12:33:58.678134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.678019+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:17.835330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.202870+0000","last_change":"2024-04-26T12:34:11.202870+0000","last_active":"2024-04-26T12:34:11.202870+0000","last_peered":"2024-04-26T12:34:11.202870+0000","last_clean":"2024-04-26T12:34:11.202870+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:34:11.202870+0000","last_undegraded":"2024-04-26T12:34:11.202870+0000","last_fullsized":"2024-04-26T12:34:11.202870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:11.202740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:11.202740+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.202740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:08.255369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.584357+0000","last_change":"2024-04-26T12:34:23.584386+0000","last_active":"2024-04-26T12:34:23.584357+0000","last_peered":"2024-04-26T12:34:23.584357+0000","last_clean":"2024-04-26T12:34:23.584357+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:34:23.584357+0000","last_undegraded":"2024-04-26T12:34:23.584357+0000","last_fullsized":"2024-04-26T12:34:23.584357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:23.584266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:23.584266+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.584266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:08.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.355150+0000","last_change":"2024-04-26T12:33:47.355150+0000","last_active":"2024-04-26T12:33:47.355150+0000","last_peered":"2024-04-26T12:33:47.355150+0000","last_clean":"2024-04-26T12:33:47.355150+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:33:47.355150+0000","last_undegraded":"2024-04-26T12:33:47.355150+0000","last_fullsized":"2024-04-26T12:33:47.355150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.355025+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:37.323218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.293799+0000","last_change":"2024-04-26T12:33:44.293799+0000","last_active":"2024-04-26T12:33:44.293799+0000","last_peered":"2024-04-26T12:33:44.293799+0000","last_clean":"2024-04-26T12:33:44.293799+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:44.293799+0000","last_undegraded":"2024-04-26T12:33:44.293799+0000","last_fullsized":"2024-04-26T12:33:44.293799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.293656+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:52.328074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.614615+0000","last_change":"2024-04-26T12:33:56.614615+0000","last_active":"2024-04-26T12:33:56.614615+0000","last_peered":"2024-04-26T12:33:56.614615+0000","last_clean":"2024-04-26T12:33:56.614615+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:33:56.614615+0000","last_undegraded":"2024-04-26T12:33:56.614615+0000","last_fullsized":"2024-04-26T12:33:56.614615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.614468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:09.789955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.649499+0000","last_change":"2024-04-26T12:34:23.649526+0000","last_active":"2024-04-26T12:34:23.649499+0000","last_peered":"2024-04-26T12:34:23.649499+0000","last_clean":"2024-04-26T12:34:23.649499+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:34:23.649499+0000","last_undegraded":"2024-04-26T12:34:23.649499+0000","last_fullsized":"2024-04-26T12:34:23.649499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:23.649405+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:23.649405+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.649405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:28.507228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.522505+0000","last_change":"2024-04-26T12:34:12.522505+0000","last_active":"2024-04-26T12:34:12.522505+0000","last_peered":"2024-04-26T12:34:12.522505+0000","last_clean":"2024-04-26T12:34:12.522505+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:34:12.522505+0000","last_undegraded":"2024-04-26T12:34:12.522505+0000","last_fullsized":"2024-04-26T12:34:12.522505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.522395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.522395+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.522395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:17.335789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:44.629299+0000","last_change":"2024-04-26T12:34:44.629325+0000","last_active":"2024-04-26T12:34:44.629299+0000","last_peered":"2024-04-26T12:34:44.629299+0000","last_clean":"2024-04-26T12:34:44.629299+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:34:44.629299+0000","last_undegraded":"2024-04-26T12:34:44.629299+0000","last_fullsized":"2024-04-26T12:34:44.629299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:44.629185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:44.629185+0000","last_clean_scrub_stamp":"2024-04-26T12:34:44.629185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.514503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.191902+0000","last_change":"2024-04-26T12:34:13.191902+0000","last_active":"2024-04-26T12:34:13.191902+0000","last_peered":"2024-04-26T12:34:13.191902+0000","last_clean":"2024-04-26T12:34:13.191902+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:34:13.191902+0000","last_undegraded":"2024-04-26T12:34:13.191902+0000","last_fullsized":"2024-04-26T12:34:13.191902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:13.191778+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:13.191778+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.191778+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:23.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.628392+0000","last_change":"2024-04-26T12:33:54.628392+0000","last_active":"2024-04-26T12:33:54.628392+0000","last_peered":"2024-04-26T12:33:54.628392+0000","last_clean":"2024-04-26T12:33:54.628392+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:33:54.628392+0000","last_undegraded":"2024-04-26T12:33:54.628392+0000","last_fullsized":"2024-04-26T12:33:54.628392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.628252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:07.053904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.999880+0000","last_change":"2024-04-26T12:33:47.999880+0000","last_active":"2024-04-26T12:33:47.999880+0000","last_peered":"2024-04-26T12:33:47.999880+0000","last_clean":"2024-04-26T12:33:47.999880+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:47.999880+0000","last_undegraded":"2024-04-26T12:33:47.999880+0000","last_fullsized":"2024-04-26T12:33:47.999880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.999755+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:40.140297+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.813237+0000","last_change":"2024-04-26T12:33:55.813237+0000","last_active":"2024-04-26T12:33:55.813237+0000","last_peered":"2024-04-26T12:33:55.813237+0000","last_clean":"2024-04-26T12:33:55.813237+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:33:55.813237+0000","last_undegraded":"2024-04-26T12:33:55.813237+0000","last_fullsized":"2024-04-26T12:33:55.813237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.813058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:32.755533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:30.861292+0000","last_change":"2024-04-26T12:34:30.861292+0000","last_active":"2024-04-26T12:34:30.861292+0000","last_peered":"2024-04-26T12:34:30.861292+0000","last_clean":"2024-04-26T12:34:30.861292+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:34:30.861292+0000","last_undegraded":"2024-04-26T12:34:30.861292+0000","last_fullsized":"2024-04-26T12:34:30.861292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:30.861136+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:30.861136+0000","last_clean_scrub_stamp":"2024-04-26T12:34:30.861136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:37.466567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.819534+0000","last_change":"2024-04-26T12:34:03.819534+0000","last_active":"2024-04-26T12:34:03.819534+0000","last_peered":"2024-04-26T12:34:03.819534+0000","last_clean":"2024-04-26T12:34:03.819534+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:34:03.819534+0000","last_undegraded":"2024-04-26T12:34:03.819534+0000","last_fullsized":"2024-04-26T12:34:03.819534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.819412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:28.268336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.192622+0000","last_change":"2024-04-26T12:34:17.192622+0000","last_active":"2024-04-26T12:34:17.192622+0000","last_peered":"2024-04-26T12:34:17.192622+0000","last_clean":"2024-04-26T12:34:17.192622+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:34:17.192622+0000","last_undegraded":"2024-04-26T12:34:17.192622+0000","last_fullsized":"2024-04-26T12:34:17.192622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:17.192508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:17.192508+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.192508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.601445+0000","last_change":"2024-04-26T12:34:19.601474+0000","last_active":"2024-04-26T12:34:19.601445+0000","last_peered":"2024-04-26T12:34:19.601445+0000","last_clean":"2024-04-26T12:34:19.601445+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:34:19.601445+0000","last_undegraded":"2024-04-26T12:34:19.601445+0000","last_fullsized":"2024-04-26T12:34:19.601445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:19.601341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:19.601341+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.601341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:40.439925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.586839+0000","last_change":"2024-04-26T12:33:53.586839+0000","last_active":"2024-04-26T12:33:53.586839+0000","last_peered":"2024-04-26T12:33:53.586839+0000","last_clean":"2024-04-26T12:33:53.586839+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:33:53.586839+0000","last_undegraded":"2024-04-26T12:33:53.586839+0000","last_fullsized":"2024-04-26T12:33:53.586839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.586700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:09.928615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.434204+0000","last_change":"2024-04-26T12:33:39.434204+0000","last_active":"2024-04-26T12:33:39.434204+0000","last_peered":"2024-04-26T12:33:39.434204+0000","last_clean":"2024-04-26T12:33:39.434204+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:33:39.434204+0000","last_undegraded":"2024-04-26T12:33:39.434204+0000","last_fullsized":"2024-04-26T12:33:39.434204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.434024+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:15.521556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.280612+0000","last_change":"2024-04-26T12:33:32.280612+0000","last_active":"2024-04-26T12:33:32.280612+0000","last_peered":"2024-04-26T12:33:32.280612+0000","last_clean":"2024-04-26T12:33:32.280612+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:33:32.280612+0000","last_undegraded":"2024-04-26T12:33:32.280612+0000","last_fullsized":"2024-04-26T12:33:32.280612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.280461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:13.869333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:30.487629+0000","last_change":"2024-04-26T12:34:30.487676+0000","last_active":"2024-04-26T12:34:30.487629+0000","last_peered":"2024-04-26T12:34:30.487629+0000","last_clean":"2024-04-26T12:34:30.487629+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:34:30.487629+0000","last_undegraded":"2024-04-26T12:34:30.487629+0000","last_fullsized":"2024-04-26T12:34:30.487629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:34:30.487521+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:34:30.487521+0000","last_clean_scrub_stamp":"2024-04-26T12:34:30.487521+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:26.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.773240+0000","last_change":"2024-04-26T12:34:02.773240+0000","last_active":"2024-04-26T12:34:02.773240+0000","last_peered":"2024-04-26T12:34:02.773240+0000","last_clean":"2024-04-26T12:34:02.773240+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:34:02.773240+0000","last_undegraded":"2024-04-26T12:34:02.773240+0000","last_fullsized":"2024-04-26T12:34:02.773240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.773121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:07.596283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.485557+0000","last_change":"2024-04-26T12:34:11.485557+0000","last_active":"2024-04-26T12:34:11.485557+0000","last_peered":"2024-04-26T12:34:11.485557+0000","last_clean":"2024-04-26T12:34:11.485557+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:34:11.485557+0000","last_undegraded":"2024-04-26T12:34:11.485557+0000","last_fullsized":"2024-04-26T12:34:11.485557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:11.485429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:11.485429+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.485429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:39.753319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:43.670131+0000","last_change":"2024-04-26T12:34:43.670157+0000","last_active":"2024-04-26T12:34:43.670131+0000","last_peered":"2024-04-26T12:34:43.670131+0000","last_clean":"2024-04-26T12:34:43.670131+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:34:43.670131+0000","last_undegraded":"2024-04-26T12:34:43.670131+0000","last_fullsized":"2024-04-26T12:34:43.670131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:43.670001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:43.670001+0000","last_clean_scrub_stamp":"2024-04-26T12:34:43.670001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:27.803083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.270349+0000","last_change":"2024-04-26T12:30:49.552367+0000","last_active":"2024-04-26T12:33:32.270349+0000","last_peered":"2024-04-26T12:33:32.270349+0000","last_clean":"2024-04-26T12:33:32.270349+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:33:32.270349+0000","last_undegraded":"2024-04-26T12:33:32.270349+0000","last_fullsized":"2024-04-26T12:33:32.270349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:13.470426+0000","last_clean_scrub_stamp":"2024-04-26T12:30:13.470426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.971703+0000","last_change":"2024-04-26T12:33:33.971703+0000","last_active":"2024-04-26T12:33:33.971703+0000","last_peered":"2024-04-26T12:33:33.971703+0000","last_clean":"2024-04-26T12:33:33.971703+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:33:33.971703+0000","last_undegraded":"2024-04-26T12:33:33.971703+0000","last_fullsized":"2024-04-26T12:33:33.971703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.971556+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:47.263739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.935865+0000","last_change":"2024-04-26T12:33:35.935865+0000","last_active":"2024-04-26T12:33:35.935865+0000","last_peered":"2024-04-26T12:33:35.935865+0000","last_clean":"2024-04-26T12:33:35.935865+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:35.935865+0000","last_undegraded":"2024-04-26T12:33:35.935865+0000","last_fullsized":"2024-04-26T12:33:35.935865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.935727+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.443130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.689221+0000","last_change":"2024-04-26T12:34:19.689247+0000","last_active":"2024-04-26T12:34:19.689221+0000","last_peered":"2024-04-26T12:34:19.689221+0000","last_clean":"2024-04-26T12:34:19.689221+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:34:19.689221+0000","last_undegraded":"2024-04-26T12:34:19.689221+0000","last_fullsized":"2024-04-26T12:34:19.689221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:19.689111+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:19.689111+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.689111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:08.076312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.853067+0000","last_change":"2024-04-26T12:33:52.853067+0000","last_active":"2024-04-26T12:33:52.853067+0000","last_peered":"2024-04-26T12:33:52.853067+0000","last_clean":"2024-04-26T12:33:52.853067+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:52.853067+0000","last_undegraded":"2024-04-26T12:33:52.853067+0000","last_fullsized":"2024-04-26T12:33:52.853067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.852918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:03.508340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:38.604003+0000","last_change":"2024-04-26T12:34:38.604027+0000","last_active":"2024-04-26T12:34:38.604003+0000","last_peered":"2024-04-26T12:34:38.604003+0000","last_clean":"2024-04-26T12:34:38.604003+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:34:38.604003+0000","last_undegraded":"2024-04-26T12:34:38.604003+0000","last_fullsized":"2024-04-26T12:34:38.604003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:38.603902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:38.603902+0000","last_clean_scrub_stamp":"2024-04-26T12:34:38.603902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:22.180798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.575719+0000","last_change":"2024-04-26T12:34:18.575719+0000","last_active":"2024-04-26T12:34:18.575719+0000","last_peered":"2024-04-26T12:34:18.575719+0000","last_clean":"2024-04-26T12:34:18.575719+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:34:18.575719+0000","last_undegraded":"2024-04-26T12:34:18.575719+0000","last_fullsized":"2024-04-26T12:34:18.575719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:18.575593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:18.575593+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.575593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:14.196858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.984631+0000","last_change":"2024-04-26T12:33:36.984631+0000","last_active":"2024-04-26T12:33:36.984631+0000","last_peered":"2024-04-26T12:33:36.984631+0000","last_clean":"2024-04-26T12:33:36.984631+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:33:36.984631+0000","last_undegraded":"2024-04-26T12:33:36.984631+0000","last_fullsized":"2024-04-26T12:33:36.984631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.984515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'17","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.768960+0000","last_change":"2024-04-26T12:34:01.768960+0000","last_active":"2024-04-26T12:34:01.768960+0000","last_peered":"2024-04-26T12:34:01.768960+0000","last_clean":"2024-04-26T12:34:01.768960+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:34:01.768960+0000","last_undegraded":"2024-04-26T12:34:01.768960+0000","last_fullsized":"2024-04-26T12:34:01.768960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.768788+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:00.147323+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":430,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.416673+0000","last_change":"2024-04-26T12:33:35.416673+0000","last_active":"2024-04-26T12:33:35.416673+0000","last_peered":"2024-04-26T12:33:35.416673+0000","last_clean":"2024-04-26T12:33:35.416673+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:35.416673+0000","last_undegraded":"2024-04-26T12:33:35.416673+0000","last_fullsized":"2024-04-26T12:33:35.416673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.416545+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.560676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:28.845871+0000","last_change":"2024-04-26T12:34:28.845900+0000","last_active":"2024-04-26T12:34:28.845871+0000","last_peered":"2024-04-26T12:34:28.845871+0000","last_clean":"2024-04-26T12:34:28.845871+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:34:28.845871+0000","last_undegraded":"2024-04-26T12:34:28.845871+0000","last_fullsized":"2024-04-26T12:34:28.845871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-26T12:34:28.845756+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-26T12:34:28.845756+0000","last_clean_scrub_stamp":"2024-04-26T12:34:28.845756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:18.430400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.357489+0000","last_change":"2024-04-26T12:33:55.357489+0000","last_active":"2024-04-26T12:33:55.357489+0000","last_peered":"2024-04-26T12:33:55.357489+0000","last_clean":"2024-04-26T12:33:55.357489+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:55.357489+0000","last_undegraded":"2024-04-26T12:33:55.357489+0000","last_fullsized":"2024-04-26T12:33:55.357489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.357374+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:33.932712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.857960+0000","last_change":"2024-04-26T12:34:19.857960+0000","last_active":"2024-04-26T12:34:19.857960+0000","last_peered":"2024-04-26T12:34:19.857960+0000","last_clean":"2024-04-26T12:34:19.857960+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:34:19.857960+0000","last_undegraded":"2024-04-26T12:34:19.857960+0000","last_fullsized":"2024-04-26T12:34:19.857960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:19.857792+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:19.857792+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.857792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:40.166269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:45.587004+0000","last_change":"2024-04-26T12:34:45.587031+0000","last_active":"2024-04-26T12:34:45.587004+0000","last_peered":"2024-04-26T12:34:45.587004+0000","last_clean":"2024-04-26T12:34:45.587004+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:34:45.587004+0000","last_undegraded":"2024-04-26T12:34:45.587004+0000","last_fullsized":"2024-04-26T12:34:45.587004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:45.586908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:45.586908+0000","last_clean_scrub_stamp":"2024-04-26T12:34:45.586908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:53.652060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.054401+0000","last_change":"2024-04-26T12:33:42.054401+0000","last_active":"2024-04-26T12:33:42.054401+0000","last_peered":"2024-04-26T12:33:42.054401+0000","last_clean":"2024-04-26T12:33:42.054401+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:33:42.054401+0000","last_undegraded":"2024-04-26T12:33:42.054401+0000","last_fullsized":"2024-04-26T12:33:42.054401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.054238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:08.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'98","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.374652+0000","last_change":"2024-04-26T12:33:36.374652+0000","last_active":"2024-04-26T12:33:36.374652+0000","last_peered":"2024-04-26T12:33:36.374652+0000","last_clean":"2024-04-26T12:33:36.374652+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:33:36.374652+0000","last_undegraded":"2024-04-26T12:33:36.374652+0000","last_fullsized":"2024-04-26T12:33:36.374652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'98","last_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_deep_scrub":"32'98","last_deep_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.374477+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:44.404332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:31.509119+0000","last_change":"2024-04-26T12:33:31.509119+0000","last_active":"2024-04-26T12:33:31.509119+0000","last_peered":"2024-04-26T12:33:31.509119+0000","last_clean":"2024-04-26T12:33:31.509119+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:33:31.509119+0000","last_undegraded":"2024-04-26T12:33:31.509119+0000","last_fullsized":"2024-04-26T12:33:31.509119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_clean_scrub_stamp":"2024-04-26T12:33:31.509011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:04.640988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.257735+0000","last_change":"2024-04-26T12:34:23.257762+0000","last_active":"2024-04-26T12:34:23.257735+0000","last_peered":"2024-04-26T12:34:23.257735+0000","last_clean":"2024-04-26T12:34:23.257735+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:34:23.257735+0000","last_undegraded":"2024-04-26T12:34:23.257735+0000","last_fullsized":"2024-04-26T12:34:23.257735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:23.257646+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:23.257646+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.257646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:46.316848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.271530+0000","last_change":"2024-04-26T12:34:20.271530+0000","last_active":"2024-04-26T12:34:20.271530+0000","last_peered":"2024-04-26T12:34:20.271530+0000","last_clean":"2024-04-26T12:34:20.271530+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:34:20.271530+0000","last_undegraded":"2024-04-26T12:34:20.271530+0000","last_fullsized":"2024-04-26T12:34:20.271530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:20.271416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:20.271416+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.271416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:04.907796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.308525+0000","last_change":"2024-04-26T12:33:56.308548+0000","last_active":"2024-04-26T12:33:56.308525+0000","last_peered":"2024-04-26T12:33:56.308525+0000","last_clean":"2024-04-26T12:33:56.308525+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:33:56.308525+0000","last_undegraded":"2024-04-26T12:33:56.308525+0000","last_fullsized":"2024-04-26T12:33:56.308525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.308437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:57.522881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:31.524640+0000","last_change":"2024-04-26T12:34:31.524678+0000","last_active":"2024-04-26T12:34:31.524640+0000","last_peered":"2024-04-26T12:34:31.524640+0000","last_clean":"2024-04-26T12:34:31.524640+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:34:31.524640+0000","last_undegraded":"2024-04-26T12:34:31.524640+0000","last_fullsized":"2024-04-26T12:34:31.524640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:31.524548+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:31.524548+0000","last_clean_scrub_stamp":"2024-04-26T12:34:31.524548+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:56.326081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.934150+0000","last_change":"2024-04-26T12:33:44.934202+0000","last_active":"2024-04-26T12:33:44.934150+0000","last_peered":"2024-04-26T12:33:44.934150+0000","last_clean":"2024-04-26T12:33:44.934150+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:33:44.934150+0000","last_undegraded":"2024-04-26T12:33:44.934150+0000","last_fullsized":"2024-04-26T12:33:44.934150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.934050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:59.400029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.816928+0000","last_change":"2024-04-26T12:33:57.816962+0000","last_active":"2024-04-26T12:33:57.816928+0000","last_peered":"2024-04-26T12:33:57.816928+0000","last_clean":"2024-04-26T12:33:57.816928+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:33:57.816928+0000","last_undegraded":"2024-04-26T12:33:57.816928+0000","last_fullsized":"2024-04-26T12:33:57.816928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.816840+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:35.943755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.746321+0000","last_change":"2024-04-26T12:33:59.746343+0000","last_active":"2024-04-26T12:33:59.746321+0000","last_peered":"2024-04-26T12:33:59.746321+0000","last_clean":"2024-04-26T12:33:59.746321+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:33:59.746321+0000","last_undegraded":"2024-04-26T12:33:59.746321+0000","last_fullsized":"2024-04-26T12:33:59.746321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.746239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:32.070259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:31.466279+0000","last_change":"2024-04-26T12:34:31.466308+0000","last_active":"2024-04-26T12:34:31.466279+0000","last_peered":"2024-04-26T12:34:31.466279+0000","last_clean":"2024-04-26T12:34:31.466279+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:34:31.466279+0000","last_undegraded":"2024-04-26T12:34:31.466279+0000","last_fullsized":"2024-04-26T12:34:31.466279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:31.466182+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:31.466182+0000","last_clean_scrub_stamp":"2024-04-26T12:34:31.466182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:47.793244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:32.884903+0000","last_change":"2024-04-26T12:34:32.884941+0000","last_active":"2024-04-26T12:34:32.884903+0000","last_peered":"2024-04-26T12:34:32.884903+0000","last_clean":"2024-04-26T12:34:32.884903+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:34:32.884903+0000","last_undegraded":"2024-04-26T12:34:32.884903+0000","last_fullsized":"2024-04-26T12:34:32.884903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:32.884800+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:32.884800+0000","last_clean_scrub_stamp":"2024-04-26T12:34:32.884800+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:09.527739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.235931+0000","last_change":"2024-04-26T12:34:18.235976+0000","last_active":"2024-04-26T12:34:18.235931+0000","last_peered":"2024-04-26T12:34:18.235931+0000","last_clean":"2024-04-26T12:34:18.235931+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:34:18.235931+0000","last_undegraded":"2024-04-26T12:34:18.235931+0000","last_fullsized":"2024-04-26T12:34:18.235931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:18.235790+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:18.235790+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.235790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.405932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.035342+0000","last_change":"2024-04-26T12:33:41.035367+0000","last_active":"2024-04-26T12:33:41.035342+0000","last_peered":"2024-04-26T12:33:41.035342+0000","last_clean":"2024-04-26T12:33:41.035342+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:33:41.035342+0000","last_undegraded":"2024-04-26T12:33:41.035342+0000","last_fullsized":"2024-04-26T12:33:41.035342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:28.509101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.437752+0000","last_change":"2024-04-26T12:33:45.437804+0000","last_active":"2024-04-26T12:33:45.437752+0000","last_peered":"2024-04-26T12:33:45.437752+0000","last_clean":"2024-04-26T12:33:45.437752+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:45.437752+0000","last_undegraded":"2024-04-26T12:33:45.437752+0000","last_fullsized":"2024-04-26T12:33:45.437752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.437634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:24.012972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.322288+0000","last_change":"2024-04-26T12:33:33.322319+0000","last_active":"2024-04-26T12:33:33.322288+0000","last_peered":"2024-04-26T12:33:33.322288+0000","last_clean":"2024-04-26T12:33:33.322288+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:33:33.322288+0000","last_undegraded":"2024-04-26T12:33:33.322288+0000","last_fullsized":"2024-04-26T12:33:33.322288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.322193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:33.954765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:33.438371+0000","last_change":"2024-04-26T12:34:33.438396+0000","last_active":"2024-04-26T12:34:33.438371+0000","last_peered":"2024-04-26T12:34:33.438371+0000","last_clean":"2024-04-26T12:34:33.438371+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:34:33.438371+0000","last_undegraded":"2024-04-26T12:34:33.438371+0000","last_fullsized":"2024-04-26T12:34:33.438371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:33.438267+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:33.438267+0000","last_clean_scrub_stamp":"2024-04-26T12:34:33.438267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:43.307235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.600351+0000","last_change":"2024-04-26T12:34:04.600423+0000","last_active":"2024-04-26T12:34:04.600351+0000","last_peered":"2024-04-26T12:34:04.600351+0000","last_clean":"2024-04-26T12:34:04.600351+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:34:04.600351+0000","last_undegraded":"2024-04-26T12:34:04.600351+0000","last_fullsized":"2024-04-26T12:34:04.600351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.600237+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:05.911708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.200686+0000","last_change":"2024-04-26T12:34:12.200726+0000","last_active":"2024-04-26T12:34:12.200686+0000","last_peered":"2024-04-26T12:34:12.200686+0000","last_clean":"2024-04-26T12:34:12.200686+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:34:12.200686+0000","last_undegraded":"2024-04-26T12:34:12.200686+0000","last_fullsized":"2024-04-26T12:34:12.200686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.200570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.200570+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.200570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:36.158516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.384229+0000","last_change":"2024-04-26T12:33:50.384269+0000","last_active":"2024-04-26T12:33:50.384229+0000","last_peered":"2024-04-26T12:33:50.384229+0000","last_clean":"2024-04-26T12:33:50.384229+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:33:50.384229+0000","last_undegraded":"2024-04-26T12:33:50.384229+0000","last_fullsized":"2024-04-26T12:33:50.384229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.384133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:33.191713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.463439+0000","last_change":"2024-04-26T12:33:43.463495+0000","last_active":"2024-04-26T12:33:43.463439+0000","last_peered":"2024-04-26T12:33:43.463439+0000","last_clean":"2024-04-26T12:33:43.463439+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:43.463439+0000","last_undegraded":"2024-04-26T12:33:43.463439+0000","last_fullsized":"2024-04-26T12:33:43.463439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.463348+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:24.510661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.045474+0000","last_change":"2024-04-26T12:33:32.045522+0000","last_active":"2024-04-26T12:33:32.045474+0000","last_peered":"2024-04-26T12:33:32.045474+0000","last_clean":"2024-04-26T12:33:32.045474+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:33:32.045474+0000","last_undegraded":"2024-04-26T12:33:32.045474+0000","last_fullsized":"2024-04-26T12:33:32.045474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.045363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:44.273391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.633676+0000","last_change":"2024-04-26T12:34:15.633701+0000","last_active":"2024-04-26T12:34:15.633676+0000","last_peered":"2024-04-26T12:34:15.633676+0000","last_clean":"2024-04-26T12:34:15.633676+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:34:15.633676+0000","last_undegraded":"2024-04-26T12:34:15.633676+0000","last_fullsized":"2024-04-26T12:34:15.633676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:15.633579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:15.633579+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.633579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:51.038174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.070835+0000","last_change":"2024-04-26T12:33:45.070862+0000","last_active":"2024-04-26T12:33:45.070835+0000","last_peered":"2024-04-26T12:33:45.070835+0000","last_clean":"2024-04-26T12:33:45.070835+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:45.070835+0000","last_undegraded":"2024-04-26T12:33:45.070835+0000","last_fullsized":"2024-04-26T12:33:45.070835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.070739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:40.944238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.918854+0000","last_change":"2024-04-26T12:34:16.918879+0000","last_active":"2024-04-26T12:34:16.918854+0000","last_peered":"2024-04-26T12:34:16.918854+0000","last_clean":"2024-04-26T12:34:16.918854+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:34:16.918854+0000","last_undegraded":"2024-04-26T12:34:16.918854+0000","last_fullsized":"2024-04-26T12:34:16.918854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:16.918745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:16.918745+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.918745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:53.861220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.064258+0000","last_change":"2024-04-26T12:33:43.064299+0000","last_active":"2024-04-26T12:33:43.064258+0000","last_peered":"2024-04-26T12:33:43.064258+0000","last_clean":"2024-04-26T12:33:43.064258+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:33:43.064258+0000","last_undegraded":"2024-04-26T12:33:43.064258+0000","last_fullsized":"2024-04-26T12:33:43.064258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.064153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:56.367388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.353452+0000","last_change":"2024-04-26T12:33:42.353487+0000","last_active":"2024-04-26T12:33:42.353452+0000","last_peered":"2024-04-26T12:33:42.353452+0000","last_clean":"2024-04-26T12:33:42.353452+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:33:42.353452+0000","last_undegraded":"2024-04-26T12:33:42.353452+0000","last_fullsized":"2024-04-26T12:33:42.353452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.353371+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:27.302471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.359118+0000","last_change":"2024-04-26T12:33:35.359140+0000","last_active":"2024-04-26T12:33:35.359118+0000","last_peered":"2024-04-26T12:33:35.359118+0000","last_clean":"2024-04-26T12:33:35.359118+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:33:35.359118+0000","last_undegraded":"2024-04-26T12:33:35.359118+0000","last_fullsized":"2024-04-26T12:33:35.359118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.359023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:00.812046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.656432+0000","last_change":"2024-04-26T12:34:13.656432+0000","last_active":"2024-04-26T12:34:13.656432+0000","last_peered":"2024-04-26T12:34:13.656432+0000","last_clean":"2024-04-26T12:34:13.656432+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:34:13.656432+0000","last_undegraded":"2024-04-26T12:34:13.656432+0000","last_fullsized":"2024-04-26T12:34:13.656432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:13.656317+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:13.656317+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.656317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:18.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.581517+0000","last_change":"2024-04-26T12:34:25.581540+0000","last_active":"2024-04-26T12:34:25.581517+0000","last_peered":"2024-04-26T12:34:25.581517+0000","last_clean":"2024-04-26T12:34:25.581517+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:34:25.581517+0000","last_undegraded":"2024-04-26T12:34:25.581517+0000","last_fullsized":"2024-04-26T12:34:25.581517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:25.581430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:25.581430+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.581430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:39.147174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.643280+0000","last_change":"2024-04-26T12:33:55.643280+0000","last_active":"2024-04-26T12:33:55.643280+0000","last_peered":"2024-04-26T12:33:55.643280+0000","last_clean":"2024-04-26T12:33:55.643280+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:33:55.643280+0000","last_undegraded":"2024-04-26T12:33:55.643280+0000","last_fullsized":"2024-04-26T12:33:55.643280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.643144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.649463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.501845+0000","last_change":"2024-04-26T12:33:42.501879+0000","last_active":"2024-04-26T12:33:42.501845+0000","last_peered":"2024-04-26T12:33:42.501845+0000","last_clean":"2024-04-26T12:33:42.501845+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:33:42.501845+0000","last_undegraded":"2024-04-26T12:33:42.501845+0000","last_fullsized":"2024-04-26T12:33:42.501845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.501766+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:10.173839+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.366864+0000","last_change":"2024-04-26T12:33:34.366886+0000","last_active":"2024-04-26T12:33:34.366864+0000","last_peered":"2024-04-26T12:33:34.366864+0000","last_clean":"2024-04-26T12:33:34.366864+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:33:34.366864+0000","last_undegraded":"2024-04-26T12:33:34.366864+0000","last_fullsized":"2024-04-26T12:33:34.366864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.366757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:47.058265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:29.448044+0000","last_change":"2024-04-26T12:34:29.448073+0000","last_active":"2024-04-26T12:34:29.448044+0000","last_peered":"2024-04-26T12:34:29.448044+0000","last_clean":"2024-04-26T12:34:29.448044+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:34:29.448044+0000","last_undegraded":"2024-04-26T12:34:29.448044+0000","last_fullsized":"2024-04-26T12:34:29.448044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-26T12:34:29.447945+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-26T12:34:29.447945+0000","last_clean_scrub_stamp":"2024-04-26T12:34:29.447945+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.738465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.626796+0000","last_change":"2024-04-26T12:34:01.626796+0000","last_active":"2024-04-26T12:34:01.626796+0000","last_peered":"2024-04-26T12:34:01.626796+0000","last_clean":"2024-04-26T12:34:01.626796+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:34:01.626796+0000","last_undegraded":"2024-04-26T12:34:01.626796+0000","last_fullsized":"2024-04-26T12:34:01.626796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.626634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:21.911777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.874928+0000","last_change":"2024-04-26T12:34:18.874958+0000","last_active":"2024-04-26T12:34:18.874928+0000","last_peered":"2024-04-26T12:34:18.874928+0000","last_clean":"2024-04-26T12:34:18.874928+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:34:18.874928+0000","last_undegraded":"2024-04-26T12:34:18.874928+0000","last_fullsized":"2024-04-26T12:34:18.874928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:18.874831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:18.874831+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.874831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:57.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.385555+0000","last_change":"2024-04-26T12:33:48.385555+0000","last_active":"2024-04-26T12:33:48.385555+0000","last_peered":"2024-04-26T12:33:48.385555+0000","last_clean":"2024-04-26T12:33:48.385555+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:33:48.385555+0000","last_undegraded":"2024-04-26T12:33:48.385555+0000","last_fullsized":"2024-04-26T12:33:48.385555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.385445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:38.984742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.993283+0000","last_change":"2024-04-26T12:33:35.993331+0000","last_active":"2024-04-26T12:33:35.993283+0000","last_peered":"2024-04-26T12:33:35.993283+0000","last_clean":"2024-04-26T12:33:35.993283+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:33:35.993283+0000","last_undegraded":"2024-04-26T12:33:35.993283+0000","last_fullsized":"2024-04-26T12:33:35.993283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.993196+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.267797+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.950944+0000","last_change":"2024-04-26T12:33:43.950965+0000","last_active":"2024-04-26T12:33:43.950944+0000","last_peered":"2024-04-26T12:33:43.950944+0000","last_clean":"2024-04-26T12:33:43.950944+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:33:43.950944+0000","last_undegraded":"2024-04-26T12:33:43.950944+0000","last_fullsized":"2024-04-26T12:33:43.950944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.950850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.030430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513984+0000","last_change":"2024-04-26T12:30:20.531925+0000","last_active":"2024-04-26T12:32:43.513984+0000","last_peered":"2024-04-26T12:32:43.513984+0000","last_clean":"2024-04-26T12:32:43.513984+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:32:43.513984+0000","last_undegraded":"2024-04-26T12:32:43.513984+0000","last_fullsized":"2024-04-26T12:32:43.513984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.015731+0000","last_change":"2024-04-26T12:33:47.015756+0000","last_active":"2024-04-26T12:33:47.015731+0000","last_peered":"2024-04-26T12:33:47.015731+0000","last_clean":"2024-04-26T12:33:47.015731+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:47.015731+0000","last_undegraded":"2024-04-26T12:33:47.015731+0000","last_fullsized":"2024-04-26T12:33:47.015731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.015630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:22.957533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.867447+0000","last_change":"2024-04-26T12:34:23.867478+0000","last_active":"2024-04-26T12:34:23.867447+0000","last_peered":"2024-04-26T12:34:23.867447+0000","last_clean":"2024-04-26T12:34:23.867447+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:34:23.867447+0000","last_undegraded":"2024-04-26T12:34:23.867447+0000","last_fullsized":"2024-04-26T12:34:23.867447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:23.867357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:23.867357+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.867357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:20.060861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.310817+0000","last_change":"2024-04-26T12:33:46.310845+0000","last_active":"2024-04-26T12:33:46.310817+0000","last_peered":"2024-04-26T12:33:46.310817+0000","last_clean":"2024-04-26T12:33:46.310817+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:33:46.310817+0000","last_undegraded":"2024-04-26T12:33:46.310817+0000","last_fullsized":"2024-04-26T12:33:46.310817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.310718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:07.825719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.467898+0000","last_change":"2024-04-26T12:33:41.467898+0000","last_active":"2024-04-26T12:33:41.467898+0000","last_peered":"2024-04-26T12:33:41.467898+0000","last_clean":"2024-04-26T12:33:41.467898+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:33:41.467898+0000","last_undegraded":"2024-04-26T12:33:41.467898+0000","last_fullsized":"2024-04-26T12:33:41.467898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.467768+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:07.391342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.445395+0000","last_change":"2024-04-26T12:33:33.445395+0000","last_active":"2024-04-26T12:33:33.445395+0000","last_peered":"2024-04-26T12:33:33.445395+0000","last_clean":"2024-04-26T12:33:33.445395+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:33:33.445395+0000","last_undegraded":"2024-04-26T12:33:33.445395+0000","last_fullsized":"2024-04-26T12:33:33.445395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.445277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.337016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513948+0000","last_change":"2024-04-26T12:30:20.532945+0000","last_active":"2024-04-26T12:32:43.513948+0000","last_peered":"2024-04-26T12:32:43.513948+0000","last_clean":"2024-04-26T12:32:43.513948+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:32:43.513948+0000","last_undegraded":"2024-04-26T12:32:43.513948+0000","last_fullsized":"2024-04-26T12:32:43.513948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.549850+0000","last_change":"2024-04-26T12:34:14.549876+0000","last_active":"2024-04-26T12:34:14.549850+0000","last_peered":"2024-04-26T12:34:14.549850+0000","last_clean":"2024-04-26T12:34:14.549850+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:34:14.549850+0000","last_undegraded":"2024-04-26T12:34:14.549850+0000","last_fullsized":"2024-04-26T12:34:14.549850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:14.549743+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:14.549743+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.549743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:37.608945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:29.542900+0000","last_change":"2024-04-26T12:34:29.542929+0000","last_active":"2024-04-26T12:34:29.542900+0000","last_peered":"2024-04-26T12:34:29.542900+0000","last_clean":"2024-04-26T12:34:29.542900+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:34:29.542900+0000","last_undegraded":"2024-04-26T12:34:29.542900+0000","last_fullsized":"2024-04-26T12:34:29.542900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:29.542794+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:29.542794+0000","last_clean_scrub_stamp":"2024-04-26T12:34:29.542794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:58.138873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:31.840068+0000","last_change":"2024-04-26T12:34:31.840091+0000","last_active":"2024-04-26T12:34:31.840068+0000","last_peered":"2024-04-26T12:34:31.840068+0000","last_clean":"2024-04-26T12:34:31.840068+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:34:31.840068+0000","last_undegraded":"2024-04-26T12:34:31.840068+0000","last_fullsized":"2024-04-26T12:34:31.840068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:31.839983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:31.839983+0000","last_clean_scrub_stamp":"2024-04-26T12:34:31.839983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:16.572329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.780643+0000","last_change":"2024-04-26T12:33:58.780643+0000","last_active":"2024-04-26T12:33:58.780643+0000","last_peered":"2024-04-26T12:33:58.780643+0000","last_clean":"2024-04-26T12:33:58.780643+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:33:58.780643+0000","last_undegraded":"2024-04-26T12:33:58.780643+0000","last_fullsized":"2024-04-26T12:33:58.780643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.780521+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:19.088998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.307469+0000","last_change":"2024-04-26T12:33:45.307469+0000","last_active":"2024-04-26T12:33:45.307469+0000","last_peered":"2024-04-26T12:33:45.307469+0000","last_clean":"2024-04-26T12:33:45.307469+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:45.307469+0000","last_undegraded":"2024-04-26T12:33:45.307469+0000","last_fullsized":"2024-04-26T12:33:45.307469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.307342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:13.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.513827+0000","last_change":"2024-04-26T12:30:20.533036+0000","last_active":"2024-04-26T12:32:43.513827+0000","last_peered":"2024-04-26T12:32:43.513827+0000","last_clean":"2024-04-26T12:32:43.513827+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:32:43.513827+0000","last_undegraded":"2024-04-26T12:32:43.513827+0000","last_fullsized":"2024-04-26T12:32:43.513827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.244297+0000","last_change":"2024-04-26T12:34:07.244321+0000","last_active":"2024-04-26T12:34:07.244297+0000","last_peered":"2024-04-26T12:34:07.244297+0000","last_clean":"2024-04-26T12:34:07.244297+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:34:07.244297+0000","last_undegraded":"2024-04-26T12:34:07.244297+0000","last_fullsized":"2024-04-26T12:34:07.244297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.244206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:57.848776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.891153+0000","last_change":"2024-04-26T12:34:22.891177+0000","last_active":"2024-04-26T12:34:22.891153+0000","last_peered":"2024-04-26T12:34:22.891153+0000","last_clean":"2024-04-26T12:34:22.891153+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:34:22.891153+0000","last_undegraded":"2024-04-26T12:34:22.891153+0000","last_fullsized":"2024-04-26T12:34:22.891153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:22.891064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:22.891064+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.891064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:21.269599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.949107+0000","last_change":"2024-04-26T12:33:42.949152+0000","last_active":"2024-04-26T12:33:42.949107+0000","last_peered":"2024-04-26T12:33:42.949107+0000","last_clean":"2024-04-26T12:33:42.949107+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:33:42.949107+0000","last_undegraded":"2024-04-26T12:33:42.949107+0000","last_fullsized":"2024-04-26T12:33:42.949107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.948988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:32.255979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.890106+0000","last_change":"2024-04-26T12:33:38.890152+0000","last_active":"2024-04-26T12:33:38.890106+0000","last_peered":"2024-04-26T12:33:38.890106+0000","last_clean":"2024-04-26T12:33:38.890106+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:33:38.890106+0000","last_undegraded":"2024-04-26T12:33:38.890106+0000","last_fullsized":"2024-04-26T12:33:38.890106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.890013+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:04.019389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.461617+0000","last_change":"2024-04-26T12:33:40.461661+0000","last_active":"2024-04-26T12:33:40.461617+0000","last_peered":"2024-04-26T12:33:40.461617+0000","last_clean":"2024-04-26T12:33:40.461617+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:33:40.461617+0000","last_undegraded":"2024-04-26T12:33:40.461617+0000","last_fullsized":"2024-04-26T12:33:40.461617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.461502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:09.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.780785+0000","last_change":"2024-04-26T12:33:59.780852+0000","last_active":"2024-04-26T12:33:59.780785+0000","last_peered":"2024-04-26T12:33:59.780785+0000","last_clean":"2024-04-26T12:33:59.780785+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:59.780785+0000","last_undegraded":"2024-04-26T12:33:59.780785+0000","last_fullsized":"2024-04-26T12:33:59.780785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.780664+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.693729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.221052+0000","last_change":"2024-04-26T12:34:09.221090+0000","last_active":"2024-04-26T12:34:09.221052+0000","last_peered":"2024-04-26T12:34:09.221052+0000","last_clean":"2024-04-26T12:34:09.221052+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:34:09.221052+0000","last_undegraded":"2024-04-26T12:34:09.221052+0000","last_fullsized":"2024-04-26T12:34:09.221052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:09.220964+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:09.220964+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.220964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:46.980912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.696822+0000","last_change":"2024-04-26T12:34:22.696849+0000","last_active":"2024-04-26T12:34:22.696822+0000","last_peered":"2024-04-26T12:34:22.696822+0000","last_clean":"2024-04-26T12:34:22.696822+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:34:22.696822+0000","last_undegraded":"2024-04-26T12:34:22.696822+0000","last_fullsized":"2024-04-26T12:34:22.696822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:22.696725+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:22.696725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.696725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:42.822222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.346128+0000","last_change":"2024-04-26T12:33:51.346173+0000","last_active":"2024-04-26T12:33:51.346128+0000","last_peered":"2024-04-26T12:33:51.346128+0000","last_clean":"2024-04-26T12:33:51.346128+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:33:51.346128+0000","last_undegraded":"2024-04-26T12:33:51.346128+0000","last_fullsized":"2024-04-26T12:33:51.346128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.346025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:20.507543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.453148+0000","last_change":"2024-04-26T12:33:38.453185+0000","last_active":"2024-04-26T12:33:38.453148+0000","last_peered":"2024-04-26T12:33:38.453148+0000","last_clean":"2024-04-26T12:33:38.453148+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:33:38.453148+0000","last_undegraded":"2024-04-26T12:33:38.453148+0000","last_fullsized":"2024-04-26T12:33:38.453148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.453065+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:29.052361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.794633+0000","last_change":"2024-04-26T12:33:56.794664+0000","last_active":"2024-04-26T12:33:56.794633+0000","last_peered":"2024-04-26T12:33:56.794633+0000","last_clean":"2024-04-26T12:33:56.794633+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:33:56.794633+0000","last_undegraded":"2024-04-26T12:33:56.794633+0000","last_fullsized":"2024-04-26T12:33:56.794633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.794541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:59.556259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.515022+0000","last_change":"2024-04-26T12:30:20.533618+0000","last_active":"2024-04-26T12:32:48.515022+0000","last_peered":"2024-04-26T12:32:48.515022+0000","last_clean":"2024-04-26T12:32:48.515022+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:32:48.515022+0000","last_undegraded":"2024-04-26T12:32:48.515022+0000","last_fullsized":"2024-04-26T12:32:48.515022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.647080+0000","last_change":"2024-04-26T12:34:16.647109+0000","last_active":"2024-04-26T12:34:16.647080+0000","last_peered":"2024-04-26T12:34:16.647080+0000","last_clean":"2024-04-26T12:34:16.647080+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:34:16.647080+0000","last_undegraded":"2024-04-26T12:34:16.647080+0000","last_fullsized":"2024-04-26T12:34:16.647080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:16.646984+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:16.646984+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.646984+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:39.688700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.595342+0000","last_change":"2024-04-26T12:34:15.595389+0000","last_active":"2024-04-26T12:34:15.595342+0000","last_peered":"2024-04-26T12:34:15.595342+0000","last_clean":"2024-04-26T12:34:15.595342+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:34:15.595342+0000","last_undegraded":"2024-04-26T12:34:15.595342+0000","last_fullsized":"2024-04-26T12:34:15.595342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:15.595199+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:15.595199+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.595199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:35.707029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.865538+0000","last_change":"2024-04-26T12:33:48.865560+0000","last_active":"2024-04-26T12:33:48.865538+0000","last_peered":"2024-04-26T12:33:48.865538+0000","last_clean":"2024-04-26T12:33:48.865538+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:33:48.865538+0000","last_undegraded":"2024-04-26T12:33:48.865538+0000","last_fullsized":"2024-04-26T12:33:48.865538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.865441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:06.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.031288+0000","last_change":"2024-04-26T12:33:40.031319+0000","last_active":"2024-04-26T12:33:40.031288+0000","last_peered":"2024-04-26T12:33:40.031288+0000","last_clean":"2024-04-26T12:33:40.031288+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:33:40.031288+0000","last_undegraded":"2024-04-26T12:33:40.031288+0000","last_fullsized":"2024-04-26T12:33:40.031288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.031195+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:09.032628+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.850966+0000","last_change":"2024-04-26T12:33:54.851018+0000","last_active":"2024-04-26T12:33:54.850966+0000","last_peered":"2024-04-26T12:33:54.850966+0000","last_clean":"2024-04-26T12:33:54.850966+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:33:54.850966+0000","last_undegraded":"2024-04-26T12:33:54.850966+0000","last_fullsized":"2024-04-26T12:33:54.850966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.850864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:43.512855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.514960+0000","last_change":"2024-04-26T12:30:20.533719+0000","last_active":"2024-04-26T12:32:48.514960+0000","last_peered":"2024-04-26T12:32:48.514960+0000","last_clean":"2024-04-26T12:32:48.514960+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:32:48.514960+0000","last_undegraded":"2024-04-26T12:32:48.514960+0000","last_fullsized":"2024-04-26T12:32:48.514960+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:19.503487+0000","last_clean_scrub_stamp":"2024-04-26T12:30:19.503487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.267026+0000","last_change":"2024-04-26T12:33:57.267051+0000","last_active":"2024-04-26T12:33:57.267026+0000","last_peered":"2024-04-26T12:33:57.267026+0000","last_clean":"2024-04-26T12:33:57.267026+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:33:57.267026+0000","last_undegraded":"2024-04-26T12:33:57.267026+0000","last_fullsized":"2024-04-26T12:33:57.267026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.266942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:20.057671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.834847+0000","last_change":"2024-04-26T12:34:06.834847+0000","last_active":"2024-04-26T12:34:06.834847+0000","last_peered":"2024-04-26T12:34:06.834847+0000","last_clean":"2024-04-26T12:34:06.834847+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:34:06.834847+0000","last_undegraded":"2024-04-26T12:34:06.834847+0000","last_fullsized":"2024-04-26T12:34:06.834847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.834717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:39.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.835414+0000","last_change":"2024-04-26T12:33:49.835479+0000","last_active":"2024-04-26T12:33:49.835414+0000","last_peered":"2024-04-26T12:33:49.835414+0000","last_clean":"2024-04-26T12:33:49.835414+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:33:49.835414+0000","last_undegraded":"2024-04-26T12:33:49.835414+0000","last_fullsized":"2024-04-26T12:33:49.835414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.835315+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.299112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.110111+0000","last_change":"2024-04-26T12:33:44.110183+0000","last_active":"2024-04-26T12:33:44.110111+0000","last_peered":"2024-04-26T12:33:44.110111+0000","last_clean":"2024-04-26T12:33:44.110111+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:44.110111+0000","last_undegraded":"2024-04-26T12:33:44.110111+0000","last_fullsized":"2024-04-26T12:33:44.110111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.110007+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:08.558930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.548918+0000","last_change":"2024-04-26T12:33:52.548980+0000","last_active":"2024-04-26T12:33:52.548918+0000","last_peered":"2024-04-26T12:33:52.548918+0000","last_clean":"2024-04-26T12:33:52.548918+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:33:52.548918+0000","last_undegraded":"2024-04-26T12:33:52.548918+0000","last_fullsized":"2024-04-26T12:33:52.548918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.548815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:10.261619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.649011+0000","last_change":"2024-04-26T12:34:11.649035+0000","last_active":"2024-04-26T12:34:11.649011+0000","last_peered":"2024-04-26T12:34:11.649011+0000","last_clean":"2024-04-26T12:34:11.649011+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:34:11.649011+0000","last_undegraded":"2024-04-26T12:34:11.649011+0000","last_fullsized":"2024-04-26T12:34:11.649011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:11.648922+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:11.648922+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.648922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:48.291861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.818359+0000","last_change":"2024-04-26T12:33:50.818359+0000","last_active":"2024-04-26T12:33:50.818359+0000","last_peered":"2024-04-26T12:33:50.818359+0000","last_clean":"2024-04-26T12:33:50.818359+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:50.818359+0000","last_undegraded":"2024-04-26T12:33:50.818359+0000","last_fullsized":"2024-04-26T12:33:50.818359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.818238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:03.334266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.340615+0000","last_change":"2024-04-26T12:34:02.340615+0000","last_active":"2024-04-26T12:34:02.340615+0000","last_peered":"2024-04-26T12:34:02.340615+0000","last_clean":"2024-04-26T12:34:02.340615+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:34:02.340615+0000","last_undegraded":"2024-04-26T12:34:02.340615+0000","last_fullsized":"2024-04-26T12:34:02.340615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.340498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:45.990532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.522256+0000","last_change":"2024-04-26T12:34:10.522256+0000","last_active":"2024-04-26T12:34:10.522256+0000","last_peered":"2024-04-26T12:34:10.522256+0000","last_clean":"2024-04-26T12:34:10.522256+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:34:10.522256+0000","last_undegraded":"2024-04-26T12:34:10.522256+0000","last_fullsized":"2024-04-26T12:34:10.522256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:10.522104+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:10.522104+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.522104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:04.553913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.590225+0000","last_change":"2024-04-26T12:34:21.590225+0000","last_active":"2024-04-26T12:34:21.590225+0000","last_peered":"2024-04-26T12:34:21.590225+0000","last_clean":"2024-04-26T12:34:21.590225+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:34:21.590225+0000","last_undegraded":"2024-04-26T12:34:21.590225+0000","last_fullsized":"2024-04-26T12:34:21.590225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:21.590040+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.590040+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.590040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:37.256101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.670636+0000","last_change":"2024-04-26T12:34:10.670636+0000","last_active":"2024-04-26T12:34:10.670636+0000","last_peered":"2024-04-26T12:34:10.670636+0000","last_clean":"2024-04-26T12:34:10.670636+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:34:10.670636+0000","last_undegraded":"2024-04-26T12:34:10.670636+0000","last_fullsized":"2024-04-26T12:34:10.670636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:10.670511+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:10.670511+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.670511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:55.402857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:47.574623+0000","last_change":"2024-04-26T12:34:47.574672+0000","last_active":"2024-04-26T12:34:47.574623+0000","last_peered":"2024-04-26T12:34:47.574623+0000","last_clean":"2024-04-26T12:34:47.574623+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:34:47.574623+0000","last_undegraded":"2024-04-26T12:34:47.574623+0000","last_fullsized":"2024-04-26T12:34:47.574623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:47.574506+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:47.574506+0000","last_clean_scrub_stamp":"2024-04-26T12:34:47.574506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:31.261685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.608406+0000","last_change":"2024-04-26T12:34:16.608406+0000","last_active":"2024-04-26T12:34:16.608406+0000","last_peered":"2024-04-26T12:34:16.608406+0000","last_clean":"2024-04-26T12:34:16.608406+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:34:16.608406+0000","last_undegraded":"2024-04-26T12:34:16.608406+0000","last_fullsized":"2024-04-26T12:34:16.608406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-26T12:34:16.608288+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-26T12:34:16.608288+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.608288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:10.148366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.557250+0000","last_change":"2024-04-26T12:34:24.557284+0000","last_active":"2024-04-26T12:34:24.557250+0000","last_peered":"2024-04-26T12:34:24.557250+0000","last_clean":"2024-04-26T12:34:24.557250+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:34:24.557250+0000","last_undegraded":"2024-04-26T12:34:24.557250+0000","last_fullsized":"2024-04-26T12:34:24.557250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.557137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.557137+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.557137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:37.751454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.649641+0000","last_change":"2024-04-26T12:34:02.649641+0000","last_active":"2024-04-26T12:34:02.649641+0000","last_peered":"2024-04-26T12:34:02.649641+0000","last_clean":"2024-04-26T12:34:02.649641+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:34:02.649641+0000","last_undegraded":"2024-04-26T12:34:02.649641+0000","last_fullsized":"2024-04-26T12:34:02.649641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.649475+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:18.869480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.572013+0000","last_change":"2024-04-26T12:34:05.572013+0000","last_active":"2024-04-26T12:34:05.572013+0000","last_peered":"2024-04-26T12:34:05.572013+0000","last_clean":"2024-04-26T12:34:05.572013+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:34:05.572013+0000","last_undegraded":"2024-04-26T12:34:05.572013+0000","last_fullsized":"2024-04-26T12:34:05.572013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.571886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:23.002390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.802145+0000","last_change":"2024-04-26T12:33:58.802145+0000","last_active":"2024-04-26T12:33:58.802145+0000","last_peered":"2024-04-26T12:33:58.802145+0000","last_clean":"2024-04-26T12:33:58.802145+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:58.802145+0000","last_undegraded":"2024-04-26T12:33:58.802145+0000","last_fullsized":"2024-04-26T12:33:58.802145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.802005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:27.815229+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.843585+0000","last_change":"2024-04-26T12:34:21.843585+0000","last_active":"2024-04-26T12:34:21.843585+0000","last_peered":"2024-04-26T12:34:21.843585+0000","last_clean":"2024-04-26T12:34:21.843585+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:34:21.843585+0000","last_undegraded":"2024-04-26T12:34:21.843585+0000","last_fullsized":"2024-04-26T12:34:21.843585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:21.843455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:21.843455+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.843455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:46.308037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.494203+0000","last_change":"2024-04-26T12:34:26.494232+0000","last_active":"2024-04-26T12:34:26.494203+0000","last_peered":"2024-04-26T12:34:26.494203+0000","last_clean":"2024-04-26T12:34:26.494203+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:34:26.494203+0000","last_undegraded":"2024-04-26T12:34:26.494203+0000","last_fullsized":"2024-04-26T12:34:26.494203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:26.494114+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:26.494114+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.494114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:29.814796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.267641+0000","last_change":"2024-04-26T12:34:08.267641+0000","last_active":"2024-04-26T12:34:08.267641+0000","last_peered":"2024-04-26T12:34:08.267641+0000","last_clean":"2024-04-26T12:34:08.267641+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:34:08.267641+0000","last_undegraded":"2024-04-26T12:34:08.267641+0000","last_fullsized":"2024-04-26T12:34:08.267641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:08.267528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:08.267528+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.267528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:44.813032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.835712+0000","last_change":"2024-04-26T12:34:13.835712+0000","last_active":"2024-04-26T12:34:13.835712+0000","last_peered":"2024-04-26T12:34:13.835712+0000","last_clean":"2024-04-26T12:34:13.835712+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:34:13.835712+0000","last_undegraded":"2024-04-26T12:34:13.835712+0000","last_fullsized":"2024-04-26T12:34:13.835712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:13.835564+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:13.835564+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.835564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:43.848744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.575792+0000","last_change":"2024-04-26T12:34:17.575792+0000","last_active":"2024-04-26T12:34:17.575792+0000","last_peered":"2024-04-26T12:34:17.575792+0000","last_clean":"2024-04-26T12:34:17.575792+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:34:17.575792+0000","last_undegraded":"2024-04-26T12:34:17.575792+0000","last_fullsized":"2024-04-26T12:34:17.575792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:17.575676+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:17.575676+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.575676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:29.191018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.838246+0000","last_change":"2024-04-26T12:34:11.838275+0000","last_active":"2024-04-26T12:34:11.838246+0000","last_peered":"2024-04-26T12:34:11.838246+0000","last_clean":"2024-04-26T12:34:11.838246+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:34:11.838246+0000","last_undegraded":"2024-04-26T12:34:11.838246+0000","last_fullsized":"2024-04-26T12:34:11.838246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:34:11.838159+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:34:11.838159+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.838159+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:53.341422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:28.544575+0000","last_change":"2024-04-26T12:34:28.544575+0000","last_active":"2024-04-26T12:34:28.544575+0000","last_peered":"2024-04-26T12:34:28.544575+0000","last_clean":"2024-04-26T12:34:28.544575+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:34:28.544575+0000","last_undegraded":"2024-04-26T12:34:28.544575+0000","last_fullsized":"2024-04-26T12:34:28.544575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:28.544450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:28.544450+0000","last_clean_scrub_stamp":"2024-04-26T12:34:28.544450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:30.289525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.700100+0000","last_change":"2024-04-26T12:34:05.700148+0000","last_active":"2024-04-26T12:34:05.700100+0000","last_peered":"2024-04-26T12:34:05.700100+0000","last_clean":"2024-04-26T12:34:05.700100+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:34:05.700100+0000","last_undegraded":"2024-04-26T12:34:05.700100+0000","last_fullsized":"2024-04-26T12:34:05.700100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.700014+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:54.202928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.516299+0000","last_change":"2024-04-26T12:34:25.516299+0000","last_active":"2024-04-26T12:34:25.516299+0000","last_peered":"2024-04-26T12:34:25.516299+0000","last_clean":"2024-04-26T12:34:25.516299+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:34:25.516299+0000","last_undegraded":"2024-04-26T12:34:25.516299+0000","last_fullsized":"2024-04-26T12:34:25.516299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:25.516169+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:25.516169+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.516169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:08.695312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.536643+0000","last_change":"2024-04-26T12:34:08.536643+0000","last_active":"2024-04-26T12:34:08.536643+0000","last_peered":"2024-04-26T12:34:08.536643+0000","last_clean":"2024-04-26T12:34:08.536643+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:34:08.536643+0000","last_undegraded":"2024-04-26T12:34:08.536643+0000","last_fullsized":"2024-04-26T12:34:08.536643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:08.536533+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:08.536533+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.536533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:29.406137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.872851+0000","last_change":"2024-04-26T12:34:12.872851+0000","last_active":"2024-04-26T12:34:12.872851+0000","last_peered":"2024-04-26T12:34:12.872851+0000","last_clean":"2024-04-26T12:34:12.872851+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:34:12.872851+0000","last_undegraded":"2024-04-26T12:34:12.872851+0000","last_fullsized":"2024-04-26T12:34:12.872851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.872720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.872720+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.872720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:43.429674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.794058+0000","last_change":"2024-04-26T12:34:07.794058+0000","last_active":"2024-04-26T12:34:07.794058+0000","last_peered":"2024-04-26T12:34:07.794058+0000","last_clean":"2024-04-26T12:34:07.794058+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:34:07.794058+0000","last_undegraded":"2024-04-26T12:34:07.794058+0000","last_fullsized":"2024-04-26T12:34:07.794058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.793931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:31.555282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.818485+0000","last_change":"2024-04-26T12:34:20.818485+0000","last_active":"2024-04-26T12:34:20.818485+0000","last_peered":"2024-04-26T12:34:20.818485+0000","last_clean":"2024-04-26T12:34:20.818485+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:34:20.818485+0000","last_undegraded":"2024-04-26T12:34:20.818485+0000","last_fullsized":"2024-04-26T12:34:20.818485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:20.818344+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:20.818344+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.818344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:53.142364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.753500+0000","last_change":"2024-04-26T12:34:01.753500+0000","last_active":"2024-04-26T12:34:01.753500+0000","last_peered":"2024-04-26T12:34:01.753500+0000","last_clean":"2024-04-26T12:34:01.753500+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:34:01.753500+0000","last_undegraded":"2024-04-26T12:34:01.753500+0000","last_fullsized":"2024-04-26T12:34:01.753500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.753343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.379403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:35.543597+0000","last_change":"2024-04-26T12:34:35.543597+0000","last_active":"2024-04-26T12:34:35.543597+0000","last_peered":"2024-04-26T12:34:35.543597+0000","last_clean":"2024-04-26T12:34:35.543597+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:34:35.543597+0000","last_undegraded":"2024-04-26T12:34:35.543597+0000","last_fullsized":"2024-04-26T12:34:35.543597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:35.543408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:35.543408+0000","last_clean_scrub_stamp":"2024-04-26T12:34:35.543408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:32.040066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.784416+0000","last_change":"2024-04-26T12:34:00.784416+0000","last_active":"2024-04-26T12:34:00.784416+0000","last_peered":"2024-04-26T12:34:00.784416+0000","last_clean":"2024-04-26T12:34:00.784416+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:34:00.784416+0000","last_undegraded":"2024-04-26T12:34:00.784416+0000","last_fullsized":"2024-04-26T12:34:00.784416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.784248+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:01.988211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:33.598208+0000","last_change":"2024-04-26T12:34:33.598208+0000","last_active":"2024-04-26T12:34:33.598208+0000","last_peered":"2024-04-26T12:34:33.598208+0000","last_clean":"2024-04-26T12:34:33.598208+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:34:33.598208+0000","last_undegraded":"2024-04-26T12:34:33.598208+0000","last_fullsized":"2024-04-26T12:34:33.598208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:33.598009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:33.598009+0000","last_clean_scrub_stamp":"2024-04-26T12:34:33.598009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:34.158656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.944361+0000","last_change":"2024-04-26T12:33:50.944361+0000","last_active":"2024-04-26T12:33:50.944361+0000","last_peered":"2024-04-26T12:33:50.944361+0000","last_clean":"2024-04-26T12:33:50.944361+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:33:50.944361+0000","last_undegraded":"2024-04-26T12:33:50.944361+0000","last_fullsized":"2024-04-26T12:33:50.944361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.944248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:32.447511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.195032+0000","last_change":"2024-04-26T12:34:16.195084+0000","last_active":"2024-04-26T12:34:16.195032+0000","last_peered":"2024-04-26T12:34:16.195032+0000","last_clean":"2024-04-26T12:34:16.195032+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:34:16.195032+0000","last_undegraded":"2024-04-26T12:34:16.195032+0000","last_fullsized":"2024-04-26T12:34:16.195032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:16.194929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:16.194929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.194929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:17.275448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.787661+0000","last_change":"2024-04-26T12:34:04.787661+0000","last_active":"2024-04-26T12:34:04.787661+0000","last_peered":"2024-04-26T12:34:04.787661+0000","last_clean":"2024-04-26T12:34:04.787661+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:34:04.787661+0000","last_undegraded":"2024-04-26T12:34:04.787661+0000","last_fullsized":"2024-04-26T12:34:04.787661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.787527+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:20.485303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:46.559544+0000","last_change":"2024-04-26T12:34:46.559580+0000","last_active":"2024-04-26T12:34:46.559544+0000","last_peered":"2024-04-26T12:34:46.559544+0000","last_clean":"2024-04-26T12:34:46.559544+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:34:46.559544+0000","last_undegraded":"2024-04-26T12:34:46.559544+0000","last_fullsized":"2024-04-26T12:34:46.559544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:46.559448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:46.559448+0000","last_clean_scrub_stamp":"2024-04-26T12:34:46.559448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:00.967850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:32.566966+0000","last_change":"2024-04-26T12:34:32.566994+0000","last_active":"2024-04-26T12:34:32.566966+0000","last_peered":"2024-04-26T12:34:32.566966+0000","last_clean":"2024-04-26T12:34:32.566966+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:34:32.566966+0000","last_undegraded":"2024-04-26T12:34:32.566966+0000","last_fullsized":"2024-04-26T12:34:32.566966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:32.566854+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:32.566854+0000","last_clean_scrub_stamp":"2024-04-26T12:34:32.566854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:56.976366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.659740+0000","last_change":"2024-04-26T12:33:57.659780+0000","last_active":"2024-04-26T12:33:57.659740+0000","last_peered":"2024-04-26T12:33:57.659740+0000","last_clean":"2024-04-26T12:33:57.659740+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:57.659740+0000","last_undegraded":"2024-04-26T12:33:57.659740+0000","last_fullsized":"2024-04-26T12:33:57.659740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.659656+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:51.882456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.634694+0000","last_change":"2024-04-26T12:34:03.634721+0000","last_active":"2024-04-26T12:34:03.634694+0000","last_peered":"2024-04-26T12:34:03.634694+0000","last_clean":"2024-04-26T12:34:03.634694+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:34:03.634694+0000","last_undegraded":"2024-04-26T12:34:03.634694+0000","last_fullsized":"2024-04-26T12:34:03.634694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.634604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:37.832568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.820080+0000","last_change":"2024-04-26T12:33:53.820107+0000","last_active":"2024-04-26T12:33:53.820080+0000","last_peered":"2024-04-26T12:33:53.820080+0000","last_clean":"2024-04-26T12:33:53.820080+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:53.820080+0000","last_undegraded":"2024-04-26T12:33:53.820080+0000","last_fullsized":"2024-04-26T12:33:53.820080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.819987+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:06.561948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673023,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":145189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673023,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":735472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705726,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":734135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":430080,"data_stored":145178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:34:54.074 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.074 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.074 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:09.454310+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.075 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T12:30:13.470426+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.076 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.076 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.076 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.077 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.077 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:30:19.503487+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=33, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:34:54.078 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:35:14.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.185+0000 7f80c8e74640 1 Processor -- start 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.185+0000 7f80c8e74640 1 -- start start 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.185+0000 7f80c8e74640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80c408e300 0x7f80c412fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.185+0000 7f80c8e74640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c406d7a0 con 0x7f80c408d810 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.185+0000 7f80c8e74640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f80c40730d0 con 0x7f80c408e300 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.186+0000 7f80bbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80c408e300 0x7f80c412fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.186+0000 7f80c259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f80c408d810 0x7f80c408dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47086/0 (socket says 172.21.15.132:47086) 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.186+0000 7f80c259c640 1 -- 172.21.15.132:0/1483758811 learned_addr learned my addr 172.21.15.132:0/1483758811 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:35:14.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.186+0000 7f80bbfff640 1 -- 172.21.15.132:0/1483758811 >> v1:172.21.15.132:6789/0 conn(0x7f80c408d810 legacy=0x7f80c408dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.186+0000 7f80bbfff640 1 -- 172.21.15.132:0/1483758811 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c406e620 con 0x7f80c408e300 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80bbfff640 1 --2- 172.21.15.132:0/1483758811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408e300 0x7f80c412fd00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00b9c0 tx=0x7f80ac02e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f474a0fe581e9f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c1d9b640 1 -- 172.21.15.132:0/1483758811 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac03b070 con 0x7f80c408e300 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c1d9b640 1 -- 172.21.15.132:0/1483758811 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac02ecf0 con 0x7f80c408e300 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c1d9b640 1 -- 172.21.15.132:0/1483758811 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac036440 con 0x7f80c408e300 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c8e74640 1 -- 172.21.15.132:0/1483758811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408e300 msgr2=0x7f80c412fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c8e74640 1 --2- 172.21.15.132:0/1483758811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408e300 0x7f80c412fd00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00b9c0 tx=0x7f80ac02e010 comp rx=0 tx=0).stop 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c8e74640 1 -- 172.21.15.132:0/1483758811 shutdown_connections 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c8e74640 1 --2- 172.21.15.132:0/1483758811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408e300 0x7f80c412fd00 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c8e74640 1 -- 172.21.15.132:0/1483758811 >> 172.21.15.132:0/1483758811 conn(0x7f80c409b7b0 msgr2=0x7f80c409bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:35:14.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c8e74640 1 -- 172.21.15.132:0/1483758811 shutdown_connections 2024-04-26T12:35:14.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.187+0000 7f80c8e74640 1 -- 172.21.15.132:0/1483758811 wait complete. 2024-04-26T12:35:14.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.188+0000 7f80c8e74640 1 Processor -- start 2024-04-26T12:35:14.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.188+0000 7f80c8e74640 1 -- start start 2024-04-26T12:35:14.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c8e74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408d810 0x7f80c41bee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:35:14.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c8e74640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f80c408d100 con 0x7f80c408d810 2024-04-26T12:35:14.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408d810 0x7f80c41bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:35:14.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408d810 0x7f80c41bee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60726/0 (socket says 172.21.15.132:60726) 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c259c640 1 -- 172.21.15.132:0/2434636299 learned_addr learned my addr 172.21.15.132:0/2434636299 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c259c640 1 -- 172.21.15.132:0/2434636299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c40996c0 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c259c640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408d810 0x7f80c41bee70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c340 tx=0x7f80b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80baffd640 1 -- 172.21.15.132:0/2434636299 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b4005cd0 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80baffd640 1 -- 172.21.15.132:0/2434636299 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b40047e0 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c41bf3b0 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80baffd640 1 -- 172.21.15.132:0/2434636299 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b4004b20 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.189+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c41bf820 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.190+0000 7f80baffd640 1 -- 172.21.15.132:0/2434636299 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f80b401a020 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.190+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c4062ed0 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.190+0000 7f80baffd640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f80a4038060 0x7f80a403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.190+0000 7f80baffd640 1 -- 172.21.15.132:0/2434636299 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7f80b404b250 con 0x7f80c408d810 2024-04-26T12:35:14.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.191+0000 7f80bbfff640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f80a4038060 0x7f80a403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:35:14.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.191+0000 7f80bbfff640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f80a4038060 0x7f80a403a520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f80ac038000 tx=0x7f80ac032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:35:14.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.195+0000 7f80baffd640 1 -- 172.21.15.132:0/2434636299 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f80b40125b0 con 0x7f80c408d810 2024-04-26T12:35:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.365+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 --> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80c4072310 con 0x7f80a4038060 2024-04-26T12:35:14.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.380+0000 7f80baffd640 1 -- 172.21.15.132:0/2434636299 <== mgr.4100 v2:172.21.15.170:6824/2720307558 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666300 (secure 0 0 0) 0x7f80c4072310 con 0x7f80a4038060 2024-04-26T12:35:14.389 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-26T12:35:14.394 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f80a4038060 msgr2=0x7f80a403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f80a4038060 0x7f80a403a520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f80ac038000 tx=0x7f80ac032000 comp rx=0 tx=0).stop 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408d810 msgr2=0x7f80c41bee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408d810 0x7f80c41bee70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c340 tx=0x7f80b400c800 comp rx=0 tx=0).stop 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 shutdown_connections 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7f80a4038060 0x7f80a403a520 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 --2- 172.21.15.132:0/2434636299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c408d810 0x7f80c41bee70 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 >> 172.21.15.132:0/2434636299 conn(0x7f80c409b7b0 msgr2=0x7f80c408ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:35:14.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 shutdown_connections 2024-04-26T12:35:14.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.385+0000 7f80c8e74640 1 -- 172.21.15.132:0/2434636299 wait complete. 2024-04-26T12:35:14.398 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-04-26T12:35:12.520763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5095,"num_read_kb":4676,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4788,"ondisk_log_size":4788,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":123384,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":120505,"kb_avail":377363976,"statfs":{"total":386547056640,"available":386420711424,"internally_reserved":0,"allocated":2908160,"data_stored":1759974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":123397911},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003809"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.288439+0000","last_change":"2024-04-26T12:33:58.288439+0000","last_active":"2024-04-26T12:33:58.288439+0000","last_peered":"2024-04-26T12:33:58.288439+0000","last_clean":"2024-04-26T12:33:58.288439+0000","last_became_active":"2024-04-26T12:30:10.507755+0000","last_became_peered":"2024-04-26T12:30:10.507755+0000","last_unstale":"2024-04-26T12:33:58.288439+0000","last_undegraded":"2024-04-26T12:33:58.288439+0000","last_fullsized":"2024-04-26T12:33:58.288439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:58.288321+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.288321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:54.223162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.854100+0000","last_change":"2024-04-26T12:33:52.854126+0000","last_active":"2024-04-26T12:33:52.854100+0000","last_peered":"2024-04-26T12:33:52.854100+0000","last_clean":"2024-04-26T12:33:52.854100+0000","last_became_active":"2024-04-26T12:30:12.498649+0000","last_became_peered":"2024-04-26T12:30:12.498649+0000","last_unstale":"2024-04-26T12:33:52.854100+0000","last_undegraded":"2024-04-26T12:33:52.854100+0000","last_fullsized":"2024-04-26T12:33:52.854100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.854008+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.854008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:48.175623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.609564+0000","last_change":"2024-04-26T12:34:22.609592+0000","last_active":"2024-04-26T12:34:22.609564+0000","last_peered":"2024-04-26T12:34:22.609564+0000","last_clean":"2024-04-26T12:34:22.609564+0000","last_became_active":"2024-04-26T12:30:10.489537+0000","last_became_peered":"2024-04-26T12:30:10.489537+0000","last_unstale":"2024-04-26T12:34:22.609564+0000","last_undegraded":"2024-04-26T12:34:22.609564+0000","last_fullsized":"2024-04-26T12:34:22.609564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:22.609471+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:22.609471+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.609471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:33.445654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'18","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.666975+0000","last_change":"2024-04-26T12:34:18.667006+0000","last_active":"2024-04-26T12:34:18.666975+0000","last_peered":"2024-04-26T12:34:18.666975+0000","last_clean":"2024-04-26T12:34:18.666975+0000","last_became_active":"2024-04-26T12:30:12.483974+0000","last_became_peered":"2024-04-26T12:30:12.483974+0000","last_unstale":"2024-04-26T12:34:18.666975+0000","last_undegraded":"2024-04-26T12:34:18.666975+0000","last_fullsized":"2024-04-26T12:34:18.666975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:34:18.666884+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:34:18.666884+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.666884+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.442000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":23,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.685114+0000","last_change":"2024-04-26T12:34:21.685114+0000","last_active":"2024-04-26T12:34:21.685114+0000","last_peered":"2024-04-26T12:34:21.685114+0000","last_clean":"2024-04-26T12:34:21.685114+0000","last_became_active":"2024-04-26T12:30:10.519202+0000","last_became_peered":"2024-04-26T12:30:10.519202+0000","last_unstale":"2024-04-26T12:34:21.685114+0000","last_undegraded":"2024-04-26T12:34:21.685114+0000","last_fullsized":"2024-04-26T12:34:21.685114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:21.684952+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.684952+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.684952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:31.971000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.669824+0000","last_change":"2024-04-26T12:34:06.669871+0000","last_active":"2024-04-26T12:34:06.669824+0000","last_peered":"2024-04-26T12:34:06.669824+0000","last_clean":"2024-04-26T12:34:06.669824+0000","last_became_active":"2024-04-26T12:30:12.492885+0000","last_became_peered":"2024-04-26T12:30:12.492885+0000","last_unstale":"2024-04-26T12:34:06.669824+0000","last_undegraded":"2024-04-26T12:34:06.669824+0000","last_fullsized":"2024-04-26T12:34:06.669824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.669725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.669725+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:33.570963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.209207+0000","last_change":"2024-04-26T12:34:15.209232+0000","last_active":"2024-04-26T12:34:15.209207+0000","last_peered":"2024-04-26T12:34:15.209207+0000","last_clean":"2024-04-26T12:34:15.209207+0000","last_became_active":"2024-04-26T12:30:10.501081+0000","last_became_peered":"2024-04-26T12:30:10.501081+0000","last_unstale":"2024-04-26T12:34:15.209207+0000","last_undegraded":"2024-04-26T12:34:15.209207+0000","last_fullsized":"2024-04-26T12:34:15.209207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:15.209099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:15.209099+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.209099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:34.233375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.669332+0000","last_change":"2024-04-26T12:34:14.669361+0000","last_active":"2024-04-26T12:34:14.669332+0000","last_peered":"2024-04-26T12:34:14.669332+0000","last_clean":"2024-04-26T12:34:14.669332+0000","last_became_active":"2024-04-26T12:30:12.489616+0000","last_became_peered":"2024-04-26T12:30:12.489616+0000","last_unstale":"2024-04-26T12:34:14.669332+0000","last_undegraded":"2024-04-26T12:34:14.669332+0000","last_fullsized":"2024-04-26T12:34:14.669332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:14.669243+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:14.669243+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.669243+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:18.241558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:30.519091+0000","last_change":"2024-04-26T12:34:30.519121+0000","last_active":"2024-04-26T12:34:30.519091+0000","last_peered":"2024-04-26T12:34:30.519091+0000","last_clean":"2024-04-26T12:34:30.519091+0000","last_became_active":"2024-04-26T12:30:10.512173+0000","last_became_peered":"2024-04-26T12:30:10.512173+0000","last_unstale":"2024-04-26T12:34:30.519091+0000","last_undegraded":"2024-04-26T12:34:30.519091+0000","last_fullsized":"2024-04-26T12:34:30.519091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:30.518998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:30.518998+0000","last_clean_scrub_stamp":"2024-04-26T12:34:30.518998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:03.943828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'12","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.819186+0000","last_change":"2024-04-26T12:34:25.819213+0000","last_active":"2024-04-26T12:34:25.819186+0000","last_peered":"2024-04-26T12:34:25.819186+0000","last_clean":"2024-04-26T12:34:25.819186+0000","last_became_active":"2024-04-26T12:30:12.497465+0000","last_became_peered":"2024-04-26T12:30:12.497465+0000","last_unstale":"2024-04-26T12:34:25.819186+0000","last_undegraded":"2024-04-26T12:34:25.819186+0000","last_fullsized":"2024-04-26T12:34:25.819186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:34:25.819067+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:34:25.819067+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.819067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:59.067925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.230538+0000","last_change":"2024-04-26T12:34:06.230563+0000","last_active":"2024-04-26T12:34:06.230538+0000","last_peered":"2024-04-26T12:34:06.230538+0000","last_clean":"2024-04-26T12:34:06.230538+0000","last_became_active":"2024-04-26T12:30:10.505158+0000","last_became_peered":"2024-04-26T12:30:10.505158+0000","last_unstale":"2024-04-26T12:34:06.230538+0000","last_undegraded":"2024-04-26T12:34:06.230538+0000","last_fullsized":"2024-04-26T12:34:06.230538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:06.230442+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.230442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:31.999710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.284821+0000","last_change":"2024-04-26T12:34:25.284821+0000","last_active":"2024-04-26T12:34:25.284821+0000","last_peered":"2024-04-26T12:34:25.284821+0000","last_clean":"2024-04-26T12:34:25.284821+0000","last_became_active":"2024-04-26T12:30:49.549935+0000","last_became_peered":"2024-04-26T12:30:49.549935+0000","last_unstale":"2024-04-26T12:34:25.284821+0000","last_undegraded":"2024-04-26T12:34:25.284821+0000","last_fullsized":"2024-04-26T12:34:25.284821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:25.284696+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:25.284696+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.284696+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.824773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:34.592452+0000","last_change":"2024-04-26T12:34:34.592487+0000","last_active":"2024-04-26T12:34:34.592452+0000","last_peered":"2024-04-26T12:34:34.592452+0000","last_clean":"2024-04-26T12:34:34.592452+0000","last_became_active":"2024-04-26T12:30:10.510916+0000","last_became_peered":"2024-04-26T12:30:10.510916+0000","last_unstale":"2024-04-26T12:34:34.592452+0000","last_undegraded":"2024-04-26T12:34:34.592452+0000","last_fullsized":"2024-04-26T12:34:34.592452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:34.592342+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:34.592342+0000","last_clean_scrub_stamp":"2024-04-26T12:34:34.592342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:48.673055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.332600+0000","last_change":"2024-04-26T12:33:54.332600+0000","last_active":"2024-04-26T12:33:54.332600+0000","last_peered":"2024-04-26T12:33:54.332600+0000","last_clean":"2024-04-26T12:33:54.332600+0000","last_became_active":"2024-04-26T12:30:12.490856+0000","last_became_peered":"2024-04-26T12:30:12.490856+0000","last_unstale":"2024-04-26T12:33:54.332600+0000","last_undegraded":"2024-04-26T12:33:54.332600+0000","last_fullsized":"2024-04-26T12:33:54.332600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:54.332483+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.332483+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:46.075405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.528863+0000","last_change":"2024-04-26T12:34:07.528890+0000","last_active":"2024-04-26T12:34:07.528863+0000","last_peered":"2024-04-26T12:34:07.528863+0000","last_clean":"2024-04-26T12:34:07.528863+0000","last_became_active":"2024-04-26T12:30:10.505334+0000","last_became_peered":"2024-04-26T12:30:10.505334+0000","last_unstale":"2024-04-26T12:34:07.528863+0000","last_undegraded":"2024-04-26T12:34:07.528863+0000","last_fullsized":"2024-04-26T12:34:07.528863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:07.528773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:07.528773+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.528773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:35.692596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'8","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.336420+0000","last_change":"2024-04-26T12:33:59.336420+0000","last_active":"2024-04-26T12:33:59.336420+0000","last_peered":"2024-04-26T12:33:59.336420+0000","last_clean":"2024-04-26T12:33:59.336420+0000","last_became_active":"2024-04-26T12:30:12.482833+0000","last_became_peered":"2024-04-26T12:30:12.482833+0000","last_unstale":"2024-04-26T12:33:59.336420+0000","last_undegraded":"2024-04-26T12:33:59.336420+0000","last_fullsized":"2024-04-26T12:33:59.336420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:59.336298+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.336298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:16.786139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.647529+0000","last_change":"2024-04-26T12:34:20.647529+0000","last_active":"2024-04-26T12:34:20.647529+0000","last_peered":"2024-04-26T12:34:20.647529+0000","last_clean":"2024-04-26T12:34:20.647529+0000","last_became_active":"2024-04-26T12:30:12.480196+0000","last_became_peered":"2024-04-26T12:30:12.480196+0000","last_unstale":"2024-04-26T12:34:20.647529+0000","last_undegraded":"2024-04-26T12:34:20.647529+0000","last_fullsized":"2024-04-26T12:34:20.647529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:20.647411+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:20.647411+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.647411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.619236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.857334+0000","last_change":"2024-04-26T12:34:14.857334+0000","last_active":"2024-04-26T12:34:14.857334+0000","last_peered":"2024-04-26T12:34:14.857334+0000","last_clean":"2024-04-26T12:34:14.857334+0000","last_became_active":"2024-04-26T12:30:10.513941+0000","last_became_peered":"2024-04-26T12:30:10.513941+0000","last_unstale":"2024-04-26T12:34:14.857334+0000","last_undegraded":"2024-04-26T12:34:14.857334+0000","last_fullsized":"2024-04-26T12:34:14.857334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:14.857209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:14.857209+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.857209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:41:12.986493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.778997+0000","last_change":"2024-04-26T12:33:54.778997+0000","last_active":"2024-04-26T12:33:54.778997+0000","last_peered":"2024-04-26T12:33:54.778997+0000","last_clean":"2024-04-26T12:33:54.778997+0000","last_became_active":"2024-04-26T12:30:12.497707+0000","last_became_peered":"2024-04-26T12:30:12.497707+0000","last_unstale":"2024-04-26T12:33:54.778997+0000","last_undegraded":"2024-04-26T12:33:54.778997+0000","last_fullsized":"2024-04-26T12:33:54.778997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:54.778831+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.778831+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:42.906362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.213732+0000","last_change":"2024-04-26T12:34:10.213732+0000","last_active":"2024-04-26T12:34:10.213732+0000","last_peered":"2024-04-26T12:34:10.213732+0000","last_clean":"2024-04-26T12:34:10.213732+0000","last_became_active":"2024-04-26T12:30:10.501239+0000","last_became_peered":"2024-04-26T12:30:10.501239+0000","last_unstale":"2024-04-26T12:34:10.213732+0000","last_undegraded":"2024-04-26T12:34:10.213732+0000","last_fullsized":"2024-04-26T12:34:10.213732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:10.213568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:10.213568+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.213568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:30.498711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.871611+0000","last_change":"2024-04-26T12:34:15.871611+0000","last_active":"2024-04-26T12:34:15.871611+0000","last_peered":"2024-04-26T12:34:15.871611+0000","last_clean":"2024-04-26T12:34:15.871611+0000","last_became_active":"2024-04-26T12:30:12.495552+0000","last_became_peered":"2024-04-26T12:30:12.495552+0000","last_unstale":"2024-04-26T12:34:15.871611+0000","last_undegraded":"2024-04-26T12:34:15.871611+0000","last_fullsized":"2024-04-26T12:34:15.871611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:15.871498+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:15.871498+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.871498+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:04.533490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.812049+0000","last_change":"2024-04-26T12:34:10.812049+0000","last_active":"2024-04-26T12:34:10.812049+0000","last_peered":"2024-04-26T12:34:10.812049+0000","last_clean":"2024-04-26T12:34:10.812049+0000","last_became_active":"2024-04-26T12:30:10.514170+0000","last_became_peered":"2024-04-26T12:30:10.514170+0000","last_unstale":"2024-04-26T12:34:10.812049+0000","last_undegraded":"2024-04-26T12:34:10.812049+0000","last_fullsized":"2024-04-26T12:34:10.812049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:10.811929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:10.811929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.811929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:20.400842+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.536925+0000","last_change":"2024-04-26T12:34:06.536925+0000","last_active":"2024-04-26T12:34:06.536925+0000","last_peered":"2024-04-26T12:34:06.536925+0000","last_clean":"2024-04-26T12:34:06.536925+0000","last_became_active":"2024-04-26T12:30:12.481815+0000","last_became_peered":"2024-04-26T12:30:12.481815+0000","last_unstale":"2024-04-26T12:34:06.536925+0000","last_undegraded":"2024-04-26T12:34:06.536925+0000","last_fullsized":"2024-04-26T12:34:06.536925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:06.536779+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.536779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:33.617819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.842555+0000","last_change":"2024-04-26T12:34:08.842555+0000","last_active":"2024-04-26T12:34:08.842555+0000","last_peered":"2024-04-26T12:34:08.842555+0000","last_clean":"2024-04-26T12:34:08.842555+0000","last_became_active":"2024-04-26T12:30:10.513327+0000","last_became_peered":"2024-04-26T12:30:10.513327+0000","last_unstale":"2024-04-26T12:34:08.842555+0000","last_undegraded":"2024-04-26T12:34:08.842555+0000","last_fullsized":"2024-04-26T12:34:08.842555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:08.842382+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:08.842382+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.842382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:39.151474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.360141+0000","last_change":"2024-04-26T12:34:03.360141+0000","last_active":"2024-04-26T12:34:03.360141+0000","last_peered":"2024-04-26T12:34:03.360141+0000","last_clean":"2024-04-26T12:34:03.360141+0000","last_became_active":"2024-04-26T12:30:12.484268+0000","last_became_peered":"2024-04-26T12:30:12.484268+0000","last_unstale":"2024-04-26T12:34:03.360141+0000","last_undegraded":"2024-04-26T12:34:03.360141+0000","last_fullsized":"2024-04-26T12:34:03.360141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:03.359974+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.359974+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:04.442738+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.566626+0000","last_change":"2024-04-26T12:34:09.566626+0000","last_active":"2024-04-26T12:34:09.566626+0000","last_peered":"2024-04-26T12:34:09.566626+0000","last_clean":"2024-04-26T12:34:09.566626+0000","last_became_active":"2024-04-26T12:30:10.499120+0000","last_became_peered":"2024-04-26T12:30:10.499120+0000","last_unstale":"2024-04-26T12:34:09.566626+0000","last_undegraded":"2024-04-26T12:34:09.566626+0000","last_fullsized":"2024-04-26T12:34:09.566626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:09.566504+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:09.566504+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.566504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:28.585857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.846287+0000","last_change":"2024-04-26T12:34:09.846287+0000","last_active":"2024-04-26T12:34:09.846287+0000","last_peered":"2024-04-26T12:34:09.846287+0000","last_clean":"2024-04-26T12:34:09.846287+0000","last_became_active":"2024-04-26T12:30:12.495867+0000","last_became_peered":"2024-04-26T12:30:12.495867+0000","last_unstale":"2024-04-26T12:34:09.846287+0000","last_undegraded":"2024-04-26T12:34:09.846287+0000","last_fullsized":"2024-04-26T12:34:09.846287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:09.846147+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:09.846147+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.846147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:02.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:40.681823+0000","last_change":"2024-04-26T12:34:40.681823+0000","last_active":"2024-04-26T12:34:40.681823+0000","last_peered":"2024-04-26T12:34:40.681823+0000","last_clean":"2024-04-26T12:34:40.681823+0000","last_became_active":"2024-04-26T12:30:10.511011+0000","last_became_peered":"2024-04-26T12:30:10.511011+0000","last_unstale":"2024-04-26T12:34:40.681823+0000","last_undegraded":"2024-04-26T12:34:40.681823+0000","last_fullsized":"2024-04-26T12:34:40.681823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:40.681684+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:40.681684+0000","last_clean_scrub_stamp":"2024-04-26T12:34:40.681684+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:33.886826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:29.862045+0000","last_change":"2024-04-26T12:34:29.862075+0000","last_active":"2024-04-26T12:34:29.862045+0000","last_peered":"2024-04-26T12:34:29.862045+0000","last_clean":"2024-04-26T12:34:29.862045+0000","last_became_active":"2024-04-26T12:30:20.535026+0000","last_became_peered":"2024-04-26T12:30:20.535026+0000","last_unstale":"2024-04-26T12:34:29.862045+0000","last_undegraded":"2024-04-26T12:34:29.862045+0000","last_fullsized":"2024-04-26T12:34:29.862045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:34:29.861947+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:34:29.861947+0000","last_clean_scrub_stamp":"2024-04-26T12:34:29.861947+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:52.284746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.684244+0000","last_change":"2024-04-26T12:34:12.684244+0000","last_active":"2024-04-26T12:34:12.684244+0000","last_peered":"2024-04-26T12:34:12.684244+0000","last_clean":"2024-04-26T12:34:12.684244+0000","last_became_active":"2024-04-26T12:30:12.490385+0000","last_became_peered":"2024-04-26T12:30:12.490385+0000","last_unstale":"2024-04-26T12:34:12.684244+0000","last_undegraded":"2024-04-26T12:34:12.684244+0000","last_fullsized":"2024-04-26T12:34:12.684244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:12.684075+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:12.684075+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.684075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:49:21.651054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:39.653883+0000","last_change":"2024-04-26T12:34:39.653883+0000","last_active":"2024-04-26T12:34:39.653883+0000","last_peered":"2024-04-26T12:34:39.653883+0000","last_clean":"2024-04-26T12:34:39.653883+0000","last_became_active":"2024-04-26T12:30:10.519097+0000","last_became_peered":"2024-04-26T12:30:10.519097+0000","last_unstale":"2024-04-26T12:34:39.653883+0000","last_undegraded":"2024-04-26T12:34:39.653883+0000","last_fullsized":"2024-04-26T12:34:39.653883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:39.653753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:39.653753+0000","last_clean_scrub_stamp":"2024-04-26T12:34:39.653753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:14.099371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.036552+0000","last_change":"2024-04-26T12:33:39.036552+0000","last_active":"2024-04-26T12:33:39.036552+0000","last_peered":"2024-04-26T12:33:39.036552+0000","last_clean":"2024-04-26T12:33:39.036552+0000","last_became_active":"2024-04-26T12:30:14.491547+0000","last_became_peered":"2024-04-26T12:30:14.491547+0000","last_unstale":"2024-04-26T12:33:39.036552+0000","last_undegraded":"2024-04-26T12:33:39.036552+0000","last_fullsized":"2024-04-26T12:33:39.036552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.036437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.036437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:05.279980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.757313+0000","last_change":"2024-04-26T12:34:00.757313+0000","last_active":"2024-04-26T12:34:00.757313+0000","last_peered":"2024-04-26T12:34:00.757313+0000","last_clean":"2024-04-26T12:34:00.757313+0000","last_became_active":"2024-04-26T12:30:16.515704+0000","last_became_peered":"2024-04-26T12:30:16.515704+0000","last_unstale":"2024-04-26T12:34:00.757313+0000","last_undegraded":"2024-04-26T12:34:00.757313+0000","last_fullsized":"2024-04-26T12:34:00.757313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-04-26T12:34:00.757183+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.757183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:25.221766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.860428+0000","last_change":"2024-04-26T12:33:47.860428+0000","last_active":"2024-04-26T12:33:47.860428+0000","last_peered":"2024-04-26T12:33:47.860428+0000","last_clean":"2024-04-26T12:33:47.860428+0000","last_became_active":"2024-04-26T12:30:18.527301+0000","last_became_peered":"2024-04-26T12:30:18.527301+0000","last_unstale":"2024-04-26T12:33:47.860428+0000","last_undegraded":"2024-04-26T12:33:47.860428+0000","last_fullsized":"2024-04-26T12:33:47.860428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.860284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.860284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:42.030097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'15","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.819119+0000","last_change":"2024-04-26T12:33:55.819147+0000","last_active":"2024-04-26T12:33:55.819119+0000","last_peered":"2024-04-26T12:33:55.819119+0000","last_clean":"2024-04-26T12:33:55.819119+0000","last_became_active":"2024-04-26T12:30:20.530244+0000","last_became_peered":"2024-04-26T12:30:20.530244+0000","last_unstale":"2024-04-26T12:33:55.819119+0000","last_undegraded":"2024-04-26T12:33:55.819119+0000","last_fullsized":"2024-04-26T12:33:55.819119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:55.819023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.819023+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:12.017682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'18","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.623569+0000","last_change":"2024-04-26T12:34:09.623569+0000","last_active":"2024-04-26T12:34:09.623569+0000","last_peered":"2024-04-26T12:34:09.623569+0000","last_clean":"2024-04-26T12:34:09.623569+0000","last_became_active":"2024-04-26T12:30:12.491280+0000","last_became_peered":"2024-04-26T12:30:12.491280+0000","last_unstale":"2024-04-26T12:34:09.623569+0000","last_undegraded":"2024-04-26T12:34:09.623569+0000","last_fullsized":"2024-04-26T12:34:09.623569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:34:09.623444+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:34:09.623444+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.623444+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:16.228875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":46,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.314012+0000","last_change":"2024-04-26T12:34:04.314012+0000","last_active":"2024-04-26T12:34:04.314012+0000","last_peered":"2024-04-26T12:34:04.314012+0000","last_clean":"2024-04-26T12:34:04.314012+0000","last_became_active":"2024-04-26T12:30:10.506648+0000","last_became_peered":"2024-04-26T12:30:10.506648+0000","last_unstale":"2024-04-26T12:34:04.314012+0000","last_undegraded":"2024-04-26T12:34:04.314012+0000","last_fullsized":"2024-04-26T12:34:04.314012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:04.313892+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.313892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:49.817325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.582709+0000","last_change":"2024-04-26T12:33:51.582709+0000","last_active":"2024-04-26T12:33:51.582709+0000","last_peered":"2024-04-26T12:33:51.582709+0000","last_clean":"2024-04-26T12:33:51.582709+0000","last_became_active":"2024-04-26T12:30:14.490339+0000","last_became_peered":"2024-04-26T12:30:14.490339+0000","last_unstale":"2024-04-26T12:33:51.582709+0000","last_undegraded":"2024-04-26T12:33:51.582709+0000","last_fullsized":"2024-04-26T12:33:51.582709+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.582551+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.582551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:26.718562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.884246+0000","last_change":"2024-04-26T12:33:37.884246+0000","last_active":"2024-04-26T12:33:37.884246+0000","last_peered":"2024-04-26T12:33:37.884246+0000","last_clean":"2024-04-26T12:33:37.884246+0000","last_became_active":"2024-04-26T12:30:16.512376+0000","last_became_peered":"2024-04-26T12:30:16.512376+0000","last_unstale":"2024-04-26T12:33:37.884246+0000","last_undegraded":"2024-04-26T12:33:37.884246+0000","last_fullsized":"2024-04-26T12:33:37.884246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:37.884093+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.884093+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:49.682928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.859050+0000","last_change":"2024-04-26T12:33:39.859050+0000","last_active":"2024-04-26T12:33:39.859050+0000","last_peered":"2024-04-26T12:33:39.859050+0000","last_clean":"2024-04-26T12:33:39.859050+0000","last_became_active":"2024-04-26T12:30:18.526267+0000","last_became_peered":"2024-04-26T12:30:18.526267+0000","last_unstale":"2024-04-26T12:33:39.859050+0000","last_undegraded":"2024-04-26T12:33:39.859050+0000","last_fullsized":"2024-04-26T12:33:39.859050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:39.858931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.858931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:37.129358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.450797+0000","last_change":"2024-04-26T12:34:27.450823+0000","last_active":"2024-04-26T12:34:27.450797+0000","last_peered":"2024-04-26T12:34:27.450797+0000","last_clean":"2024-04-26T12:34:27.450797+0000","last_became_active":"2024-04-26T12:30:20.523333+0000","last_became_peered":"2024-04-26T12:30:20.523333+0000","last_unstale":"2024-04-26T12:34:27.450797+0000","last_undegraded":"2024-04-26T12:34:27.450797+0000","last_fullsized":"2024-04-26T12:34:27.450797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:27.450670+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:27.450670+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.450670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:28.031703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.271818+0000","last_change":"2024-04-26T12:34:26.271846+0000","last_active":"2024-04-26T12:34:26.271818+0000","last_peered":"2024-04-26T12:34:26.271818+0000","last_clean":"2024-04-26T12:34:26.271818+0000","last_became_active":"2024-04-26T12:30:49.694561+0000","last_became_peered":"2024-04-26T12:30:49.694561+0000","last_unstale":"2024-04-26T12:34:26.271818+0000","last_undegraded":"2024-04-26T12:34:26.271818+0000","last_fullsized":"2024-04-26T12:34:26.271818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:26.271725+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:26.271725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.271725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:37.887067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.566652+0000","last_change":"2024-04-26T12:34:27.566652+0000","last_active":"2024-04-26T12:34:27.566652+0000","last_peered":"2024-04-26T12:34:27.566652+0000","last_clean":"2024-04-26T12:34:27.566652+0000","last_became_active":"2024-04-26T12:30:10.511472+0000","last_became_peered":"2024-04-26T12:30:10.511472+0000","last_unstale":"2024-04-26T12:34:27.566652+0000","last_undegraded":"2024-04-26T12:34:27.566652+0000","last_fullsized":"2024-04-26T12:34:27.566652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:27.566516+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:27.566516+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.566516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:12.334644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.457327+0000","last_change":"2024-04-26T12:33:46.457327+0000","last_active":"2024-04-26T12:33:46.457327+0000","last_peered":"2024-04-26T12:33:46.457327+0000","last_clean":"2024-04-26T12:33:46.457327+0000","last_became_active":"2024-04-26T12:30:14.495059+0000","last_became_peered":"2024-04-26T12:30:14.495059+0000","last_unstale":"2024-04-26T12:33:46.457327+0000","last_undegraded":"2024-04-26T12:33:46.457327+0000","last_fullsized":"2024-04-26T12:33:46.457327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:46.457219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.457219+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:47.671663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.342730+0000","last_change":"2024-04-26T12:33:38.342730+0000","last_active":"2024-04-26T12:33:38.342730+0000","last_peered":"2024-04-26T12:33:38.342730+0000","last_clean":"2024-04-26T12:33:38.342730+0000","last_became_active":"2024-04-26T12:30:16.517700+0000","last_became_peered":"2024-04-26T12:30:16.517700+0000","last_unstale":"2024-04-26T12:33:38.342730+0000","last_undegraded":"2024-04-26T12:33:38.342730+0000","last_fullsized":"2024-04-26T12:33:38.342730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.342608+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.342608+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:02.654541+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.668165+0000","last_change":"2024-04-26T12:34:07.668165+0000","last_active":"2024-04-26T12:34:07.668165+0000","last_peered":"2024-04-26T12:34:07.668165+0000","last_clean":"2024-04-26T12:34:07.668165+0000","last_became_active":"2024-04-26T12:30:18.530056+0000","last_became_peered":"2024-04-26T12:30:18.530056+0000","last_unstale":"2024-04-26T12:34:07.668165+0000","last_undegraded":"2024-04-26T12:34:07.668165+0000","last_fullsized":"2024-04-26T12:34:07.668165+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-04-26T12:34:07.667991+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.667991+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:57.252635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.255875+0000","last_change":"2024-04-26T12:34:21.255905+0000","last_active":"2024-04-26T12:34:21.255875+0000","last_peered":"2024-04-26T12:34:21.255875+0000","last_clean":"2024-04-26T12:34:21.255875+0000","last_became_active":"2024-04-26T12:30:20.527979+0000","last_became_peered":"2024-04-26T12:30:20.527979+0000","last_unstale":"2024-04-26T12:34:21.255875+0000","last_undegraded":"2024-04-26T12:34:21.255875+0000","last_fullsized":"2024-04-26T12:34:21.255875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:21.255772+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.255772+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.255772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:26.069167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.639842+0000","last_change":"2024-04-26T12:33:59.639842+0000","last_active":"2024-04-26T12:33:59.639842+0000","last_peered":"2024-04-26T12:33:59.639842+0000","last_clean":"2024-04-26T12:33:59.639842+0000","last_became_active":"2024-04-26T12:30:12.499721+0000","last_became_peered":"2024-04-26T12:30:12.499721+0000","last_unstale":"2024-04-26T12:33:59.639842+0000","last_undegraded":"2024-04-26T12:33:59.639842+0000","last_fullsized":"2024-04-26T12:33:59.639842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:59.639717+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.639717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:28.819645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.834188+0000","last_change":"2024-04-26T12:34:24.834188+0000","last_active":"2024-04-26T12:34:24.834188+0000","last_peered":"2024-04-26T12:34:24.834188+0000","last_clean":"2024-04-26T12:34:24.834188+0000","last_became_active":"2024-04-26T12:30:10.512529+0000","last_became_peered":"2024-04-26T12:30:10.512529+0000","last_unstale":"2024-04-26T12:34:24.834188+0000","last_undegraded":"2024-04-26T12:34:24.834188+0000","last_fullsized":"2024-04-26T12:34:24.834188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.834032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.834032+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.834032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:40.390751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.942913+0000","last_change":"2024-04-26T12:33:33.942913+0000","last_active":"2024-04-26T12:33:33.942913+0000","last_peered":"2024-04-26T12:33:33.942913+0000","last_clean":"2024-04-26T12:33:33.942913+0000","last_became_active":"2024-04-26T12:30:14.492004+0000","last_became_peered":"2024-04-26T12:30:14.492004+0000","last_unstale":"2024-04-26T12:33:33.942913+0000","last_undegraded":"2024-04-26T12:33:33.942913+0000","last_fullsized":"2024-04-26T12:33:33.942913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.942777+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.942777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:36.777412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.337566+0000","last_change":"2024-04-26T12:33:39.337566+0000","last_active":"2024-04-26T12:33:39.337566+0000","last_peered":"2024-04-26T12:33:39.337566+0000","last_clean":"2024-04-26T12:33:39.337566+0000","last_became_active":"2024-04-26T12:30:16.516316+0000","last_became_peered":"2024-04-26T12:30:16.516316+0000","last_unstale":"2024-04-26T12:33:39.337566+0000","last_undegraded":"2024-04-26T12:33:39.337566+0000","last_fullsized":"2024-04-26T12:33:39.337566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:39.337430+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.337430+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:45.269245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":423,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.466107+0000","last_change":"2024-04-26T12:33:37.466107+0000","last_active":"2024-04-26T12:33:37.466107+0000","last_peered":"2024-04-26T12:33:37.466107+0000","last_clean":"2024-04-26T12:33:37.466107+0000","last_became_active":"2024-04-26T12:30:18.513275+0000","last_became_peered":"2024-04-26T12:30:18.513275+0000","last_unstale":"2024-04-26T12:33:37.466107+0000","last_undegraded":"2024-04-26T12:33:37.466107+0000","last_fullsized":"2024-04-26T12:33:37.466107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:37.465931+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.465931+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.639127+0000","last_change":"2024-04-26T12:34:08.639127+0000","last_active":"2024-04-26T12:34:08.639127+0000","last_peered":"2024-04-26T12:34:08.639127+0000","last_clean":"2024-04-26T12:34:08.639127+0000","last_became_active":"2024-04-26T12:30:12.492460+0000","last_became_peered":"2024-04-26T12:30:12.492460+0000","last_unstale":"2024-04-26T12:34:08.639127+0000","last_undegraded":"2024-04-26T12:34:08.639127+0000","last_fullsized":"2024-04-26T12:34:08.639127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:08.639013+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:08.639013+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.639013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:31.061812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.373086+0000","last_change":"2024-04-26T12:34:00.373086+0000","last_active":"2024-04-26T12:34:00.373086+0000","last_peered":"2024-04-26T12:34:00.373086+0000","last_clean":"2024-04-26T12:34:00.373086+0000","last_became_active":"2024-04-26T12:30:10.508123+0000","last_became_peered":"2024-04-26T12:30:10.508123+0000","last_unstale":"2024-04-26T12:34:00.373086+0000","last_undegraded":"2024-04-26T12:34:00.373086+0000","last_fullsized":"2024-04-26T12:34:00.373086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:00.372929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.372929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:27.486437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.872579+0000","last_change":"2024-04-26T12:33:46.872579+0000","last_active":"2024-04-26T12:33:46.872579+0000","last_peered":"2024-04-26T12:33:46.872579+0000","last_clean":"2024-04-26T12:33:46.872579+0000","last_became_active":"2024-04-26T12:30:14.488563+0000","last_became_peered":"2024-04-26T12:30:14.488563+0000","last_unstale":"2024-04-26T12:33:46.872579+0000","last_undegraded":"2024-04-26T12:33:46.872579+0000","last_fullsized":"2024-04-26T12:33:46.872579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.872459+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.872459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:20.085162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'54","reported_seq":115,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.341067+0000","last_change":"2024-04-26T12:33:40.341067+0000","last_active":"2024-04-26T12:33:40.341067+0000","last_peered":"2024-04-26T12:33:40.341067+0000","last_clean":"2024-04-26T12:33:40.341067+0000","last_became_active":"2024-04-26T12:30:16.511972+0000","last_became_peered":"2024-04-26T12:30:16.511972+0000","last_unstale":"2024-04-26T12:33:40.341067+0000","last_undegraded":"2024-04-26T12:33:40.341067+0000","last_fullsized":"2024-04-26T12:33:40.341067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'54","last_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_deep_scrub":"32'54","last_deep_scrub_stamp":"2024-04-26T12:33:40.340927+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.340927+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:00.228500+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.457526+0000","last_change":"2024-04-26T12:33:34.457526+0000","last_active":"2024-04-26T12:33:34.457526+0000","last_peered":"2024-04-26T12:33:34.457526+0000","last_clean":"2024-04-26T12:33:34.457526+0000","last_became_active":"2024-04-26T12:30:18.516996+0000","last_became_peered":"2024-04-26T12:30:18.516996+0000","last_unstale":"2024-04-26T12:33:34.457526+0000","last_undegraded":"2024-04-26T12:33:34.457526+0000","last_fullsized":"2024-04-26T12:33:34.457526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.457383+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.457383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:18.910969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.259347+0000","last_change":"2024-04-26T12:34:22.259347+0000","last_active":"2024-04-26T12:34:22.259347+0000","last_peered":"2024-04-26T12:34:22.259347+0000","last_clean":"2024-04-26T12:34:22.259347+0000","last_became_active":"2024-04-26T12:30:20.528817+0000","last_became_peered":"2024-04-26T12:30:20.528817+0000","last_unstale":"2024-04-26T12:34:22.259347+0000","last_undegraded":"2024-04-26T12:34:22.259347+0000","last_fullsized":"2024-04-26T12:34:22.259347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:34:22.259235+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:34:22.259235+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.259235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:23.699604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.791149+0000","last_change":"2024-04-26T12:34:05.791149+0000","last_active":"2024-04-26T12:34:05.791149+0000","last_peered":"2024-04-26T12:34:05.791149+0000","last_clean":"2024-04-26T12:34:05.791149+0000","last_became_active":"2024-04-26T12:30:12.495726+0000","last_became_peered":"2024-04-26T12:30:12.495726+0000","last_unstale":"2024-04-26T12:34:05.791149+0000","last_undegraded":"2024-04-26T12:34:05.791149+0000","last_fullsized":"2024-04-26T12:34:05.791149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:05.791018+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.791018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:41.156216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.216174+0000","last_change":"2024-04-26T12:34:14.216174+0000","last_active":"2024-04-26T12:34:14.216174+0000","last_peered":"2024-04-26T12:34:14.216174+0000","last_clean":"2024-04-26T12:34:14.216174+0000","last_became_active":"2024-04-26T12:30:10.499481+0000","last_became_peered":"2024-04-26T12:30:10.499481+0000","last_unstale":"2024-04-26T12:34:14.216174+0000","last_undegraded":"2024-04-26T12:34:14.216174+0000","last_fullsized":"2024-04-26T12:34:14.216174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:14.216059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:14.216059+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.216059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:23.021916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.534500+0000","last_change":"2024-04-26T12:33:50.534500+0000","last_active":"2024-04-26T12:33:50.534500+0000","last_peered":"2024-04-26T12:33:50.534500+0000","last_clean":"2024-04-26T12:33:50.534500+0000","last_became_active":"2024-04-26T12:30:14.490800+0000","last_became_peered":"2024-04-26T12:30:14.490800+0000","last_unstale":"2024-04-26T12:33:50.534500+0000","last_undegraded":"2024-04-26T12:33:50.534500+0000","last_fullsized":"2024-04-26T12:33:50.534500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:50.534336+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.534336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:36.444391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.724251+0000","last_change":"2024-04-26T12:34:02.724251+0000","last_active":"2024-04-26T12:34:02.724251+0000","last_peered":"2024-04-26T12:34:02.724251+0000","last_clean":"2024-04-26T12:34:02.724251+0000","last_became_active":"2024-04-26T12:30:16.517040+0000","last_became_peered":"2024-04-26T12:30:16.517040+0000","last_unstale":"2024-04-26T12:34:02.724251+0000","last_undegraded":"2024-04-26T12:34:02.724251+0000","last_fullsized":"2024-04-26T12:34:02.724251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-04-26T12:34:02.724129+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.724129+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:58.917634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.451884+0000","last_change":"2024-04-26T12:33:36.451884+0000","last_active":"2024-04-26T12:33:36.451884+0000","last_peered":"2024-04-26T12:33:36.451884+0000","last_clean":"2024-04-26T12:33:36.451884+0000","last_became_active":"2024-04-26T12:30:18.522621+0000","last_became_peered":"2024-04-26T12:30:18.522621+0000","last_unstale":"2024-04-26T12:33:36.451884+0000","last_undegraded":"2024-04-26T12:33:36.451884+0000","last_fullsized":"2024-04-26T12:33:36.451884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.451767+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.451767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:45.412706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'6","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.821196+0000","last_change":"2024-04-26T12:34:26.821196+0000","last_active":"2024-04-26T12:34:26.821196+0000","last_peered":"2024-04-26T12:34:26.821196+0000","last_clean":"2024-04-26T12:34:26.821196+0000","last_became_active":"2024-04-26T12:30:20.531720+0000","last_became_peered":"2024-04-26T12:30:20.531720+0000","last_unstale":"2024-04-26T12:34:26.821196+0000","last_undegraded":"2024-04-26T12:34:26.821196+0000","last_fullsized":"2024-04-26T12:34:26.821196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:26.821082+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:26.821082+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.821082+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:15.323997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.334451+0000","last_change":"2024-04-26T12:34:01.334451+0000","last_active":"2024-04-26T12:34:01.334451+0000","last_peered":"2024-04-26T12:34:01.334451+0000","last_clean":"2024-04-26T12:34:01.334451+0000","last_became_active":"2024-04-26T12:30:12.483305+0000","last_became_peered":"2024-04-26T12:30:12.483305+0000","last_unstale":"2024-04-26T12:34:01.334451+0000","last_undegraded":"2024-04-26T12:34:01.334451+0000","last_fullsized":"2024-04-26T12:34:01.334451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.334329+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.334329+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:19.047133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:37.573038+0000","last_change":"2024-04-26T12:34:37.573038+0000","last_active":"2024-04-26T12:34:37.573038+0000","last_peered":"2024-04-26T12:34:37.573038+0000","last_clean":"2024-04-26T12:34:37.573038+0000","last_became_active":"2024-04-26T12:30:10.516846+0000","last_became_peered":"2024-04-26T12:30:10.516846+0000","last_unstale":"2024-04-26T12:34:37.573038+0000","last_undegraded":"2024-04-26T12:34:37.573038+0000","last_fullsized":"2024-04-26T12:34:37.573038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:37.572885+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:37.572885+0000","last_clean_scrub_stamp":"2024-04-26T12:34:37.572885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:16.636879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.471028+0000","last_change":"2024-04-26T12:33:47.471028+0000","last_active":"2024-04-26T12:33:47.471028+0000","last_peered":"2024-04-26T12:33:47.471028+0000","last_clean":"2024-04-26T12:33:47.471028+0000","last_became_active":"2024-04-26T12:30:14.491457+0000","last_became_peered":"2024-04-26T12:30:14.491457+0000","last_unstale":"2024-04-26T12:33:47.471028+0000","last_undegraded":"2024-04-26T12:33:47.471028+0000","last_fullsized":"2024-04-26T12:33:47.471028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:47.470897+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.470897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:56.719758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.902471+0000","last_change":"2024-04-26T12:33:51.902471+0000","last_active":"2024-04-26T12:33:51.902471+0000","last_peered":"2024-04-26T12:33:51.902471+0000","last_clean":"2024-04-26T12:33:51.902471+0000","last_became_active":"2024-04-26T12:30:16.515664+0000","last_became_peered":"2024-04-26T12:30:16.515664+0000","last_unstale":"2024-04-26T12:33:51.902471+0000","last_undegraded":"2024-04-26T12:33:51.902471+0000","last_fullsized":"2024-04-26T12:33:51.902471+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:51.902291+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.902291+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:22.459245+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.490381+0000","last_change":"2024-04-26T12:33:48.490381+0000","last_active":"2024-04-26T12:33:48.490381+0000","last_peered":"2024-04-26T12:33:48.490381+0000","last_clean":"2024-04-26T12:33:48.490381+0000","last_became_active":"2024-04-26T12:30:18.525961+0000","last_became_peered":"2024-04-26T12:30:18.525961+0000","last_unstale":"2024-04-26T12:33:48.490381+0000","last_undegraded":"2024-04-26T12:33:48.490381+0000","last_fullsized":"2024-04-26T12:33:48.490381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:48.490266+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.490266+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:44.425107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:32.429275+0000","last_change":"2024-04-26T12:34:32.429275+0000","last_active":"2024-04-26T12:34:32.429275+0000","last_peered":"2024-04-26T12:34:32.429275+0000","last_clean":"2024-04-26T12:34:32.429275+0000","last_became_active":"2024-04-26T12:30:20.531115+0000","last_became_peered":"2024-04-26T12:30:20.531115+0000","last_unstale":"2024-04-26T12:34:32.429275+0000","last_undegraded":"2024-04-26T12:34:32.429275+0000","last_fullsized":"2024-04-26T12:34:32.429275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:32.429145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:32.429145+0000","last_clean_scrub_stamp":"2024-04-26T12:34:32.429145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:23.497400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.255286+0000","last_change":"2024-04-26T12:34:19.255286+0000","last_active":"2024-04-26T12:34:19.255286+0000","last_peered":"2024-04-26T12:34:19.255286+0000","last_clean":"2024-04-26T12:34:19.255286+0000","last_became_active":"2024-04-26T12:30:12.490194+0000","last_became_peered":"2024-04-26T12:30:12.490194+0000","last_unstale":"2024-04-26T12:34:19.255286+0000","last_undegraded":"2024-04-26T12:34:19.255286+0000","last_fullsized":"2024-04-26T12:34:19.255286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:19.255094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:19.255094+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.255094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:13.286904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:49.517290+0000","last_change":"2024-04-26T12:34:49.517318+0000","last_active":"2024-04-26T12:34:49.517290+0000","last_peered":"2024-04-26T12:34:49.517290+0000","last_clean":"2024-04-26T12:34:49.517290+0000","last_became_active":"2024-04-26T12:30:10.523252+0000","last_became_peered":"2024-04-26T12:30:10.523252+0000","last_unstale":"2024-04-26T12:34:49.517290+0000","last_undegraded":"2024-04-26T12:34:49.517290+0000","last_fullsized":"2024-04-26T12:34:49.517290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:49.517194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:49.517194+0000","last_clean_scrub_stamp":"2024-04-26T12:34:49.517194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:21.491237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.284415+0000","last_change":"2024-04-26T12:34:24.284479+0000","last_active":"2024-04-26T12:34:24.284415+0000","last_peered":"2024-04-26T12:34:24.284415+0000","last_clean":"2024-04-26T12:34:24.284415+0000","last_became_active":"2024-04-26T12:30:49.552660+0000","last_became_peered":"2024-04-26T12:30:49.552660+0000","last_unstale":"2024-04-26T12:34:24.284415+0000","last_undegraded":"2024-04-26T12:34:24.284415+0000","last_fullsized":"2024-04-26T12:34:24.284415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.284319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.284319+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.284319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:44.396150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'63","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.025645+0000","last_change":"2024-04-26T12:33:46.025645+0000","last_active":"2024-04-26T12:33:46.025645+0000","last_peered":"2024-04-26T12:33:46.025645+0000","last_clean":"2024-04-26T12:33:46.025645+0000","last_became_active":"2024-04-26T12:30:16.515380+0000","last_became_peered":"2024-04-26T12:30:16.515380+0000","last_unstale":"2024-04-26T12:33:46.025645+0000","last_undegraded":"2024-04-26T12:33:46.025645+0000","last_fullsized":"2024-04-26T12:33:46.025645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:46.025519+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.025519+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:28.207080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.486192+0000","last_change":"2024-04-26T12:33:32.486192+0000","last_active":"2024-04-26T12:33:32.486192+0000","last_peered":"2024-04-26T12:33:32.486192+0000","last_clean":"2024-04-26T12:33:32.486192+0000","last_became_active":"2024-04-26T12:30:18.522223+0000","last_became_peered":"2024-04-26T12:30:18.522223+0000","last_unstale":"2024-04-26T12:33:32.486192+0000","last_undegraded":"2024-04-26T12:33:32.486192+0000","last_fullsized":"2024-04-26T12:33:32.486192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.486110+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.486110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:19.318546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.625149+0000","last_change":"2024-04-26T12:34:00.625149+0000","last_active":"2024-04-26T12:34:00.625149+0000","last_peered":"2024-04-26T12:34:00.625149+0000","last_clean":"2024-04-26T12:34:00.625149+0000","last_became_active":"2024-04-26T12:30:20.522646+0000","last_became_peered":"2024-04-26T12:30:20.522646+0000","last_unstale":"2024-04-26T12:34:00.625149+0000","last_undegraded":"2024-04-26T12:34:00.625149+0000","last_fullsized":"2024-04-26T12:34:00.625149+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:34:00.625009+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.625009+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.384957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.852418+0000","last_change":"2024-04-26T12:33:56.852418+0000","last_active":"2024-04-26T12:33:56.852418+0000","last_peered":"2024-04-26T12:33:56.852418+0000","last_clean":"2024-04-26T12:33:56.852418+0000","last_became_active":"2024-04-26T12:30:12.497664+0000","last_became_peered":"2024-04-26T12:30:12.497664+0000","last_unstale":"2024-04-26T12:33:56.852418+0000","last_undegraded":"2024-04-26T12:33:56.852418+0000","last_fullsized":"2024-04-26T12:33:56.852418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:56.852284+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.852284+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.300655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.538013+0000","last_change":"2024-04-26T12:34:13.538013+0000","last_active":"2024-04-26T12:34:13.538013+0000","last_peered":"2024-04-26T12:34:13.538013+0000","last_clean":"2024-04-26T12:34:13.538013+0000","last_became_active":"2024-04-26T12:30:10.498695+0000","last_became_peered":"2024-04-26T12:30:10.498695+0000","last_unstale":"2024-04-26T12:34:13.538013+0000","last_undegraded":"2024-04-26T12:34:13.538013+0000","last_fullsized":"2024-04-26T12:34:13.538013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:13.537899+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:13.537899+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.537899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:14.978267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.377200+0000","last_change":"2024-04-26T12:33:52.377200+0000","last_active":"2024-04-26T12:33:52.377200+0000","last_peered":"2024-04-26T12:33:52.377200+0000","last_clean":"2024-04-26T12:33:52.377200+0000","last_became_active":"2024-04-26T12:30:14.488467+0000","last_became_peered":"2024-04-26T12:30:14.488467+0000","last_unstale":"2024-04-26T12:33:52.377200+0000","last_undegraded":"2024-04-26T12:33:52.377200+0000","last_fullsized":"2024-04-26T12:33:52.377200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.377072+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.377072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:20.049145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.870573+0000","last_change":"2024-04-26T12:33:40.870573+0000","last_active":"2024-04-26T12:33:40.870573+0000","last_peered":"2024-04-26T12:33:40.870573+0000","last_clean":"2024-04-26T12:33:40.870573+0000","last_became_active":"2024-04-26T12:30:16.511759+0000","last_became_peered":"2024-04-26T12:30:16.511759+0000","last_unstale":"2024-04-26T12:33:40.870573+0000","last_undegraded":"2024-04-26T12:33:40.870573+0000","last_fullsized":"2024-04-26T12:33:40.870573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:40.870443+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.870443+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:06.471328+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.854635+0000","last_change":"2024-04-26T12:33:53.854635+0000","last_active":"2024-04-26T12:33:53.854635+0000","last_peered":"2024-04-26T12:33:53.854635+0000","last_clean":"2024-04-26T12:33:53.854635+0000","last_became_active":"2024-04-26T12:30:18.528396+0000","last_became_peered":"2024-04-26T12:30:18.528396+0000","last_unstale":"2024-04-26T12:33:53.854635+0000","last_undegraded":"2024-04-26T12:33:53.854635+0000","last_fullsized":"2024-04-26T12:33:53.854635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:53.854523+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.854523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:51.983807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:51.526371+0000","last_change":"2024-04-26T12:34:51.526400+0000","last_active":"2024-04-26T12:34:51.526371+0000","last_peered":"2024-04-26T12:34:51.526371+0000","last_clean":"2024-04-26T12:34:51.526371+0000","last_became_active":"2024-04-26T12:30:20.532374+0000","last_became_peered":"2024-04-26T12:30:20.532374+0000","last_unstale":"2024-04-26T12:34:51.526371+0000","last_undegraded":"2024-04-26T12:34:51.526371+0000","last_fullsized":"2024-04-26T12:34:51.526371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:51.526287+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:51.526287+0000","last_clean_scrub_stamp":"2024-04-26T12:34:51.526287+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:46.779032+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.957328+0000","last_change":"2024-04-26T12:33:48.957328+0000","last_active":"2024-04-26T12:33:48.957328+0000","last_peered":"2024-04-26T12:33:48.957328+0000","last_clean":"2024-04-26T12:33:48.957328+0000","last_became_active":"2024-04-26T12:30:12.500111+0000","last_became_peered":"2024-04-26T12:30:12.500111+0000","last_unstale":"2024-04-26T12:33:48.957328+0000","last_undegraded":"2024-04-26T12:33:48.957328+0000","last_fullsized":"2024-04-26T12:33:48.957328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:48.957209+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.957209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:19.960752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:48.561007+0000","last_change":"2024-04-26T12:34:48.561051+0000","last_active":"2024-04-26T12:34:48.561007+0000","last_peered":"2024-04-26T12:34:48.561007+0000","last_clean":"2024-04-26T12:34:48.561007+0000","last_became_active":"2024-04-26T12:30:10.512167+0000","last_became_peered":"2024-04-26T12:30:10.512167+0000","last_unstale":"2024-04-26T12:34:48.561007+0000","last_undegraded":"2024-04-26T12:34:48.561007+0000","last_fullsized":"2024-04-26T12:34:48.561007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:48.560878+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:48.560878+0000","last_clean_scrub_stamp":"2024-04-26T12:34:48.560878+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:21.731882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.485594+0000","last_change":"2024-04-26T12:33:49.485594+0000","last_active":"2024-04-26T12:33:49.485594+0000","last_peered":"2024-04-26T12:33:49.485594+0000","last_clean":"2024-04-26T12:33:49.485594+0000","last_became_active":"2024-04-26T12:30:14.490904+0000","last_became_peered":"2024-04-26T12:30:14.490904+0000","last_unstale":"2024-04-26T12:33:49.485594+0000","last_undegraded":"2024-04-26T12:33:49.485594+0000","last_fullsized":"2024-04-26T12:33:49.485594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:49.485434+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.485434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.630769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.335394+0000","last_change":"2024-04-26T12:33:43.335394+0000","last_active":"2024-04-26T12:33:43.335394+0000","last_peered":"2024-04-26T12:33:43.335394+0000","last_clean":"2024-04-26T12:33:43.335394+0000","last_became_active":"2024-04-26T12:30:16.509036+0000","last_became_peered":"2024-04-26T12:30:16.509036+0000","last_unstale":"2024-04-26T12:33:43.335394+0000","last_undegraded":"2024-04-26T12:33:43.335394+0000","last_fullsized":"2024-04-26T12:33:43.335394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-04-26T12:33:43.335257+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.335257+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:44.822905+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":422,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.325114+0000","last_change":"2024-04-26T12:33:41.325114+0000","last_active":"2024-04-26T12:33:41.325114+0000","last_peered":"2024-04-26T12:33:41.325114+0000","last_clean":"2024-04-26T12:33:41.325114+0000","last_became_active":"2024-04-26T12:30:18.525544+0000","last_became_peered":"2024-04-26T12:30:18.525544+0000","last_unstale":"2024-04-26T12:33:41.325114+0000","last_undegraded":"2024-04-26T12:33:41.325114+0000","last_fullsized":"2024-04-26T12:33:41.325114+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:41.325000+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.325000+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:42.600411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:28.495981+0000","last_change":"2024-04-26T12:34:28.495981+0000","last_active":"2024-04-26T12:34:28.495981+0000","last_peered":"2024-04-26T12:34:28.495981+0000","last_clean":"2024-04-26T12:34:28.495981+0000","last_became_active":"2024-04-26T12:30:20.523478+0000","last_became_peered":"2024-04-26T12:30:20.523478+0000","last_unstale":"2024-04-26T12:34:28.495981+0000","last_undegraded":"2024-04-26T12:34:28.495981+0000","last_fullsized":"2024-04-26T12:34:28.495981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:34:28.495862+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:34:28.495862+0000","last_clean_scrub_stamp":"2024-04-26T12:34:28.495862+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:58.659027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.271830+0000","last_change":"2024-04-26T12:34:05.271830+0000","last_active":"2024-04-26T12:34:05.271830+0000","last_peered":"2024-04-26T12:34:05.271830+0000","last_clean":"2024-04-26T12:34:05.271830+0000","last_became_active":"2024-04-26T12:30:12.484338+0000","last_became_peered":"2024-04-26T12:30:12.484338+0000","last_unstale":"2024-04-26T12:34:05.271830+0000","last_undegraded":"2024-04-26T12:34:05.271830+0000","last_fullsized":"2024-04-26T12:34:05.271830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:05.271706+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.271706+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:10.784909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.607765+0000","last_change":"2024-04-26T12:34:24.607765+0000","last_active":"2024-04-26T12:34:24.607765+0000","last_peered":"2024-04-26T12:34:24.607765+0000","last_clean":"2024-04-26T12:34:24.607765+0000","last_became_active":"2024-04-26T12:30:10.518967+0000","last_became_peered":"2024-04-26T12:30:10.518967+0000","last_unstale":"2024-04-26T12:34:24.607765+0000","last_undegraded":"2024-04-26T12:34:24.607765+0000","last_fullsized":"2024-04-26T12:34:24.607765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.607633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.607633+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.607633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:36.469232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.919526+0000","last_change":"2024-04-26T12:33:41.919526+0000","last_active":"2024-04-26T12:33:41.919526+0000","last_peered":"2024-04-26T12:33:41.919526+0000","last_clean":"2024-04-26T12:33:41.919526+0000","last_became_active":"2024-04-26T12:30:14.494491+0000","last_became_peered":"2024-04-26T12:30:14.494491+0000","last_unstale":"2024-04-26T12:33:41.919526+0000","last_undegraded":"2024-04-26T12:33:41.919526+0000","last_fullsized":"2024-04-26T12:33:41.919526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-04-26T12:33:41.919360+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.919360+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:08.145030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.033639+0000","last_change":"2024-04-26T12:33:38.033639+0000","last_active":"2024-04-26T12:33:38.033639+0000","last_peered":"2024-04-26T12:33:38.033639+0000","last_clean":"2024-04-26T12:33:38.033639+0000","last_became_active":"2024-04-26T12:30:16.514757+0000","last_became_peered":"2024-04-26T12:30:16.514757+0000","last_unstale":"2024-04-26T12:33:38.033639+0000","last_undegraded":"2024-04-26T12:33:38.033639+0000","last_fullsized":"2024-04-26T12:33:38.033639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:38.033508+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.033508+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:09.947838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":512,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.012799+0000","last_change":"2024-04-26T12:33:33.012799+0000","last_active":"2024-04-26T12:33:33.012799+0000","last_peered":"2024-04-26T12:33:33.012799+0000","last_clean":"2024-04-26T12:33:33.012799+0000","last_became_active":"2024-04-26T12:30:18.518677+0000","last_became_peered":"2024-04-26T12:30:18.518677+0000","last_unstale":"2024-04-26T12:33:33.012799+0000","last_undegraded":"2024-04-26T12:33:33.012799+0000","last_fullsized":"2024-04-26T12:33:33.012799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:33.012673+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.012673+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:23.693315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.329889+0000","last_change":"2024-04-26T12:33:53.329889+0000","last_active":"2024-04-26T12:33:53.329889+0000","last_peered":"2024-04-26T12:33:53.329889+0000","last_clean":"2024-04-26T12:33:53.329889+0000","last_became_active":"2024-04-26T12:30:20.526671+0000","last_became_peered":"2024-04-26T12:30:20.526671+0000","last_unstale":"2024-04-26T12:33:53.329889+0000","last_undegraded":"2024-04-26T12:33:53.329889+0000","last_fullsized":"2024-04-26T12:33:53.329889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:53.329710+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.329710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:13.585776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'18","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.835053+0000","last_change":"2024-04-26T12:33:57.835053+0000","last_active":"2024-04-26T12:33:57.835053+0000","last_peered":"2024-04-26T12:33:57.835053+0000","last_clean":"2024-04-26T12:33:57.835053+0000","last_became_active":"2024-04-26T12:30:12.497722+0000","last_became_peered":"2024-04-26T12:30:12.497722+0000","last_unstale":"2024-04-26T12:33:57.835053+0000","last_undegraded":"2024-04-26T12:33:57.835053+0000","last_fullsized":"2024-04-26T12:33:57.835053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-04-26T12:33:57.834902+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.834902+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:31.144768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.584425+0000","last_change":"2024-04-26T12:34:26.584425+0000","last_active":"2024-04-26T12:34:26.584425+0000","last_peered":"2024-04-26T12:34:26.584425+0000","last_clean":"2024-04-26T12:34:26.584425+0000","last_became_active":"2024-04-26T12:30:10.519141+0000","last_became_peered":"2024-04-26T12:30:10.519141+0000","last_unstale":"2024-04-26T12:34:26.584425+0000","last_undegraded":"2024-04-26T12:34:26.584425+0000","last_fullsized":"2024-04-26T12:34:26.584425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:26.584268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:26.584268+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.584268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:32.141285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.972968+0000","last_change":"2024-04-26T12:33:32.972968+0000","last_active":"2024-04-26T12:33:32.972968+0000","last_peered":"2024-04-26T12:33:32.972968+0000","last_clean":"2024-04-26T12:33:32.972968+0000","last_became_active":"2024-04-26T12:30:14.492382+0000","last_became_peered":"2024-04-26T12:30:14.492382+0000","last_unstale":"2024-04-26T12:33:32.972968+0000","last_undegraded":"2024-04-26T12:33:32.972968+0000","last_fullsized":"2024-04-26T12:33:32.972968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.972836+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.972836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:10.206586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.924967+0000","last_change":"2024-04-26T12:33:36.924967+0000","last_active":"2024-04-26T12:33:36.924967+0000","last_peered":"2024-04-26T12:33:36.924967+0000","last_clean":"2024-04-26T12:33:36.924967+0000","last_became_active":"2024-04-26T12:30:16.512590+0000","last_became_peered":"2024-04-26T12:30:16.512590+0000","last_unstale":"2024-04-26T12:33:36.924967+0000","last_undegraded":"2024-04-26T12:33:36.924967+0000","last_fullsized":"2024-04-26T12:33:36.924967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-04-26T12:33:36.924772+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.924772+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:29.763584+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:37.358839+0000","last_change":"2024-04-26T12:33:37.358839+0000","last_active":"2024-04-26T12:33:37.358839+0000","last_peered":"2024-04-26T12:33:37.358839+0000","last_clean":"2024-04-26T12:33:37.358839+0000","last_became_active":"2024-04-26T12:30:18.524004+0000","last_became_peered":"2024-04-26T12:30:18.524004+0000","last_unstale":"2024-04-26T12:33:37.358839+0000","last_undegraded":"2024-04-26T12:33:37.358839+0000","last_fullsized":"2024-04-26T12:33:37.358839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:37.358703+0000","last_clean_scrub_stamp":"2024-04-26T12:33:37.358703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:07.891090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.830448+0000","last_change":"2024-04-26T12:33:51.830448+0000","last_active":"2024-04-26T12:33:51.830448+0000","last_peered":"2024-04-26T12:33:51.830448+0000","last_clean":"2024-04-26T12:33:51.830448+0000","last_became_active":"2024-04-26T12:30:20.526822+0000","last_became_peered":"2024-04-26T12:30:20.526822+0000","last_unstale":"2024-04-26T12:33:51.830448+0000","last_undegraded":"2024-04-26T12:33:51.830448+0000","last_fullsized":"2024-04-26T12:33:51.830448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-04-26T12:33:51.830335+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.830335+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:23.254930+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.916310+0000","last_change":"2024-04-26T12:33:49.916310+0000","last_active":"2024-04-26T12:33:49.916310+0000","last_peered":"2024-04-26T12:33:49.916310+0000","last_clean":"2024-04-26T12:33:49.916310+0000","last_became_active":"2024-04-26T12:30:12.499544+0000","last_became_peered":"2024-04-26T12:30:12.499544+0000","last_unstale":"2024-04-26T12:33:49.916310+0000","last_undegraded":"2024-04-26T12:33:49.916310+0000","last_fullsized":"2024-04-26T12:33:49.916310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:49.916195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.916195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:02.556981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.900215+0000","last_change":"2024-04-26T12:34:17.900270+0000","last_active":"2024-04-26T12:34:17.900215+0000","last_peered":"2024-04-26T12:34:17.900215+0000","last_clean":"2024-04-26T12:34:17.900215+0000","last_became_active":"2024-04-26T12:29:54.460961+0000","last_became_peered":"2024-04-26T12:29:54.460961+0000","last_unstale":"2024-04-26T12:34:17.900215+0000","last_undegraded":"2024-04-26T12:34:17.900215+0000","last_fullsized":"2024-04-26T12:34:17.900215+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-04-26T12:34:17.900111+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-04-26T12:34:17.900111+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.900111+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.661828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:41.676511+0000","last_change":"2024-04-26T12:34:41.676544+0000","last_active":"2024-04-26T12:34:41.676511+0000","last_peered":"2024-04-26T12:34:41.676511+0000","last_clean":"2024-04-26T12:34:41.676511+0000","last_became_active":"2024-04-26T12:30:01.439339+0000","last_became_peered":"2024-04-26T12:30:01.439339+0000","last_unstale":"2024-04-26T12:34:41.676511+0000","last_undegraded":"2024-04-26T12:34:41.676511+0000","last_fullsized":"2024-04-26T12:34:41.676511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:41.676422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:41.676422+0000","last_clean_scrub_stamp":"2024-04-26T12:34:41.676422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:20.964187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:36.577535+0000","last_change":"2024-04-26T12:34:36.577576+0000","last_active":"2024-04-26T12:34:36.577535+0000","last_peered":"2024-04-26T12:34:36.577535+0000","last_clean":"2024-04-26T12:34:36.577535+0000","last_became_active":"2024-04-26T12:30:10.515480+0000","last_became_peered":"2024-04-26T12:30:10.515480+0000","last_unstale":"2024-04-26T12:34:36.577535+0000","last_undegraded":"2024-04-26T12:34:36.577535+0000","last_fullsized":"2024-04-26T12:34:36.577535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:36.577412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:36.577412+0000","last_clean_scrub_stamp":"2024-04-26T12:34:36.577412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:21.710353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.891610+0000","last_change":"2024-04-26T12:33:45.891610+0000","last_active":"2024-04-26T12:33:45.891610+0000","last_peered":"2024-04-26T12:33:45.891610+0000","last_clean":"2024-04-26T12:33:45.891610+0000","last_became_active":"2024-04-26T12:30:14.492989+0000","last_became_peered":"2024-04-26T12:30:14.492989+0000","last_unstale":"2024-04-26T12:33:45.891610+0000","last_undegraded":"2024-04-26T12:33:45.891610+0000","last_fullsized":"2024-04-26T12:33:45.891610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:45.891453+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.891453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:38.825131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'90","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.748578+0000","last_change":"2024-04-26T12:34:04.748578+0000","last_active":"2024-04-26T12:34:04.748578+0000","last_peered":"2024-04-26T12:34:04.748578+0000","last_clean":"2024-04-26T12:34:04.748578+0000","last_became_active":"2024-04-26T12:30:16.516607+0000","last_became_peered":"2024-04-26T12:30:16.516607+0000","last_unstale":"2024-04-26T12:34:04.748578+0000","last_undegraded":"2024-04-26T12:34:04.748578+0000","last_fullsized":"2024-04-26T12:34:04.748578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-04-26T12:34:04.748449+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.748449+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:37.997307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.459732+0000","last_change":"2024-04-26T12:33:44.459732+0000","last_active":"2024-04-26T12:33:44.459732+0000","last_peered":"2024-04-26T12:33:44.459732+0000","last_clean":"2024-04-26T12:33:44.459732+0000","last_became_active":"2024-04-26T12:30:18.525847+0000","last_became_peered":"2024-04-26T12:30:18.525847+0000","last_unstale":"2024-04-26T12:33:44.459732+0000","last_undegraded":"2024-04-26T12:33:44.459732+0000","last_fullsized":"2024-04-26T12:33:44.459732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.459618+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.459618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:37.847661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'83","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.385606+0000","last_change":"2024-04-26T12:33:49.385606+0000","last_active":"2024-04-26T12:33:49.385606+0000","last_peered":"2024-04-26T12:33:49.385606+0000","last_clean":"2024-04-26T12:33:49.385606+0000","last_became_active":"2024-04-26T12:30:20.526028+0000","last_became_peered":"2024-04-26T12:30:20.526028+0000","last_unstale":"2024-04-26T12:33:49.385606+0000","last_undegraded":"2024-04-26T12:33:49.385606+0000","last_fullsized":"2024-04-26T12:33:49.385606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'83","last_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_deep_scrub":"32'83","last_deep_scrub_stamp":"2024-04-26T12:33:49.385474+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.385474+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:25.473005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.651628+0000","last_change":"2024-04-26T12:34:17.651628+0000","last_active":"2024-04-26T12:34:17.651628+0000","last_peered":"2024-04-26T12:34:17.651628+0000","last_clean":"2024-04-26T12:34:17.651628+0000","last_became_active":"2024-04-26T12:30:12.488596+0000","last_became_peered":"2024-04-26T12:30:12.488596+0000","last_unstale":"2024-04-26T12:34:17.651628+0000","last_undegraded":"2024-04-26T12:34:17.651628+0000","last_fullsized":"2024-04-26T12:34:17.651628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:17.651456+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:17.651456+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.651456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:57.164554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:42.639503+0000","last_change":"2024-04-26T12:34:42.639532+0000","last_active":"2024-04-26T12:34:42.639503+0000","last_peered":"2024-04-26T12:34:42.639503+0000","last_clean":"2024-04-26T12:34:42.639503+0000","last_became_active":"2024-04-26T12:30:01.440219+0000","last_became_peered":"2024-04-26T12:30:01.440219+0000","last_unstale":"2024-04-26T12:34:42.639503+0000","last_undegraded":"2024-04-26T12:34:42.639503+0000","last_fullsized":"2024-04-26T12:34:42.639503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:42.639395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:42.639395+0000","last_clean_scrub_stamp":"2024-04-26T12:34:42.639395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:43.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.577169+0000","last_change":"2024-04-26T12:34:20.577169+0000","last_active":"2024-04-26T12:34:20.577169+0000","last_peered":"2024-04-26T12:34:20.577169+0000","last_clean":"2024-04-26T12:34:20.577169+0000","last_became_active":"2024-04-26T12:30:10.488147+0000","last_became_peered":"2024-04-26T12:30:10.488147+0000","last_unstale":"2024-04-26T12:34:20.577169+0000","last_undegraded":"2024-04-26T12:34:20.577169+0000","last_fullsized":"2024-04-26T12:34:20.577169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:20.577044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:20.577044+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.577044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:08.079282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.990341+0000","last_change":"2024-04-26T12:33:34.990341+0000","last_active":"2024-04-26T12:33:34.990341+0000","last_peered":"2024-04-26T12:33:34.990341+0000","last_clean":"2024-04-26T12:33:34.990341+0000","last_became_active":"2024-04-26T12:30:14.491673+0000","last_became_peered":"2024-04-26T12:30:14.491673+0000","last_unstale":"2024-04-26T12:33:34.990341+0000","last_undegraded":"2024-04-26T12:33:34.990341+0000","last_fullsized":"2024-04-26T12:33:34.990341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.990216+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.990216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:51.188875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":516,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.968276+0000","last_change":"2024-04-26T12:33:34.968276+0000","last_active":"2024-04-26T12:33:34.968276+0000","last_peered":"2024-04-26T12:33:34.968276+0000","last_clean":"2024-04-26T12:33:34.968276+0000","last_became_active":"2024-04-26T12:30:16.515004+0000","last_became_peered":"2024-04-26T12:30:16.515004+0000","last_unstale":"2024-04-26T12:33:34.968276+0000","last_undegraded":"2024-04-26T12:33:34.968276+0000","last_fullsized":"2024-04-26T12:33:34.968276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-04-26T12:33:34.968125+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.968125+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:55.925235+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.757744+0000","last_change":"2024-04-26T12:34:03.757744+0000","last_active":"2024-04-26T12:34:03.757744+0000","last_peered":"2024-04-26T12:34:03.757744+0000","last_clean":"2024-04-26T12:34:03.757744+0000","last_became_active":"2024-04-26T12:30:18.529996+0000","last_became_peered":"2024-04-26T12:30:18.529996+0000","last_unstale":"2024-04-26T12:34:03.757744+0000","last_undegraded":"2024-04-26T12:34:03.757744+0000","last_fullsized":"2024-04-26T12:34:03.757744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.757597+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.757597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:19.314316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:27.815095+0000","last_change":"2024-04-26T12:34:27.815095+0000","last_active":"2024-04-26T12:34:27.815095+0000","last_peered":"2024-04-26T12:34:27.815095+0000","last_clean":"2024-04-26T12:34:27.815095+0000","last_became_active":"2024-04-26T12:30:20.531277+0000","last_became_peered":"2024-04-26T12:30:20.531277+0000","last_unstale":"2024-04-26T12:34:27.815095+0000","last_undegraded":"2024-04-26T12:34:27.815095+0000","last_fullsized":"2024-04-26T12:34:27.815095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:27.814977+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:27.814977+0000","last_clean_scrub_stamp":"2024-04-26T12:34:27.814977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:54.716214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'32","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.678134+0000","last_change":"2024-04-26T12:33:58.678134+0000","last_active":"2024-04-26T12:33:58.678134+0000","last_peered":"2024-04-26T12:33:58.678134+0000","last_clean":"2024-04-26T12:33:58.678134+0000","last_became_active":"2024-04-26T12:30:12.499795+0000","last_became_peered":"2024-04-26T12:30:12.499795+0000","last_unstale":"2024-04-26T12:33:58.678134+0000","last_undegraded":"2024-04-26T12:33:58.678134+0000","last_fullsized":"2024-04-26T12:33:58.678134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-04-26T12:33:58.678019+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.678019+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:17.835330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":74,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.202870+0000","last_change":"2024-04-26T12:34:11.202870+0000","last_active":"2024-04-26T12:34:11.202870+0000","last_peered":"2024-04-26T12:34:11.202870+0000","last_clean":"2024-04-26T12:34:11.202870+0000","last_became_active":"2024-04-26T12:30:01.440865+0000","last_became_peered":"2024-04-26T12:30:01.440865+0000","last_unstale":"2024-04-26T12:34:11.202870+0000","last_undegraded":"2024-04-26T12:34:11.202870+0000","last_fullsized":"2024-04-26T12:34:11.202870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:11.202740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:11.202740+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.202740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:08.255369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.584357+0000","last_change":"2024-04-26T12:34:23.584386+0000","last_active":"2024-04-26T12:34:23.584357+0000","last_peered":"2024-04-26T12:34:23.584357+0000","last_clean":"2024-04-26T12:34:23.584357+0000","last_became_active":"2024-04-26T12:30:10.489465+0000","last_became_peered":"2024-04-26T12:30:10.489465+0000","last_unstale":"2024-04-26T12:34:23.584357+0000","last_undegraded":"2024-04-26T12:34:23.584357+0000","last_fullsized":"2024-04-26T12:34:23.584357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:23.584266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:23.584266+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.584266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:08.510693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.355150+0000","last_change":"2024-04-26T12:33:47.355150+0000","last_active":"2024-04-26T12:33:47.355150+0000","last_peered":"2024-04-26T12:33:47.355150+0000","last_clean":"2024-04-26T12:33:47.355150+0000","last_became_active":"2024-04-26T12:30:14.491754+0000","last_became_peered":"2024-04-26T12:30:14.491754+0000","last_unstale":"2024-04-26T12:33:47.355150+0000","last_undegraded":"2024-04-26T12:33:47.355150+0000","last_fullsized":"2024-04-26T12:33:47.355150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:47.355025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.355025+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:37.323218+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.293799+0000","last_change":"2024-04-26T12:33:44.293799+0000","last_active":"2024-04-26T12:33:44.293799+0000","last_peered":"2024-04-26T12:33:44.293799+0000","last_clean":"2024-04-26T12:33:44.293799+0000","last_became_active":"2024-04-26T12:30:16.508848+0000","last_became_peered":"2024-04-26T12:30:16.508848+0000","last_unstale":"2024-04-26T12:33:44.293799+0000","last_undegraded":"2024-04-26T12:33:44.293799+0000","last_fullsized":"2024-04-26T12:33:44.293799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-04-26T12:33:44.293656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.293656+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:52.328074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.614615+0000","last_change":"2024-04-26T12:33:56.614615+0000","last_active":"2024-04-26T12:33:56.614615+0000","last_peered":"2024-04-26T12:33:56.614615+0000","last_clean":"2024-04-26T12:33:56.614615+0000","last_became_active":"2024-04-26T12:30:18.526003+0000","last_became_peered":"2024-04-26T12:30:18.526003+0000","last_unstale":"2024-04-26T12:33:56.614615+0000","last_undegraded":"2024-04-26T12:33:56.614615+0000","last_fullsized":"2024-04-26T12:33:56.614615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.614468+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.614468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:09.789955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.649526+0000","last_change":"2024-04-26T12:34:23.649526+0000","last_active":"2024-04-26T12:34:23.649526+0000","last_peered":"2024-04-26T12:34:23.649526+0000","last_clean":"2024-04-26T12:34:23.649526+0000","last_became_active":"2024-04-26T12:30:20.531154+0000","last_became_peered":"2024-04-26T12:30:20.531154+0000","last_unstale":"2024-04-26T12:34:23.649526+0000","last_undegraded":"2024-04-26T12:34:23.649526+0000","last_fullsized":"2024-04-26T12:34:23.649526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:23.649405+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:23.649405+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.649405+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:28.507228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.522505+0000","last_change":"2024-04-26T12:34:12.522505+0000","last_active":"2024-04-26T12:34:12.522505+0000","last_peered":"2024-04-26T12:34:12.522505+0000","last_clean":"2024-04-26T12:34:12.522505+0000","last_became_active":"2024-04-26T12:30:12.488906+0000","last_became_peered":"2024-04-26T12:30:12.488906+0000","last_unstale":"2024-04-26T12:34:12.522505+0000","last_undegraded":"2024-04-26T12:34:12.522505+0000","last_fullsized":"2024-04-26T12:34:12.522505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.522395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.522395+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.522395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:17.335789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:44.629299+0000","last_change":"2024-04-26T12:34:44.629325+0000","last_active":"2024-04-26T12:34:44.629299+0000","last_peered":"2024-04-26T12:34:44.629299+0000","last_clean":"2024-04-26T12:34:44.629299+0000","last_became_active":"2024-04-26T12:30:01.440784+0000","last_became_peered":"2024-04-26T12:30:01.440784+0000","last_unstale":"2024-04-26T12:34:44.629299+0000","last_undegraded":"2024-04-26T12:34:44.629299+0000","last_fullsized":"2024-04-26T12:34:44.629299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:44.629185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:44.629185+0000","last_clean_scrub_stamp":"2024-04-26T12:34:44.629185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.514503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.191902+0000","last_change":"2024-04-26T12:34:13.191902+0000","last_active":"2024-04-26T12:34:13.191902+0000","last_peered":"2024-04-26T12:34:13.191902+0000","last_clean":"2024-04-26T12:34:13.191902+0000","last_became_active":"2024-04-26T12:30:10.500176+0000","last_became_peered":"2024-04-26T12:30:10.500176+0000","last_unstale":"2024-04-26T12:34:13.191902+0000","last_undegraded":"2024-04-26T12:34:13.191902+0000","last_fullsized":"2024-04-26T12:34:13.191902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:13.191778+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:13.191778+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.191778+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:23.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.628392+0000","last_change":"2024-04-26T12:33:54.628392+0000","last_active":"2024-04-26T12:33:54.628392+0000","last_peered":"2024-04-26T12:33:54.628392+0000","last_clean":"2024-04-26T12:33:54.628392+0000","last_became_active":"2024-04-26T12:30:14.487150+0000","last_became_peered":"2024-04-26T12:30:14.487150+0000","last_unstale":"2024-04-26T12:33:54.628392+0000","last_undegraded":"2024-04-26T12:33:54.628392+0000","last_fullsized":"2024-04-26T12:33:54.628392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.628252+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.628252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:07.053904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.999880+0000","last_change":"2024-04-26T12:33:47.999880+0000","last_active":"2024-04-26T12:33:47.999880+0000","last_peered":"2024-04-26T12:33:47.999880+0000","last_clean":"2024-04-26T12:33:47.999880+0000","last_became_active":"2024-04-26T12:30:16.516511+0000","last_became_peered":"2024-04-26T12:30:16.516511+0000","last_unstale":"2024-04-26T12:33:47.999880+0000","last_undegraded":"2024-04-26T12:33:47.999880+0000","last_fullsized":"2024-04-26T12:33:47.999880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-04-26T12:33:47.999755+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.999755+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:40.140297+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.813237+0000","last_change":"2024-04-26T12:33:55.813237+0000","last_active":"2024-04-26T12:33:55.813237+0000","last_peered":"2024-04-26T12:33:55.813237+0000","last_clean":"2024-04-26T12:33:55.813237+0000","last_became_active":"2024-04-26T12:30:18.528702+0000","last_became_peered":"2024-04-26T12:30:18.528702+0000","last_unstale":"2024-04-26T12:33:55.813237+0000","last_undegraded":"2024-04-26T12:33:55.813237+0000","last_fullsized":"2024-04-26T12:33:55.813237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.813058+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.813058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:32.755533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:30.861292+0000","last_change":"2024-04-26T12:34:30.861292+0000","last_active":"2024-04-26T12:34:30.861292+0000","last_peered":"2024-04-26T12:34:30.861292+0000","last_clean":"2024-04-26T12:34:30.861292+0000","last_became_active":"2024-04-26T12:30:20.535065+0000","last_became_peered":"2024-04-26T12:30:20.535065+0000","last_unstale":"2024-04-26T12:34:30.861292+0000","last_undegraded":"2024-04-26T12:34:30.861292+0000","last_fullsized":"2024-04-26T12:34:30.861292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:30.861136+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:30.861136+0000","last_clean_scrub_stamp":"2024-04-26T12:34:30.861136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:37.466567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.819534+0000","last_change":"2024-04-26T12:34:03.819534+0000","last_active":"2024-04-26T12:34:03.819534+0000","last_peered":"2024-04-26T12:34:03.819534+0000","last_clean":"2024-04-26T12:34:03.819534+0000","last_became_active":"2024-04-26T12:30:12.493485+0000","last_became_peered":"2024-04-26T12:30:12.493485+0000","last_unstale":"2024-04-26T12:34:03.819534+0000","last_undegraded":"2024-04-26T12:34:03.819534+0000","last_fullsized":"2024-04-26T12:34:03.819534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:03.819412+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.819412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:28.268336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.192622+0000","last_change":"2024-04-26T12:34:17.192622+0000","last_active":"2024-04-26T12:34:17.192622+0000","last_peered":"2024-04-26T12:34:17.192622+0000","last_clean":"2024-04-26T12:34:17.192622+0000","last_became_active":"2024-04-26T12:30:10.501314+0000","last_became_peered":"2024-04-26T12:30:10.501314+0000","last_unstale":"2024-04-26T12:34:17.192622+0000","last_undegraded":"2024-04-26T12:34:17.192622+0000","last_fullsized":"2024-04-26T12:34:17.192622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:17.192508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:17.192508+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.192508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.601445+0000","last_change":"2024-04-26T12:34:19.601474+0000","last_active":"2024-04-26T12:34:19.601445+0000","last_peered":"2024-04-26T12:34:19.601445+0000","last_clean":"2024-04-26T12:34:19.601445+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:34:19.601445+0000","last_undegraded":"2024-04-26T12:34:19.601445+0000","last_fullsized":"2024-04-26T12:34:19.601445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:19.601341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:19.601341+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.601341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:40.439925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.586839+0000","last_change":"2024-04-26T12:33:53.586839+0000","last_active":"2024-04-26T12:33:53.586839+0000","last_peered":"2024-04-26T12:33:53.586839+0000","last_clean":"2024-04-26T12:33:53.586839+0000","last_became_active":"2024-04-26T12:30:14.490186+0000","last_became_peered":"2024-04-26T12:30:14.490186+0000","last_unstale":"2024-04-26T12:33:53.586839+0000","last_undegraded":"2024-04-26T12:33:53.586839+0000","last_fullsized":"2024-04-26T12:33:53.586839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:53.586700+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.586700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:09.928615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:39.434204+0000","last_change":"2024-04-26T12:33:39.434204+0000","last_active":"2024-04-26T12:33:39.434204+0000","last_peered":"2024-04-26T12:33:39.434204+0000","last_clean":"2024-04-26T12:33:39.434204+0000","last_became_active":"2024-04-26T12:30:16.515840+0000","last_became_peered":"2024-04-26T12:30:16.515840+0000","last_unstale":"2024-04-26T12:33:39.434204+0000","last_undegraded":"2024-04-26T12:33:39.434204+0000","last_fullsized":"2024-04-26T12:33:39.434204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-04-26T12:33:39.434024+0000","last_clean_scrub_stamp":"2024-04-26T12:33:39.434024+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:15.521556+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.280612+0000","last_change":"2024-04-26T12:33:32.280612+0000","last_active":"2024-04-26T12:33:32.280612+0000","last_peered":"2024-04-26T12:33:32.280612+0000","last_clean":"2024-04-26T12:33:32.280612+0000","last_became_active":"2024-04-26T12:30:18.523173+0000","last_became_peered":"2024-04-26T12:30:18.523173+0000","last_unstale":"2024-04-26T12:33:32.280612+0000","last_undegraded":"2024-04-26T12:33:32.280612+0000","last_fullsized":"2024-04-26T12:33:32.280612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.280461+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.280461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:13.869333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:30.487676+0000","last_change":"2024-04-26T12:34:30.487676+0000","last_active":"2024-04-26T12:34:30.487676+0000","last_peered":"2024-04-26T12:34:30.487676+0000","last_clean":"2024-04-26T12:34:30.487676+0000","last_became_active":"2024-04-26T12:30:20.526945+0000","last_became_peered":"2024-04-26T12:30:20.526945+0000","last_unstale":"2024-04-26T12:34:30.487676+0000","last_undegraded":"2024-04-26T12:34:30.487676+0000","last_fullsized":"2024-04-26T12:34:30.487676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:34:30.487521+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:34:30.487521+0000","last_clean_scrub_stamp":"2024-04-26T12:34:30.487521+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:26.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'10","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.773240+0000","last_change":"2024-04-26T12:34:02.773240+0000","last_active":"2024-04-26T12:34:02.773240+0000","last_peered":"2024-04-26T12:34:02.773240+0000","last_clean":"2024-04-26T12:34:02.773240+0000","last_became_active":"2024-04-26T12:30:12.492031+0000","last_became_peered":"2024-04-26T12:30:12.492031+0000","last_unstale":"2024-04-26T12:34:02.773240+0000","last_undegraded":"2024-04-26T12:34:02.773240+0000","last_fullsized":"2024-04-26T12:34:02.773240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.773121+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.773121+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:07.596283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.485557+0000","last_change":"2024-04-26T12:34:11.485557+0000","last_active":"2024-04-26T12:34:11.485557+0000","last_peered":"2024-04-26T12:34:11.485557+0000","last_clean":"2024-04-26T12:34:11.485557+0000","last_became_active":"2024-04-26T12:30:10.498735+0000","last_became_peered":"2024-04-26T12:30:10.498735+0000","last_unstale":"2024-04-26T12:34:11.485557+0000","last_undegraded":"2024-04-26T12:34:11.485557+0000","last_fullsized":"2024-04-26T12:34:11.485557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:11.485429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:11.485429+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.485429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:39.753319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:43.670131+0000","last_change":"2024-04-26T12:34:43.670157+0000","last_active":"2024-04-26T12:34:43.670131+0000","last_peered":"2024-04-26T12:34:43.670131+0000","last_clean":"2024-04-26T12:34:43.670131+0000","last_became_active":"2024-04-26T12:30:01.440315+0000","last_became_peered":"2024-04-26T12:30:01.440315+0000","last_unstale":"2024-04-26T12:34:43.670131+0000","last_undegraded":"2024-04-26T12:34:43.670131+0000","last_fullsized":"2024-04-26T12:34:43.670131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:43.670001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:43.670001+0000","last_clean_scrub_stamp":"2024-04-26T12:34:43.670001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:27.803083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:56.524151+0000","last_change":"2024-04-26T12:34:56.524212+0000","last_active":"2024-04-26T12:34:56.524151+0000","last_peered":"2024-04-26T12:34:56.524151+0000","last_clean":"2024-04-26T12:34:56.524151+0000","last_became_active":"2024-04-26T12:30:49.551977+0000","last_became_peered":"2024-04-26T12:30:49.551977+0000","last_unstale":"2024-04-26T12:34:56.524151+0000","last_undegraded":"2024-04-26T12:34:56.524151+0000","last_fullsized":"2024-04-26T12:34:56.524151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:56.524048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:56.524048+0000","last_clean_scrub_stamp":"2024-04-26T12:34:56.524048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:29.792630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.971703+0000","last_change":"2024-04-26T12:33:33.971703+0000","last_active":"2024-04-26T12:33:33.971703+0000","last_peered":"2024-04-26T12:33:33.971703+0000","last_clean":"2024-04-26T12:33:33.971703+0000","last_became_active":"2024-04-26T12:30:16.519450+0000","last_became_peered":"2024-04-26T12:30:16.519450+0000","last_unstale":"2024-04-26T12:33:33.971703+0000","last_undegraded":"2024-04-26T12:33:33.971703+0000","last_fullsized":"2024-04-26T12:33:33.971703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-04-26T12:33:33.971556+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.971556+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:47.263739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.935865+0000","last_change":"2024-04-26T12:33:35.935865+0000","last_active":"2024-04-26T12:33:35.935865+0000","last_peered":"2024-04-26T12:33:35.935865+0000","last_clean":"2024-04-26T12:33:35.935865+0000","last_became_active":"2024-04-26T12:30:18.522046+0000","last_became_peered":"2024-04-26T12:30:18.522046+0000","last_unstale":"2024-04-26T12:33:35.935865+0000","last_undegraded":"2024-04-26T12:33:35.935865+0000","last_fullsized":"2024-04-26T12:33:35.935865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.935727+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.935727+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:01.443130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.689247+0000","last_change":"2024-04-26T12:34:19.689247+0000","last_active":"2024-04-26T12:34:19.689247+0000","last_peered":"2024-04-26T12:34:19.689247+0000","last_clean":"2024-04-26T12:34:19.689247+0000","last_became_active":"2024-04-26T12:30:20.529924+0000","last_became_peered":"2024-04-26T12:30:20.529924+0000","last_unstale":"2024-04-26T12:34:19.689247+0000","last_undegraded":"2024-04-26T12:34:19.689247+0000","last_fullsized":"2024-04-26T12:34:19.689247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:19.689111+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:19.689111+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.689111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:08.076312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.853067+0000","last_change":"2024-04-26T12:33:52.853067+0000","last_active":"2024-04-26T12:33:52.853067+0000","last_peered":"2024-04-26T12:33:52.853067+0000","last_clean":"2024-04-26T12:33:52.853067+0000","last_became_active":"2024-04-26T12:30:12.496493+0000","last_became_peered":"2024-04-26T12:30:12.496493+0000","last_unstale":"2024-04-26T12:33:52.853067+0000","last_undegraded":"2024-04-26T12:33:52.853067+0000","last_fullsized":"2024-04-26T12:33:52.853067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:52.852918+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.852918+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:03.508340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:38.604003+0000","last_change":"2024-04-26T12:34:38.604027+0000","last_active":"2024-04-26T12:34:38.604003+0000","last_peered":"2024-04-26T12:34:38.604003+0000","last_clean":"2024-04-26T12:34:38.604003+0000","last_became_active":"2024-04-26T12:30:10.513104+0000","last_became_peered":"2024-04-26T12:30:10.513104+0000","last_unstale":"2024-04-26T12:34:38.604003+0000","last_undegraded":"2024-04-26T12:34:38.604003+0000","last_fullsized":"2024-04-26T12:34:38.604003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:38.603902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:38.603902+0000","last_clean_scrub_stamp":"2024-04-26T12:34:38.603902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:22.180798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.575719+0000","last_change":"2024-04-26T12:34:18.575719+0000","last_active":"2024-04-26T12:34:18.575719+0000","last_peered":"2024-04-26T12:34:18.575719+0000","last_clean":"2024-04-26T12:34:18.575719+0000","last_became_active":"2024-04-26T12:30:01.439733+0000","last_became_peered":"2024-04-26T12:30:01.439733+0000","last_unstale":"2024-04-26T12:34:18.575719+0000","last_undegraded":"2024-04-26T12:34:18.575719+0000","last_fullsized":"2024-04-26T12:34:18.575719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:18.575593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:18.575593+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.575593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:14.196858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.984631+0000","last_change":"2024-04-26T12:33:36.984631+0000","last_active":"2024-04-26T12:33:36.984631+0000","last_peered":"2024-04-26T12:33:36.984631+0000","last_clean":"2024-04-26T12:33:36.984631+0000","last_became_active":"2024-04-26T12:30:14.490712+0000","last_became_peered":"2024-04-26T12:30:14.490712+0000","last_unstale":"2024-04-26T12:33:36.984631+0000","last_undegraded":"2024-04-26T12:33:36.984631+0000","last_fullsized":"2024-04-26T12:33:36.984631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:36.984515+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.984515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:56.690151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'17","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.768960+0000","last_change":"2024-04-26T12:34:01.768960+0000","last_active":"2024-04-26T12:34:01.768960+0000","last_peered":"2024-04-26T12:34:01.768960+0000","last_clean":"2024-04-26T12:34:01.768960+0000","last_became_active":"2024-04-26T12:30:16.517195+0000","last_became_peered":"2024-04-26T12:30:16.517195+0000","last_unstale":"2024-04-26T12:34:01.768960+0000","last_undegraded":"2024-04-26T12:34:01.768960+0000","last_fullsized":"2024-04-26T12:34:01.768960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-04-26T12:34:01.768788+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.768788+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:00.147323+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":430,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.416673+0000","last_change":"2024-04-26T12:33:35.416673+0000","last_active":"2024-04-26T12:33:35.416673+0000","last_peered":"2024-04-26T12:33:35.416673+0000","last_clean":"2024-04-26T12:33:35.416673+0000","last_became_active":"2024-04-26T12:30:18.513269+0000","last_became_peered":"2024-04-26T12:30:18.513269+0000","last_unstale":"2024-04-26T12:33:35.416673+0000","last_undegraded":"2024-04-26T12:33:35.416673+0000","last_fullsized":"2024-04-26T12:33:35.416673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:35.416545+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.416545+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:08.560676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:28.845900+0000","last_change":"2024-04-26T12:34:28.845900+0000","last_active":"2024-04-26T12:34:28.845900+0000","last_peered":"2024-04-26T12:34:28.845900+0000","last_clean":"2024-04-26T12:34:28.845900+0000","last_became_active":"2024-04-26T12:30:20.532629+0000","last_became_peered":"2024-04-26T12:30:20.532629+0000","last_unstale":"2024-04-26T12:34:28.845900+0000","last_undegraded":"2024-04-26T12:34:28.845900+0000","last_fullsized":"2024-04-26T12:34:28.845900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-26T12:34:28.845756+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-26T12:34:28.845756+0000","last_clean_scrub_stamp":"2024-04-26T12:34:28.845756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:18.430400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.357489+0000","last_change":"2024-04-26T12:33:55.357489+0000","last_active":"2024-04-26T12:33:55.357489+0000","last_peered":"2024-04-26T12:33:55.357489+0000","last_clean":"2024-04-26T12:33:55.357489+0000","last_became_active":"2024-04-26T12:30:12.481444+0000","last_became_peered":"2024-04-26T12:30:12.481444+0000","last_unstale":"2024-04-26T12:33:55.357489+0000","last_undegraded":"2024-04-26T12:33:55.357489+0000","last_fullsized":"2024-04-26T12:33:55.357489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:33:55.357374+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.357374+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:33.932712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:19.857960+0000","last_change":"2024-04-26T12:34:19.857960+0000","last_active":"2024-04-26T12:34:19.857960+0000","last_peered":"2024-04-26T12:34:19.857960+0000","last_clean":"2024-04-26T12:34:19.857960+0000","last_became_active":"2024-04-26T12:30:10.506696+0000","last_became_peered":"2024-04-26T12:30:10.506696+0000","last_unstale":"2024-04-26T12:34:19.857960+0000","last_undegraded":"2024-04-26T12:34:19.857960+0000","last_fullsized":"2024-04-26T12:34:19.857960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:19.857792+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:19.857792+0000","last_clean_scrub_stamp":"2024-04-26T12:34:19.857792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:40.166269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:45.587004+0000","last_change":"2024-04-26T12:34:45.587031+0000","last_active":"2024-04-26T12:34:45.587004+0000","last_peered":"2024-04-26T12:34:45.587004+0000","last_clean":"2024-04-26T12:34:45.587004+0000","last_became_active":"2024-04-26T12:30:01.460344+0000","last_became_peered":"2024-04-26T12:30:01.460344+0000","last_unstale":"2024-04-26T12:34:45.587004+0000","last_undegraded":"2024-04-26T12:34:45.587004+0000","last_fullsized":"2024-04-26T12:34:45.587004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:45.586908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:45.586908+0000","last_clean_scrub_stamp":"2024-04-26T12:34:45.586908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:53.652060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.054401+0000","last_change":"2024-04-26T12:33:42.054401+0000","last_active":"2024-04-26T12:33:42.054401+0000","last_peered":"2024-04-26T12:33:42.054401+0000","last_clean":"2024-04-26T12:33:42.054401+0000","last_became_active":"2024-04-26T12:30:14.490677+0000","last_became_peered":"2024-04-26T12:30:14.490677+0000","last_unstale":"2024-04-26T12:33:42.054401+0000","last_undegraded":"2024-04-26T12:33:42.054401+0000","last_fullsized":"2024-04-26T12:33:42.054401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.054238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.054238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:08.095979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'98","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:36.374652+0000","last_change":"2024-04-26T12:33:36.374652+0000","last_active":"2024-04-26T12:33:36.374652+0000","last_peered":"2024-04-26T12:33:36.374652+0000","last_clean":"2024-04-26T12:33:36.374652+0000","last_became_active":"2024-04-26T12:30:16.517886+0000","last_became_peered":"2024-04-26T12:30:16.517886+0000","last_unstale":"2024-04-26T12:33:36.374652+0000","last_undegraded":"2024-04-26T12:33:36.374652+0000","last_fullsized":"2024-04-26T12:33:36.374652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'98","last_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_deep_scrub":"32'98","last_deep_scrub_stamp":"2024-04-26T12:33:36.374477+0000","last_clean_scrub_stamp":"2024-04-26T12:33:36.374477+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:44.404332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":99,"num_read_kb":103,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:31.509119+0000","last_change":"2024-04-26T12:33:31.509119+0000","last_active":"2024-04-26T12:33:31.509119+0000","last_peered":"2024-04-26T12:33:31.509119+0000","last_clean":"2024-04-26T12:33:31.509119+0000","last_became_active":"2024-04-26T12:30:18.522137+0000","last_became_peered":"2024-04-26T12:30:18.522137+0000","last_unstale":"2024-04-26T12:33:31.509119+0000","last_undegraded":"2024-04-26T12:33:31.509119+0000","last_fullsized":"2024-04-26T12:33:31.509119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:31.509011+0000","last_clean_scrub_stamp":"2024-04-26T12:33:31.509011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:04.640988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.257762+0000","last_change":"2024-04-26T12:34:23.257762+0000","last_active":"2024-04-26T12:34:23.257762+0000","last_peered":"2024-04-26T12:34:23.257762+0000","last_clean":"2024-04-26T12:34:23.257762+0000","last_became_active":"2024-04-26T12:30:20.530003+0000","last_became_peered":"2024-04-26T12:30:20.530003+0000","last_unstale":"2024-04-26T12:34:23.257762+0000","last_undegraded":"2024-04-26T12:34:23.257762+0000","last_fullsized":"2024-04-26T12:34:23.257762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:23.257646+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:23.257646+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.257646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:46.316848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.271530+0000","last_change":"2024-04-26T12:34:20.271530+0000","last_active":"2024-04-26T12:34:20.271530+0000","last_peered":"2024-04-26T12:34:20.271530+0000","last_clean":"2024-04-26T12:34:20.271530+0000","last_became_active":"2024-04-26T12:30:20.527842+0000","last_became_peered":"2024-04-26T12:30:20.527842+0000","last_unstale":"2024-04-26T12:34:20.271530+0000","last_undegraded":"2024-04-26T12:34:20.271530+0000","last_fullsized":"2024-04-26T12:34:20.271530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:20.271416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:20.271416+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.271416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:04.907796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.308548+0000","last_change":"2024-04-26T12:33:56.308548+0000","last_active":"2024-04-26T12:33:56.308548+0000","last_peered":"2024-04-26T12:33:56.308548+0000","last_clean":"2024-04-26T12:33:56.308548+0000","last_became_active":"2024-04-26T12:30:12.480305+0000","last_became_peered":"2024-04-26T12:30:12.480305+0000","last_unstale":"2024-04-26T12:33:56.308548+0000","last_undegraded":"2024-04-26T12:33:56.308548+0000","last_fullsized":"2024-04-26T12:33:56.308548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:56.308437+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.308437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:57.522881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:31.524678+0000","last_change":"2024-04-26T12:34:31.524678+0000","last_active":"2024-04-26T12:34:31.524678+0000","last_peered":"2024-04-26T12:34:31.524678+0000","last_clean":"2024-04-26T12:34:31.524678+0000","last_became_active":"2024-04-26T12:30:10.521843+0000","last_became_peered":"2024-04-26T12:30:10.521843+0000","last_unstale":"2024-04-26T12:34:31.524678+0000","last_undegraded":"2024-04-26T12:34:31.524678+0000","last_fullsized":"2024-04-26T12:34:31.524678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:31.524548+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:31.524548+0000","last_clean_scrub_stamp":"2024-04-26T12:34:31.524548+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:56.326081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.934202+0000","last_change":"2024-04-26T12:33:44.934202+0000","last_active":"2024-04-26T12:33:44.934202+0000","last_peered":"2024-04-26T12:33:44.934202+0000","last_clean":"2024-04-26T12:33:44.934202+0000","last_became_active":"2024-04-26T12:30:14.492877+0000","last_became_peered":"2024-04-26T12:30:14.492877+0000","last_unstale":"2024-04-26T12:33:44.934202+0000","last_undegraded":"2024-04-26T12:33:44.934202+0000","last_fullsized":"2024-04-26T12:33:44.934202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:44.934050+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.934050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:59.400029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.816962+0000","last_change":"2024-04-26T12:33:57.816962+0000","last_active":"2024-04-26T12:33:57.816962+0000","last_peered":"2024-04-26T12:33:57.816962+0000","last_clean":"2024-04-26T12:33:57.816962+0000","last_became_active":"2024-04-26T12:30:16.517188+0000","last_became_peered":"2024-04-26T12:30:16.517188+0000","last_unstale":"2024-04-26T12:33:57.816962+0000","last_undegraded":"2024-04-26T12:33:57.816962+0000","last_fullsized":"2024-04-26T12:33:57.816962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:57.816840+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.816840+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:35.943755+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.746343+0000","last_change":"2024-04-26T12:33:59.746343+0000","last_active":"2024-04-26T12:33:59.746343+0000","last_peered":"2024-04-26T12:33:59.746343+0000","last_clean":"2024-04-26T12:33:59.746343+0000","last_became_active":"2024-04-26T12:30:18.529026+0000","last_became_peered":"2024-04-26T12:30:18.529026+0000","last_unstale":"2024-04-26T12:33:59.746343+0000","last_undegraded":"2024-04-26T12:33:59.746343+0000","last_fullsized":"2024-04-26T12:33:59.746343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:59.746239+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.746239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:32.070259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:31.466279+0000","last_change":"2024-04-26T12:34:31.466308+0000","last_active":"2024-04-26T12:34:31.466279+0000","last_peered":"2024-04-26T12:34:31.466279+0000","last_clean":"2024-04-26T12:34:31.466279+0000","last_became_active":"2024-04-26T12:30:20.528412+0000","last_became_peered":"2024-04-26T12:30:20.528412+0000","last_unstale":"2024-04-26T12:34:31.466279+0000","last_undegraded":"2024-04-26T12:34:31.466279+0000","last_fullsized":"2024-04-26T12:34:31.466279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:31.466182+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:31.466182+0000","last_clean_scrub_stamp":"2024-04-26T12:34:31.466182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:47.793244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'10","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:32.884941+0000","last_change":"2024-04-26T12:34:32.884941+0000","last_active":"2024-04-26T12:34:32.884941+0000","last_peered":"2024-04-26T12:34:32.884941+0000","last_clean":"2024-04-26T12:34:32.884941+0000","last_became_active":"2024-04-26T12:30:49.551710+0000","last_became_peered":"2024-04-26T12:30:49.551710+0000","last_unstale":"2024-04-26T12:34:32.884941+0000","last_undegraded":"2024-04-26T12:34:32.884941+0000","last_fullsized":"2024-04-26T12:34:32.884941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:32.884800+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:32.884800+0000","last_clean_scrub_stamp":"2024-04-26T12:34:32.884800+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:09.527739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.235976+0000","last_change":"2024-04-26T12:34:18.235976+0000","last_active":"2024-04-26T12:34:18.235976+0000","last_peered":"2024-04-26T12:34:18.235976+0000","last_clean":"2024-04-26T12:34:18.235976+0000","last_became_active":"2024-04-26T12:30:10.502257+0000","last_became_peered":"2024-04-26T12:30:10.502257+0000","last_unstale":"2024-04-26T12:34:18.235976+0000","last_undegraded":"2024-04-26T12:34:18.235976+0000","last_fullsized":"2024-04-26T12:34:18.235976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:18.235790+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:18.235790+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.235790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:13.405932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.035367+0000","last_change":"2024-04-26T12:33:41.035367+0000","last_active":"2024-04-26T12:33:41.035367+0000","last_peered":"2024-04-26T12:33:41.035367+0000","last_clean":"2024-04-26T12:33:41.035367+0000","last_became_active":"2024-04-26T12:30:14.491189+0000","last_became_peered":"2024-04-26T12:30:14.491189+0000","last_unstale":"2024-04-26T12:33:41.035367+0000","last_undegraded":"2024-04-26T12:33:41.035367+0000","last_fullsized":"2024-04-26T12:33:41.035367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:41.035219+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:28.509101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'9","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.437804+0000","last_change":"2024-04-26T12:33:45.437804+0000","last_active":"2024-04-26T12:33:45.437804+0000","last_peered":"2024-04-26T12:33:45.437804+0000","last_clean":"2024-04-26T12:33:45.437804+0000","last_became_active":"2024-04-26T12:30:16.504138+0000","last_became_peered":"2024-04-26T12:30:16.504138+0000","last_unstale":"2024-04-26T12:33:45.437804+0000","last_undegraded":"2024-04-26T12:33:45.437804+0000","last_fullsized":"2024-04-26T12:33:45.437804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-04-26T12:33:45.437634+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.437634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:24.012972+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.322319+0000","last_change":"2024-04-26T12:33:33.322319+0000","last_active":"2024-04-26T12:33:33.322319+0000","last_peered":"2024-04-26T12:33:33.322319+0000","last_clean":"2024-04-26T12:33:33.322319+0000","last_became_active":"2024-04-26T12:30:18.523364+0000","last_became_peered":"2024-04-26T12:30:18.523364+0000","last_unstale":"2024-04-26T12:33:33.322319+0000","last_undegraded":"2024-04-26T12:33:33.322319+0000","last_fullsized":"2024-04-26T12:33:33.322319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.322193+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.322193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:33.954765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:33.438371+0000","last_change":"2024-04-26T12:34:33.438396+0000","last_active":"2024-04-26T12:34:33.438371+0000","last_peered":"2024-04-26T12:34:33.438371+0000","last_clean":"2024-04-26T12:34:33.438371+0000","last_became_active":"2024-04-26T12:30:20.531292+0000","last_became_peered":"2024-04-26T12:30:20.531292+0000","last_unstale":"2024-04-26T12:34:33.438371+0000","last_undegraded":"2024-04-26T12:34:33.438371+0000","last_fullsized":"2024-04-26T12:34:33.438371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:33.438267+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:33.438267+0000","last_clean_scrub_stamp":"2024-04-26T12:34:33.438267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:43.307235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'20","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.600423+0000","last_change":"2024-04-26T12:34:04.600423+0000","last_active":"2024-04-26T12:34:04.600423+0000","last_peered":"2024-04-26T12:34:04.600423+0000","last_clean":"2024-04-26T12:34:04.600423+0000","last_became_active":"2024-04-26T12:30:12.481782+0000","last_became_peered":"2024-04-26T12:30:12.481782+0000","last_unstale":"2024-04-26T12:34:04.600423+0000","last_undegraded":"2024-04-26T12:34:04.600423+0000","last_fullsized":"2024-04-26T12:34:04.600423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-04-26T12:34:04.600237+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.600237+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:05.911708+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.200726+0000","last_change":"2024-04-26T12:34:12.200726+0000","last_active":"2024-04-26T12:34:12.200726+0000","last_peered":"2024-04-26T12:34:12.200726+0000","last_clean":"2024-04-26T12:34:12.200726+0000","last_became_active":"2024-04-26T12:30:10.493055+0000","last_became_peered":"2024-04-26T12:30:10.493055+0000","last_unstale":"2024-04-26T12:34:12.200726+0000","last_undegraded":"2024-04-26T12:34:12.200726+0000","last_fullsized":"2024-04-26T12:34:12.200726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.200570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.200570+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.200570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:36.158516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.384269+0000","last_change":"2024-04-26T12:33:50.384269+0000","last_active":"2024-04-26T12:33:50.384269+0000","last_peered":"2024-04-26T12:33:50.384269+0000","last_clean":"2024-04-26T12:33:50.384269+0000","last_became_active":"2024-04-26T12:30:14.489308+0000","last_became_peered":"2024-04-26T12:30:14.489308+0000","last_unstale":"2024-04-26T12:33:50.384269+0000","last_undegraded":"2024-04-26T12:33:50.384269+0000","last_fullsized":"2024-04-26T12:33:50.384269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.384133+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.384133+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:33.191713+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.463495+0000","last_change":"2024-04-26T12:33:43.463495+0000","last_active":"2024-04-26T12:33:43.463495+0000","last_peered":"2024-04-26T12:33:43.463495+0000","last_clean":"2024-04-26T12:33:43.463495+0000","last_became_active":"2024-04-26T12:30:16.506836+0000","last_became_peered":"2024-04-26T12:30:16.506836+0000","last_unstale":"2024-04-26T12:33:43.463495+0000","last_undegraded":"2024-04-26T12:33:43.463495+0000","last_fullsized":"2024-04-26T12:33:43.463495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-04-26T12:33:43.463348+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.463348+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:24.510661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:32.045522+0000","last_change":"2024-04-26T12:33:32.045522+0000","last_active":"2024-04-26T12:33:32.045522+0000","last_peered":"2024-04-26T12:33:32.045522+0000","last_clean":"2024-04-26T12:33:32.045522+0000","last_became_active":"2024-04-26T12:30:18.520598+0000","last_became_peered":"2024-04-26T12:30:18.520598+0000","last_unstale":"2024-04-26T12:33:32.045522+0000","last_undegraded":"2024-04-26T12:33:32.045522+0000","last_fullsized":"2024-04-26T12:33:32.045522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:32.045363+0000","last_clean_scrub_stamp":"2024-04-26T12:33:32.045363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:44.273391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.633676+0000","last_change":"2024-04-26T12:34:15.633701+0000","last_active":"2024-04-26T12:34:15.633676+0000","last_peered":"2024-04-26T12:34:15.633676+0000","last_clean":"2024-04-26T12:34:15.633676+0000","last_became_active":"2024-04-26T12:30:20.524582+0000","last_became_peered":"2024-04-26T12:30:20.524582+0000","last_unstale":"2024-04-26T12:34:15.633676+0000","last_undegraded":"2024-04-26T12:34:15.633676+0000","last_fullsized":"2024-04-26T12:34:15.633676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:15.633579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:15.633579+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.633579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:51.038174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.070862+0000","last_change":"2024-04-26T12:33:45.070862+0000","last_active":"2024-04-26T12:33:45.070862+0000","last_peered":"2024-04-26T12:33:45.070862+0000","last_clean":"2024-04-26T12:33:45.070862+0000","last_became_active":"2024-04-26T12:30:12.501959+0000","last_became_peered":"2024-04-26T12:30:12.501959+0000","last_unstale":"2024-04-26T12:33:45.070862+0000","last_undegraded":"2024-04-26T12:33:45.070862+0000","last_fullsized":"2024-04-26T12:33:45.070862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:45.070739+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.070739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:40.944238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.918879+0000","last_change":"2024-04-26T12:34:16.918879+0000","last_active":"2024-04-26T12:34:16.918879+0000","last_peered":"2024-04-26T12:34:16.918879+0000","last_clean":"2024-04-26T12:34:16.918879+0000","last_became_active":"2024-04-26T12:30:10.513099+0000","last_became_peered":"2024-04-26T12:30:10.513099+0000","last_unstale":"2024-04-26T12:34:16.918879+0000","last_undegraded":"2024-04-26T12:34:16.918879+0000","last_fullsized":"2024-04-26T12:34:16.918879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:16.918745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:16.918745+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.918745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:53.861220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.064299+0000","last_change":"2024-04-26T12:33:43.064299+0000","last_active":"2024-04-26T12:33:43.064299+0000","last_peered":"2024-04-26T12:33:43.064299+0000","last_clean":"2024-04-26T12:33:43.064299+0000","last_became_active":"2024-04-26T12:30:14.489701+0000","last_became_peered":"2024-04-26T12:30:14.489701+0000","last_unstale":"2024-04-26T12:33:43.064299+0000","last_undegraded":"2024-04-26T12:33:43.064299+0000","last_fullsized":"2024-04-26T12:33:43.064299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.064153+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.064153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:56.367388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.353487+0000","last_change":"2024-04-26T12:33:42.353487+0000","last_active":"2024-04-26T12:33:42.353487+0000","last_peered":"2024-04-26T12:33:42.353487+0000","last_clean":"2024-04-26T12:33:42.353487+0000","last_became_active":"2024-04-26T12:30:16.510194+0000","last_became_peered":"2024-04-26T12:30:16.510194+0000","last_unstale":"2024-04-26T12:33:42.353487+0000","last_undegraded":"2024-04-26T12:33:42.353487+0000","last_fullsized":"2024-04-26T12:33:42.353487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:42.353371+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.353371+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:27.302471+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.359140+0000","last_change":"2024-04-26T12:33:35.359140+0000","last_active":"2024-04-26T12:33:35.359140+0000","last_peered":"2024-04-26T12:33:35.359140+0000","last_clean":"2024-04-26T12:33:35.359140+0000","last_became_active":"2024-04-26T12:30:18.515652+0000","last_became_peered":"2024-04-26T12:30:18.515652+0000","last_unstale":"2024-04-26T12:33:35.359140+0000","last_undegraded":"2024-04-26T12:33:35.359140+0000","last_fullsized":"2024-04-26T12:33:35.359140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:35.359023+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.359023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:00.812046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.656432+0000","last_change":"2024-04-26T12:34:13.656432+0000","last_active":"2024-04-26T12:34:13.656432+0000","last_peered":"2024-04-26T12:34:13.656432+0000","last_clean":"2024-04-26T12:34:13.656432+0000","last_became_active":"2024-04-26T12:30:12.489802+0000","last_became_peered":"2024-04-26T12:30:12.489802+0000","last_unstale":"2024-04-26T12:34:13.656432+0000","last_undegraded":"2024-04-26T12:34:13.656432+0000","last_fullsized":"2024-04-26T12:34:13.656432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:13.656317+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:13.656317+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.656317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:26:18.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.581540+0000","last_change":"2024-04-26T12:34:25.581540+0000","last_active":"2024-04-26T12:34:25.581540+0000","last_peered":"2024-04-26T12:34:25.581540+0000","last_clean":"2024-04-26T12:34:25.581540+0000","last_became_active":"2024-04-26T12:30:10.520491+0000","last_became_peered":"2024-04-26T12:30:10.520491+0000","last_unstale":"2024-04-26T12:34:25.581540+0000","last_undegraded":"2024-04-26T12:34:25.581540+0000","last_fullsized":"2024-04-26T12:34:25.581540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:25.581430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:25.581430+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.581430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:39.147174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:55.643280+0000","last_change":"2024-04-26T12:33:55.643280+0000","last_active":"2024-04-26T12:33:55.643280+0000","last_peered":"2024-04-26T12:33:55.643280+0000","last_clean":"2024-04-26T12:33:55.643280+0000","last_became_active":"2024-04-26T12:30:14.487190+0000","last_became_peered":"2024-04-26T12:30:14.487190+0000","last_unstale":"2024-04-26T12:33:55.643280+0000","last_undegraded":"2024-04-26T12:33:55.643280+0000","last_fullsized":"2024-04-26T12:33:55.643280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:55.643144+0000","last_clean_scrub_stamp":"2024-04-26T12:33:55.643144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:22.649463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.501845+0000","last_change":"2024-04-26T12:33:42.501879+0000","last_active":"2024-04-26T12:33:42.501845+0000","last_peered":"2024-04-26T12:33:42.501845+0000","last_clean":"2024-04-26T12:33:42.501845+0000","last_became_active":"2024-04-26T12:30:16.510188+0000","last_became_peered":"2024-04-26T12:30:16.510188+0000","last_unstale":"2024-04-26T12:33:42.501845+0000","last_undegraded":"2024-04-26T12:33:42.501845+0000","last_fullsized":"2024-04-26T12:33:42.501845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-04-26T12:33:42.501766+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.501766+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:10.173839+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:34.366864+0000","last_change":"2024-04-26T12:33:34.366886+0000","last_active":"2024-04-26T12:33:34.366864+0000","last_peered":"2024-04-26T12:33:34.366864+0000","last_clean":"2024-04-26T12:33:34.366864+0000","last_became_active":"2024-04-26T12:30:18.517177+0000","last_became_peered":"2024-04-26T12:30:18.517177+0000","last_unstale":"2024-04-26T12:33:34.366864+0000","last_undegraded":"2024-04-26T12:33:34.366864+0000","last_fullsized":"2024-04-26T12:33:34.366864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:34.366757+0000","last_clean_scrub_stamp":"2024-04-26T12:33:34.366757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:47.058265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:29.448073+0000","last_change":"2024-04-26T12:34:29.448073+0000","last_active":"2024-04-26T12:34:29.448073+0000","last_peered":"2024-04-26T12:34:29.448073+0000","last_clean":"2024-04-26T12:34:29.448073+0000","last_became_active":"2024-04-26T12:30:20.523549+0000","last_became_peered":"2024-04-26T12:30:20.523549+0000","last_unstale":"2024-04-26T12:34:29.448073+0000","last_undegraded":"2024-04-26T12:34:29.448073+0000","last_fullsized":"2024-04-26T12:34:29.448073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-26T12:34:29.447945+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-26T12:34:29.447945+0000","last_clean_scrub_stamp":"2024-04-26T12:34:29.447945+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.738465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.626796+0000","last_change":"2024-04-26T12:34:01.626796+0000","last_active":"2024-04-26T12:34:01.626796+0000","last_peered":"2024-04-26T12:34:01.626796+0000","last_clean":"2024-04-26T12:34:01.626796+0000","last_became_active":"2024-04-26T12:30:12.495877+0000","last_became_peered":"2024-04-26T12:30:12.495877+0000","last_unstale":"2024-04-26T12:34:01.626796+0000","last_undegraded":"2024-04-26T12:34:01.626796+0000","last_fullsized":"2024-04-26T12:34:01.626796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:01.626634+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.626634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:21.911777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:18.874958+0000","last_change":"2024-04-26T12:34:18.874958+0000","last_active":"2024-04-26T12:34:18.874958+0000","last_peered":"2024-04-26T12:34:18.874958+0000","last_clean":"2024-04-26T12:34:18.874958+0000","last_became_active":"2024-04-26T12:30:10.495294+0000","last_became_peered":"2024-04-26T12:30:10.495294+0000","last_unstale":"2024-04-26T12:34:18.874958+0000","last_undegraded":"2024-04-26T12:34:18.874958+0000","last_fullsized":"2024-04-26T12:34:18.874958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:18.874831+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:18.874831+0000","last_clean_scrub_stamp":"2024-04-26T12:34:18.874831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:57.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.385555+0000","last_change":"2024-04-26T12:33:48.385555+0000","last_active":"2024-04-26T12:33:48.385555+0000","last_peered":"2024-04-26T12:33:48.385555+0000","last_clean":"2024-04-26T12:33:48.385555+0000","last_became_active":"2024-04-26T12:30:14.491271+0000","last_became_peered":"2024-04-26T12:30:14.491271+0000","last_unstale":"2024-04-26T12:33:48.385555+0000","last_undegraded":"2024-04-26T12:33:48.385555+0000","last_fullsized":"2024-04-26T12:33:48.385555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.385445+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.385445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:38.984742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:35.993283+0000","last_change":"2024-04-26T12:33:35.993331+0000","last_active":"2024-04-26T12:33:35.993283+0000","last_peered":"2024-04-26T12:33:35.993283+0000","last_clean":"2024-04-26T12:33:35.993283+0000","last_became_active":"2024-04-26T12:30:16.513684+0000","last_became_peered":"2024-04-26T12:30:16.513684+0000","last_unstale":"2024-04-26T12:33:35.993283+0000","last_undegraded":"2024-04-26T12:33:35.993283+0000","last_fullsized":"2024-04-26T12:33:35.993283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:35.993196+0000","last_clean_scrub_stamp":"2024-04-26T12:33:35.993196+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:04.267797+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:43.950944+0000","last_change":"2024-04-26T12:33:43.950965+0000","last_active":"2024-04-26T12:33:43.950944+0000","last_peered":"2024-04-26T12:33:43.950944+0000","last_clean":"2024-04-26T12:33:43.950944+0000","last_became_active":"2024-04-26T12:30:18.527799+0000","last_became_peered":"2024-04-26T12:30:18.527799+0000","last_unstale":"2024-04-26T12:33:43.950944+0000","last_undegraded":"2024-04-26T12:33:43.950944+0000","last_fullsized":"2024-04-26T12:33:43.950944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:43.950850+0000","last_clean_scrub_stamp":"2024-04-26T12:33:43.950850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:41.030430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:50.510386+0000","last_change":"2024-04-26T12:34:50.510386+0000","last_active":"2024-04-26T12:34:50.510386+0000","last_peered":"2024-04-26T12:34:50.510386+0000","last_clean":"2024-04-26T12:34:50.510386+0000","last_became_active":"2024-04-26T12:30:20.531577+0000","last_became_peered":"2024-04-26T12:30:20.531577+0000","last_unstale":"2024-04-26T12:34:50.510386+0000","last_undegraded":"2024-04-26T12:34:50.510386+0000","last_fullsized":"2024-04-26T12:34:50.510386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:50.510252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:50.510252+0000","last_clean_scrub_stamp":"2024-04-26T12:34:50.510252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:51.893232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:47.015731+0000","last_change":"2024-04-26T12:33:47.015756+0000","last_active":"2024-04-26T12:33:47.015731+0000","last_peered":"2024-04-26T12:33:47.015731+0000","last_clean":"2024-04-26T12:33:47.015731+0000","last_became_active":"2024-04-26T12:30:12.500952+0000","last_became_peered":"2024-04-26T12:30:12.500952+0000","last_unstale":"2024-04-26T12:33:47.015731+0000","last_undegraded":"2024-04-26T12:33:47.015731+0000","last_fullsized":"2024-04-26T12:33:47.015731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:47.015630+0000","last_clean_scrub_stamp":"2024-04-26T12:33:47.015630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:22.957533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:23.867447+0000","last_change":"2024-04-26T12:34:23.867478+0000","last_active":"2024-04-26T12:34:23.867447+0000","last_peered":"2024-04-26T12:34:23.867447+0000","last_clean":"2024-04-26T12:34:23.867447+0000","last_became_active":"2024-04-26T12:30:10.511056+0000","last_became_peered":"2024-04-26T12:30:10.511056+0000","last_unstale":"2024-04-26T12:34:23.867447+0000","last_undegraded":"2024-04-26T12:34:23.867447+0000","last_fullsized":"2024-04-26T12:34:23.867447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:23.867357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:23.867357+0000","last_clean_scrub_stamp":"2024-04-26T12:34:23.867357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:20.060861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:46.310817+0000","last_change":"2024-04-26T12:33:46.310845+0000","last_active":"2024-04-26T12:33:46.310817+0000","last_peered":"2024-04-26T12:33:46.310817+0000","last_clean":"2024-04-26T12:33:46.310817+0000","last_became_active":"2024-04-26T12:30:14.491694+0000","last_became_peered":"2024-04-26T12:30:14.491694+0000","last_unstale":"2024-04-26T12:33:46.310817+0000","last_undegraded":"2024-04-26T12:33:46.310817+0000","last_fullsized":"2024-04-26T12:33:46.310817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:46.310718+0000","last_clean_scrub_stamp":"2024-04-26T12:33:46.310718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:07.825719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:41.467898+0000","last_change":"2024-04-26T12:33:41.467898+0000","last_active":"2024-04-26T12:33:41.467898+0000","last_peered":"2024-04-26T12:33:41.467898+0000","last_clean":"2024-04-26T12:33:41.467898+0000","last_became_active":"2024-04-26T12:30:16.515600+0000","last_became_peered":"2024-04-26T12:30:16.515600+0000","last_unstale":"2024-04-26T12:33:41.467898+0000","last_undegraded":"2024-04-26T12:33:41.467898+0000","last_fullsized":"2024-04-26T12:33:41.467898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:41.467768+0000","last_clean_scrub_stamp":"2024-04-26T12:33:41.467768+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:07.391342+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:33.445395+0000","last_change":"2024-04-26T12:33:33.445395+0000","last_active":"2024-04-26T12:33:33.445395+0000","last_peered":"2024-04-26T12:33:33.445395+0000","last_clean":"2024-04-26T12:33:33.445395+0000","last_became_active":"2024-04-26T12:30:18.517123+0000","last_became_peered":"2024-04-26T12:30:18.517123+0000","last_unstale":"2024-04-26T12:33:33.445395+0000","last_undegraded":"2024-04-26T12:33:33.445395+0000","last_fullsized":"2024-04-26T12:33:33.445395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:33.445277+0000","last_clean_scrub_stamp":"2024-04-26T12:33:33.445277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:52.337016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:52.566983+0000","last_change":"2024-04-26T12:34:52.566983+0000","last_active":"2024-04-26T12:34:52.566983+0000","last_peered":"2024-04-26T12:34:52.566983+0000","last_clean":"2024-04-26T12:34:52.566983+0000","last_became_active":"2024-04-26T12:30:20.532670+0000","last_became_peered":"2024-04-26T12:30:20.532670+0000","last_unstale":"2024-04-26T12:34:52.566983+0000","last_undegraded":"2024-04-26T12:34:52.566983+0000","last_fullsized":"2024-04-26T12:34:52.566983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:52.566831+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:52.566831+0000","last_clean_scrub_stamp":"2024-04-26T12:34:52.566831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:22.265174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:14.549850+0000","last_change":"2024-04-26T12:34:14.549876+0000","last_active":"2024-04-26T12:34:14.549850+0000","last_peered":"2024-04-26T12:34:14.549850+0000","last_clean":"2024-04-26T12:34:14.549850+0000","last_became_active":"2024-04-26T12:30:12.491160+0000","last_became_peered":"2024-04-26T12:30:12.491160+0000","last_unstale":"2024-04-26T12:34:14.549850+0000","last_undegraded":"2024-04-26T12:34:14.549850+0000","last_fullsized":"2024-04-26T12:34:14.549850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:14.549743+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:14.549743+0000","last_clean_scrub_stamp":"2024-04-26T12:34:14.549743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:37.608945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:29.542900+0000","last_change":"2024-04-26T12:34:29.542929+0000","last_active":"2024-04-26T12:34:29.542900+0000","last_peered":"2024-04-26T12:34:29.542900+0000","last_clean":"2024-04-26T12:34:29.542900+0000","last_became_active":"2024-04-26T12:30:10.518503+0000","last_became_peered":"2024-04-26T12:30:10.518503+0000","last_unstale":"2024-04-26T12:34:29.542900+0000","last_undegraded":"2024-04-26T12:34:29.542900+0000","last_fullsized":"2024-04-26T12:34:29.542900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:34:29.542794+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:34:29.542794+0000","last_clean_scrub_stamp":"2024-04-26T12:34:29.542794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:58.138873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:31.840068+0000","last_change":"2024-04-26T12:34:31.840091+0000","last_active":"2024-04-26T12:34:31.840068+0000","last_peered":"2024-04-26T12:34:31.840068+0000","last_clean":"2024-04-26T12:34:31.840068+0000","last_became_active":"2024-04-26T12:30:49.551185+0000","last_became_peered":"2024-04-26T12:30:49.551185+0000","last_unstale":"2024-04-26T12:34:31.840068+0000","last_undegraded":"2024-04-26T12:34:31.840068+0000","last_fullsized":"2024-04-26T12:34:31.840068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:31.839983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:31.839983+0000","last_clean_scrub_stamp":"2024-04-26T12:34:31.839983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:16.572329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.780643+0000","last_change":"2024-04-26T12:33:58.780643+0000","last_active":"2024-04-26T12:33:58.780643+0000","last_peered":"2024-04-26T12:33:58.780643+0000","last_clean":"2024-04-26T12:33:58.780643+0000","last_became_active":"2024-04-26T12:30:16.516800+0000","last_became_peered":"2024-04-26T12:30:16.516800+0000","last_unstale":"2024-04-26T12:33:58.780643+0000","last_undegraded":"2024-04-26T12:33:58.780643+0000","last_fullsized":"2024-04-26T12:33:58.780643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-04-26T12:33:58.780521+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.780521+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:19.088998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:45.307469+0000","last_change":"2024-04-26T12:33:45.307469+0000","last_active":"2024-04-26T12:33:45.307469+0000","last_peered":"2024-04-26T12:33:45.307469+0000","last_clean":"2024-04-26T12:33:45.307469+0000","last_became_active":"2024-04-26T12:30:18.527966+0000","last_became_peered":"2024-04-26T12:30:18.527966+0000","last_unstale":"2024-04-26T12:33:45.307469+0000","last_undegraded":"2024-04-26T12:33:45.307469+0000","last_fullsized":"2024-04-26T12:33:45.307469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-04-26T12:33:45.307342+0000","last_clean_scrub_stamp":"2024-04-26T12:33:45.307342+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:13.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:53.580037+0000","last_change":"2024-04-26T12:34:53.580037+0000","last_active":"2024-04-26T12:34:53.580037+0000","last_peered":"2024-04-26T12:34:53.580037+0000","last_clean":"2024-04-26T12:34:53.580037+0000","last_became_active":"2024-04-26T12:30:20.532719+0000","last_became_peered":"2024-04-26T12:30:20.532719+0000","last_unstale":"2024-04-26T12:34:53.580037+0000","last_undegraded":"2024-04-26T12:34:53.580037+0000","last_fullsized":"2024-04-26T12:34:53.580037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:53.579925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:53.579925+0000","last_clean_scrub_stamp":"2024-04-26T12:34:53.579925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:48.100236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.244297+0000","last_change":"2024-04-26T12:34:07.244321+0000","last_active":"2024-04-26T12:34:07.244297+0000","last_peered":"2024-04-26T12:34:07.244297+0000","last_clean":"2024-04-26T12:34:07.244297+0000","last_became_active":"2024-04-26T12:30:12.488774+0000","last_became_peered":"2024-04-26T12:30:12.488774+0000","last_unstale":"2024-04-26T12:34:07.244297+0000","last_undegraded":"2024-04-26T12:34:07.244297+0000","last_fullsized":"2024-04-26T12:34:07.244297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:07.244206+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.244206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:57.848776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.891153+0000","last_change":"2024-04-26T12:34:22.891177+0000","last_active":"2024-04-26T12:34:22.891153+0000","last_peered":"2024-04-26T12:34:22.891153+0000","last_clean":"2024-04-26T12:34:22.891153+0000","last_became_active":"2024-04-26T12:30:10.509820+0000","last_became_peered":"2024-04-26T12:30:10.509820+0000","last_unstale":"2024-04-26T12:34:22.891153+0000","last_undegraded":"2024-04-26T12:34:22.891153+0000","last_fullsized":"2024-04-26T12:34:22.891153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:22.891064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:22.891064+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.891064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:21.269599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:42.949107+0000","last_change":"2024-04-26T12:33:42.949152+0000","last_active":"2024-04-26T12:33:42.949107+0000","last_peered":"2024-04-26T12:33:42.949107+0000","last_clean":"2024-04-26T12:33:42.949107+0000","last_became_active":"2024-04-26T12:30:14.494504+0000","last_became_peered":"2024-04-26T12:30:14.494504+0000","last_unstale":"2024-04-26T12:33:42.949107+0000","last_undegraded":"2024-04-26T12:33:42.949107+0000","last_fullsized":"2024-04-26T12:33:42.949107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:42.948988+0000","last_clean_scrub_stamp":"2024-04-26T12:33:42.948988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:32.255979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.890152+0000","last_change":"2024-04-26T12:33:38.890152+0000","last_active":"2024-04-26T12:33:38.890152+0000","last_peered":"2024-04-26T12:33:38.890152+0000","last_clean":"2024-04-26T12:33:38.890152+0000","last_became_active":"2024-04-26T12:30:16.512108+0000","last_became_peered":"2024-04-26T12:30:16.512108+0000","last_unstale":"2024-04-26T12:33:38.890152+0000","last_undegraded":"2024-04-26T12:33:38.890152+0000","last_fullsized":"2024-04-26T12:33:38.890152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-04-26T12:33:38.890013+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.890013+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:04.019389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.461617+0000","last_change":"2024-04-26T12:33:40.461661+0000","last_active":"2024-04-26T12:33:40.461617+0000","last_peered":"2024-04-26T12:33:40.461617+0000","last_clean":"2024-04-26T12:33:40.461617+0000","last_became_active":"2024-04-26T12:30:18.523273+0000","last_became_peered":"2024-04-26T12:30:18.523273+0000","last_unstale":"2024-04-26T12:33:40.461617+0000","last_undegraded":"2024-04-26T12:33:40.461617+0000","last_fullsized":"2024-04-26T12:33:40.461617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:40.461502+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.461502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:09.237139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:59.780785+0000","last_change":"2024-04-26T12:33:59.780852+0000","last_active":"2024-04-26T12:33:59.780785+0000","last_peered":"2024-04-26T12:33:59.780785+0000","last_clean":"2024-04-26T12:33:59.780785+0000","last_became_active":"2024-04-26T12:30:20.530693+0000","last_became_peered":"2024-04-26T12:30:20.530693+0000","last_unstale":"2024-04-26T12:33:59.780785+0000","last_undegraded":"2024-04-26T12:33:59.780785+0000","last_fullsized":"2024-04-26T12:33:59.780785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:59.780664+0000","last_clean_scrub_stamp":"2024-04-26T12:33:59.780664+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:39.693729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:09.221052+0000","last_change":"2024-04-26T12:34:09.221090+0000","last_active":"2024-04-26T12:34:09.221052+0000","last_peered":"2024-04-26T12:34:09.221052+0000","last_clean":"2024-04-26T12:34:09.221052+0000","last_became_active":"2024-04-26T12:30:12.489459+0000","last_became_peered":"2024-04-26T12:30:12.489459+0000","last_unstale":"2024-04-26T12:34:09.221052+0000","last_undegraded":"2024-04-26T12:34:09.221052+0000","last_fullsized":"2024-04-26T12:34:09.221052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:09.220964+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:09.220964+0000","last_clean_scrub_stamp":"2024-04-26T12:34:09.220964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:46.980912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:22.696822+0000","last_change":"2024-04-26T12:34:22.696849+0000","last_active":"2024-04-26T12:34:22.696822+0000","last_peered":"2024-04-26T12:34:22.696822+0000","last_clean":"2024-04-26T12:34:22.696822+0000","last_became_active":"2024-04-26T12:30:10.515283+0000","last_became_peered":"2024-04-26T12:30:10.515283+0000","last_unstale":"2024-04-26T12:34:22.696822+0000","last_undegraded":"2024-04-26T12:34:22.696822+0000","last_fullsized":"2024-04-26T12:34:22.696822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:22.696725+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:22.696725+0000","last_clean_scrub_stamp":"2024-04-26T12:34:22.696725+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:42.822222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:51.346128+0000","last_change":"2024-04-26T12:33:51.346173+0000","last_active":"2024-04-26T12:33:51.346128+0000","last_peered":"2024-04-26T12:33:51.346128+0000","last_clean":"2024-04-26T12:33:51.346128+0000","last_became_active":"2024-04-26T12:30:14.488479+0000","last_became_peered":"2024-04-26T12:30:14.488479+0000","last_unstale":"2024-04-26T12:33:51.346128+0000","last_undegraded":"2024-04-26T12:33:51.346128+0000","last_fullsized":"2024-04-26T12:33:51.346128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:51.346025+0000","last_clean_scrub_stamp":"2024-04-26T12:33:51.346025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:20.507543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:38.453185+0000","last_change":"2024-04-26T12:33:38.453185+0000","last_active":"2024-04-26T12:33:38.453185+0000","last_peered":"2024-04-26T12:33:38.453185+0000","last_clean":"2024-04-26T12:33:38.453185+0000","last_became_active":"2024-04-26T12:30:16.518288+0000","last_became_peered":"2024-04-26T12:30:16.518288+0000","last_unstale":"2024-04-26T12:33:38.453185+0000","last_undegraded":"2024-04-26T12:33:38.453185+0000","last_fullsized":"2024-04-26T12:33:38.453185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-04-26T12:33:38.453065+0000","last_clean_scrub_stamp":"2024-04-26T12:33:38.453065+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:29.052361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:56.794664+0000","last_change":"2024-04-26T12:33:56.794664+0000","last_active":"2024-04-26T12:33:56.794664+0000","last_peered":"2024-04-26T12:33:56.794664+0000","last_clean":"2024-04-26T12:33:56.794664+0000","last_became_active":"2024-04-26T12:30:18.523075+0000","last_became_peered":"2024-04-26T12:30:18.523075+0000","last_unstale":"2024-04-26T12:33:56.794664+0000","last_undegraded":"2024-04-26T12:33:56.794664+0000","last_fullsized":"2024-04-26T12:33:56.794664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:56.794541+0000","last_clean_scrub_stamp":"2024-04-26T12:33:56.794541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:59.556259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:54.546371+0000","last_change":"2024-04-26T12:34:54.546393+0000","last_active":"2024-04-26T12:34:54.546371+0000","last_peered":"2024-04-26T12:34:54.546371+0000","last_clean":"2024-04-26T12:34:54.546371+0000","last_became_active":"2024-04-26T12:30:20.533334+0000","last_became_peered":"2024-04-26T12:30:20.533334+0000","last_unstale":"2024-04-26T12:34:54.546371+0000","last_undegraded":"2024-04-26T12:34:54.546371+0000","last_fullsized":"2024-04-26T12:34:54.546371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:54.546237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:54.546237+0000","last_clean_scrub_stamp":"2024-04-26T12:34:54.546237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:42.577078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.647109+0000","last_change":"2024-04-26T12:34:16.647109+0000","last_active":"2024-04-26T12:34:16.647109+0000","last_peered":"2024-04-26T12:34:16.647109+0000","last_clean":"2024-04-26T12:34:16.647109+0000","last_became_active":"2024-04-26T12:30:12.489365+0000","last_became_peered":"2024-04-26T12:30:12.489365+0000","last_unstale":"2024-04-26T12:34:16.647109+0000","last_undegraded":"2024-04-26T12:34:16.647109+0000","last_fullsized":"2024-04-26T12:34:16.647109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:16.646984+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:16.646984+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.646984+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:39.688700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:15.595342+0000","last_change":"2024-04-26T12:34:15.595389+0000","last_active":"2024-04-26T12:34:15.595342+0000","last_peered":"2024-04-26T12:34:15.595342+0000","last_clean":"2024-04-26T12:34:15.595342+0000","last_became_active":"2024-04-26T12:30:10.498509+0000","last_became_peered":"2024-04-26T12:30:10.498509+0000","last_unstale":"2024-04-26T12:34:15.595342+0000","last_undegraded":"2024-04-26T12:34:15.595342+0000","last_fullsized":"2024-04-26T12:34:15.595342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:15.595199+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:15.595199+0000","last_clean_scrub_stamp":"2024-04-26T12:34:15.595199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:35.707029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:48.865560+0000","last_change":"2024-04-26T12:33:48.865560+0000","last_active":"2024-04-26T12:33:48.865560+0000","last_peered":"2024-04-26T12:33:48.865560+0000","last_clean":"2024-04-26T12:33:48.865560+0000","last_became_active":"2024-04-26T12:30:14.488336+0000","last_became_peered":"2024-04-26T12:30:14.488336+0000","last_unstale":"2024-04-26T12:33:48.865560+0000","last_undegraded":"2024-04-26T12:33:48.865560+0000","last_fullsized":"2024-04-26T12:33:48.865560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:48.865441+0000","last_clean_scrub_stamp":"2024-04-26T12:33:48.865441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:06.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'30","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:40.031288+0000","last_change":"2024-04-26T12:33:40.031319+0000","last_active":"2024-04-26T12:33:40.031288+0000","last_peered":"2024-04-26T12:33:40.031288+0000","last_clean":"2024-04-26T12:33:40.031288+0000","last_became_active":"2024-04-26T12:30:16.515347+0000","last_became_peered":"2024-04-26T12:30:16.515347+0000","last_unstale":"2024-04-26T12:33:40.031288+0000","last_undegraded":"2024-04-26T12:33:40.031288+0000","last_fullsized":"2024-04-26T12:33:40.031288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-04-26T12:33:40.031195+0000","last_clean_scrub_stamp":"2024-04-26T12:33:40.031195+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:09.032628+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:54.850966+0000","last_change":"2024-04-26T12:33:54.851018+0000","last_active":"2024-04-26T12:33:54.850966+0000","last_peered":"2024-04-26T12:33:54.850966+0000","last_clean":"2024-04-26T12:33:54.850966+0000","last_became_active":"2024-04-26T12:30:18.524400+0000","last_became_peered":"2024-04-26T12:30:18.524400+0000","last_unstale":"2024-04-26T12:33:54.850966+0000","last_undegraded":"2024-04-26T12:33:54.850966+0000","last_fullsized":"2024-04-26T12:33:54.850966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:54.850864+0000","last_clean_scrub_stamp":"2024-04-26T12:33:54.850864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:43.512855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:55.497409+0000","last_change":"2024-04-26T12:34:55.497456+0000","last_active":"2024-04-26T12:34:55.497409+0000","last_peered":"2024-04-26T12:34:55.497409+0000","last_clean":"2024-04-26T12:34:55.497409+0000","last_became_active":"2024-04-26T12:30:20.533440+0000","last_became_peered":"2024-04-26T12:30:20.533440+0000","last_unstale":"2024-04-26T12:34:55.497409+0000","last_undegraded":"2024-04-26T12:34:55.497409+0000","last_fullsized":"2024-04-26T12:34:55.497409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:55.497290+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:55.497290+0000","last_clean_scrub_stamp":"2024-04-26T12:34:55.497290+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:33.937757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.267051+0000","last_change":"2024-04-26T12:33:57.267051+0000","last_active":"2024-04-26T12:33:57.267051+0000","last_peered":"2024-04-26T12:33:57.267051+0000","last_clean":"2024-04-26T12:33:57.267051+0000","last_became_active":"2024-04-26T12:30:12.482170+0000","last_became_peered":"2024-04-26T12:30:12.482170+0000","last_unstale":"2024-04-26T12:33:57.267051+0000","last_undegraded":"2024-04-26T12:33:57.267051+0000","last_fullsized":"2024-04-26T12:33:57.267051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:33:57.266942+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.266942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:20.057671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:06.834847+0000","last_change":"2024-04-26T12:34:06.834847+0000","last_active":"2024-04-26T12:34:06.834847+0000","last_peered":"2024-04-26T12:34:06.834847+0000","last_clean":"2024-04-26T12:34:06.834847+0000","last_became_active":"2024-04-26T12:30:10.514841+0000","last_became_peered":"2024-04-26T12:30:10.514841+0000","last_unstale":"2024-04-26T12:34:06.834847+0000","last_undegraded":"2024-04-26T12:34:06.834847+0000","last_fullsized":"2024-04-26T12:34:06.834847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:06.834717+0000","last_clean_scrub_stamp":"2024-04-26T12:34:06.834717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:39.941986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:49.835479+0000","last_change":"2024-04-26T12:33:49.835479+0000","last_active":"2024-04-26T12:33:49.835479+0000","last_peered":"2024-04-26T12:33:49.835479+0000","last_clean":"2024-04-26T12:33:49.835479+0000","last_became_active":"2024-04-26T12:30:14.488205+0000","last_became_peered":"2024-04-26T12:30:14.488205+0000","last_unstale":"2024-04-26T12:33:49.835479+0000","last_undegraded":"2024-04-26T12:33:49.835479+0000","last_fullsized":"2024-04-26T12:33:49.835479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-26T12:33:49.835315+0000","last_clean_scrub_stamp":"2024-04-26T12:33:49.835315+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:09.299112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:44.110111+0000","last_change":"2024-04-26T12:33:44.110183+0000","last_active":"2024-04-26T12:33:44.110111+0000","last_peered":"2024-04-26T12:33:44.110111+0000","last_clean":"2024-04-26T12:33:44.110111+0000","last_became_active":"2024-04-26T12:30:16.515447+0000","last_became_peered":"2024-04-26T12:30:16.515447+0000","last_unstale":"2024-04-26T12:33:44.110111+0000","last_undegraded":"2024-04-26T12:33:44.110111+0000","last_fullsized":"2024-04-26T12:33:44.110111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-04-26T12:33:44.110007+0000","last_clean_scrub_stamp":"2024-04-26T12:33:44.110007+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:08.558930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:52.548918+0000","last_change":"2024-04-26T12:33:52.548980+0000","last_active":"2024-04-26T12:33:52.548918+0000","last_peered":"2024-04-26T12:33:52.548918+0000","last_clean":"2024-04-26T12:33:52.548918+0000","last_became_active":"2024-04-26T12:30:18.525911+0000","last_became_peered":"2024-04-26T12:30:18.525911+0000","last_unstale":"2024-04-26T12:33:52.548918+0000","last_undegraded":"2024-04-26T12:33:52.548918+0000","last_fullsized":"2024-04-26T12:33:52.548918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:33:52.548815+0000","last_clean_scrub_stamp":"2024-04-26T12:33:52.548815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:10.261619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'6","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.649035+0000","last_change":"2024-04-26T12:34:11.649035+0000","last_active":"2024-04-26T12:34:11.649035+0000","last_peered":"2024-04-26T12:34:11.649035+0000","last_clean":"2024-04-26T12:34:11.649035+0000","last_became_active":"2024-04-26T12:30:20.522656+0000","last_became_peered":"2024-04-26T12:30:20.522656+0000","last_unstale":"2024-04-26T12:34:11.649035+0000","last_undegraded":"2024-04-26T12:34:11.649035+0000","last_fullsized":"2024-04-26T12:34:11.649035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:11.648922+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:11.648922+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.648922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:48.291861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.818359+0000","last_change":"2024-04-26T12:33:50.818359+0000","last_active":"2024-04-26T12:33:50.818359+0000","last_peered":"2024-04-26T12:33:50.818359+0000","last_clean":"2024-04-26T12:33:50.818359+0000","last_became_active":"2024-04-26T12:30:12.498036+0000","last_became_peered":"2024-04-26T12:30:12.498036+0000","last_unstale":"2024-04-26T12:33:50.818359+0000","last_undegraded":"2024-04-26T12:33:50.818359+0000","last_fullsized":"2024-04-26T12:33:50.818359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:33:50.818238+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.818238+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:03.334266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.340615+0000","last_change":"2024-04-26T12:34:02.340615+0000","last_active":"2024-04-26T12:34:02.340615+0000","last_peered":"2024-04-26T12:34:02.340615+0000","last_clean":"2024-04-26T12:34:02.340615+0000","last_became_active":"2024-04-26T12:30:10.508079+0000","last_became_peered":"2024-04-26T12:30:10.508079+0000","last_unstale":"2024-04-26T12:34:02.340615+0000","last_undegraded":"2024-04-26T12:34:02.340615+0000","last_fullsized":"2024-04-26T12:34:02.340615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:02.340498+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.340498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:45.990532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.522256+0000","last_change":"2024-04-26T12:34:10.522256+0000","last_active":"2024-04-26T12:34:10.522256+0000","last_peered":"2024-04-26T12:34:10.522256+0000","last_clean":"2024-04-26T12:34:10.522256+0000","last_became_active":"2024-04-26T12:30:12.488467+0000","last_became_peered":"2024-04-26T12:30:12.488467+0000","last_unstale":"2024-04-26T12:34:10.522256+0000","last_undegraded":"2024-04-26T12:34:10.522256+0000","last_fullsized":"2024-04-26T12:34:10.522256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:10.522104+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:10.522104+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.522104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:04.553913+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.590225+0000","last_change":"2024-04-26T12:34:21.590225+0000","last_active":"2024-04-26T12:34:21.590225+0000","last_peered":"2024-04-26T12:34:21.590225+0000","last_clean":"2024-04-26T12:34:21.590225+0000","last_became_active":"2024-04-26T12:30:10.488040+0000","last_became_peered":"2024-04-26T12:30:10.488040+0000","last_unstale":"2024-04-26T12:34:21.590225+0000","last_undegraded":"2024-04-26T12:34:21.590225+0000","last_fullsized":"2024-04-26T12:34:21.590225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:21.590040+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:21.590040+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.590040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:37.256101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:10.670636+0000","last_change":"2024-04-26T12:34:10.670636+0000","last_active":"2024-04-26T12:34:10.670636+0000","last_peered":"2024-04-26T12:34:10.670636+0000","last_clean":"2024-04-26T12:34:10.670636+0000","last_became_active":"2024-04-26T12:30:12.490956+0000","last_became_peered":"2024-04-26T12:30:12.490956+0000","last_unstale":"2024-04-26T12:34:10.670636+0000","last_undegraded":"2024-04-26T12:34:10.670636+0000","last_fullsized":"2024-04-26T12:34:10.670636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:10.670511+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:10.670511+0000","last_clean_scrub_stamp":"2024-04-26T12:34:10.670511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:55.402857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:47.574623+0000","last_change":"2024-04-26T12:34:47.574672+0000","last_active":"2024-04-26T12:34:47.574623+0000","last_peered":"2024-04-26T12:34:47.574623+0000","last_clean":"2024-04-26T12:34:47.574623+0000","last_became_active":"2024-04-26T12:30:10.511517+0000","last_became_peered":"2024-04-26T12:30:10.511517+0000","last_unstale":"2024-04-26T12:34:47.574623+0000","last_undegraded":"2024-04-26T12:34:47.574623+0000","last_fullsized":"2024-04-26T12:34:47.574623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:47.574506+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:47.574506+0000","last_clean_scrub_stamp":"2024-04-26T12:34:47.574506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:31.261685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'14","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.608406+0000","last_change":"2024-04-26T12:34:16.608406+0000","last_active":"2024-04-26T12:34:16.608406+0000","last_peered":"2024-04-26T12:34:16.608406+0000","last_clean":"2024-04-26T12:34:16.608406+0000","last_became_active":"2024-04-26T12:30:12.491201+0000","last_became_peered":"2024-04-26T12:30:12.491201+0000","last_unstale":"2024-04-26T12:34:16.608406+0000","last_undegraded":"2024-04-26T12:34:16.608406+0000","last_fullsized":"2024-04-26T12:34:16.608406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-04-26T12:34:16.608288+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-04-26T12:34:16.608288+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.608288+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:10.148366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:24.557250+0000","last_change":"2024-04-26T12:34:24.557284+0000","last_active":"2024-04-26T12:34:24.557250+0000","last_peered":"2024-04-26T12:34:24.557250+0000","last_clean":"2024-04-26T12:34:24.557250+0000","last_became_active":"2024-04-26T12:30:10.497741+0000","last_became_peered":"2024-04-26T12:30:10.497741+0000","last_unstale":"2024-04-26T12:34:24.557250+0000","last_undegraded":"2024-04-26T12:34:24.557250+0000","last_fullsized":"2024-04-26T12:34:24.557250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:24.557137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:24.557137+0000","last_clean_scrub_stamp":"2024-04-26T12:34:24.557137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:37.751454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:02.649641+0000","last_change":"2024-04-26T12:34:02.649641+0000","last_active":"2024-04-26T12:34:02.649641+0000","last_peered":"2024-04-26T12:34:02.649641+0000","last_clean":"2024-04-26T12:34:02.649641+0000","last_became_active":"2024-04-26T12:30:12.477715+0000","last_became_peered":"2024-04-26T12:30:12.477715+0000","last_unstale":"2024-04-26T12:34:02.649641+0000","last_undegraded":"2024-04-26T12:34:02.649641+0000","last_fullsized":"2024-04-26T12:34:02.649641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:02.649475+0000","last_clean_scrub_stamp":"2024-04-26T12:34:02.649475+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:18.869480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.572013+0000","last_change":"2024-04-26T12:34:05.572013+0000","last_active":"2024-04-26T12:34:05.572013+0000","last_peered":"2024-04-26T12:34:05.572013+0000","last_clean":"2024-04-26T12:34:05.572013+0000","last_became_active":"2024-04-26T12:30:10.505444+0000","last_became_peered":"2024-04-26T12:30:10.505444+0000","last_unstale":"2024-04-26T12:34:05.572013+0000","last_undegraded":"2024-04-26T12:34:05.572013+0000","last_fullsized":"2024-04-26T12:34:05.572013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:34:05.571886+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.571886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:23.002390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:58.802145+0000","last_change":"2024-04-26T12:33:58.802145+0000","last_active":"2024-04-26T12:33:58.802145+0000","last_peered":"2024-04-26T12:33:58.802145+0000","last_clean":"2024-04-26T12:33:58.802145+0000","last_became_active":"2024-04-26T12:30:12.495756+0000","last_became_peered":"2024-04-26T12:30:12.495756+0000","last_unstale":"2024-04-26T12:33:58.802145+0000","last_undegraded":"2024-04-26T12:33:58.802145+0000","last_fullsized":"2024-04-26T12:33:58.802145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:33:58.802005+0000","last_clean_scrub_stamp":"2024-04-26T12:33:58.802005+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:27.815229+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:21.843585+0000","last_change":"2024-04-26T12:34:21.843585+0000","last_active":"2024-04-26T12:34:21.843585+0000","last_peered":"2024-04-26T12:34:21.843585+0000","last_clean":"2024-04-26T12:34:21.843585+0000","last_became_active":"2024-04-26T12:30:10.506907+0000","last_became_peered":"2024-04-26T12:30:10.506907+0000","last_unstale":"2024-04-26T12:34:21.843585+0000","last_undegraded":"2024-04-26T12:34:21.843585+0000","last_fullsized":"2024-04-26T12:34:21.843585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:21.843455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:21.843455+0000","last_clean_scrub_stamp":"2024-04-26T12:34:21.843455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:46.308037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:26.494203+0000","last_change":"2024-04-26T12:34:26.494232+0000","last_active":"2024-04-26T12:34:26.494203+0000","last_peered":"2024-04-26T12:34:26.494203+0000","last_clean":"2024-04-26T12:34:26.494203+0000","last_became_active":"2024-04-26T12:30:12.495940+0000","last_became_peered":"2024-04-26T12:30:12.495940+0000","last_unstale":"2024-04-26T12:34:26.494203+0000","last_undegraded":"2024-04-26T12:34:26.494203+0000","last_fullsized":"2024-04-26T12:34:26.494203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:26.494114+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:26.494114+0000","last_clean_scrub_stamp":"2024-04-26T12:34:26.494114+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:29.814796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.267641+0000","last_change":"2024-04-26T12:34:08.267641+0000","last_active":"2024-04-26T12:34:08.267641+0000","last_peered":"2024-04-26T12:34:08.267641+0000","last_clean":"2024-04-26T12:34:08.267641+0000","last_became_active":"2024-04-26T12:30:10.504186+0000","last_became_peered":"2024-04-26T12:30:10.504186+0000","last_unstale":"2024-04-26T12:34:08.267641+0000","last_undegraded":"2024-04-26T12:34:08.267641+0000","last_fullsized":"2024-04-26T12:34:08.267641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:08.267528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:08.267528+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.267528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:44.813032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:13.835712+0000","last_change":"2024-04-26T12:34:13.835712+0000","last_active":"2024-04-26T12:34:13.835712+0000","last_peered":"2024-04-26T12:34:13.835712+0000","last_clean":"2024-04-26T12:34:13.835712+0000","last_became_active":"2024-04-26T12:30:12.492224+0000","last_became_peered":"2024-04-26T12:30:12.492224+0000","last_unstale":"2024-04-26T12:34:13.835712+0000","last_undegraded":"2024-04-26T12:34:13.835712+0000","last_fullsized":"2024-04-26T12:34:13.835712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:13.835564+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:13.835564+0000","last_clean_scrub_stamp":"2024-04-26T12:34:13.835564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:43.848744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:17.575792+0000","last_change":"2024-04-26T12:34:17.575792+0000","last_active":"2024-04-26T12:34:17.575792+0000","last_peered":"2024-04-26T12:34:17.575792+0000","last_clean":"2024-04-26T12:34:17.575792+0000","last_became_active":"2024-04-26T12:30:10.498125+0000","last_became_peered":"2024-04-26T12:30:10.498125+0000","last_unstale":"2024-04-26T12:34:17.575792+0000","last_undegraded":"2024-04-26T12:34:17.575792+0000","last_fullsized":"2024-04-26T12:34:17.575792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:17.575676+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:17.575676+0000","last_clean_scrub_stamp":"2024-04-26T12:34:17.575676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:29.191018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:11.838275+0000","last_change":"2024-04-26T12:34:11.838275+0000","last_active":"2024-04-26T12:34:11.838275+0000","last_peered":"2024-04-26T12:34:11.838275+0000","last_clean":"2024-04-26T12:34:11.838275+0000","last_became_active":"2024-04-26T12:30:12.495711+0000","last_became_peered":"2024-04-26T12:30:12.495711+0000","last_unstale":"2024-04-26T12:34:11.838275+0000","last_undegraded":"2024-04-26T12:34:11.838275+0000","last_fullsized":"2024-04-26T12:34:11.838275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-04-26T12:34:11.838159+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-04-26T12:34:11.838159+0000","last_clean_scrub_stamp":"2024-04-26T12:34:11.838159+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:53.341422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:28.544575+0000","last_change":"2024-04-26T12:34:28.544575+0000","last_active":"2024-04-26T12:34:28.544575+0000","last_peered":"2024-04-26T12:34:28.544575+0000","last_clean":"2024-04-26T12:34:28.544575+0000","last_became_active":"2024-04-26T12:30:10.518595+0000","last_became_peered":"2024-04-26T12:30:10.518595+0000","last_unstale":"2024-04-26T12:34:28.544575+0000","last_undegraded":"2024-04-26T12:34:28.544575+0000","last_fullsized":"2024-04-26T12:34:28.544575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:28.544450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:28.544450+0000","last_clean_scrub_stamp":"2024-04-26T12:34:28.544450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:30.289525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:05.700148+0000","last_change":"2024-04-26T12:34:05.700148+0000","last_active":"2024-04-26T12:34:05.700148+0000","last_peered":"2024-04-26T12:34:05.700148+0000","last_clean":"2024-04-26T12:34:05.700148+0000","last_became_active":"2024-04-26T12:30:12.492414+0000","last_became_peered":"2024-04-26T12:30:12.492414+0000","last_unstale":"2024-04-26T12:34:05.700148+0000","last_undegraded":"2024-04-26T12:34:05.700148+0000","last_fullsized":"2024-04-26T12:34:05.700148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:05.700014+0000","last_clean_scrub_stamp":"2024-04-26T12:34:05.700014+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:54.202928+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:25.516299+0000","last_change":"2024-04-26T12:34:25.516299+0000","last_active":"2024-04-26T12:34:25.516299+0000","last_peered":"2024-04-26T12:34:25.516299+0000","last_clean":"2024-04-26T12:34:25.516299+0000","last_became_active":"2024-04-26T12:30:10.497830+0000","last_became_peered":"2024-04-26T12:30:10.497830+0000","last_unstale":"2024-04-26T12:34:25.516299+0000","last_undegraded":"2024-04-26T12:34:25.516299+0000","last_fullsized":"2024-04-26T12:34:25.516299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:25.516169+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:25.516169+0000","last_clean_scrub_stamp":"2024-04-26T12:34:25.516169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:08.695312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:08.536643+0000","last_change":"2024-04-26T12:34:08.536643+0000","last_active":"2024-04-26T12:34:08.536643+0000","last_peered":"2024-04-26T12:34:08.536643+0000","last_clean":"2024-04-26T12:34:08.536643+0000","last_became_active":"2024-04-26T12:30:12.484389+0000","last_became_peered":"2024-04-26T12:30:12.484389+0000","last_unstale":"2024-04-26T12:34:08.536643+0000","last_undegraded":"2024-04-26T12:34:08.536643+0000","last_fullsized":"2024-04-26T12:34:08.536643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:08.536533+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:08.536533+0000","last_clean_scrub_stamp":"2024-04-26T12:34:08.536533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:29.406137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:12.872851+0000","last_change":"2024-04-26T12:34:12.872851+0000","last_active":"2024-04-26T12:34:12.872851+0000","last_peered":"2024-04-26T12:34:12.872851+0000","last_clean":"2024-04-26T12:34:12.872851+0000","last_became_active":"2024-04-26T12:30:10.514009+0000","last_became_peered":"2024-04-26T12:30:10.514009+0000","last_unstale":"2024-04-26T12:34:12.872851+0000","last_undegraded":"2024-04-26T12:34:12.872851+0000","last_fullsized":"2024-04-26T12:34:12.872851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:12.872720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:12.872720+0000","last_clean_scrub_stamp":"2024-04-26T12:34:12.872720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:43.429674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:07.794058+0000","last_change":"2024-04-26T12:34:07.794058+0000","last_active":"2024-04-26T12:34:07.794058+0000","last_peered":"2024-04-26T12:34:07.794058+0000","last_clean":"2024-04-26T12:34:07.794058+0000","last_became_active":"2024-04-26T12:30:12.495775+0000","last_became_peered":"2024-04-26T12:30:12.495775+0000","last_unstale":"2024-04-26T12:34:07.794058+0000","last_undegraded":"2024-04-26T12:34:07.794058+0000","last_fullsized":"2024-04-26T12:34:07.794058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-26T12:34:07.793931+0000","last_clean_scrub_stamp":"2024-04-26T12:34:07.793931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:31.555282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:20.818485+0000","last_change":"2024-04-26T12:34:20.818485+0000","last_active":"2024-04-26T12:34:20.818485+0000","last_peered":"2024-04-26T12:34:20.818485+0000","last_clean":"2024-04-26T12:34:20.818485+0000","last_became_active":"2024-04-26T12:30:10.506931+0000","last_became_peered":"2024-04-26T12:30:10.506931+0000","last_unstale":"2024-04-26T12:34:20.818485+0000","last_undegraded":"2024-04-26T12:34:20.818485+0000","last_fullsized":"2024-04-26T12:34:20.818485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:20.818344+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:20.818344+0000","last_clean_scrub_stamp":"2024-04-26T12:34:20.818344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:53.142364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:01.753500+0000","last_change":"2024-04-26T12:34:01.753500+0000","last_active":"2024-04-26T12:34:01.753500+0000","last_peered":"2024-04-26T12:34:01.753500+0000","last_clean":"2024-04-26T12:34:01.753500+0000","last_became_active":"2024-04-26T12:30:12.492366+0000","last_became_peered":"2024-04-26T12:30:12.492366+0000","last_unstale":"2024-04-26T12:34:01.753500+0000","last_undegraded":"2024-04-26T12:34:01.753500+0000","last_fullsized":"2024-04-26T12:34:01.753500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:34:01.753343+0000","last_clean_scrub_stamp":"2024-04-26T12:34:01.753343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:55.379403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:35.543597+0000","last_change":"2024-04-26T12:34:35.543597+0000","last_active":"2024-04-26T12:34:35.543597+0000","last_peered":"2024-04-26T12:34:35.543597+0000","last_clean":"2024-04-26T12:34:35.543597+0000","last_became_active":"2024-04-26T12:30:10.523110+0000","last_became_peered":"2024-04-26T12:30:10.523110+0000","last_unstale":"2024-04-26T12:34:35.543597+0000","last_undegraded":"2024-04-26T12:34:35.543597+0000","last_fullsized":"2024-04-26T12:34:35.543597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:35.543408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:35.543408+0000","last_clean_scrub_stamp":"2024-04-26T12:34:35.543408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:32.040066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'6","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:00.784416+0000","last_change":"2024-04-26T12:34:00.784416+0000","last_active":"2024-04-26T12:34:00.784416+0000","last_peered":"2024-04-26T12:34:00.784416+0000","last_clean":"2024-04-26T12:34:00.784416+0000","last_became_active":"2024-04-26T12:30:12.496023+0000","last_became_peered":"2024-04-26T12:30:12.496023+0000","last_unstale":"2024-04-26T12:34:00.784416+0000","last_undegraded":"2024-04-26T12:34:00.784416+0000","last_fullsized":"2024-04-26T12:34:00.784416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-04-26T12:34:00.784248+0000","last_clean_scrub_stamp":"2024-04-26T12:34:00.784248+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:01.988211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:33.598208+0000","last_change":"2024-04-26T12:34:33.598208+0000","last_active":"2024-04-26T12:34:33.598208+0000","last_peered":"2024-04-26T12:34:33.598208+0000","last_clean":"2024-04-26T12:34:33.598208+0000","last_became_active":"2024-04-26T12:30:10.511178+0000","last_became_peered":"2024-04-26T12:30:10.511178+0000","last_unstale":"2024-04-26T12:34:33.598208+0000","last_undegraded":"2024-04-26T12:34:33.598208+0000","last_fullsized":"2024-04-26T12:34:33.598208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:33.598009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:33.598009+0000","last_clean_scrub_stamp":"2024-04-26T12:34:33.598009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:34.158656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:50.944361+0000","last_change":"2024-04-26T12:33:50.944361+0000","last_active":"2024-04-26T12:33:50.944361+0000","last_peered":"2024-04-26T12:33:50.944361+0000","last_clean":"2024-04-26T12:33:50.944361+0000","last_became_active":"2024-04-26T12:30:12.497929+0000","last_became_peered":"2024-04-26T12:30:12.497929+0000","last_unstale":"2024-04-26T12:33:50.944361+0000","last_undegraded":"2024-04-26T12:33:50.944361+0000","last_fullsized":"2024-04-26T12:33:50.944361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-26T12:33:50.944248+0000","last_clean_scrub_stamp":"2024-04-26T12:33:50.944248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:32.447511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:16.195084+0000","last_change":"2024-04-26T12:34:16.195084+0000","last_active":"2024-04-26T12:34:16.195084+0000","last_peered":"2024-04-26T12:34:16.195084+0000","last_clean":"2024-04-26T12:34:16.195084+0000","last_became_active":"2024-04-26T12:30:10.499991+0000","last_became_peered":"2024-04-26T12:30:10.499991+0000","last_unstale":"2024-04-26T12:34:16.195084+0000","last_undegraded":"2024-04-26T12:34:16.195084+0000","last_fullsized":"2024-04-26T12:34:16.195084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:16.194929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:16.194929+0000","last_clean_scrub_stamp":"2024-04-26T12:34:16.194929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:17.275448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:04.787661+0000","last_change":"2024-04-26T12:34:04.787661+0000","last_active":"2024-04-26T12:34:04.787661+0000","last_peered":"2024-04-26T12:34:04.787661+0000","last_clean":"2024-04-26T12:34:04.787661+0000","last_became_active":"2024-04-26T12:30:12.490254+0000","last_became_peered":"2024-04-26T12:30:12.490254+0000","last_unstale":"2024-04-26T12:34:04.787661+0000","last_undegraded":"2024-04-26T12:34:04.787661+0000","last_fullsized":"2024-04-26T12:34:04.787661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:34:04.787527+0000","last_clean_scrub_stamp":"2024-04-26T12:34:04.787527+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:20.485303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:46.559580+0000","last_change":"2024-04-26T12:34:46.559580+0000","last_active":"2024-04-26T12:34:46.559580+0000","last_peered":"2024-04-26T12:34:46.559580+0000","last_clean":"2024-04-26T12:34:46.559580+0000","last_became_active":"2024-04-26T12:30:10.511672+0000","last_became_peered":"2024-04-26T12:30:10.511672+0000","last_unstale":"2024-04-26T12:34:46.559580+0000","last_undegraded":"2024-04-26T12:34:46.559580+0000","last_fullsized":"2024-04-26T12:34:46.559580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:46.559448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:46.559448+0000","last_clean_scrub_stamp":"2024-04-26T12:34:46.559448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:00.967850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:32.566994+0000","last_change":"2024-04-26T12:34:32.566994+0000","last_active":"2024-04-26T12:34:32.566994+0000","last_peered":"2024-04-26T12:34:32.566994+0000","last_clean":"2024-04-26T12:34:32.566994+0000","last_became_active":"2024-04-26T12:30:10.513323+0000","last_became_peered":"2024-04-26T12:30:10.513323+0000","last_unstale":"2024-04-26T12:34:32.566994+0000","last_undegraded":"2024-04-26T12:34:32.566994+0000","last_fullsized":"2024-04-26T12:34:32.566994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-26T12:34:32.566854+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-26T12:34:32.566854+0000","last_clean_scrub_stamp":"2024-04-26T12:34:32.566854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:56.976366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:57.659780+0000","last_change":"2024-04-26T12:33:57.659780+0000","last_active":"2024-04-26T12:33:57.659780+0000","last_peered":"2024-04-26T12:33:57.659780+0000","last_clean":"2024-04-26T12:33:57.659780+0000","last_became_active":"2024-04-26T12:30:12.500159+0000","last_became_peered":"2024-04-26T12:30:12.500159+0000","last_unstale":"2024-04-26T12:33:57.659780+0000","last_undegraded":"2024-04-26T12:33:57.659780+0000","last_fullsized":"2024-04-26T12:33:57.659780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-04-26T12:33:57.659656+0000","last_clean_scrub_stamp":"2024-04-26T12:33:57.659656+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:51.882456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:34:03.634721+0000","last_change":"2024-04-26T12:34:03.634721+0000","last_active":"2024-04-26T12:34:03.634721+0000","last_peered":"2024-04-26T12:34:03.634721+0000","last_clean":"2024-04-26T12:34:03.634721+0000","last_became_active":"2024-04-26T12:30:10.505644+0000","last_became_peered":"2024-04-26T12:30:10.505644+0000","last_unstale":"2024-04-26T12:34:03.634721+0000","last_undegraded":"2024-04-26T12:34:03.634721+0000","last_fullsized":"2024-04-26T12:34:03.634721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:34:03.634604+0000","last_clean_scrub_stamp":"2024-04-26T12:34:03.634604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:37.832568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:33:53.820107+0000","last_change":"2024-04-26T12:33:53.820107+0000","last_active":"2024-04-26T12:33:53.820107+0000","last_peered":"2024-04-26T12:33:53.820107+0000","last_clean":"2024-04-26T12:33:53.820107+0000","last_became_active":"2024-04-26T12:30:12.497988+0000","last_became_peered":"2024-04-26T12:30:12.497988+0000","last_unstale":"2024-04-26T12:33:53.820107+0000","last_undegraded":"2024-04-26T12:33:53.820107+0000","last_fullsized":"2024-04-26T12:33:53.820107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-04-26T12:33:53.819987+0000","last_clean_scrub_stamp":"2024-04-26T12:33:53.819987+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:06.561948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1607,"num_read_kb":1497,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673027,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":458752,"data_stored":145189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673027,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":735472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":734135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":430080,"data_stored":145178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:14.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:35:14.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbadb560640 1 Processor -- start 2024-04-26T12:35:14.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbadb560640 1 -- start start 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbadb560640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbad4095450 0x7fbad412fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbadb560640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad40961e0 con 0x7fbad4094960 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbadb560640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbad406b3c0 con 0x7fbad4095450 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbad92fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbad4094960 0x7fbad4094d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60812/0 (socket says 172.21.15.132:60812) 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbad92fc640 1 -- 172.21.15.132:0/2378598139 learned_addr learned my addr 172.21.15.132:0/2378598139 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbad8afb640 1 --2- 172.21.15.132:0/2378598139 >> v2:172.21.15.132:3300/0 conn(0x7fbad4095450 0x7fbad412fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.535+0000 7fbacbfff640 1 -- 172.21.15.132:0/2378598139 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781654130 0 0) 0x7fbad40961e0 con 0x7fbad4094960 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.536+0000 7fbacbfff640 1 -- 172.21.15.132:0/2378598139 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbac0003520 con 0x7fbad4094960 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.536+0000 7fbad8afb640 1 -- 172.21.15.132:0/2378598139 >> v1:172.21.15.132:6789/0 conn(0x7fbad4094960 legacy=0x7fbad4094d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.536+0000 7fbad8afb640 1 -- 172.21.15.132:0/2378598139 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad4090500 con 0x7fbad4095450 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.536+0000 7fbad8afb640 1 --2- 172.21.15.132:0/2378598139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4095450 0x7fbad412fc40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009720 tx=0x7fbac402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a711e8ca772a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.536+0000 7fbacbfff640 1 -- 172.21.15.132:0/2378598139 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbac40316d0 con 0x7fbad4095450 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.536+0000 7fbacbfff640 1 -- 172.21.15.132:0/2378598139 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac4037070 con 0x7fbad4095450 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.536+0000 7fbacbfff640 1 -- 172.21.15.132:0/2378598139 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbac40319a0 con 0x7fbad4095450 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.537+0000 7fbadb560640 1 -- 172.21.15.132:0/2378598139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4095450 msgr2=0x7fbad412fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.537+0000 7fbadb560640 1 --2- 172.21.15.132:0/2378598139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4095450 0x7fbad412fc40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009720 tx=0x7fbac402b840 comp rx=0 tx=0).stop 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.537+0000 7fbadb560640 1 -- 172.21.15.132:0/2378598139 shutdown_connections 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.537+0000 7fbadb560640 1 --2- 172.21.15.132:0/2378598139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4095450 0x7fbad412fc40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.537+0000 7fbadb560640 1 -- 172.21.15.132:0/2378598139 >> 172.21.15.132:0/2378598139 conn(0x7fbad409a980 msgr2=0x7fbad409ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.537+0000 7fbadb560640 1 -- 172.21.15.132:0/2378598139 shutdown_connections 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.537+0000 7fbadb560640 1 -- 172.21.15.132:0/2378598139 wait complete. 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbadb560640 1 Processor -- start 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbadb560640 1 -- start start 2024-04-26T12:35:14.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbadb560640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4094960 0x7fbad408da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbadb560640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4130510 con 0x7fbad4094960 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbad92fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4094960 0x7fbad408da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbad92fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4094960 0x7fbad408da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42066/0 (socket says 172.21.15.132:42066) 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbad92fc640 1 -- 172.21.15.132:0/4133445320 learned_addr learned my addr 172.21.15.132:0/4133445320 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.538+0000 7fbad92fc640 1 -- 172.21.15.132:0/4133445320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad4121c40 con 0x7fbad4094960 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.539+0000 7fbad92fc640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4094960 0x7fbad408da80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c310 tx=0x7fbad000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.539+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad0017070 con 0x7fbad4094960 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.539+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad0005c10 con 0x7fbad4094960 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.539+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad4072ce0 con 0x7fbad4094960 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.539+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbad00070d0 con 0x7fbad4094960 2024-04-26T12:35:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.539+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad4122710 con 0x7fbad4094960 2024-04-26T12:35:14.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.540+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbad001a070 con 0x7fbad4094960 2024-04-26T12:35:14.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.540+0000 7fbac9ffb640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbab8038060 0x7fbab803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T12:35:14.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.540+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6307+0+0 (secure 0 0 0) 0x7fbad004ad80 con 0x7fbad4094960 2024-04-26T12:35:14.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.540+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad4062ed0 con 0x7fbad4094960 2024-04-26T12:35:14.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.540+0000 7fbad8afb640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbab8038060 0x7fbab803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T12:35:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.541+0000 7fbad8afb640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbab8038060 0x7fbab803a520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbac4036000 tx=0x7fbac4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T12:35:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.545+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbad0010950 con 0x7fbad4094960 2024-04-26T12:35:14.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.715+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbad4121630 con 0x7fbad4094960 2024-04-26T12:35:14.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.717+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fbad0010bb0 con 0x7fbad4094960 2024-04-26T12:35:14.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.717+0000 7fbac9ffb640 1 -- 172.21.15.132:0/4133445320 <== mon.0 v2:172.21.15.132:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbad001b8d0 con 0x7fbad4094960 2024-04-26T12:35:14.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbab8038060 msgr2=0x7fbab803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbab8038060 0x7fbab803a520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbac4036000 tx=0x7fbac4008030 comp rx=0 tx=0).stop 2024-04-26T12:35:14.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4094960 msgr2=0x7fbad408da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T12:35:14.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4094960 0x7fbad408da80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c310 tx=0x7fbad000c7d0 comp rx=0 tx=0).stop 2024-04-26T12:35:14.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 shutdown_connections 2024-04-26T12:35:14.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.170:6824/2720307558,v1:172.21.15.170:6825/2720307558] conn(0x7fbab8038060 0x7fbab803a520 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:35:14.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 --2- 172.21.15.132:0/4133445320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbad4094960 0x7fbad408da80 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T12:35:14.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.719+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 >> 172.21.15.132:0/4133445320 conn(0x7fbad409a980 msgr2=0x7fbad4090c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T12:35:14.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.720+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 shutdown_connections 2024-04-26T12:35:14.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-26T12:35:14.720+0000 7fbadb560640 1 -- 172.21.15.132:0/4133445320 wait complete. 2024-04-26T12:35:14.731 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:35:14.731 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:35:14.731 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:35:14.731 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:35:14.768 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:35:14.769 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:35:14.769 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:35:14.807 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:35:14.807 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:35:14.807 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:35:14.878 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:35:14.879 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T12:35:14.879 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:35:14.949 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T12:35:14.949 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:35:14.949 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:35:14.949 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:35:15.019 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:35:15.020 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:35:15.020 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:35:15.020 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:35:15.032 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:35:15.032 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:35:15.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-26T12:35:15.100 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-26T12:35:15.100 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:35:15.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:35:15.262 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:35:15.399 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:35:15.399 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:35:15.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:35:15.500 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T12:35:15.575 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:35:15.577 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/data/mon.a.tgz 2024-04-26T12:35:15.578 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-26T12:35:15.594 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.hAXKDck6jI 2024-04-26T12:35:15.594 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hAXKDck6jI 2024-04-26T12:35:15.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.hAXKDck6jI 2024-04-26T12:35:15.818 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.hAXKDck6jI is 270KB 2024-04-26T12:35:15.915 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.hAXKDck6jI 2024-04-26T12:35:15.929 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:35:15.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:35:15.971 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:35:16.047 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T12:35:16.064 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T12:35:16.064 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:35:16.065 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/remote/smithi132/crash 2024-04-26T12:35:16.066 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:35:16.109 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/remote/smithi170/crash 2024-04-26T12:35:16.110 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:35:16.151 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:35:16.151 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T12:35:16.154 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T12:35:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-04-26T12:35:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30266.log 2024-04-26T12:35:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29970.log 2024-04-26T12:35:16.192 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.31056.log: /var/log/ceph/ceph-client.admin.30266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30636.log 2024-04-26T12:35:16.192 INFO:teuthology.orchestra.run.smithi132.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29970.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30266.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30498.log 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29970.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30138.log 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30636.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30316.log 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30138.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30498.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30138.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27511.log 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30316.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29573.log 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.27511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29802.log 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.27511.log.gz 2024-04-26T12:35:16.193 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27670.log 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29573.log.gz 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29802.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.27670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30246.log 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29802.log.gz 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27670.log.gz 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.audit.log: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31140.log 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30762.log 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.31140.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30246.log.gz 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29910.log 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31140.log.gz 2024-04-26T12:35:16.194 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29799.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29910.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30762.log.gz 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30414.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29910.log.gz 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30846.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30414.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.29799.log.gz --verbose 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr: -- /var/log/ceph/ceph-client.admin.29531.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30414.log.gz 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30930.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30846.log.gz 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29800.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30930.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29531.log.gz 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29800.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30930.log.gzgzip 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31098.log 2024-04-26T12:35:16.195 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29800.log.gz 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29969.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.31098.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25809.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31098.log.gz 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31182.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.tmp-client.admin.25809.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29969.log.gz 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29420.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.25809.log.gz 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.31182.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31182.log.gz 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30137.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.a.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29420.log.gz 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30804.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30456.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30137.log.gz 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30078.log 2024-04-26T12:35:16.196 INFO:teuthology.orchestra.run.smithi132.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30804.log.gz 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30594.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30456.log.gz 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29968.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30078.log: /var/log/ceph/ceph-client.admin.30594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30720.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30078.log.gz 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30594.log.gz 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30552.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr: 86.7%/var/log/ceph/ceph-client.admin.30720.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.29968.log.gz 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30972.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30552.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30720.log.gz 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30136.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30552.log.gz 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31267.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30972.log: /var/log/ceph/ceph-client.admin.30136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29658.log 2024-04-26T12:35:16.197 INFO:teuthology.orchestra.run.smithi132.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30972.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30136.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.31267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27629.log 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29658.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31267.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31307.log 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29658.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.27629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31225.log 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr: 85.7%/var/log/ceph/ceph-client.admin.31307.log: -- replaced with /var/log/ceph/ceph-client.admin.27629.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30315.log 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31307.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.31225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29616.log 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31225.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30678.log 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30315.log.gz 2024-04-26T12:35:16.198 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31014.log 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29616.log: /var/log/ceph/ceph-client.admin.30678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29801.log 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29616.log.gz 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30678.log.gz 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.31014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29475.log 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31014.log.gz 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29700.log 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29801.log: /var/log/ceph/ceph-client.admin.29475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30888.log 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29801.log.gz 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.29700.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29475.log.gz 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30888.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29700.log.gz 2024-04-26T12:35:16.199 INFO:teuthology.orchestra.run.smithi132.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30888.log.gz 2024-04-26T12:35:16.225 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72600.log 2024-04-26T12:35:16.225 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87090.log 2024-04-26T12:35:16.225 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.72600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45980.log 2024-04-26T12:35:16.225 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.87090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71995.log 2024-04-26T12:35:16.225 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.45980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71390.log 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.71995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82280.log 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.71390.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.72600.log.gz 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42350.log 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87090.log.gz 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.82280.log: 91.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.0.45980.log.gz --verbose 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr: -- /var/log/ceph/ceph-client.0.82885.log 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.42350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76835.log 2024-04-26T12:35:16.231 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.82885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52030.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71995.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% 91.4% -- replaced with /var/log/ceph/ceph-client.0.71390.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.82280.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.76835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68970.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.82885.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.52030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42955.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.68970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38115.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42350.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:gzip/var/log/ceph/ceph-client.0.42955.log: -5 --verbose -- /var/log/ceph/ceph-client.0.74415.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.38115.log: gzip -5 --verbose -- 91.1% /var/log/ceph/ceph-client.0.93140.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.76835.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52030.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.74415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64130.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.68970.log.gz 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.93140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94414.log 2024-04-26T12:35:16.232 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.64130.log: gzip 91.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.42955.log.gz -- 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr: /var/log/ceph/ceph-client.0.50820.log 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.94414.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74415.log.gz 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.38115.log.gz 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.50820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65340.log 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93140.log.gz 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88300.log 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.64130.log.gz 2024-04-26T12:35:16.233 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.65340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66550.log 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.88300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78045.log 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50820.log.gz 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.66550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60500.log 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.78045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77440.log 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.60500.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.94414.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.0.65340.log.gz 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41140.log 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T12:35:16.259 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88300.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.77440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49005.log 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.41140.log: gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.78045.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr: --verbose -- /var/log/ceph/ceph-client.0.56870.log 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.49005.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60500.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.66550.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.56870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56265.log 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81070.log 91.1% 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.41140.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.56265.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.77440.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84682.log 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49005.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56870.log.gz 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75020.log 2024-04-26T12:35:16.260 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.81070.log: /var/log/ceph/ceph-client.0.84682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73205.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.75020.log: gzip 90.5% -- replaced with /var/log/ceph/ceph-client.0.84682.log.gz 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.34491.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.73205.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58080.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.56265.log.gz 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81070.log.gz 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.34491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39930.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.58080.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.75020.log.gz/var/log/ceph/ceph-client.0.39930.log: 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33537.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73205.log.gz 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57475.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.34491.log.gz 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr:gzip 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29938.log 2024-04-26T12:35:16.261 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58080.log.gz 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.39930.log.gz 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.33537.log: /var/log/ceph/ceph-client.0.57475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59895.log 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.33537.log.gz 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69575.log 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29938.log.gz 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.59895.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.69575.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.0.57475.log.gz 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr: -- /var/log/ceph/ceph-client.0.67155.log 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37516.log 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.67155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80465.log 2024-04-26T12:35:16.262 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.69575.log.gz 91.3% -- replaced with /var/log/ceph/ceph-client.0.59895.log.gz 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.37516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39325.log 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.80465.log: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78650.log 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.37516.log.gz 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.39325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76230.log 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.78650.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80465.log.gz 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.67155.log.gz 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78650.log.gz 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39325.log.gz 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36306.log 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.76230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29898.log 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.36306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55660.log 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29898.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29898.log.gz 2024-04-26T12:35:16.263 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76230.log.gz 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.55660.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36306.log.gz 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.55660.log.gz 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75625.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64735.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.75625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62920.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.64735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86485.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.62920.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75625.log.gz 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.64735.log.gz 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62920.log.gz 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35096.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.86485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91325.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.35096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51425.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.91325.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.86485.log.gz 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35701.log 2024-04-26T12:35:16.264 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.51425.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35096.log.gz 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91325.log.gz 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53240.log 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.35701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85281.log 91.3% -- replaced with /var/log/ceph/ceph-client.0.51425.log.gz 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90115.log 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.85281.log: /var/log/ceph/ceph-client.0.53240.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.85281.log.gz 91.5% -- replaced with /var/log/ceph/ceph-client.0.35701.log.gz 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73810.log 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.90115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90720.log 2024-04-26T12:35:16.265 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.53240.log.gz 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.73810.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90115.log.gz 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.73810.log.gz 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70180.log 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.90720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47190.log 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.70180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93745.log 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.47190.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.90720.log.gz 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67760.log 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.93745.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.47190.log.gz 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46585.log 2024-04-26T12:35:16.276 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70180.log.gz/var/log/ceph/ceph-client.0.67760.log: 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93745.log.gz 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87695.log 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.46585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29978.log 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.87695.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.67760.log.gz 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.46585.log.gz 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.62315.log 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.29978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70785.log 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.29978.log.gz 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.62315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47795.log 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87695.log.gz 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.70785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63525.log 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.47795.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62315.log.gz 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70785.log.gz 2024-04-26T12:35:16.277 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30018.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.63525.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47795.log.gz 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91930.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33578.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.91930.log: /var/log/ceph/ceph-client.admin.30018.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30018.log.gz 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58685.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63525.log.gz 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.33578.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.33578.log.gz 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91930.log.gz 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81675.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84083.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.58685.log: /var/log/ceph/ceph-client.0.81675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45375.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.84083.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.84083.log.gz 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58685.log.gz 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88905.log 2024-04-26T12:35:16.278 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85880.log 2024-04-26T12:35:16.279 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.88905.log: /var/log/ceph/ceph-client.0.45375.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81675.log.gz 2024-04-26T12:35:16.281 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45375.log.gz 2024-04-26T12:35:16.281 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41745.log 2024-04-26T12:35:16.281 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.88905.log.gz 2024-04-26T12:35:16.281 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53845.log 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.85880.log: /var/log/ceph/ceph-client.0.41745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38720.log 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.53845.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41745.log.gz 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.85880.log.gz 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53845.log.gz 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43560.log 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33658.log 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.38720.log: /var/log/ceph/ceph-client.0.43560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55055.log 2024-04-26T12:35:16.282 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.33658.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.33658.log.gz 2024-04-26T12:35:16.283 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38720.log.gz 2024-04-26T12:35:16.284 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43560.log.gz 2024-04-26T12:35:16.284 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50215.log 2024-04-26T12:35:16.284 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-04-26T12:35:16.284 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.55055.log: /var/log/ceph/ceph-client.0.50215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68365.log 2024-04-26T12:35:16.284 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.33698.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-04-26T12:35:16.286 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50215.log.gz 2024-04-26T12:35:16.286 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55055.log.gz 2024-04-26T12:35:16.286 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40535.log 2024-04-26T12:35:16.286 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.68365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-04-26T12:35:16.286 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.40535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54450.log 2024-04-26T12:35:16.286 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.33618.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz 2024-04-26T12:35:16.289 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44165.log 2024-04-26T12:35:16.289 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68365.log.gz 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40535.log.gz/var/log/ceph/ceph-client.0.54450.log: 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44770.log 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.44165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92535.log 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.44770.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54450.log.gz 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52635.log 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.0.44165.log.gz 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.92535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61710.log 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.52635.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.44770.log.gz 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48400.log 2024-04-26T12:35:16.290 INFO:teuthology.orchestra.run.smithi170.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-26T12:35:16.291 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.61710.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92535.log.gz 2024-04-26T12:35:16.291 INFO:teuthology.orchestra.run.smithi170.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.52635.log.gz 2024-04-26T12:35:16.291 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.61710.log.gz 2024-04-26T12:35:16.293 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79255.log 2024-04-26T12:35:16.293 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.48400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49610.log 2024-04-26T12:35:16.293 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.79255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79860.log 2024-04-26T12:35:16.293 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.49610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89510.log 2024-04-26T12:35:16.293 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.79860.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.48400.log.gz 2024-04-26T12:35:16.297 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61105.log 2024-04-26T12:35:16.297 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.89510.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.49610.log.gz 2024-04-26T12:35:16.297 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65945.log 2024-04-26T12:35:16.297 INFO:teuthology.orchestra.run.smithi170.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.79255.log.gz 2024-04-26T12:35:16.297 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.61105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36911.log 2024-04-26T12:35:16.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.89510.log.gz/var/log/ceph/ceph-client.0.65945.log: 2024-04-26T12:35:16.298 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59290.log 2024-04-26T12:35:16.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.36911.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.79860.log.gz 2024-04-26T12:35:16.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61105.log.gz 2024-04-26T12:35:16.298 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83484.log 2024-04-26T12:35:16.298 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.65945.log.gz 2024-04-26T12:35:16.298 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.59290.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36911.log.gz 2024-04-26T12:35:16.301 INFO:teuthology.orchestra.run.smithi170.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59290.log.gz 2024-04-26T12:35:16.301 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.0.83484.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83484.log.gz 2024-04-26T12:35:16.303 INFO:teuthology.orchestra.run.smithi170.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T12:35:16.352 INFO:teuthology.orchestra.run.smithi132.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T12:35:17.173 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T12:35:17.177 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T12:35:17.179 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-26T12:35:17.179 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m1.013s 2024-04-26T12:35:17.179 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m1.156s 2024-04-26T12:35:17.179 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m0.070s 2024-04-26T12:35:17.301 INFO:teuthology.orchestra.run.smithi170.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T12:35:17.305 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T12:35:17.307 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T12:35:17.307 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m1.093s 2024-04-26T12:35:17.308 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m3.212s 2024-04-26T12:35:17.308 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.214s 2024-04-26T12:35:17.308 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:35:17.308 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/remote/smithi132/log 2024-04-26T12:35:17.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:35:17.555 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/remote/smithi170/log 2024-04-26T12:35:17.556 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:35:18.141 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:35:18.151 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:35:18.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:35:18.154 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:35:18.231 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:35:18.240 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:35:18.241 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:35:18.243 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:35:18.256 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:35:18.257 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-04-26T12:35:18.261 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:35:18.261 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-26T12:35:18.261 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 34 +776us[ +776us] +/- 46ms 2024-04-26T12:35:18.261 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -1282us[-1274us] +/- 64ms 2024-04-26T12:35:18.261 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +412us[ +420us] +/- 85ms 2024-04-26T12:35:18.261 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:35:18.263 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:35:18.263 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-04-26T12:35:18.264 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +765us[ +784us] +/- 45ms 2024-04-26T12:35:18.264 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 -1309us[-1291us] +/- 64ms 2024-04-26T12:35:18.264 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +380us[ +398us] +/- 85ms 2024-04-26T12:35:18.264 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:35:18.264 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:35:18.292 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:35:18.293 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:35:18.324 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:35:18.385 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:35:18.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T12:35:18.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:35:18.470 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T12:35:18.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:35:18.496 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:35:18.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:35:18.552 INFO:teuthology.task.internal:Duration was 702.100832 seconds 2024-04-26T12:35:18.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:35:18.598 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:35:18.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:35:18.600 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:35:18.636 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:35:18.637 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:35:18.943 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:35:18.943 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-04-26T12:35:18.944 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:35:19.003 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T12:35:19.003 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:35:19.027 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:35:19.027 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:35:19.046 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:35:19.093 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:35:19.093 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:35:19.116 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:35:19.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:35:19.235 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:35:19.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:35:19.259 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:35:19.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:35:19.294 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:35:19.301 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:35:19.321 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-04-26T12:35:19.344 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-04-26T12:35:19.395 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:35:19.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:35:19.410 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:35:19.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:35:19.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:35:19.461 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:35:19.462 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/remote/smithi132 2024-04-26T12:35:19.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:35:19.494 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674698/remote/smithi170 2024-04-26T12:35:19.495 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:35:19.529 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:35:19.529 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:35:19.533 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:35:19.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:35:19.591 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:35:19.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:35:19.608 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:35:19.608 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:35:19.610 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:35:19.623 INFO:teuthology.orchestra.run.smithi132.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:35 /home/ubuntu/cephtest 2024-04-26T12:35:19.633 INFO:teuthology.orchestra.run.smithi170.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:35 /home/ubuntu/cephtest 2024-04-26T12:35:19.634 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:35:19.646 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:35:19.767 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 702.1008322238922 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-04-26T12:35:19.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:35:19.850 INFO:teuthology.run:pass